Skip to content

Estimating model thetas using 1) Gradient Descent, 2) Stochastic Gradient Descent 3) Mini-batch Gradient Descent and 4) Newton Raphson Method (using Quasi Methods) and Backtracking Linesearch. This is a dense topic. Get ready for some linear algebra

Notifications You must be signed in to change notification settings

nirupampratap/softmax_estmating_parameters

Repository files navigation

softmax_estmating_parameters

Estimating the thetas for Softmax Regression (Multinomial logistic regression) using

  1. Gradient Descent,
  2. Stochastic Gradient Descent
  3. Mini-batch Gradient Descent and
  4. Newton Raphson Method (using Quasi Methods) and Backtracking Linesearch

Notebook does not use Scikit learn's functions but I have coded all of them into the notebook. All references are also mentioned. Give it a try and report any bugs.

About

Estimating model thetas using 1) Gradient Descent, 2) Stochastic Gradient Descent 3) Mini-batch Gradient Descent and 4) Newton Raphson Method (using Quasi Methods) and Backtracking Linesearch. This is a dense topic. Get ready for some linear algebra

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published