Partial Derivatives

Summary

Derivatives with respect to one variable while holding others constant — how gradient descent computes how much to adjust each individual weight.

• 1Compute partial derivatives of a multi-variable function by hand.
• 2Connect partial derivatives to gradient vectors used in optimization.
• 3Practice on a simple loss function with two parameters.