Pytorch grad(Pytorch grad)

Gradient

Clarificaton
导数,derivate
偏微分,partial derivate
梯度,gradient

How to search for minima?

Common Functions

Common Functions Function Derivative
Constant $$C$$ $$0$$
Line $$x$$ $$1$$
$$ax$$ $$a$$
Square $$x^2$$ $$2x$$
Square root $$\sqrt{x}$$ $$\frac{1}{2}x^{-\frac{1}{2}}$$
Exponential $$e^x$$ $$e^x$$
$$a^x$$ $$\ln(a)a^x$$
Logarithms $$\ln(x)$$ $$\frac{1}{x}$$
$$\log_a(x)$$ $$\frac{1}{x\ln(a)}$$
Trigonometry $$\sin(x)$$ $$\cos(x)$$
$$\cos(x)$$ $$-\sin(x)$$
$$\tan(x)$$ $${\sec(x)}^2$$
eg.
————————

Gradient

Clarificaton
导数,derivate
偏微分,partial derivate
梯度,gradient

How to search for minima?

Common Functions

Common Functions Function Derivative
Constant $$C$$ $$0$$
Line $$x$$ $$1$$
$$ax$$ $$a$$
Square $$x^2$$ $$2x$$
Square root $$\sqrt{x}$$ $$\frac{1}{2}x^{-\frac{1}{2}}$$
Exponential $$e^x$$ $$e^x$$
$$a^x$$ $$\ln(a)a^x$$
Logarithms $$\ln(x)$$ $$\frac{1}{x}$$
$$\log_a(x)$$ $$\frac{1}{x\ln(a)}$$
Trigonometry $$\sin(x)$$ $$\cos(x)$$
$$\cos(x)$$ $$-\sin(x)$$
$$\tan(x)$$ $${\sec(x)}^2$$
eg.