Univariate Calculus Refresher

Formal
(Derivative)

For h>0h>0 the derivative of ff at xx is defined as the limit

dfdx≔lim⁡h→0f(x+h)−f(x)h,\begin{align} \frac{d f}{dx} \coloneqq \lim_{ h \to 0 } \frac{f(x+h)-f(x)}{h}, \tag{1} \end{align}

The derivative of ff points in the direction of steepest ascent of ff.

(Taylor Polynomial)

The Taylor Polynomial of degree nn of f:R→Rf:\mathbb{R} \rightarrow \mathbb{R} at x0x_0 is defined as

Tn(x)≔∑k=1nfk(x0)k!(x−x0)k,\begin{align} T_{n}(x) \coloneqq \sum_{k=1}^n \frac{f^k(x_{0})}{k!}(x-x_{0})^k, \tag{2} \end{align}

where fk(x0)f^k(x_{0}) is the kk-th derivative of ff at x0x_0 and fk(x0)k!\frac{f_{k(x_{0})}}{k!} are the coefficients of the polynomial.

(Taylor Series)

For a smooth function f∈C∞,f:R→Rf \in \mathcal{C}^\infty, f : \mathbb{R} \rightarrow \mathbb{R}, the Taylor Series of ff at x0x_0 is defined as

T∞(x0)=∑k=0∞fk(x)k!(x−x0)k.\begin{align} T_{\infty}(x_{0}) = \sum_{k=0}^\infty \frac{f^k(x)}{k!}(x-x_{0})^k. \tag{3} \end{align}

C∞\mathcal{C}^\infty means that the function ff is continuously differentiable infinitely many times.

For x0=0x_{0} = 0, we obtain the Maclaurin series as a special instance of the Taylor Series. Also, if f(x)=T∞f(x) = T_{\infty}, then ff is called analytic.

(Differentiation Rules)
  • Product Rule: (f(x)g(x))′=f′(x)g(x)+f(x)g′(x)(f(x)g(x))' = f'(x)g(x)+f(x)g'(x)
  • Quotient Rule: (f(x)g(x))′=(f(x)g(x))′(g(x))2\left( \frac{f(x)}{g(x)}\right)'=\frac{(f(x)g(x))'}{(g(x))^2}
  • Sum Rule: (f(x)+g(x))′=f′(x)+g′(x)(f(x) +g(x))' = f'(x) +g'(x)
  • Chain Rule: ((g∘f)(x))′=(g∘f)′(x)=g′(f(x))f′(x)((g\circ f)(x))'=(g\circ f)'(x) = g'(f(x))f'(x)
Intuition

At its core, the Taylor series is a method for approximating any complex, smooth function with a much simpler function—a polynomial—around a specific point. Imagine you’re looking at a complicated curve on a graph. If you zoom in very close to one point, the curve starts to look like a straight line. If you zoom out a bit, it might look like a parabola. The Taylor series formalizes this idea.

The kk-th coefficient represents the curvature of kk-th degree for the function. So, fist coefficient for k=0k=0 is the value of ff at x0x_{0} The 1st coefficient represents the slope of the function at x0x_{0}, the second coefficient represents the shape of the curve (parabola etc) and so on.

Connections
  • #vector-calculus
  • #taylor-series
  • #type/definition