Differential (calculus)

In mathematics, differential refers to several related notions derived from the early days of calculus, put on a rigorous footing, such as infinitesimal differences and the derivatives of functions.

The term is used in various branches of mathematics such as calculus, differential geometry, algebraic geometry and algebraic topology.

Introduction

The term differential is used nonrigorously in calculus to refer to an infinitesimal ("infinitely small") change in some varying quantity. For example, if ''x'' is a variable, then a change in the value of ''x'' is often denoted Δ''x'' (pronounced ''delta x''). The differential ''dx'' represents an infinitely small change in the variable ''x''. The idea of an infinitely small or infinitely slow change is, intuitively, extremely useful, and there are a number of ways to make the notion mathematically precise.

Using calculus, it is possible to relate the infinitely small changes of various variables to each other mathematically using derivatives. If ''y'' is a function of ''x'', then the differential ''dy'' of ''y'' is related to ''dx'' by the formula
$dy = \frac \,dx,$
where $\frac \,$denotes not 'dy divided by dx' as one would intuitively read, but 'the derivative of ''y'' with respect to ''x'' '. This formula summarizes the idea that the derivative of ''y'' with respect to ''x'' is the limit of the ratio of differences Δ''y''/Δ''x'' as Δ''x'' approaches zero:

$\dfrac = \lim_\dfrac$

You can meet $d$ is italicised ($d$) or slanted (''d'') or regular, the last emphasizes $\mathrm$ is an operator designation like the summation operator $\left(\sum\right)$, the delta operator (the finite difference operator) ($\Delta$), trigonometric functions ($\sin, \cos, \tan$)...

Basic notions

* In calculus, the differential represents a change in the linearization of a function.
** The total differential is its generalization for functions of multiple variables.
* In traditional approaches to calculus, differentials (e.g. ''dx'', ''dy'', ''dt'', etc.) are interpreted as infinitesimals. There are several methods of defining infinitesimals rigorously, but it is sufficient to say that an infinitesimal number is smaller in absolute value than any positive real number, just as an infinitely large number is larger than any real number.
* The differential is another name for the Jacobian matrix of partial derivatives of a function from R^''n'' to R^''m'' (especially when this matrix is viewed as a linear map).
* More generally, the differential or '' pushforward'' refers to the derivative of a map between smooth manifolds and the pushforward operations it defines. The differential is also used to define the dual concept of pullback.
* Stochastic calculus provides a notion of stochastic differential and an associated calculus for stochastic processes.
* The integrator in a Stieltjes integral is represented as the differential of a function. Formally, the differential appearing under the integral behaves exactly as a differential: thus, the integration by substitution and integration by parts formulae for Stieltjes integral correspond, respectively, to the chain rule and product rule for the differential.

History and usage

Infinitesimal quantities played a significant role in the development of calculus. Archimedes used them, even though he did not believe that arguments involving infinitesimals were rigorous. Isaac Newton referred to them as fluxions. However, it was Gottfried Leibniz who coined the term ''differentials'' for infinitesimal quantities and introduced the notation for them which is still used today.

In Leibniz's notation, if ''x'' is a variable quantity, then ''dx'' denotes an infinitesimal change in the variable ''x''. Thus, if ''y'' is a function of ''x'', then the derivative of ''y'' with respect to ''x'' is often denoted ''dy''/''dx'', which would otherwise be denoted (in the notation of Newton or Lagrange by Bishop Berkeley. Nevertheless, the notation has remained popular because it suggests strongly the idea that the derivative of ''y'' at ''x'' is its instantaneous rate of change (the slope of the graph's tangent line), which may be obtained by taking the limit of the ratio Δ''y''/Δ''x'' as Δ''x'' becomes arbitrarily small. Differentials are also compatible with dimensional analysis, where a differential such as ''dx'' has the same dimensions as the variable ''x''.

Calculus evolved into a distinct branch of mathematics during the 17th century CE, although there were antecedents going back to antiquity. The presentations of, e.g., Newton, Leibniz, were marked by non-rigorous definitions of terms like differential, fluent and "infinitely small". While many of the arguments in Bishop Berkeley's 1734 The Analyst are theological in nature, modern mathematicians acknowledge the validity of his argument against " the Ghosts of departed Quantities"; however, the modern approaches do not have the same technical issues. Despite the lack of rigor, immense progress was made in the 17th and 18th centuries. In the 19th century, Cauchy and others gradually developed the Epsilon, delta approach to continuity, limits and derivatives, giving a solid conceptual foundation for calculus.

In the 20th century, several new concepts in, e.g., multivariable calculus, differential geometry, seemed to encapsulate the intent of the old terms, especially ''differential''; both differential and infinitesimal are used with new, more rigorous, meanings.

Differentials are also used in the notation for integrals because an integral can be regarded as an infinite sum of infinitesimal quantities: the area under a graph is obtained by subdividing the graph into infinitely thin strips and summing their areas. In an expression such as
$\int f(x) \,dx,$
the integral sign (which is a modified long s) denotes the infinite sum, ''f''(''x'') denotes the "height" of a thin strip, and the differential ''dx'' denotes its infinitely thin width.

Approaches

There are several approaches for making the notion of differentials mathematically precise.
# Differentials as linear maps. This approach underlies the definition of the derivative and the exterior derivative in differential geometry.
# Differentials as nilpotent elements of commutative rings. This approach is popular in algebraic geometry..
# Differentials in smooth models of set theory. This approach is known as synthetic differential geometry or smooth infinitesimal analysis and is closely related to the algebraic geometric approach, except that ideas from topos theory are used to ''hide'' the mechanisms by which nilpotent infinitesimals are introduced.
# Differentials as infinitesimals in hyperreal number systems, which are extensions of the real numbers that contain invertible infinitesimals and infinitely large numbers. This is the approach of nonstandard analysis pioneered by Abraham Robinson.See and .

These approaches are very different from each other, but they have in common the idea of being ''quantitative'', i.e., saying not just that a differential is infinitely small, but ''how'' small it is.

Differentials as linear maps

There is a simple way to make precise sense of differentials, first used on the Real line by regarding them as linear maps. It can be used on $\mathbb$, $\mathbb^n$, a Hilbert space, a Banach space, or more generally, a topological vector space. The case of the Real line is the easiest to explain. This type of differential is also known as a covariant vector or cotangent vector, depending on context.

Differentials as linear maps on R

Suppose $f(x)$ is a real-valued function on $\mathbb$. We can reinterpret the variable $x$ in $f(x)$ as being a function rather than a number, namely the identity map on the real line, which takes a real number $p$ to itself: $x(p)=p$. Then $f(x)$ is the composite of $f$ with $x$, whose value at $p$ is $f(x(p))=f(p)$. The differential $\operatornamef$ (which of course depends on $f$) is then a function whose value at $p$ (usually denoted $df_p$) is not a number, but a linear map from $\mathbb$ to $\mathbb$. Since a linear map from $\mathbb$ to $\mathbb$ is given by a $1\times 1$ matrix, it is essentially the same thing as a number, but the change in the point of view allows us to think of $df_p$ as an infinitesimal and ''compare'' it with the ''standard infinitesimal'' $dx_p$, which is again just the identity map from $\mathbb$ to $\mathbb$ (a $1\times 1$ matrix with entry $1$). The identity map has the property that if $\varepsilon$ is very small, then $dx_p(\varepsilon)$ is very small, which enables us to regard it as infinitesimal. The differential $df_p$ has the same property, because it is just a multiple of $dx_p$, and this multiple is the derivative $f'(p)$ by definition. We therefore obtain that $df_p=f'(p)\,dx_p$, and hence $df=f'\,dx$. Thus we recover the idea that $f'$ is the ratio of the differentials $df$ and $dx$.

This would just be a trick were it not for the fact that:
# it captures the idea of the derivative of $f$ at $p$ as the ''best linear approximation'' to $f$ at $p$;
# it has many generalizations.

Differentials as linear maps on Rⁿ

If $f$ is a function from $\mathbb^n$ to $\mathbb$, then we say that $f$ is ''differentiable'' at $p\in\mathbb^n$ if there is a linear map $df_p$ from $\mathbb^n$ to $\mathbb$ such that for any $\varepsilon>0$, there is a neighbourhood $N$ of $p$ such that for $x\in N$,
$\left, f(x) - f(p) - df_p(x-p)\ < \varepsilon \left, x-p\ .$

We can now use the same trick as in the one-dimensional case and think of the expression $f(x_1, x_2, \ldots, x_n)$ as the composite of $f$ with the standard coordinates $x_1, x_2, \ldots, x_n$ on $\mathbb^n$ (so that $x_j(p)$ is the $j$-th component of $p\in\mathbb^n$). Then the differentials $\left(dx_1\right)_p, \left(dx_2\right)_p, \ldots, \left(dx_n\right)_p$ at a point $p$ form a basis for the vector space of linear maps from $\mathbb^n$ to $\mathbb$ and therefore, if $f$ is differentiable at $p$, we can write ''$\operatornamef_p$'' as a linear combination of these basis elements:
$df_p = \sum_^n D_j f(p) \,(dx_j)_p.$

The coefficients $D_j f(p)$ are (by definition) the partial derivatives of $f$ at $p$ with respect to $x_1, x_2, \ldots, x_n$. Hence, if $f$ is differentiable on all of $\mathbb^n$, we can write, more concisely:
$\operatornamef = \frac \,dx_1 + \frac \,dx_2 + \cdots +\frac \,dx_n.$

In the one-dimensional case this becomes
$df = \fracdx$
as before.

This idea generalizes straightforwardly to functions from $\mathbb^n$ to $\mathbb^m$. Furthermore, it has the decisive advantage over other definitions of the derivative that it is invariant under changes of coordinates. This means that the same idea can be used to define the differential of smooth maps between smooth manifolds.

Aside: Note that the existence of all the partial derivatives of $f(x)$ at $x$ is a necessary condition for the existence of a differential at $x$. However it is not a sufficient condition. For counterexamples, see Gateaux derivative.

Differentials as linear maps on a vector space

The same procedure works on a vector space with a enough additional structure to reasonably talk about continuity. The most concrete case is a Hilbert space, also known as a complete inner product space, where the inner product and its associated norm define a suitable concept of distance. The same procedure works for a Banach space, also known as a complete Normed vector space. However, for a more general topological vector space, some of the details are more abstract because there is no concept of distance.

For the important case of a finite dimension, any inner product space is a Hilbert space, any normed vector space is a Banach space and any topological vector space is complete. As a result, you can define a coordinate system from an arbitrary basis and use the same technique as for $\mathbb^n$.

Differentials as germs of functions

This approach works on any differentiable manifold. If
# and are open sets containing
# $f\colon U\to \mathbb$ is continuous
# $g\colon V\to \mathbb$ is continuous
then is equivalent to at , denoted $f \sim_p g$, if and only if
there is an open $W \subseteq U \cap V$ containing such that $f(x) = g(x)$ for every in .
The germ of at , denoted p, is the set of all real continuous functions equivalent to at ; if is smooth at then p is a smooth germ.
If
#$U_1$, $U_2$ $V_1$ and $V_2$ are open sets containing
#$f_1\colon U_1\to \mathbb$, $f_2\colon U_2\to \mathbb$, $g_1\colon V_1\to \mathbb$ and $g_2\colon V_2\to \mathbb$ are smooth functions
#$f_1 \sim_p g_1$
#$f_2 \sim_p g_2$
# is a real number
then
#$r*f_1 \sim_p r*g_1$
#$f_1+f_2\colon U_1 \cap U_2\to \mathbb \sim_p g_1+g_2\colon V_1 \cap V_2\to \mathbb$
#$f_1*f_2\colon U_1 \cap U_2\to \mathbb \sim_p g_1*g_2\colon V_1 \cap V_2\to \mathbb$
This shows that the germs at p form an algebra.

Define $\mathcal_p$ to be the set of all smooth germs vanishing at and
$\mathcal_p^2$ to be the product of ideals $\mathcal_p \mathcal_p$. Then a differential at (cotangent vector at ) is an element of $\mathcal_p/\mathcal_p^2$. The differential of a smooth function at , denoted $\mathrm d f_p$, is -f(p)p/\mathcal_p^2.

A similar approach is to define differential equivalence of first order in terms of derivatives in an arbitrary coordinate patch.
Then the differential of at is the set of all functions differentially equivalent to $f-f(p)$ at .

Algebraic geometry

In algebraic geometry, differentials and other infinitesimal notions are handled in a very explicit way by accepting that the coordinate ring or structure sheaf of a space may contain nilpotent elements. The simplest example is the ring of dual numbers R 'ε'' where ''ε''² = 0.

This can be motivated by the algebro-geometric point of view on the derivative of a function ''f'' from R to R at a point ''p''. For this, note first that ''f'' − ''f''(''p'') belongs to the ideal ''I''_''p'' of functions on R which vanish at ''p''. If the derivative ''f'' vanishes at ''p'', then ''f'' − ''f''(''p'') belongs to the square ''I''_''p''² of this ideal. Hence the derivative of ''f'' at ''p'' may be captured by the equivalence class 'f'' − ''f''(''p'')in the quotient space ''I''_''p''/''I''_''p''², and the 1-jet of ''f'' (which encodes its value and its first derivative) is the equivalence class of ''f'' in the space of all functions modulo ''I''_''p''². Algebraic geometers regard this equivalence class as the ''restriction'' of ''f'' to a ''thickened'' version of the point ''p'' whose coordinate ring is not R (which is the quotient space of functions on R modulo ''I''_''p'') but R 'ε''which is the quotient space of functions on R modulo ''I''_''p''². Such a thickened point is a simple example of a scheme.

Algebraic geometry notions

Differentials are also important in algebraic geometry, and there are several important notions.
* Abelian differentials usually mean differential one-forms on an algebraic curve or Riemann surface.
* Quadratic differentials (which behave like "squares" of abelian differentials) are also important in the theory of Riemann surfaces.
* Kähler differentials provide a general notion of differential in algebraic geometry.

Synthetic differential geometry

A fifth approach to infinitesimals is the method of synthetic differential geometry or smooth infinitesimal analysis.See and . This is closely related to the algebraic-geometric approach, except that the infinitesimals are more implicit and intuitive. The main idea of this approach is to replace the category of sets with another category of ''smoothly varying sets'' which is a topos. In this category, one can define the real numbers, smooth functions, and so on, but the real numbers ''automatically'' contain nilpotent infinitesimals, so these do not need to be introduced by hand as in the algebraic geometric approach. However the logic in this new category is not identical to the familiar logic of the category of sets: in particular, the law of the excluded middle does not hold. This means that set-theoretic mathematical arguments only extend to smooth infinitesimal analysis if they are '' constructive'' (e.g., do not use proof by contradiction). Constructivists regard this disadvantage as a positive thing, since it forces one to find constructive arguments wherever they are available.

Nonstandard analysis

The final approach to infinitesimals again involves extending the real numbers, but in a less drastic way. In the nonstandard analysis approach there are no nilpotent infinitesimals, only invertible ones, which may be viewed as the reciprocals of infinitely large numbers. Such extensions of the real numbers may be constructed explicitly using equivalence classes of sequences of real numbers, so that, for example, the sequence (1, 1/2, 1/3, ..., 1/''n'', ...) represents an infinitesimal. The first-order logic of this new set of hyperreal numbers is the same as the logic for the usual real numbers, but the completeness axiom (which involves second-order logic) does not hold. Nevertheless, this suffices to develop an elementary and quite intuitive approach to calculus using infinitesimals, see transfer principle.

Differential geometry

The notion of a differential motivates several concepts in differential geometry (and differential topology).
*The differential (Pushforward) of a map between manifolds.
*Differential forms provide a framework which accommodates multiplication and differentiation of differentials.
*The exterior derivative is a notion of differentiation of differential forms which generalizes the differential of a function (which is a differential 1-form).
*Pullback is, in particular, a geometric name for the chain rule for composing a map between manifolds with a differential form on the target manifold.
* Covariant derivatives or differentials provide a general notion for differentiating of vector fields and tensor fields on a manifold, or, more generally, sections of a vector bundle: see Connection (vector bundle). This ultimately leads to the general concept of a connection.

Other meanings

The term ''differential'' has also been adopted in homological algebra and algebraic topology, because of the role the exterior derivative plays in de Rham cohomology: in a cochain complex $(C_\bullet, d_\bullet),$ the maps (or ''coboundary operators'') ''d_i'' are often called differentials. Dually, the boundary operators in a chain complex are sometimes called ''codifferentials''.

The properties of the differential also motivate the algebraic notions of a '' derivation'' and a '' differential algebra''.

See also

* Differential equation
* Differential form
* Differential of a function

Notes

Citations

References

* .
* .
* .
* .
*
* .
* .
* .
* .
* .
*

Mathematical terminology
Differential calculus

{{Infinitesimals

Calculus