The calculus of variations (or Variational Calculus) is a field of
mathematical analysis
Analysis is the branch of mathematics dealing with continuous functions, limit (mathematics), limits, and related theories, such as Derivative, differentiation, Integral, integration, measure (mathematics), measure, infinite sequences, series (m ...
that uses variations, which are small changes in
functions
and
functionals, to find maxima and minima of functionals:
mappings from a set of
functions to the
real number
In mathematics, a real number is a number that can be used to measurement, measure a ''continuous'' one-dimensional quantity such as a distance, time, duration or temperature. Here, ''continuous'' means that values can have arbitrarily small var ...
s. Functionals are often expressed as
definite integrals involving functions and their
derivative
In mathematics
Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented ...
s. Functions that maximize or minimize functionals may be found using the
Euler–Lagrange equation
In the calculus of variations and classical mechanics, the Euler–Lagrange equations are a system of second-order ordinary differential equations whose solutions are stationary points of the given action (physics), action functional. The equations ...
of the calculus of variations.
A simple example of such a problem is to find the curve of shortest length connecting two points. If there are no constraints, the solution is a
straight line
In geometry, a line is an infinitely long object with no width, depth, or curvature. Thus, lines are One-dimensional space, one-dimensional objects, though they may exist in Two-dimensional Euclidean space, two, Three-dimensional space, three, ...
between the points. However, if the curve is constrained to lie on a surface in space, then the solution is less obvious, and possibly many solutions may exist. Such solutions are known as ''
geodesic
In geometry, a geodesic () is a curve representing in some sense the shortest path (arc (geometry), arc) between two points in a differential geometry of surfaces, surface, or more generally in a Riemannian manifold. The term also has meaning in ...
s''. A related problem is posed by
Fermat's principle: light follows the path of shortest
optical length connecting two points, which depends upon the material of the medium. One corresponding concept in
mechanics
Mechanics (from Ancient Greek: wikt:μηχανική#Ancient_Greek, μηχανική, ''mēkhanikḗ'', "of machine, machines") is the area of mathematics and physics concerned with the relationships between force, matter, and motion among Ph ...
is the
principle of least/stationary action.
Many important problems involve functions of several variables. Solutions of
boundary value problems for the
Laplace equation
In mathematics and physics, Laplace's equation is a second-order partial differential equation named after Pierre-Simon Laplace, who first studied its properties. This is often written as
\nabla^2\! f = 0 or \Delta f = 0,
where \Delta = \nab ...
satisfy the
Dirichlet's principle.
Plateau's problem requires finding a surface of minimal area that spans a given contour in space: a solution can often be found by dipping a frame in soapy water. Although such experiments are relatively easy to perform, their mathematical formulation is far from simple: there may be more than one locally minimizing surface, and they may have non-trivial
topology
In mathematics, topology (from the Greek language, Greek words , and ) is concerned with the properties of a mathematical object, geometric object that are preserved under Continuous function, continuous Deformation theory, deformations, such ...
.
History
The calculus of variations may be said to begin with
Newton's minimal resistance problem in 1687, followed by the
brachistochrone curve
In physics and mathematics, a brachistochrone curve (), or curve of fastest descent, is the one lying on the plane between a point ''A'' and a lower point ''B'', where ''B'' is not directly below ''A'', on which a bead slides frictionlessly under ...
problem raised by
Johann Bernoulli
Johann Bernoulli (also known as Jean or John; – 1 January 1748) was a Swiss mathematician and was one of the many prominent mathematicians in the Bernoulli family. He is known for his contributions to infinitesimal calculus and educating ...
(1696).
It immediately occupied the attention of
Jakob Bernoulli and the
Marquis de l'Hôpital, but
Leonhard Euler
Leonhard Euler ( , ; 15 April 170718 September 1783) was a Swiss mathematician, physicist, astronomer, geographer, logician and engineer who founded the studies of graph theory and topology and made pioneering and influential discoveries in ma ...
first elaborated the subject, beginning in 1733.
Lagrange
Joseph-Louis Lagrange (born Giuseppe Luigi Lagrangia[Legendre (1786) laid down a method, not entirely satisfactory, for the discrimination of maxima and minima. ](_blank)Isaac Newton
Sir Isaac Newton (25 December 1642 – 20 March 1726/27) was an English mathematician, physicist, astronomer, alchemist, Theology, theologian, and author (described in his time as a "natural philosophy, natural philosopher"), widely ...
and Gottfried Leibniz
Gottfried Wilhelm (von) Leibniz . ( – 14 November 1716) was a German polymath active as a mathematician, philosopher, scientist and diplomat. He is one of the most prominent figures in both the history of philosophy and the history of mathema ...
also gave some early attention to the subject. To this discrimination Vincenzo Brunacci (1810), Carl Friedrich Gauss
Johann Carl Friedrich Gauss (; german: Gauß ; la, Carolus Fridericus Gauss; 30 April 177723 February 1855) was a German mathematician and physicist who made significant contributions to many fields in mathematics and science. Sometimes refer ...
(1829), Siméon Poisson (1831), Mikhail Ostrogradsky (1834), and Carl Jacobi (1837) have been among the contributors. An important general work is that of Sarrus (1842) which was condensed and improved by Cauchy
Baron Augustin-Louis Cauchy (, ; ; 21 August 178923 May 1857) was a French mathematician, engineer, and physicist who made pioneering contributions to several branches of mathematics, including mathematical analysis and continuum mechanics. He w ...
(1844). Other valuable treatises and memoirs have been written by Strauch (1849), Jellett (1850), Otto Hesse (1857), Alfred Clebsch (1858), and Lewis Buffett Carll (1885), but perhaps the most important work of the century is that of Weierstrass
Karl Theodor Wilhelm Weierstrass (german: link=no, Weierstraß ; 31 October 1815 – 19 February 1897) was a German mathematician often cited as the "father of modern mathematical analysis, analysis". Despite leaving university without a degree, ...
. His celebrated course on the theory is epoch-making, and it may be asserted that he was the first to place it on a firm and unquestionable foundation. The 20th and the 23rd Hilbert problem published in 1900 encouraged further development.
In the 20th century David Hilbert
David Hilbert (; ; 23 January 1862 – 14 February 1943) was a German mathematician, one of the most influential mathematicians of the 19th and early 20th centuries. Hilbert discovered and developed a broad range of fundamental ideas in many a ...
, Oskar Bolza, Gilbert Ames Bliss, Emmy Noether
Amalie Emmy NoetherEmmy (given name), Emmy is the ''Rufname'', the second of two official given names, intended for daily use. Cf. for example the résumé submitted by Noether to Erlangen University in 1907 (Erlangen University archive, ''Promot ...
, Leonida Tonelli, Henri Lebesgue
Henri Léon Lebesgue (; June 28, 1875 – July 26, 1941) was a French mathematician
A mathematician is someone who uses an extensive knowledge of mathematics in their work, typically to solve mathematical problems.
Mathematicians are con ...
and Jacques Hadamard
Jacques Salomon Hadamard (; 8 December 1865 – 17 October 1963) was a French mathematician who made major contributions in number theory, complex analysis, differential geometry and partial differential equations.
Biography
The son of a teac ...
among others made significant contributions. Marston Morse applied calculus of variations in what is now called Morse theory. Lev Pontryagin, Ralph Rockafellar and F. H. Clarke developed new mathematical tools for the calculus of variations in optimal control theory. The dynamic programming
Dynamic programming is both a mathematical optimization method and a computer programming method. The method was developed by Richard Bellman in the 1950s and has found applications in numerous fields, from aerospace engineering to economics.
I ...
of Richard Bellman is an alternative to the calculus of variations.
Extrema
The calculus of variations is concerned with the maxima or minima (collectively called extrema) of functionals. A functional maps functions to scalars, so functionals have been described as "functions of functions." Functionals have extrema with respect to the elements of a given function space
In mathematics
Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented in mo ...
defined over a given domain. A functional