In
thermodynamics
Thermodynamics is a branch of physics that deals with heat, work, and temperature, and their relation to energy, entropy, and the physical properties of matter and radiation. The behavior of these quantities is governed by the four laws of th ...
, the Helmholtz free energy (or Helmholtz energy) is a
thermodynamic potential that measures the useful
work
Work may refer to:
* Work (human activity), intentional activity people perform to support themselves, others, or the community
** Manual labour, physical work done by humans
** House work, housework, or homemaking
** Working animal, an animal t ...
obtainable from a
closed thermodynamic system
A thermodynamic system is a body of matter and/or radiation, confined in space by walls, with defined permeabilities, which separate it from its surroundings. The surroundings may include other thermodynamic systems, or physical systems that are ...
at a constant
temperature
Temperature is a physical quantity that expresses quantitatively the perceptions of hotness and coldness. Temperature is measurement, measured with a thermometer.
Thermometers are calibrated in various Conversion of units of temperature, temp ...
(
isothermal
In thermodynamics, an isothermal process is a type of thermodynamic process in which the temperature ''T'' of a system remains constant: Δ''T'' = 0. This typically occurs when a system is in contact with an outside thermal reservoir, and ...
). The change in the Helmholtz energy during a process is equal to the maximum amount of work that the system can perform in a thermodynamic process in which temperature is held constant. At constant temperature, the Helmholtz free energy is minimized at equilibrium.
In contrast, the
Gibbs free energy
In thermodynamics, the Gibbs free energy (or Gibbs energy; symbol G) is a thermodynamic potential that can be used to calculate the maximum amount of work that may be performed by a thermodynamically closed system at constant temperature and ...
or free enthalpy is most commonly used as a measure of thermodynamic potential (especially in
chemistry) when it is convenient for applications that occur at constant ''pressure''. For example, in
explosives research Helmholtz free energy is often used, since explosive reactions by their nature induce pressure changes. It is also frequently used to define fundamental
equations of state of pure substances.
The concept of free energy was developed by
Hermann von Helmholtz
Hermann Ludwig Ferdinand von Helmholtz (31 August 1821 – 8 September 1894) was a German physicist and physician who made significant contributions in several scientific fields, particularly hydrodynamic stability. The Helmholtz Associatio ...
, a German physicist, and first presented in 1882 in a lecture called "On the thermodynamics of chemical processes". From the German word ''Arbeit'' (work), the
International Union of Pure and Applied Chemistry
The International Union of Pure and Applied Chemistry (IUPAC ) is an international federation of National Adhering Organizations working for the advancement of the chemical sciences, especially by developing nomenclature and terminology. It is ...
(IUPAC) recommends the symbol ''A'' and the name ''Helmholtz energy''. In
physics
Physics is the natural science that studies matter, its fundamental constituents, its motion and behavior through space and time, and the related entities of energy and force. "Physical science is that department of knowledge which r ...
, the symbol ''F'' is also used in reference to ''free energy'' or ''Helmholtz function''.
Definition
The Helmholtz free energy is defined as
where
* ''F'' is the Helmholtz free energy (sometimes also called ''A'', particularly in the field of
chemistry) (
SI:
joule
The joule ( , ; symbol: J) is the unit of energy in the International System of Units (SI). It is equal to the amount of work done when a force of 1 newton displaces a mass through a distance of 1 metre in the direction of the force applie ...
s,
CGS:
ergs),
* ''U'' is the
internal energy of the system (SI: joules, CGS: ergs),
* ''T'' is the absolute temperature (
kelvin
The kelvin, symbol K, is the primary unit of temperature in the International System of Units (SI), used alongside its prefixed forms and the degree Celsius. It is named after the Belfast-born and University of Glasgow-based engineer and phy ...
s) of the surroundings, modelled as a heat bath,
* ''S'' is the
entropy
Entropy is a scientific concept, as well as a measurable physical property, that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynam ...
of the system (SI: joules per kelvin, CGS: ergs per kelvin).
The Helmholtz energy is the
Legendre transformation
In mathematics, the Legendre transformation (or Legendre transform), named after Adrien-Marie Legendre, is an involutive transformation on real-valued convex functions of one real variable. In physical problems, it is used to convert functions ...
of the internal energy ''U'', in which temperature replaces entropy as the independent variable.
Formal development
The
first law of thermodynamics
The first law of thermodynamics is a formulation of the law of conservation of energy, adapted for thermodynamic processes. It distinguishes in principle two forms of energy transfer, heat and thermodynamic work for a system of a constant amou ...
in a closed system provides
:
where
is the internal energy,
is the energy added as heat, and
is the work done on the system. The
second law of thermodynamics for a
reversible process yields
. In case of a reversible change, the work done can be expressed as
(ignoring electrical and other non-''PV'' work) and so:
:
Applying the product rule for differentiation to
, it follows
:
and
:
The definition of
enables to rewrite this as
:
Because ''F'' is a thermodynamic
function of state
In the thermodynamics of equilibrium, a state function, function of state, or point function for a thermodynamic system is a mathematical function relating several state variables or state quantities (that describe equilibrium states of a syste ...
, this
relation is also valid for a process (without electrical work or composition change) that is not reversible.
Minimum free energy and maximum work principles
The laws of thermodynamics are only directly applicable to systems in thermal equilibrium. If we wish to describe phenomena like chemical reactions, then the best we can do is to consider suitably chosen initial and final states in which the system is in (metastable) thermal equilibrium. If the system is kept at fixed volume and is in contact with a heat bath at some constant temperature, then we can reason as follows.
Since the thermodynamical variables of the system are well defined in the initial state and the final state, the internal energy increase
, the
entropy
Entropy is a scientific concept, as well as a measurable physical property, that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynam ...
increase
, and the total amount of work that can be extracted, performed by the system,
, are well defined quantities. Conservation of energy implies
:
The volume of the system is kept constant. This means that the volume of the heat bath does not change either, and we can conclude that the heat bath does not perform any work. This implies that the amount of heat that flows into the heat bath is given by
:
The heat bath remains in thermal equilibrium at temperature ''T'' no matter what the system does. Therefore, the entropy change of the heat bath is
:
The total entropy change is thus given by
:
Since the system is in thermal equilibrium with the heat bath in the initial and the final states, ''T'' is also the temperature of the system in these states. The fact that the system's temperature does not change allows us to express the numerator as the free energy change of the system:
:
Since the total change in entropy must always be larger or equal to zero, we obtain the inequality
:
We see that the total amount of work that can be extracted in an isothermal process is limited by the free-energy decrease, and that increasing the free energy in a reversible process requires work to be done on the system. If no work is extracted from the system, then
:
and thus for a system kept at constant temperature and volume and not capable of performing electrical or other non-''PV'' work, the total free energy during a spontaneous change can only decrease.
This result seems to contradict the equation d''F'' = −''S'' d''T'' − ''P'' d''V'', as keeping ''T'' and ''V'' constant seems to imply d''F'' = 0, and hence ''F'' = constant. In reality there is no contradiction: In a simple one-component system, to which the validity of the equation d''F'' = −''S'' d''T'' − ''P'' d''V'' is restricted, no process can occur at constant ''T'' and ''V'', since there is a unique ''P''(''T'', ''V'') relation, and thus ''T'', ''V'', and ''P'' are all fixed. To allow for spontaneous processes at constant ''T'' and ''V'', one needs to enlarge the thermodynamical state space of the system. In case of a chemical reaction, one must allow for changes in the numbers ''N''
''j'' of particles of each type ''j''. The differential of the free energy then generalizes to
:
where the
are the numbers of particles of type j and the
are the corresponding
chemical potentials. This equation is then again valid for both reversible and non-reversible changes. In case of a spontaneous change at constant T and V, the last term will thus be negative.
In case there are other external parameters, the above
relation further generalizes to
:
Here the
are the external variables, and the
the corresponding
generalized forces Generalized forces find use in Lagrangian mechanics, where they play a role conjugate to generalized coordinates. They are obtained from the applied forces, Fi, i=1,..., n, acting on a system that has its configuration defined in terms of generaliz ...
.
Relation to the canonical partition function
A system kept at constant volume, temperature, and particle number is described by the
canonical ensemble
In statistical mechanics, a canonical ensemble is the statistical ensemble that represents the possible states of a mechanical system in thermal equilibrium with a heat bath at a fixed temperature. The system can exchange energy with the heat ...
. The probability of finding the system in some energy eigenstate ''r'', for any microstate ''i'', is given by
where
*
*
is the energy of accessible state
*
''Z'' is called the
partition function of the system. The fact that the system does not have a unique energy means that the various thermodynamical quantities must be defined as expectation values. In the thermodynamical limit of infinite system size, the relative fluctuations in these averages will go to zero.
The average internal energy of the system is the expectation value of the energy and can be expressed in terms of ''Z'' as follows:
:
If the system is in state ''r'', then the generalized force corresponding to an external variable ''x'' is given by
:
The thermal average of this can be written as
:
Suppose that the system has one external variable
. Then changing the system's temperature parameter by
and the external variable by
will lead to a change in
:
:
If we write
as
:
we get
:
This means that the change in the internal energy is given by
:
In the thermodynamic limit, the
fundamental thermodynamic relation
In thermodynamics, the fundamental thermodynamic relation are four fundamental equations which demonstrate how four important thermodynamic quantities depend on variables that can be controlled and measured experimentally. Thus, they are essentiall ...
should hold:
:
This then implies that the entropy of the system is given by
:
where ''c'' is some constant. The value of ''c'' can be determined by considering the limit ''T'' → 0. In this limit the entropy becomes
, where
is the ground-state degeneracy. The partition function in this limit is
, where
is the ground-state energy. Thus, we see that
and that
:
Relating free energy to other variables
Combining the definition of Helmholtz free energy
:
along with the fundamental thermodynamic relation
one can find expressions for entropy, pressure and chemical potential:
:
These three equations, along with the free energy in terms of the partition function,
:
allow an efficient way of calculating thermodynamic variables of interest given the partition function and are often used in density of state calculations. One can also do
Legendre transformation
In mathematics, the Legendre transformation (or Legendre transform), named after Adrien-Marie Legendre, is an involutive transformation on real-valued convex functions of one real variable. In physical problems, it is used to convert functions ...
s for different systems. For example, for a system with a magnetic field or potential, it is true that
:
Bogoliubov inequality
Computing the free energy is an intractable problem for all but the simplest models in statistical physics. A powerful approximation method is
mean-field theory
In physics and probability theory, Mean-field theory (MFT) or Self-consistent field theory studies the behavior of high-dimensional random (stochastic) models by studying a simpler model that approximates the original by averaging over degrees of ...
, which is a variational method based on the Bogoliubov inequality. This inequality can be formulated as follows.
Suppose we replace the real Hamiltonian
of the model by a trial Hamiltonian
, which has different interactions and may depend on extra parameters that are not present in the original model. If we choose this trial Hamiltonian such that
:
where both averages are taken with respect to the canonical distribution defined by the trial Hamiltonian
, then the Bogoliubov inequality states
:
where
is the free energy of the original Hamiltonian, and
is the free energy of the trial Hamiltonian. We will prove this below.
By including a large number of parameters in the trial Hamiltonian and minimizing the free energy, we can expect to get a close approximation to the exact free energy.
The Bogoliubov inequality is often applied in the following way. If we write the Hamiltonian as
:
where
is some exactly solvable Hamiltonian, then we can apply the above inequality by defining
:
Here we have defined
to be the average of ''X'' over the canonical ensemble defined by
. Since
defined this way differs from
by a constant, we have in general
:
where
is still the average over
, as specified above. Therefore,
:
and thus the inequality
:
holds. The free energy
is the free energy of the model defined by
plus
. This means that
:
and thus
:
Proof of the Bogoliubov inequality
For a classical model we can prove the Bogoliubov inequality as follows. We denote the canonical probability distributions for the Hamiltonian and the trial Hamiltonian by
and
, respectively. From
Gibbs' inequality 200px, Josiah Willard Gibbs
In information theory, Gibbs' inequality is a statement about the information entropy of a discrete probability distribution. Several other bounds on the entropy of probability distributions are derived from Gibbs' inequ ...
we know that:
:
holds. To see this, consider the difference between the left hand side and the right hand side. We can write this as:
:
Since
:
it follows that:
:
where in the last step we have used that both probability distributions are normalized to 1.
We can write the inequality as:
:
where the averages are taken with respect to
. If we now substitute in here the expressions for the probability distributions:
:
and
:
we get:
:
Since the averages of
and
are, by assumption, identical we have:
:
Here we have used that the partition functions are constants with respect to taking averages and that the free energy is proportional to minus the logarithm of the partition function.
We can easily generalize this proof to the case of quantum mechanical models. We denote the eigenstates of
by
. We denote the diagonal components of the density matrices for the canonical distributions for
and
in this basis as:
:
and
:
where the
are the eigenvalues of
We assume again that the averages of H and
in the canonical ensemble defined by
are the same:
:
where
:
The inequality
:
still holds as both the
and the
sum to 1. On the l.h.s. we can replace:
:
On the right-hand side we can use the inequality
:
where we have introduced the notation
:
for the expectation value of the operator Y in the state r.
See here for a proof. Taking the logarithm of this inequality gives:
:
This allows us to write:
:
The fact that the averages of H and
are the same then leads to the same conclusion as in the classical case:
:
Generalized Helmholtz energy
In the more general case, the mechanical term
must be replaced by the product of volume,
stress
Stress may refer to:
Science and medicine
* Stress (biology), an organism's response to a stressor such as an environmental condition
* Stress (linguistics), relative emphasis or prominence given to a syllable in a word, or to a word in a phrase ...
, and an infinitesimal strain:
:
where
is the stress tensor, and
is the strain tensor. In the case of linear
elastic materials that obey
Hooke's law
In physics, Hooke's law is an empirical law which states that the force () needed to extend or compress a spring by some distance () scales linearly with respect to that distance—that is, where is a constant factor characteristic of ...
, the stress is related to the strain by
:
where we are now using
Einstein notation for the tensors, in which repeated indices in a product are summed. We may integrate the expression for
to obtain the Helmholtz energy:
:
Application to fundamental equations of state
The Helmholtz free energy function for a pure substance (together with its partial derivatives) can be used to determine all other thermodynamic properties for the substance. See, for example, the equations of state for
water
Water (chemical formula ) is an Inorganic compound, inorganic, transparent, tasteless, odorless, and Color of water, nearly colorless chemical substance, which is the main constituent of Earth's hydrosphere and the fluids of all known living ...
, as given by the
IAPWS in thei
IAPWS-95release.
Application to training auto-encoders
Hinton and Zemel
"derive an objective function for training
auto-encoder based on the
minimum description length
Minimum Description Length (MDL) is a model selection principle where the shortest description of the data is the best model. MDL methods learn through a data compression perspective and are sometimes described as mathematical applications of Occa ...
(MDL) principle". "The description length of an input vector using a particular code is the sum of the code cost and reconstruction cost.
heydefine this to be the energy of the code, for reasons that will become clear later. Given an input vector,
heydefine the energy of a code to be the sum of the code cost and the reconstruction cost." The true expected combined cost is
:
"which has exactly the form of Helmholtz free energy".
See also
*
Gibbs free energy
In thermodynamics, the Gibbs free energy (or Gibbs energy; symbol G) is a thermodynamic potential that can be used to calculate the maximum amount of work that may be performed by a thermodynamically closed system at constant temperature and ...
and
thermodynamic free energy
The thermodynamic free energy is a concept useful in the thermodynamics of chemical or thermal processes in engineering and science. The change in the free energy is the maximum amount of work that a thermodynamic system can perform in a process ...
for thermodynamics history overview and discussion of ''free energy''
*
Grand potential
The grand potential is a quantity used in statistical mechanics, especially for irreversible processes in open systems.
The grand potential is the characteristic state function for the grand canonical ensemble.
Definition
Grand potential is de ...
*
Enthalpy
*
Statistical mechanics
* This page details the Helmholtz energy from the point of view of
thermal
A thermal column (or thermal) is a rising mass of buoyant air, a convective current in the atmosphere, that transfers heat energy vertically. Thermals are created by the uneven heating of Earth's surface from solar radiation, and are an example ...
and
statistical physics
Statistical physics is a branch of physics that evolved from a foundation of statistical mechanics, which uses methods of probability theory and statistics, and particularly the mathematical tools for dealing with large populations and approxim ...
.
*
Bennett acceptance ratio
The Bennett acceptance ratio method (BAR) is an algorithm for estimating the difference in free energy between two systems (usually the systems will be simulated on the computer).
It was suggested by Charles H. Bennett in 1976.
Preliminaries
Tak ...
for an efficient way to calculate free energy differences and comparison with other methods.
References
Further reading
* Atkins' ''Physical Chemistry'', 7th edition, by
Peter Atkins and Julio de Paula, Oxford University Press
* HyperPhysics Helmholtz Free Energ
Helmholtz and Gibbs Free Energies
{{Authority control
Physical quantities
Hermann von Helmholtz
State functions
Thermodynamic free energy