Grand canonical ensemble

In statistical mechanics, the grand canonical ensemble (also known as the macrocanonical ensemble) is the statistical ensemble that is used to represent the possible states of a mechanical system of particles that are in thermodynamic equilibrium (thermal and chemical) with a reservoir. The system is said to be open in the sense that the system can exchange energy and particles with a reservoir, so that various possible states of the system can differ in both their total energy and total number of particles. The system's volume, shape, and other external coordinates are kept the same in all possible states of the system.

The thermodynamic variables of the grand canonical ensemble are chemical potential (symbol: ) and absolute temperature (symbol: . The ensemble is also dependent on mechanical variables such as volume (symbol: which influence the nature of the system's internal states. This ensemble is therefore sometimes called the ensemble, as each of these three quantities are constants of the ensemble.

Basics

In simple terms, the grand canonical ensemble assigns a probability to each distinct microstate given by the following exponential:
:$P = e^,$
where is the number of particles in the microstate and is the total energy of the microstate. is Boltzmann's constant.

The number is known as the grand potential and is constant for the ensemble. However, the probabilities and will vary if different are selected. The grand potential serves two roles: to provide a normalization factor for the probability distribution (the probabilities, over the complete set of microstates, must add up to one); and, many important ensemble averages can be directly calculated from the function .

In the case where more than one kind of particle is allowed to vary in number, the probability expression generalizes to
:$P = e^,$
where is the chemical potential for the first kind of particles, is the number of that kind of particle in the microstate, is the chemical potential for the second kind of particles and so on ( is the number of distinct kinds of particles). However, these particle numbers should be defined carefully (see the note on particle number conservation below).

The distribution of the grand canonical ensemble is called generalized Boltzmann distribution by some authors.

Grand ensembles are apt for use when describing systems such as the electrons in a conductor, or the photons in a cavity, where the shape is fixed but the energy and number of particles can easily fluctuate due to contact with a reservoir (e.g., an electrical ground or a dark surface, in these cases). The grand canonical ensemble provides a natural setting for an exact derivation of the Fermi–Dirac statistics or Bose–Einstein statistics for a system of non-interacting quantum particles (see examples below).

; Note on formulation
: An alternative formulation for the same concept writes the probability as $\textstyle P = \frac e^$, using the grand partition function $\textstyle \mathcal Z = e^$ rather than the grand potential. The equations in this article (in terms of grand potential) may be restated in terms of the grand partition function by simple mathematical manipulations.

Applicability

The grand canonical ensemble is the ensemble that describes the possible states of an isolated system that is in thermal and chemical equilibrium with a reservoir (the derivation proceeds along lines analogous to the heat bath derivation of the normal canonical ensemble, and can be found in Reif). The grand canonical ensemble applies to systems of any size, small or large; it is only necessary to assume that the reservoir with which it is in contact is much larger (i.e., to take the macroscopic limit).

The condition that the system is isolated is necessary in order to ensure it has well-defined thermodynamic quantities and evolution. In practice, however, it is desirable to apply the grand canonical ensemble to describe systems that are in direct contact with the reservoir, since it is that contact that ensures the equilibrium. The use of the grand canonical ensemble in these cases is usually justified either 1) by assuming that the contact is weak, or 2) by incorporating a part of the reservoir connection into the system under analysis, so that the connection's influence on the region of interest is correctly modeled. Alternatively, theoretical approaches can be used to model the influence of the connection, yielding an open statistical ensemble.

Another case in which the grand canonical ensemble appears is when considering a system that is large and thermodynamic (a system that is "in equilibrium with itself"). Even if the exact conditions of the system do not actually allow for variations in energy or particle number, the grand canonical ensemble can be used to simplify calculations of some thermodynamic properties. The reason for this is that various thermodynamic ensembles ( microcanonical, canonical) become equivalent in some aspects to the grand canonical ensemble, once the system is very large.To quote Reif, "For purposes of calculating mean values of physical quantities, it makes no noticeable difference whether a macroscopic system is isolated, or in contact with a reservoir with which it can only exchange energy, or in contact with a reservoir with which it can exchange both energy and particles. ..In some problems where the constraint of a fixed number of particles is cumbersome, one can thus readily circumvent the complication by approximating the actual situation with ..the grand canonical distribution." Of course, for small systems, the different ensembles are no longer equivalent even in the mean. As a result, the grand canonical ensemble can be highly inaccurate when applied to small systems of fixed particle number, such as atomic nuclei.

Properties

Grand potential, ensemble averages, and exact differentials

The partial derivatives of the function give important grand canonical ensemble average quantities:

''Exact differential'': From the above expressions, it can be seen that the function has the exact differential
:$d\Omega = - S dT - \langle N_1 \rangle d\mu_1 \ldots - \langle N_s \rangle d\mu_s - \langle p\rangle dV .$

''First law of thermodynamics'': Substituting the above relationship for into the exact differential of , an equation similar to the first law of thermodynamics is found, except with average signs on some of the quantities:
:$d\langle E \rangle = T dS + \mu_1 d\langle N_1 \rangle \ldots + \mu_s d\langle N_s \rangle - \langle p\rangle dV .$

'' Thermodynamic fluctuations'': The variances in energy and particle numbers are
:$\langle E^2 \rangle - \langle E \rangle^2 = k T^2 \frac + k T \mu_1 \frac + k T \mu_2 \frac + \ldots ,$
:$\langle N_1^2 \rangle - \langle N_1 \rangle^2 = k T \frac .$

''Correlations in fluctuations'': The covariances of particle numbers and energy are
:$\langle N_1 N_2 \rangle - \langle N_1 \rangle\langle N_2\rangle = k T \frac = k T \frac .$
:$\langle N_1 E \rangle - \langle N_1 \rangle\langle E\rangle = k T \frac ,$

Example ensembles

The usefulness of the grand canonical ensemble is illustrated in the examples below. In each case the grand potential is calculated on the basis of the relationship
:$\Omega = -kT \ln \left(\sum_\text e^\right)$
which is required for the microstates' probabilities to add up to 1.

Statistics of noninteracting particles

Bosons and fermions (quantum)

In the special case of a quantum system of many ''non-interacting'' particles, the thermodynamics are simple to compute.
Since the particles are non-interacting, one can compute a series of single-particle stationary states, each of which represent a separable part that can be included into the total quantum state of the system.
For now let us refer to these single-particle stationary states as ''orbitals'' (to avoid confusing these "states" with the total many-body state), with the provision that each possible internal particle property (spin or polarization) counts as a separate orbital.
Each orbital may be occupied by a particle (or particles), or may be empty.

Since the particles are non-interacting, we may take the viewpoint that ''each orbital forms a separate thermodynamic system''.
Thus each orbital is a grand canonical ensemble unto itself, one so simple that its statistics can be immediately derived here. Focusing on just one orbital labelled , the total energy for a microstate of particles in this orbital will be , where is the characteristic energy level of that orbital. The grand potential for the orbital is given by one of two forms, depending on whether the orbital is bosonic or fermionic:

In each case the value $\scriptstyle\langle N_i\rangle = -\tfrac$ gives the thermodynamic average number of particles on the orbital: the Fermi–Dirac distribution for fermions, and the Bose–Einstein distribution for bosons.
Considering again the entire system, the total grand potential is found by adding up the for all orbitals.

Indistinguishable classical particles

In classical mechanics it is also possible to consider indistinguishable particles (in fact, indistinguishability is a prerequisite for defining a chemical potential in a consistent manner; all particles of a given kind must be interchangeable). We again consider placing multiple particles of the same kind into the same microstate of single-particle phase space, which we again call an "orbital". However, compared to quantum mechanics, the classical case is complicated by the fact that a microstate in classical mechanics does not refer to a single point in phase space but rather to an extended region in phase space: one microstate contains an infinite number of states, all distinct but of similar character. As a result, when multiple particles are placed into the same orbital, the overall collection of the particles (in the system phase space) does not count as one whole microstate but rather only a ''fraction'' of a microstate, because identical states (formed by permutation of identical particles) should not be overcounted. The overcounting correction factor is the factorial of the number of particles.

The statistics in this case take the form of an exponential power series
:$\begin \Omega_ & = -kT \ln \Big( \sum_^ \frac e^\Big) \\ & = -kT \ln \Big( e^\Big) \\ & = - kT e^, \end$
the value $\scriptstyle\langle N_\rangle = -\tfrac$ corresponding to Maxwell–Boltzmann statistics.

Ionization of an isolated atom

The grand canonical ensemble can be used to predict whether an atom prefers to be in a neutral state or ionized state.
An atom is able to exist in ionized states with more or fewer electrons compared to neutral. As shown below, ionized states may be thermodynamically preferred depending on the environment.
Consider a simplified model where the atom can be in a neutral state or in one of two ionized states (a detailed calculation also includes the degeneracy factors of the states):
* charge neutral state, with electrons and energy .
* an oxidized state ( electrons) with energy
* a reduced state ( electrons) with energy
Here and are the atom's ionization energy and electron affinity, respectively; is the local electrostatic potential in the vacuum nearby the atom, and is the electron charge.

The grand potential in this case is thus determined by
:$\begin \Omega & = -kT \ln \Big(e^ + e^ + e^\Big). \\ & = E_0 - \mu N_0 -kT \ln \Big( 1 + e^ + e^\Big). \\ \end$

The quantity is critical in this case, for determining the balance between the various states. This value is determined by the environment around the atom.

If one of these atoms is placed into a vacuum box, then , the work function of the box lining material. Comparing the tables of work function for various solid materials with the tables of electron affinity and ionization energy for atomic species, it is clear that many combinations would result in a neutral atom, however some specific combinations would result in the atom preferring an ionized state: e.g., a halogen atom in a ytterbium box, or a cesium atom in a tungsten box. At room temperature this situation is not stable since the atom tends to adsorb to the exposed lining of the box instead of floating freely. At high temperatures, however, the atoms are evaporated from the surface in ionic form; this spontaneous surface ionization effect has been used as a cesium ion source.

At room temperature, this example finds application in semiconductors, where the ionization of a dopant atom is well described by this ensemble. In the semiconductor, the conduction band edge plays the role of the vacuum energy level (replacing ), and is known as the Fermi level. Of course, the ionization energy and electron affinity of the dopant atom are strongly modified relative to their vacuum values. A typical donor dopant in silicon, phosphorus, has ;
the value of in the intrinsic silicon is initially about , guaranteeing the ionization of the dopant.
The value of depends strongly on electrostatics, however, so under some circumstances it is possible to de-ionize the dopant.

Meaning of chemical potential, generalized "particle number"

In order for a particle number to have an associated chemical potential, it must be conserved during the internal dynamics of the system, and only able to change when the system exchanges particles with an external reservoir.

If the particles can be created out of energy during the dynamics of the system, then an associated term must not appear in the probability expression for the grand canonical ensemble. In effect, this is the same as requiring that for that kind of particle. Such is the case for photons in a black cavity, whose number regularly change due to absorption and emission on the cavity walls. (On the other hand, photons in a highly reflective cavity can be conserved and caused to have a nonzero .)

In some cases the number of particles is not conserved and the represents a more abstract conserved quantity:

* ''Chemical reactions'': Chemical reactions can convert one type of molecule to another; if reactions occur then the must be defined such that they do not change during the chemical reaction.
* ''High energy particle physics'': Ordinary particles can be spawned out of pure energy, if a corresponding antiparticle is created. If this sort of process is allowed, then neither the number of particles nor antiparticles are conserved. Instead, is conserved.Of course, very high temperatures are required for significant thermal generation of particle-antiparticle pairs, e.g., of order 10⁹ K for electron-positron creation, and so this process is not a concern for everyday thermodynamics. As particle energies increase, there are more possibilities to convert between particle types, and so there are fewer numbers that are truly conserved. At the very highest energies the only conserved numbers are electric charge, weak isospin, and baryon number − lepton number.

On the other hand, in some cases a single kind of particle may have multiple conserved numbers:

* ''Closed compartments'': In a system composed of multiple compartments that share energy but do not share particles, it is possible to set the chemical potentials separately for each compartment. For example, a capacitor is composed of two isolated conductors and is charged by applying a difference in electron chemical potential.
* ''Slow equilibration'': In some quasi-equilibrium situations it is possible to have two distinct populations of the same kind of particle in the same location, which are each equilibrated internally but not with each other. Though not strictly in equilibrium, it may be useful to name quasi-equilibrium chemical potentials which can differ among the different populations. Examples: (semiconductor physics) distinct quasi-Fermi levels (electron chemical potentials) in the conduction band and valence band; ( spintronics) distinct spin-up and spin-down chemical potentials; (cryogenics) distinct parahydrogen and orthohydrogen chemical potentials.

Precise expressions for the ensemble

The precise mathematical expression for statistical ensembles has a distinct form depending on the type of mechanics under consideration (quantum or classical), as the notion of a "microstate" is considerably different. In quantum mechanics, the grand canonical ensemble affords a simple description since diagonalization provides a set of distinct microstates of a system, each with well-defined energy and particle number. The classical mechanical case is more complex as it involves not stationary states but instead an integral over canonical phase space.

Quantum mechanical

A statistical ensemble in quantum mechanics is represented by a density matrix, denoted by $\hat \rho$. The grand canonical ensemble is the density matrix
:$\hat \rho = \exp\big(\tfrac(\Omega + \mu_1 \hat N_1 + \ldots + \mu_s \hat N_s - \hat H)\big),$
where is the system's total energy operator ( Hamiltonian), is the system's total particle number operator for particles of type 1, is the total particle number operator for particles of type 2, and so on. is the matrix exponential operator. The grand potential is determined by the probability normalization condition that the density matrix has a trace of one, $Tr \hat \rho = 1$:
:$e^ = \operatorname \exp\big(\tfrac(\mu_1 \hat N_1 + \ldots + \mu_s \hat N_s - \hat H)\big).$

Note that for the grand ensemble, the basis states of the operators , , etc. are all states with ''multiple particles'' in Fock space, and the density matrix is defined on the same basis. Since the energy and particle numbers are all separately conserved, these operators are mutually commuting.

The grand canonical ensemble can alternatively be written in a simple form using bra–ket notation, since it is possible (given the mutually commuting nature of the energy and particle number operators) to find a complete basis of simultaneous eigenstates , indexed by , where , , and so on. Given such an eigenbasis, the grand canonical ensemble is simply
:$\hat \rho = \sum_i e^ , \psi_i\rangle \langle \psi_i ,$
:$e^ = \sum_i e^.$
where the sum is over the complete set of states with state having total energy, particles of type 1, particles of type 2, and so on.

Classical mechanical

In classical mechanics, a grand ensemble is instead represented by a joint probability density function defined over multiple phase spaces of varying dimensions, , where the and are the canonical coordinates (generalized momenta and generalized coordinates) of the system's internal degrees of freedom. The expression for the grand canonical ensemble is somewhat more delicate than the canonical ensemble since:
* The number of particles and thus the number of coordinates varies between the different phase spaces, and,
* it is vital to consider whether permuting similar particles counts as a distinct state or not.
In a system of particles, the number of degrees of freedom depends on the number of particles in a way that depends on the physical situation. For example, in a three-dimensional gas of monoatoms , however in molecular gases there will also be rotational and vibrational degrees of freedom.

The probability density function for the grand canonical ensemble is:
:$\rho = \frac e^,$
where
* is the energy of the system, a function of the phase ,
* is an arbitrary but predetermined constant with the units of , setting the extent of one microstate and providing correct dimensions to .(Historical note) Gibbs' original ensemble effectively set , leading to unit-dependence in the values of some thermodynamic quantities like entropy and chemical potential. Since the advent of quantum mechanics, is often taken to be equal to Planck's constant in order to obtain a semiclassical correspondence with quantum mechanics.
* is an overcounting correction factor (see below), a function of .

Again, the value of is determined by demanding that is a normalized probability density function:
:$e^ = \sum_^ \ldots \sum_^ \int \ldots \int \frac e^ \, dp_1 \ldots dq_n$
This integral is taken over the entire available phase space for the given numbers of particles.

Overcounting correction

A well-known problem in the statistical mechanics of fluids (gases, liquids, plasmas) is how to treat particles that are similar or identical in nature: should they be regarded as distinguishable or not? In the system's equation of motion each particle is forever tracked as a distinguishable entity, and yet there are also valid states of the system where the positions of each particle have simply been swapped: these states are represented at different places in phase space, yet would seem to be equivalent.

If the permutations of similar particles are regarded to count as distinct states, then the factor above is simply . From this point of view, ensembles include every permuted state as a separate microstate. Although appearing benign at first, this leads to a problem of severely non-extensive entropy in the canonical ensemble, known today as the Gibbs paradox. In the grand canonical ensemble a further logical inconsistency occurs: the number of distinguishable permutations depends not only on how many particles are in the system, but also on how many particles are in the reservoir (since the system may exchange particles with a reservoir). In this case the entropy and chemical potential are non-extensive but also badly defined, depending on a parameter (reservoir size) that should be irrelevant.

To solve these issues it is necessary that the exchange of two similar particles (within the system, or between the system and reservoir) must not be regarded as giving a distinct state of the system.This can be compared to the canonical ensemble where it is optional to consider particles as distinguishable; this only gives -dependent error in entropy, which is unobservable as long as is kept constant. In general, however, there is no such freedom: "when the number of particles in a system is to be treated as variable, the average index of probability for phases generically defined corresponds to entropy." (Gibbs). In order to incorporate this fact, integrals are still carried over full phase space but the result is divided by
:$C = N_1! N_2! \ldots N_s!,$
which is the number of different permutations possible. The division by neatly corrects the overcounting that occurs in the integral over all phase space.

It is of course possible to include distinguishable ''types'' of particles in the grand canonical ensemble—each distinguishable type $i$ is tracked by a separate particle counter $N_i$ and chemical potential $\mu_i$. As a result, the only consistent way to include "fully distinguishable" particles in the grand canonical ensemble is to consider every possible distinguishable type of those particles, and to track each and every possible type with a separate particle counter and separate chemical potential.

Notes

References

{{Statistical mechanics topics

Statistical ensembles