Physical
Physical
Contents
1 Fundamental Concepts 2
3 Stirling’s Approximation 3
4 Distribution of Microstates 3
4.1 Example: N=10 Distinguishable Particles in a 2-State System . . . . . . . . . . . 3
11 Degeneracy 8
1
13 The Canonical Partition Function (Q) 9
13.1 Distinguishable, Non-Interacting Particles . . . . . . . . . . . . . . . . . . . . . . 10
13.2 Indistinguishable, Non-Interacting Particles . . . . . . . . . . . . . . . . . . . . . 10
2
1 Fundamental Concepts
• Statistical Thermodynamics provides the link between the microscopic properties of
matter (positions, energies, momenta of individual particles) and its bulk macroscopic
properties (temperature, pressure, entropy, heat capacity).
= 2N = 24 = 16.
P
• Total Number of Microstates (Ω): Ω = R WR
3
• Average Number of Heads (N̄H ):
P
N W
P H,R R
X
R
N̄H = NH,R PR =
R R WR
(4 × 1) + (3 × 4) + (2 × 6) + (1 × 4) + (0 × 1) 4 + 12 + 12 + 4 + 0 32
N̄H = = = =2
16 16 16
Similarly, N̄T = 2.
3 Stirling’s Approximation
Used to estimate the factorial of very large numbers (N 1), common in statistical mechanics.
ln(N !) ≈ N ln N − N
The 12 ln(2πN ) term is the correction factor, often negligible in logarithmic calculations
involving NA .
4 Distribution of Microstates
4.1 Example: N=10 Distinguishable Particles in a 2-State System
Let the states be State 1 and State 2. A macrostate is defined by N1 (number
in State
1). Then
N 10
N2 = N − N1 = 10 − N1 . The thermodynamic probability is W (N1 ) = N1 = N1 .
4
10
N1 W = N 1
0 1
1 10
2 45
3 120
4 210
5 252 (Wmax )
6 210
7 120
8 45
9 10
10 1
N! N!
W (N1 , N2 , . . . , Nn ) = = Qn
N1 !N2 ! . . . Nn ! i=1 Ni !
5
6 Energy Distributions (Distinguishable Particles)
Constraints:
P
1. Conservation of Particles: i Ni = N
P
2. Conservation of Energy: i Ni εi = U (Total Energy)
Note: WR here counts the number of ways to assign distinguishable particles A, B, C to the
specified energy levels.
S = kB ln W
• The equilibrium state corresponds to the macrostate with the maximum W (and thus
maximum S).
6
7.1 Example: Entropy of Coin Toss Macrostates
Using the results from the 4-coin toss:
The macrostate (2, 2) is the most disordered and has the highest entropy. Macrostates (4, 0)
and (0, 4) are the most ordered and have zero entropy.
∆S = kB ln 20 − kB ln 1 = kB ln 20 ≈ 2.996kB
This positive entropy change reflects the spontaneous tendency for the gas to expand and become
more disordered.
W = N6I
Macrostate NI NII S = kB ln W
1 0 6 1 0
2 1 5 6 1.79kB
3 2 4 15 2.71kB
4 3 3 20 2.96kB
5 4 2 15 2.71kB
6 5 1 6 1.79kB
7 6 0 1 0
• Arrangement: How the partitions are assigned the numbers (e.g., (6,0,0) can be arranged
as [6 0 0], [0 6 0], [0 0 6]).
• WR (Ways per Arrangement): For a given arrangement, the number of ways to assign
the 6 distinguishable particles, WR = N1 !N6!2 !N3 ! .
Examples of Macrostates:
7
6!
• Macrostate (6,0,0): 3 arrangements ([600],[060],[006]). WR = 6!0!0! = 1. WTotal = 3 × 1 =
3.
6!
• Macrostate (5,1,0): 6 arrangements ([510],[501],[150],[051],[105],[015]). WR = 5!1!0! = 6.
WTotal = 6 × 6 = 36.
6!
• Macrostate (4,1,1): 3 arrangements ([411],[141],[114]). WR = 4!1!1! = 30. WTotal =
3 × 30 = 90.
6!
• Macrostate (3,2,1): 6 arrangements. WR = 3!2!1! = 60. WTotal = 6 × 60 = 360.
6!
• Macrostate (4,2,0): 6 arrangements. WR = 4!2!0! = 15. WTotal = 6 × 15 = 90.
6!
• Macrostate (3,3,0): 3 arrangements. WR = 3!3!0! = 20. WTotal = 3 × 20 = 60.
6!
• Macrostate (2,2,2): 1 arrangement ([222]). WR = 2!2!2! = 90. WTotal = 1 × 90 = 90.
S = kB ln W = kB ln(NA !)
ln(NA !) ≈ NA ln NA − NA
S ≈ kB (NA ln NA − NA ) = R ln NA − R
Calculating ln NA = ln 6.022 × 1023 ≈ 54.75.
S ≈ R(54.75 − 1) = 53.75R
8
10 Entropy Change, Probability, and Impossibility
10.1 Entropy Change for Volume Change
Consider N molecules isothermally changing volume from V1 to V2 . The probability ratio of
finding the molecules in V2 compared to V1 is related to the ratio of available microstates (phase
space volume):
N
W2 V2
p= =
W1 V1
The change in entropy is given by thermodynamics (for ideal gas):
V2
∆S = N kB ln
V1
Comparing these, we find a relationship between entropy change and the probability ratio:
N
V2
∆S = kB ln = kB ln p
V1
V1 /2 N
N
1
p= =
V1 2
• If N = 10, p = (1/2)10 = 1/1024 ≈ 1 × 10−3 . This might occur relatively frequently on
molecular timescales.
• If N = 50, p = (1/2)50 ≈ 8.9 × 10−16 . Extremely improbable.
• If N = NA ≈ 6 × 1023 , p = (1/2)NA which is practically zero. Spontaneous compression
of macroscopic gas is impossible.
Note: The magnitude of ∆S is the same for compression (V1 → V1 /2, ∆S < 0) and expansion
(V1 /2 → V1 , ∆S > 0), but the sign reflects the direction of spontaneous change. |∆S| =
N kB ln 2.
11 Degeneracy
An energy level εi is degenerate if there is more than one distinct quantum state corresponding
to that energy level. The degree of degeneracy, gi , is the number of states having the energy
εi .
9
12.2 The Partition Function (q)
P
To normalize the probability ( Pi = 1), we introduce the molecular partition function, q:
X
q= e−βεi
states i
The sum is over all possible quantum states accessible to a single particle. The probability of
finding a particle in state i is:
e−βεi
Pi =
q
e−βεj
Pk (state) =
q
gj e−βεj
Pj (level) =
q
The partition function q provides a measure of the number of thermally accessible states at a
given temperature.
• Higher T or smaller energy spacing (∆ε) increases q and excited state populations.
• The occupational probability Pj depends on both the Boltzmann factor e−βεj and the
partition function q.
10
13.1 Distinguishable, Non-Interacting Particles
If the N particles arePdistinguishable (e.g., fixed in a crystal lattice) and do not interact, the
total energy is E = N k=1 εk , where εk is the energy of the k-th particle in its specific state.
The system partition function Q is:
X X X X
Q= e−βE = ··· e−β(ε1 +ε2 +···+εN )
all system states states of p1 states of p2 states of pN
! !
X X X
Q= e−βεi1 e−βεi2 ... e−βεiN
states i1 states i2 states iN
If the particles are identical (have the same energy levels available):
• Fermions: Obey Pauli exclusion principle (max one particle per quantum state). Use
Fermi-Dirac statistics.
qN
Q= (Indistinguishable identical particles, high T / low ρ limit)
N!
11
15 Ideal Monoatomic Gas
Particles like He, Ne, Ar. Only translational energy is significant at normal temperatures.
Etotal = Etrans + Erot + Evib + Eelec qtotal = qtrans × qrot × qvib × qelec
For monoatomic gas:
• qelec ≈ gel,0 (ground state electronic degeneracy, usually 1 for noble gases).
∞
!3
2 n2
− βh
X
qtrans = e 8ma2
n=1
Approximating the sum by an integral (valid for large box / high T):
s
∞ Z ∞
βh2 n2 βh2 n2 2πma2
r
1 π
e− 8ma2 ≈ e− 8ma2 dn =
X
=
0 2 βh2 /(8ma2 ) βh2
n=1
s !3 3/2 3/2
2πma2 2πma2 kB T
2πmkB T
qtrans = = = a3
βh2 h2 h2
3/2
2πmkB T V
qtrans = V =
h2 Λ3
q
h2
where Λ = 2πmkB T is the thermal de Broglie wavelength.
ln Q = N ln qtrans − ln N ! ≈ N ln qtrans − (N ln N − N )
3 2πmkB T
ln Q = N ln + ln V − N ln N + N
2 h2
12
Average Energy hEi:
∂ ln Q 2 ∂ ln Q
hEi = − = kB T
∂β N,V ∂T N,V
3
Since qtrans ∝ T 3/2 , ln qtrans = 2 ln T + const.
3
ln Q = N ( ln T ) + terms independent of T
2
∂ ln Q 31 3N
=N =
∂T N,V 2T 2T
2 3N 3 3
hEi = kB T = N kB T = nRT
2T 2 2
Heat Capacity CV :
∂hEi 3 3
CV = = N kB = nR
∂T N,V 2 2
Pressure hP i:
∂ ln Q
hP i = kB T
∂V N,T
ln Q = N ln V + terms independent of V
∂ ln Q N
=
∂V N,T V
N
hP i = kB T
V
hP iV = N kB T = nRT (Ideal Gas Law)
Sens X
Ssystem = = −kB Pj ln Pj (Gibbs entropy formula)
A
j
13
16.2 Relation to Partition Function (Canonical Ensemble)
In the canonical ensemble (N, V, T fixed), Pj = e−βEj /Q. Substituting into Gibbs entropy
formula:
X e−βEj
Ssystem = −kB (−βEj − ln Q)
Q
j
X e−βEj X e−βEj
= kB β Ej + kB ln Q
Q Q
j j
X
= kB βhEi + kB ln Q (since Pj = 1)
hEi
= + kB ln Q
T
Since A = −kB T ln Q (Helmholtz free energy), S = (hEi−A)/T . Also, hEi = kB T 2 (∂ ln Q/∂T )N,V .
Substituting this gives:
∂ ln Q
Ssystem = kB T + kB ln Q
∂T N,V
hν
where Θvib = is the characteristic vibrational temperature. Note: Often, energy is
kB
measured relative to the ZPE, so ε0v = vhν. In this case:
∞
0
X 1 1
qvib = e−βvhν = −βhν
= −Θ
v=0
1−e 1 − e vib /T
0
Thermodynamic results are independent of the energy zero choice. Let’s use qvib for simplicity.
14
17.3 Interpretation and Population
Θvib is typically high (1000 K to 4000 K).
~2
εJ = J(J + 1) = BJ(J + 1) (J = 0, 1, 2, . . . )
2I
where B = ~2 /(2I) is the rotational constant (in Joules). ~ = h/(2π). Often use B in Hz
(BH = B/h) or B̃ in cm−1 (B̃ = B/(hc)). Each level J has degeneracy gJ = 2J + 1.
B ~2
Define the characteristic rotational temperature: Θrot = = .
kB 2IkB
∞
X
qrot = (2J + 1)e−J(J+1)Θrot /T
J=0
15
Let x = J(J + 1), dx = (2J + 1)dJ.
Z ∞ " #∞
−xΘrot /T
−xΘrot /T e 1 T
qrot ≈ e dx = =0− =
0 −Θrot /T −Θrot /T Θrot
0
T
qrot ≈ (T Θrot )
σΘrot
Example: Calculate Θrot for H2 and D2 . r ≈ 74.16 pm. µ(H2 ) ≈ 0.5 amu ≈ 8.35 × 10−28 kg.
(1.054 × 10−34 J s)2
I(H2 ) ≈ 4.60 × 10−48 kg m2 . Θrot (H2 ) = 2(4.60 × 10−48 kg m2 )(1.38 × 10−23 J K−1 )
≈ 87.5 K. µ(D2 ) ≈
1 amu ≈ 1.67 × 10−27 kg. I(D2 ) ≈ 9.20 × 10−48 kg m2 . Θrot (D2 ) ≈ 43.8 K.
Electronic energy spacings are usually very large (∼ eV ∼ 104 − 105 cm−1 ). Corresponding
”electronic temperature” Θel is very high. At normal temperatures, T Θel . Only the ground
electronic state is significantly populated. Choosing εel,0 = 0:
qelec ≈ gel,0
where gel,0 is the degeneracy of the ground electronic state (often 1 for closed-shell molecules).
16
19.2 Electronic Energy and Heat Capacity
If qelec ≈ gel,0 (constant).
2 ∂ ln qelec
hEielec = kB T =0 (relative to ground state)
∂T V
∂hEi
(CV )elec = =0
∂T V
Electronic degrees of freedom usually do not contribute to hEi or CV at ordinary temperatures.
(Note: If energy is measured relative to dissociated atoms, εel,0 = −De , then hEielec = −De ).
17