Ackley, Hinton & Sejnowski, A Learning Algorithm for Boltzmann Machines, 1985 · §2, fig. 1

The Stochastic Neuron & Simulated Annealing ChamberEscaping local minima

Energy landscape

Annealing sequencer

READY
20.0T
t = 0.0 s · 0 sweeps
0.050.5T (log scale)520

Equilibrium distribution

Bars: where the particles have been recently (a moving average). Line: the Boltzmann distribution P ∝ e−E/T at the current temperature, which the bars approach when T is held fixed.

Ground state success rate