Ackley, Hinton & Sejnowski, A Learning Algorithm for Boltzmann Machines, 1985 · §3.2, §4.1
Weight Divergence & the Noisy Clamping Lab
Why rare patterns demand infinite energies, and how noise prevents it
Train
sign · δ
ε(p − p′)
δ
SIGMOID SATURATED · NUMERICAL RUNAWAY
cycle
0
/
Weight spectrum
every link once, and every bias
±100
auto
■
lateral links inside V1 and V2
■
links between visible and hidden units
■
biases
■
beyond the axis
Energy spectrum
free energy F(V) of every visible pattern
Where the units operate
ΔE/T on the logistic of Eq. 5