Ackley, Hinton & Sejnowski, A Learning Algorithm for Boltzmann Machines, 1985 · §4.1–4.3, fig. 3

Code Repulsion & Territory CompetitionHow the learning rule pushes clashing codes apart in hidden space

cycle 0 / 0

Hidden space

drag to orbit · scroll to zoom · drag a token onto a corner to move its code

Hamming radar DH between every pair of codes

■ DH = 0, a collision ■ 1 ■ 2 or more

Cosine spectrum V1→H weight vectors

Bars: every pair, largest first. Line: the largest over the cycles. Dashed: 0.73, the largest the paper found in its 40-10-40 codes (§4.4).

Territory who holds which corner