A Counterexample to Fourier Alignment in Single-Neuron Modular Addition

Gautam Neelakantan Memana

For the single-neuron modular-addition setting, Appendix A extends Memana’s human counterexample to selection-independent Clarke trajectories and dead-neuron examples under the specified ReLU, dead-zone smoothing and fixed-step full-batch gradient-descent dynamics.

Sources for this record

What was already known

The human main theorem already gave a positive-probability nonaligned trajectory under a measurable Clarke selection. It did not establish the appendix's selection independence or robustness across the stated dynamics.

AI involvement AI-centered

Memana credits GPT-5.6 Sol conversations and a model draft for the strengthened appendix; Memana developed the main text and reviewed and edited the appendix.

The strengthened appendix theorems and draft are expressly credited to GPT-5.6 Sol conversations; the original main counterexample was human work.

Importance Modest

Shows the nonalignment example persists under several precisely stated training dynamics.

Limitations

The human main theorem already supplied a positive-probability nonaligned trajectory. The smooth case needs an exact dead half-line, and the discrete case is fixed-step full-batch descent. A completed check of the appendix proofs is not documented.

Technical verification Reported

The appendix provides proofs and the author reviewed and edited them, but a completed rigorous check of these strengthened results is not explicitly documented.

Human understanding Full

The author explains the gate-sliding, dead-neuron and Fourier-energy mechanisms in the adjoining human main argument and edited appendix.

Correction and publication history

2026-10-18 · publication

Shows the nonalignment example persists under several precisely stated training dynamics.

Read this published revision