OpenAI reports sharp binary-information contraction on the discrete cube
- Theoretical Computer Science
For a binary channel on a uniform discrete cube under independent symmetric noise, a noisy coordinate maximizes retained information at fixed initial information; for Boolean functions this gives I(f(X);Y) ≤ 1 − h₂(ε) at crossover probability 0≤ε≤1/2.