Entropy of Bernoulli Measures Conditioned on Affine Subspaces and a Problem of Ancheta--Massey

Yihong Wu

For iid Bernoulli(p) bits with 0<p≤1/2 and a full-row-rank k×n binary linear encoder H, its optimal bitwise-MAP distortion D(H) obeys k/n≥h(p)(1−D(H)/p). A nonasymptotic entropy bound for every affine subspace drives the converse.

Sources for this record

What was already known

Ancheta proved the p=1/2 case. Massey asked whether a time-sharing strategy remains optimal for biased Bernoulli sources.

AI involvement AI-centered

Wu credits GPT-5.6 Sol with the first proof of the key entropy inequality in an interactive process. Wu simplified the proof, connected it to prior coding work and wrote the paper.

The model supplied the central first entropy proof; Wu’s later simplification and self-contained proof are separately credited.

Importance Notable

Establishes the biased-source linear-encoding rate and resolves Massey’s question.

Limitations

Wu gives a self-contained proof and explanation, but the available source does not document a completed separate check of the retained model-derived entropy argument.

Technical verification Reported

Proof availability and the author’s responsibility statement do not specify a completed check of the original AI argument; default Reported.

Human understanding Full

Wu explains the coset reduction, zero-coset entropy argument, induction and coding consequence in §§2–4.

Correction and publication history