OpenAI reports a memory–sample lower bound for noiseless Gaussian regression

For every fixed A>0 and sufficiently large dimension d, a one-pass learner retaining at most Ad² bits between independent exact Gaussian linear measurements needs at least c_A d log(1/ε) measurements to estimate a uniformly random unit vector to angular error ε≤1/10 with success probability at least 2/3.

Curated contributions 1

Understand the problem ↓

OpenAI reports a memory–sample lower bound for noiseless Gaussian regression

  • Theoretical Computer Science

For every fixed A>0 and sufficiently large dimension d, a one-pass learner retaining at most Ad² bits between independent exact Gaussian linear measurements needs at least c_A d log(1/ε) measurements to estimate a uniformly random unit vector to angular error ε≤1/10 with success probability at least 2/3.

AI involvementAI-led
ImportanceNotable
Technical verificationFormal (Lean 4)
Human understandingFew

Understanding the problem

Read the background

For every fixed A>0 and sufficiently large dimension d, a one-pass learner retaining at most Ad² bits between independent exact Gaussian linear measurements needs at least c_A d log(1/ε) measurements to estimate a uniformly random unit vector to angular error ε≤1/10 with success probability at least 2/3.

Why it matters

If correct, establishes a precision-driven sample lower bound even though every observation is noiseless.

What counts as progress

How many noiseless Gaussian measurements are needed when a learner remembers at most O(d²) bits?

Website timeline

Publication dates and editorial changes.