OpenAI reports a memory–sample lower bound for noiseless Gaussian regression
- Theoretical Computer Science
For every fixed A>0 and sufficiently large dimension d, a one-pass learner retaining at most Ad² bits between independent exact Gaussian linear measurements needs at least c_A d log(1/ε) measurements to estimate a uniformly random unit vector to angular error ε≤1/10 with success probability at least 2/3.