Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora
1 directory member surfaced this signal.
“@ngMachina Ya, directionally. There's a 3-4 OOM gap between brain vs ANN sample efficiency, at least for language acquisition. The brain has innate priors from evolution so it's not an exact comparison, but at least suggestive we're still missing something …”