paper web signal

One Researcher, 1/12 the Training Data: Metis-1.6 Logs Ranks 7th on 40 Benchmarks

Summary

A solo researcher trained two competitive mixture-of-experts models from scratch using roughly a 12th of the median training data of their nearest comparators, challenging the assumption that frontier-competitive model development requires large teams and massive token budgets.