Ai2

Modular training is gaining momentum as frontier models become costlier to train & deploy. This project shows how open, distributed approaches can make development more practical for national projects, public institutions, & smaller teams. → Learn more: buff.ly/N0b3zI7

Modular LLMs at scale: How the Danish Foundation Models project is using FlexOlmo to pool national expertise without pooling sensitive data | Ai2 allenai.org

The pre-training dataset for OlmoEarth includes Sentinel-2, Sentinel-1, and Landsat satellite imagery, paired with various "maps" such as ESA WorldCover and the USDA Cropland Data Layer. For details, see: - Hugging Face: huggingface.co/datasets/all... - OlmoEarth v1 paper: arx…

allenai/olmoearth_pretrain_dataset · Datasets at Hugging Face huggingface.co

The pre-training dataset for OlmoEarth includes Sentinel-2, Sentinel-1, and Landsat satellite imagery, paired with various "maps" such as ESA WorldCover and the USDA Cropland Data Layer. For details, see: - Hugging Face: huggingface.co/datasets/all... - OlmoEarth v1 paper: arx…

arxiv.org

Score & density show up across many fields. We hope one pretrained model like DiScoFormer can serve them all, at scale. 📝 Blog: https://t.co/bomZWcgcfy 📄 Report: https://t.co/g9M5oaYY2m

arxiv.org

This update came directly from partners asking for cleaner embeddings. OlmoEarth v1.2 comes in Nano, Tiny, Small, & Base—all open source + available now. 🤗 Models: buff.ly/T7IU2ZD 💻 Training & fine-tuning code: buff.ly/kj0fXJh 📄 Tech report: buff.ly/arhawz1

OlmoEarth - a allenai Collection huggingface.co

Everything is open—download the MolmoMotion weights, inspect the training data, & customize for your applications. ✏️ Blog: allenai.org/blog/molmo-m... 🤗 Models: huggingface.co/collections/... 📊 Data: huggingface.co/datasets/all... 📄 Paper: allenai.org/papers/molmo...

MolmoMotion - a allenai Collection huggingface.co

Everything is open—download the MolmoMotion weights, inspect the training data, & customize for your applications. ✏️ Blog: allenai.org/blog/molmo-m... 🤗 Models: huggingface.co/collections/... 📊 Data: huggingface.co/datasets/all... 📄 Paper: allenai.org/papers/molmo...

allenai/molmo-motion-1m · Datasets at Hugging Face huggingface.co

This work was done in collaboration with NOAA's Geophysical Fluid Dynamics Laboratory. → Read more about ACE2S-SHiELD+ in our preprint: buff.ly/0CeLUeW

Disentangling the effects of sea surface temperature and CO$_2$ in global machine learned weather-climate emulators arxiv.org

Modular training is gaining momentum as frontier models become costlier to train & deploy. This project shows how open, distributed approaches can make development more practical for national projects, public institutions, & smaller teams. → Learn more: buff.ly/N0b3zI7

Modular LLMs at scale: How the Danish Foundation Models project is using FlexOlmo to pool national expertise without pooling sensitive data | Ai2 buff.ly

This update came directly from partners asking for cleaner embeddings. OlmoEarth v1.2 comes in Nano, Tiny, Small, & Base—all open source. 🤗 Models: https://t.co/9uGJLi9loK 💻 Training & fine-tuning code: https://t.co/QzncWyXuq6 📄 Tech report: https://t.co/bmeRA1zJwt

OlmoEarth - a allenai Collection buff.ly

This update came directly from partners asking for cleaner embeddings. OlmoEarth v1.2 comes in Nano, Tiny, Small, & Base—all open source. 🤗 Models: https://t.co/9uGJLi9loK 💻 Training & fine-tuning code: https://t.co/QzncWyXuq6 📄 Tech report: https://t.co/bmeRA1zJwt

GitHub - allenai/olmoearth_pretrain: Earth system foundation model data, training, and eval github.com

LLMs are no longer created w/ human data alone. They rely on other models to generate & filter data, evaluate outputs, & guide dev work. So what is a modern LLM built on? Olmo 3 → 89 model + 183 dataset dependencies; Nemotron 3 → 273 + 560 We made ModSleuth to trace this. 🧵

AI image generators don't "draw"—they follow a compass: the score function, which points toward more probable images. The same compass drives Bayesian sampling and plasma physics. We built DiScoFormer to estimate the score far better when data gets complex. 🧵

Building an LLM means evaluating it over & over as it changes. Tweak a hyperparameter or scale the model up, & every new checkpoint sends you back through the same benchmarking loop. We're releasing olmo-eval, a workbench built for this kind of iterative model development. 🧵

MolmoAct 2 artifacts have been downloaded 400K+ times in under 1 month. Today we're opening up the full code & training data: everything you need to fine-tune or build on our fully open robotics foundation model. 🧵

What can you build with a fully open robotics model in a weekend? 🤖 Robotics engineer @0xbinh.bsky.social used MolmoAct 2, our open vision-language-action model, in the voice-controlled robot that won @southparkcommons.bsky.social's AI hackathon. Watch our interview with him ↓ 🎥

Learn how @thinkaisquared.bsky.social & Domyn used Olmo, our family of fully open language models, to build their own models for regulated industries like finance, healthcare, & the public sector. 🧵