IFM Open-Weights K2-Horizon MoVA, a 36B/4B-Active MoE With Native 512K Context Under Apache 2.0
Summary
The Institute of Foundation Models released K2-Horizon-MoVA-36B-A4B on Hugging Face, a sparse mixture-of-experts checkpoint with 36B total and 4B active parameters, native 512K context, and a Mixture-of-Values attention design shipped under Apache 2.0. Benchmarks published with the release include 80.8% on GPQA Diamond, 58.6% on Terminal-Bench 2.1, and 26.8% on Tau3-Banking. The model logged 19,390 downloads in its first month.
Originally reported by huggingface.co
Read the original article →Original headline: IFM Open-Weights K2-Horizon MoVA, a 36B/4B-Active MoE With Native 512K Context Under Apache 2.0