Nvidia Training Nemotron 4 Open-Source Model With 1 Trillion+ Parameters to Rival Chinese Labs

The Information reports Nvidia is developing a Nemotron 4 open-source family, with the flagship expected to exceed 1 trillion parameters — roughly twice the 550B Nemotron 3 Ultra released in June. Employees say training is not complete but the model could be ready as early as late fall, with Nvidia's Nemotron cloud-compute budget capped at $7B through fiscal 2028. The push follows cheap Chinese open models closing on top US closed labs and comes the same week Nvidia shipped the 30B Nemotron 3.5 Lightning MoE.