Nvidia Releases Nemotron 3 Open-Weights Models

Nvidia on Monday unveiled Nemotron 3, a family of open-weights large language models available in Nano, Super, and Ultra sizes (≈30B, 100B, 500B parameters), with Nemotron 3 Nano releasing this week and larger models expected in H1 next year. Nvidia will publish model weights, training data and NeMo Gym RL environments on repos like Hugging Face; models use hybrid latent MoE, Mamba-2/transformer layers, a million‑token context window and multi-token decoding for up to 3x inference speedups.
Key Points
- 1Announces Nemotron 3 open-weights LLMs in 30B, 100B, and 500B parameter sizes
- 2Implements hybrid latent MoE with Mamba-2 and transformer layers for long-context efficiency
- 3Publishes weights, training data, and NeMo Gym enabling enterprise customization and RL fine-tuning
Scoring Rationale
Official release of performant open models, datasets, and tooling enables broad enterprise adoption, amplified by Nvidia's ecosystem reach.
Sources
Public references used for this report.
Practice with real Logistics & Shipping data
90 SQL & Python problems · 15 industry datasets
250 free problems · No credit card
See all Logistics & Shipping problems