Nvidia Launches Nemotron Lightning and AI Model Router

Nvidia has released Nemotron 3.5 Lightning, a 30 billion-parameter mixture-of-experts model designed for enterprise agentic AI workloads. It delivers up to four times faster output and 30% quicker task completion than comparable models, and can be fine-tuned cheaply on proprietary data using a single H100 GPU. Alongside it, Nvidia unveiled NeMo Switchyard, an open-source model routing library that directs AI agent prompts to the most suitable model based on cost, speed, and capability requirements. Partners including Boomi, Siemens, and LangChain are already integrating the router into their workflows.