2 results found
NVIDIA Nemotron 3.5 Lightning is an open-weights, hybrid MoE (Mamba-2 + MoE + Attention) LLM designed for efficient AI agent development. It supports 1M token context, offers speculative decoding methods like DSpark, and is optimized for NVIDIA Blackwell, Hopper, and Ampere GPUs. Developers can deploy it via vLLM, TensorRT-LLM, or SGLang, leveraging its advanced features like reasoning control and tool-calling through an OpenAI-compatible API.
IndexCache, a novel sparse attention optimizer by Tsinghua University and Z.ai, dramatically accelerates long-context AI models. It cuts up to 75% redundant computation, delivering up to 1.82x faster inference and significant cost savings.
