# NVIDIA tunes a 4 GB open model for voice assistants and game characters

NVIDIA has retrained Google's small Gemma 4 model to follow instructions and use tools better, while keeping replies short. It fits in about 4 GB of memory and comes with a helper that speeds up replies.

- Category: Language models
- Readiness level: III (Open source) on Science Underway's four-step scale, as proposed
- Published: 2026-11-17
- Editor: Stefan Perdal
- URL: https://scienceunderway.com/articles/nvidia-tunes-a-4-gb-open-model-for-voice-assistants-and-game-characters

## The study

Nemotron 3.5 Bolt E4B 4GB: An Open and Efficient Small Language Model for Fast Conversational Agents (preprint, not peer reviewed). arXiv 2611.20771. https://arxiv.org/abs/2611.20771

## At a glance

- What it shows: NVIDIA took a small, freely available Google model and trained it further for spoken assistants, game characters and robots. On NVIDIA's own tests it scored higher on average than three similar-sized models while giving shorter answers.
- What it does not show: It does not show the model matching larger or cloud models, which still score higher. It also does not show anyone using it in a real product yet.
- Why it matters: Assistants that run on a local graphics card or small device avoid cloud costs and delays. This release gives builders a ready-made, downloadable option aimed at that use.

## What the study shows

The model is called Nemotron 3.5 Bolt E4B. It starts from Gemma-4-E4B-it, a small open model from Google. NVIDIA trained it further using reinforcement learning, where a model improves by being rewarded for good answers. The training targeted multi-turn tool use, following instructions, and output formatting. A compressed 4-bit version fits in about 4 GB of memory.

The team tested it on 21 benchmarks against Gemma-4-E4B-it, Qwen3.5-4B and NVIDIA's earlier Nemotron-3 Nano-4B. The authors report it scored best on 15 of the 21 tests with reasoning switched on, and 14 of 21 with it off. Reasoning here means the model writes out working steps before answering.

The largest gains over Gemma were in following instructions. On a test of resolving conflicts between system and user instructions, the score rose from about 67 to about 85. On a test that mixes tool use with dialogue, it rose from about 39 to about 55.

Averaged across all 21 tests, the authors report about 64% accuracy in reasoning mode against about 58% for Gemma and Qwen. It also used fewer output words. Qwen needed roughly five times as many output tokens, the word pieces a model generates.

The team also trained a small helper model called a drafter. It guesses several words ahead and the main model checks them, a method called speculative decoding. On one NVIDIA workstation card this made replies for a single user about 2.7 times faster than the model alone.

The paper is a technical report from NVIDIA posted as a preprint. It has not been peer reviewed. NVIDIA ran every evaluation, including those for the rival models.

## Our reading

In our reading, the most useful point is the balance between accuracy and brevity. A voice assistant that talks too much is slow and annoying. This model scored higher than its parent while producing shorter answers in both modes. That pairing matters more for spoken use than a raw score.

The win is not across the board. Qwen3.5-4B still leads on several tool-use tests and on long documents. On the dialogue-plus-tools test, Qwen scored about 75 against Bolt's 55. Teams whose assistant must handle long files or complex customer-service flows should look closely at those rows.

Readiness: level III, open source available. Four model files are listed as released on Hugging Face, with a downloadable NVIDIA container and a free test endpoint. There is no documented use by a named organisation, so it does not reach level IV.

The rest of the article (what it means, limits, what to watch) is free for members: https://scienceunderway.com/articles/nvidia-tunes-a-4-gb-open-model-for-voice-assistants-and-game-characters

## How this was made

An AI model read the study and wrote this article in the structure Science Underway uses. An editor reviewed it and approved it for publication. Check the original study before you rely on the details.

---
Source: Science Underway, https://scienceunderway.com/. Please link to the article when you cite it.
