# Brain-to-text decoding runs on a phone, in offline tests

A preprint adapts off-the-shelf speech recognition models to turn recorded brain activity into text on an iPhone. It uses a small fraction of the memory that current research systems need. It has not yet been tried with a live user.

- Category: Efficiency
- Readiness level: II (Benchmarked) on Science Underway's four-step scale, as proposed
- Published: 2026-11-16
- Editor: Stefan Perdal
- URL: https://scienceunderway.com/articles/brain-to-text-decoding-runs-on-a-phone-in-offline-tests

## The study

FETTUCCINE: Fast and efficient brain-to-text decoding on mobile devices (preprint, not peer reviewed). arXiv 2611.18561. https://arxiv.org/abs/2611.18561

## At a glance

- What it shows: Some people who cannot speak have brain implants that turn attempted speech into text. Today these systems need a powerful computer. This study shows the decoding can run on an ordinary phone, with error rates under 10%.
- What it does not show: It does not show the system working live with a person. All tests used recordings played back offline, from two people, and the models still need fresh calibration each session.
- Why it matters: Today's systems need a computer with hundreds of gigabytes of memory, or a link to cloud servers. A phone-sized decoder could make these devices portable and keep sensitive brain data on the device.

## What the study shows

Speech neuroprostheses are brain implants that read the activity of speech areas while a person tries to talk. Software then turns that activity into text. Most current systems work in stages. One model guesses speech sounds. Then large language models, which predict likely word sequences, turn those sounds into sentences. The language stage alone can need about 320 GB of computer memory.

The authors take a different route. They start with open speech recognition models, Whisper from OpenAI and Parakeet from NVIDIA. These normally turn audio into text. They swap the audio input layer for a small trained adapter that feeds brain signals in instead. They also lightly tune the model with LoRA, a method that trains a small set of extra weights rather than the whole model. Text comes out in one step, with no separate language stack. They call the framework FETTUCCINE.

They tested it on the public Brain-to-Text 2025 benchmark. This holds recordings from one participant with ALS, known as T15, copying cued sentences. The best variant got 4.39% of words wrong on the public test split. The usual staged system scored 6.67%. The best earlier one-step system in their comparison scored 8.70%. Their own models needed about 1 to 5 GB of memory on a server GPU, against about 320 GB for the staged baseline.

The authors then ran six variants on an iPhone 15 Pro Max, on the benchmark's validation set. The smallest model used about 209 MB of memory. It got 8.4% of words wrong and took under a twentieth of a second per sentence. The authors say this is the first brain-to-text decoding on a mobile device. That claim is based on their own knowledge of the field.

The models do not transfer to new days on their own. Brain signals drift over time. On five later sessions, error without adjustment ranged from 13% to 79% for one variant. Retraining on that day's data brought it down to between 3% and 13%. On average, about 15 minutes of new recordings, around 50 sentences, gave reasonable results.

Results were weaker for a second participant, T12, from the 2024 benchmark. There, the staged systems still did better, and the authors call these results preliminary. The paper is a preprint and has not been peer reviewed.

## Our reading

In our reading, the main result is about cost and portability, not accuracy. The accuracy is good for a one-step system. It is not the best on the benchmark: the authors note the top five competition entries reach 2% error or lower. What changes is the hardware bill. A decoder that fits in a few hundred megabytes removes the need for a workstation or a cloud link.

The steadiness of response time may matter as much as speed. The staged baseline averaged about half a second per sentence, but some sentences took more than 10 seconds. That happens when the word search expands on noisy input. The new models stayed close to their average. For someone using an implant to ask for help, a reliably quick answer is worth more than a fast average with long stalls.

A concrete example: a person with ALS at home could carry the decoder on a phone, with no server and no internet. Their brain data would stay on the device. That is the authors' stated aim. This study shows the computing part is feasible on recorded data. It does not yet show the whole loop working with a person. On our four-level scale, we rate it II, Benchmarked: there are public benchmark results, but no released code or weights.

The rest of the article (what it means, limits, what to watch) is free for members: https://scienceunderway.com/articles/brain-to-text-decoding-runs-on-a-phone-in-offline-tests

## How this was made

An AI model read the study and wrote this article in the structure Science Underway uses. An editor reviewed it and approved it for publication. Check the original study before you rely on the details.

---
Source: Science Underway, https://scienceunderway.com/. Please link to the article when you cite it.
