# AI trading agents beat no simple rule; their only edge was memory

A preprint tested five language models as stock traders around earnings and bad news. None beat a plain rule, and the few gains that appeared came from what the models had seen in training.

- Category: Agents
- Readiness level: III (Open source) on Science Underway's four-step scale, as proposed
- Published: 2026-11-18
- Editor: Stefan Perdal
- URL: https://scienceunderway.com/articles/ai-trading-agents-beat-no-simple-rule-their-only-edge-was-memory

## The study

The Only Edge Was Memorized in Training: LLM Trading Agents Around Earnings and Bad News (preprint, not peer reviewed). arXiv 2611.22177. https://arxiv.org/abs/2611.22177

## At a glance

- What it shows: AI agents built on five language models traded US stocks before earnings reports and after bad-news falls. They did no better than simply buying every time. Their only gains appeared when they could recognise the company and the event came before their training data ended.
- What it does not show: It does not show that AI agents can never trade news profitably. Only these models, prompts, 56 large stocks and three periods were tested. Each model ran once, so the study does not rank models.
- Why it matters: A profitable backtest of an AI trading agent can simply be the model remembering what happened. Checks for that are cheap, but most published results do not run them.

## What the study shows

The author tested AI agents built on five language models from four vendors as stock traders. The setting was a replay of past market data, 56 large US stocks in 2020, 2022 and 2026, with realistic order fills and trading costs. The paper is a preprint and has not been peer reviewed.

The first test came before 598 scheduled earnings announcements. Agents read recent headlines, prices, earlier results from peer companies, short-selling data and insider trades, then chose to buy, sell short or stay out. Most of the time they just bought. Their returns tracked a rule that buys before every announcement, which made money in 2020 and lost it in 2026.

No agent beat the simple controls once the author corrected for running many comparisons. A logistic regression, a basic statistical model fed the same numbers but no text, did at least as well as every agent. Splitting the decision into stages, or adding peer, short-selling and insider data, changed little. The agents guessed the direction of the share price reaction about as well as a coin.

The second test came after 409 bad-news days on which a stock fell 3% or more. Agents judged whether the market had overreacted and decided whether to buy the dip. The Gemini-based agent called almost every fall an overreaction and bought 96% of them. No agent's picks beat buying every drop. Their warnings of a further fall were barely better than ranking stocks by how far they had already dropped.

The only gains looked like memory. Each decision was made twice: once with the company name and dates, once with them hidden. Given only a ticker and dates, the GPT-based model called the direction of 59.2% of announcements from before its training cutoff, the date its training data ends, but only 53.3% after it. On events from July 2026 on, after every model's cutoff, no agent made reliable money in either test.

## Our reading

In our reading, the most useful result is about method, not markets. The author built agents that reason like an analyst, then compared them with the dullest possible baseline. The analyst-style reasoning mostly collapsed into that baseline. An agent that buys before nearly every earnings report is running a known, cheap strategy at the price of many model calls.

The memory finding matters beyond finance. A language model has read news about past quarters and past crashes. When it is shown a company name and a date from that past, it can lean on what it remembers. The paper shows this directly: a model given no news at all, only a ticker and dates, called past earnings moves better than any agent that read the actual inputs. That advantage faded on events after its training data ended.

A concrete case: a vendor pitches an earnings agent backed by a strong backtest on well-known stocks from 2020 to 2024. On this study's evidence, that backtest cannot separate skill from recall. The same agent would need to be run with names hidden, and on events after its cutoff, before the profit means anything.

The rest of the article (what it means, limits, what to watch) is free for members: https://scienceunderway.com/articles/ai-trading-agents-beat-no-simple-rule-their-only-edge-was-memory

## How this was made

An AI model read the study and wrote this article in the structure Science Underway uses. An editor reviewed it and approved it for publication. Check the original study before you rely on the details.

---
Source: Science Underway, https://scienceunderway.com/. Please link to the article when you cite it.
