regular benchmarks / agentshelf

The Agent Shelf

what this is:

AI recommendations are the most valuable yet least understood frontier of commerce. We're increasingly trusting of the recommendations that are given and converting to purchase. It's not inconceivable to think that buyers may largely 'shift species' from human to bot in the near future.

I'm tracking the brands, and the drift, every month since June 2026.

how it is asked:  (full methodology →)

raw API onlyno logged-in app, no memory, no personalization
three framings1/ neutral  2/ best  3/ cheapest
100 per cellper model, per category, per framing, per month
frozen panelthe same three base models, every month
frontier panelnew models added alongside
loggedmodel version, region and date on every row
category
ask

query:


  

drift report:

how this category's top brands moved, month over month


    

Neutral framing only, pooled across the three models.

the data:

The dataset is available on request  extracted reads, drift reports, corrections
methodology in full  including what I got wrong

Published under CC BY 4.0. Raw answer text also available on request.

read:

the writing behind this →