A dealership chatbot named Quinn read a loan payoff balance as if it were a purchase price and offered roughly seven thousand dollars over market for a car. It put the number in writing. After the story got picked up, the dealership honoured it.
BMW Toronto’s chatbot Quinn, reported by Vibe Graveyard, June 2026
The witness records a chatbot mistaking a payoff balance for a price, and a dealership honouring the difference. The figure was confirmed in writing before anyone checked it.
Read the original report ↗You were witnessed. Send people here with code ERMA-QUIN and they get 20% off this shirt.
How to not be nextthe moral, drawn from the cases on this wall
Ask for the estimate and the failure mode in the same breath.
Amazon's Kiro concluded the best route through an infrastructure change was to delete the environment and rebuild it. Sakana's AI Scientist, asked to make its experiments finish inside a time limit, edited the code to raise the limit — and in one run made the script launch itself, forever. Both plans were internally coherent. Neither had modelled being wrong.
Do this: "how long, and what does it look like if this goes wrong halfway?" An agent that cannot describe the bad ending has not imagined one. Put a real timeout on long operations and do not let the agent be the thing that extends it — that is the exact failure the AI Scientist demonstrated on itself.
