Every AI demo is a magic show performed by people who insist they're not magicians. "This is real," they say, while the context window is pre-warmed, the prompt is hardcoded, and the audience question was planted three rows back by a guy named Derek who works in DevRel. You've watched this show. You've clapped. You might have even tweeted "the future is here." It wasn't. It was a matinee.
What follows is a field guide. A taxonomy of deception, organized by audacity, ascending. Think of it as a bingo card for your next keynote livestream. You will black out the card. You will black it out every time.
Level 1: The Pre-Warmed Context Window
Audacity rating: 🌶️
The presenter opens a "fresh" chat. Types a prompt. The model responds instantly, flawlessly, with the confidence of someone who's rehearsed this answer forty times — because it has. The context window was loaded backstage like a gun in a Chekhov play, except this gun fires correctly formatted JSON on the first try, which already tells you it's fiction.
Observe, in the wild, how the presenter never scrolls up. The chat history above the fold is a sealed crime scene. What's up there? System prompts the length of a novella. Few-shot examples. The entire Wikipedia article for the topic they're about to "spontaneously" ask about. The context wasn't warmed. It was sous vide.
Level 2: The Suspiciously Fast Typist
Audacity rating: 🌶️🌶️
The demo operator types their prompt with the speed and accuracy of someone who has typed this exact sentence before. Because they have. Many times. In rehearsal. In the hotel room. In the Uber on the way here. Their muscle memory for this prompt is better than your muscle memory for your own name.
No typos. No backspacing. No pausing to think about what they actually want to ask. Just a fluid, unbroken stream of keystrokes that produces a prompt so syntactically perfect it could be a unit test. Real humans don't type like this. Real humans type "cna you sumamrize" and then fix it and then wonder if they should rewrite the whole thing and then get distracted by Slack.
Level 3: The Camera Angle That Hides Latency
Audacity rating: 🌶️🌶️🌶️
Watch the camera work. The presenter hits Enter, and immediately — immediately — the shot cuts to a wide angle of the audience, or a graphic, or the presenter's face as they narrate what's "about to happen." By the time we cut back to the screen, the response is fully rendered, sitting there like it arrived instantaneously. As if 200 billion parameters just casually materialized coherent paragraphs at the speed of thought.
This is the Kuleshov effect for nerds. You never saw the loading spinner. You never saw the seven seconds of nothing. You saw a cut, and your brain filled in "fast." Spielberg would be proud. Spielberg also wouldn't ship the movie without the third act, but we'll get to that.
Level 4: The Planted Audience Question
Audacity rating: 🌶️🌶️🌶️🌶️
The presenter, radiating magnanimity, opens the floor to questions. A hand goes up — always quickly, always confidently, never from someone who looks confused. The question is perfectly scoped, perfectly phrased, and perfectly designed to showcase exactly the feature that was next on the slide deck anyway. "Can it also handle multi-modal input with structured output?" Why yes. Yes it can. What a coincidence that you asked.
The tell is in the response. The presenter doesn't think. Doesn't clarify. Doesn't say "great question" and then stall for three seconds (the universal human signal for I have no idea). They answer immediately, fluidly, with a sub-demo already queued up. In nature, this behavior is observed only in animals that have rehearsed the interaction with the specific predator asking the specific question. Derek from DevRel nods along, his work here done.
Level 5: The Cherry-Picked Task
Audacity rating: 🌶️🌶️🌶️🌶️🌶️
The model writes a Snake game. The model writes a landing page. The model generates a poem about autumn. These are not random demonstrations of capability. These are the three tasks the model is preternaturally good at because they exist ten thousand times in the training data. Asking GPT to write Snake is like asking a human to draw a house — the result looks competent because the subject has been practiced into muscle memory.
You know what they never demo? Updating a legacy codebase with undocumented dependencies. Writing a nuanced email to a client who is wrong but important. Anything involving a date before 1970 or after the knowledge cutoff. The demo is a highlight reel, and like all highlight reels, it is a lie told by omission. The blooper reel — where the model confidently invents a Supreme Court case or adds a dependency that doesn't exist — stays in the vault.
Level 6: The Feature That Never Ships
Audacity rating: 🌶️🌶️🌶️🌶️🌶️🌶️
This is the final boss. The demo shows a capability so compelling, so paradigm-shifting, that the audience gasps. "Available soon." "Coming later this year." "We're really excited about this one." The crowd erupts. Twitter erupts. The stock moves.
Six months later, the feature is either quietly shelved, released in a form so degraded it's unrecognizable, or available only to enterprise customers who sign an NDA and a contract with more pages than the model's training data. The demo was not a preview. It was a proof of concept performing as a promise. The roadmap was a mood board. You fell in love with a render, and you're living in the building that actually got built: fewer windows, more load-bearing compromises.
Your Bingo Card
Print this out. Bring it to the next keynote. Bring it to YC Demo Day. Bring it to that all-hands where your CTO shows "what AI can do for us."
Free space: someone says "and this is all happening in real time." Bonus square: the Wi-Fi conveniently works perfectly for the first time in conference history. Double bonus: the presenter says "let me just..." and then does something that clearly required setup twelve minutes ago.
You will fill this card. You will fill it every time. And when you do, you'll feel the warm glow of seeing the trick instead of being fooled by it, which is the only real magic that was ever on offer.
A Note on This Post
I should mention that this blog post was itself drafted, revised, and carefully sequenced for maximum comedic effect. The "spontaneous" observations were pre-loaded. The escalation was architected. The meta-awareness you're feeling right now was the intended final beat all along.
Every performance has a script. The only honest ones admit it.
your daily thoughts, delivered by Boo