This issue is about decision models, a new kind of AI model that does not write text. You give it an input and a fixed list of answers, and it returns the best answer with a probability, in milliseconds. TypeSafe AI released the first one, Jev, on September 15. On Wednesday Google released its own, after OpenAI and Microsoft did in October, and all three charge $0.10 or less per million input tokens and nothing for output. Shanghai AI Lab says its 4B model beat Jev on its tests, and Microsoft built its model on Alibaba's Qwen. Chatbots still score a little higher on the hardest decisions, at 15 times the cost. In the middle: on Vercel's gateway, decision models took one in four AI requests in October.

Sponsor

In the Wild

What's trending in AI right now, from the developer feeds to the model charts.

Quick Hits

The Lab Gladiator Era

  • Google released its own decision model on Wednesday. Gemini Decision 1 and a new Decisions API went live on November 11 for yes/no, choice and rubric decisions across text, images, audio, video and PDFs. Its answers are calibrated decisions with zero output tokens, so there is no text to parse.
  • OpenAI opened its version to every customer, built on a sped-up GPT-6 Luna. OpenAI made its Decisions API widely available on October 22, TechCrunch reported. Product lead Nikunj Handa said answers now take 100 to 180 milliseconds instead of one to three seconds. Speak, which makes AI language tutors, cut the time between actions from 1.4 seconds to 0.13 seconds.
  • The startup that started the category raised $870 million weeks after launch. TypeSafe AI, maker of Jev, is now valued at $7.5 billion after a round led by Andreessen Horowitz, with Sequoia and DCVC. CEO Diogo Almeida previously worked as a researcher at OpenAI.

DeepSeek's Quiet Takeover

Auto Mode Everything

Production AI just split into two jobs

Vercel routes more than 100 trillion tokens a month through its AI Gateway, and its November report says production AI is splitting into two jobs: generation and judgment.

Decision models arrived on the gateway in mid-September. By October there were 15 of them from eight vendors, and they took 26% of all requests while accounting for 0.53% of spend. Per request, they cost about a seventieth as much as a language model.

Nearly a third of paid teams used one in October. The bigger the team, the more likely: just over one in five teams running fewer than 10 million tokens a month used a decision model, and seven in ten teams running more than 10 billion did.

Almost all of that volume went to Jev, which alone got nearly four times as many requests as all Anthropic models. The money still went the other way: for every $1 teams spent on Jev, they spent $64 on Anthropic.

That is the split the labs are now fighting over. Language models still earn most of the money, and the cheap, fast calls inside software now go to a different kind of model. Google charges $0.10 per million input tokens for Gemini Decision 1, with no charge for output. OpenAI charges the same $0.10 for its Decisions API, with no output, cache-read or cache-write charges. Microsoft charges $0.042 per million input tokens and nothing for output.

Key Takeaways

  • If your code asks a chatbot to pick from a list, try a decision model. Google, OpenAI and Microsoft all sell one now, for $0.10 or less per million input tokens and nothing for output.
  • Chinese work is already inside this market. Shanghai AI Lab's Intern-Decision 4B beat Jev on its paper's tests, and Microsoft built its model on Alibaba's Qwen.
  • Keep a language model for the hardest calls. Claude Haiku 5.5 and GPT-6 Luna still lead Artificial Analysis' decision index by about 3 points, but cost 15 times as much and take far longer.

Worth Reading

Wait, What?

This week's poll

Are you using a decision model yet?

Last week, 402 of you voted:

**Which result this week will tell you the most about AI?**

  • The governor races on Tuesday30%
  • AMD's and Apple's earnings26%
  • Apple Intelligence testing in China22%
  • None of these22%

See full results →

Until next time,

Alexis