FrontierThe story, in brief

TypeSafe AI’s new models work with machines, not humans

TypeSafe AI's Jev trades verbose reasoning for machine-native decisions: 70-500ms latency, $0.042 per million input tokens, built for agentic workflows that would bankrupt you on general-purpose LLMs.

Illustration of a transparent lens revealing connected networks across layers of paper.
Exploring the next frontier of AI research.AI illustration by KeyNews
The KeyNews take

Why it matters

A specialized model class (decision-return vs. text-generation) is emerging to solve a real agent-economics problem: general-purpose LLMs are too slow and expensive for the millions of bounded decisions that agentic workflows demand. This represents a measurable shift in how enterprises will architect multi-model stacks.

The key facts

9 to know
  1. TypeSafe AI founded by Diogo Almeida, OpenAI researcher and RLHF co-inventor

  2. Jev model designed to return defined decisions with probabilities instead of free-form text

  3. Latency: 70-500ms vs. several seconds for general-purpose LLMs tested

  4. Pricing: $0.042 per million input tokens; output tokens 'too cheap to meter'

  5. Use cases: routing, approval decisions, tool invocation, task handoff

  6. Elimination of sequential text-token generation as core architectural difference

  7. Tradeoffs: requires pre-specification of questions, outputs, thresholds; probability calibration and auditability concerns for regulated industries

  8. Current deployment: hosted service, single region, waitlist model

  9. Analyst consensus: Jev likely complements rather than replaces general-purpose LLMs in mixed workflows

Go to the source

CIOcio.com

Publisher excerpt: Today’s large language models are verbose, even if they’re being asked to recommend a simple decision, driving up usage costs through the sheer volume of tokens they consume or generate. Enterprises looking to incorporate AI into automated workflows will want something less verbose — both because…
Read original report
Back to today's editionMore frontier news

Keep reading

Related stories

More from Frontier