Is this statement true?
Returns one number, the probability of yes. 0.05 is a confident no and 0.95 a confident yes. There is no separate confidence field because the number is one.
TypeSafe AI · Jev 1.13 · early access September 15, 2026
A frontier-intelligence function call. State goes in, typed probabilities come out, and no paragraph comes out with them.
The machine reads the slip in one pass, so the gauges swing while the slip is still in the chute. The telegraph is a chat model answering the same question. Gauge readings are TechSpot's example, and the timing is illustrative.
Han Yuan wrote on September 17 that most LLM calls inside software are if statements. Is this email important? Which team owns this ticket? We ask a chat model, get a paragraph back, and write code to turn the paragraph into true or false. Then the model wraps its JSON in Markdown fences and the parser breaks.
Han Yuan, "What Jev Knows, and What It Doesn't," September 17, 2026.
You send a state, text or JSON, plus a map of typed questions. The model encodes the state once and evaluates every question against it in parallel. TypeSafe's docs say adding a question barely changes the response time. Its parallel-questions cookbook reports one batched 13-question request running 12.2× cheaper and 10× faster than the same questions asked separately, with no change in answers. The budget is 64k tokens per request, with 32k for the state plus the longest single question. Output tokens are free because there are none.
Returns one number, the probability of yes. 0.05 is a confident no and 0.95 a confident yes. There is no separate confidence field because the number is one.
Up to 255 options you describe at call time. Returns the pick, a probability for every option, and a confidence derived from how concentrated that distribution is.
Two to ten described levels. Returns a probability-weighted score, so 1.4 can sit between named levels, plus the distribution and a confidence. The docs say to treat it as a threshold and never as a measurement.
Three canned tickets. Values illustrate the docs' three bands.
Move a valve on instrument 2 and the other two rescale to keep the total at 100%, the way the docs demo does. Your code never asks the model how sure it is. The shape of the distribution is the certainty measure, which removes the failure mode where a chat model asserts 95% because assertive text scores well with human raters. The docs suggest three bands, act, confirm, and route to a human, with the line for a destructive action set higher than the line for a read.
An autoregressive model predicts one token, conditions on it, and predicts the next. That loop is where most of a chat model's response time goes. That loop is also where test-time compute lives, the room to write out intermediate steps before committing. Jev produces every answer in one pass, so it has nowhere to think longer about a hard case. TypeSafe's own list of weak spots is the receipt for that trade, and the bench below runs four of them.
These readings are illustrations of the failure modes TypeSafe documents for jev-1.13. We invented them for the bench, and the API never returned them. Counting, ordering dates, resolving a double negative and reading around a distractor all reward intermediate steps. A model with no loop has to recognize the shape of the answer instead of working toward it.
Append, repeat, and stop when the sampler draws STOP. The project's biggest single improvement was doing the append before the model saw it. Presenting options as finished strings instead of bare symbols roughly tripled top-1 accuracy and doubled the mass on the right symbol, for fewer input tokens. Flip the switch to symbol mode and the distributions flatten by about that much. Any step you can compute deterministically should stay out of the model.
Aman Kumar spent two days and about 16,000 calls on it. He ran four public classification sets against two small OpenAI models, then a few thousand real decisions from his own pipelines, scored against what happened afterwards instead of another model's opinion. On short text with crisp labels Jev was level with or ahead of the small tier on three of four sets, at 5 to 56 times lower cost, with a median under a second. The whole-document read was where it lost, and no prompt fixed that.
| Dataset | Jev | gpt-5.4-mini | gpt-5.6-luna | Jev when confident (share of items) |
|---|---|---|---|---|
| Enron spam · 2 options | 98.7 | 97.7 | 98.0 | 99.6 (90%) |
| SST-2 sentiment · 2 | 95.7 | 92.7 | 93.0 | 98.8 (82%) |
| AG News topic · 4 | 91.3 | 88.3 | 89.7 | 94.7 (88%) |
| Banking77 intent · 77 | 76.0 | 78.7 | 81.7 | 89.9 (66%) |
"When confident" means Jev's confidence in its pick was 0.9 or higher. Across the public sets, 82% of answers came back at or above 0.9 and 96% of those were correct. Below 0.9 it was right 55 to 72% of the time depending on the band. The 77-option set is the one place both small LLMs beat it.
Band shares and hit rates are his. 82% of pages came back under 0.1 and 0.3% of those turned out to matter. 4% came back at 0.9 or above and 97% of those mattered. The 14% in between ran from 6% to 83% depending on the sub-band, so no single cutoff works there. We invented the shape inside each band so the lever has something to move through. Fit the line on part of the data and check it on the rest, because next month can bring a real positive lower than any you have seen.
Han Yuan's inbox tells the same story. Jev alone scored F1 0.786, his trained classifier scored 0.880, the two together reached 0.897, and scoring 600 emails cost two cents.
TypeSafe's headline of 193.6× faster and 444.6× cheaper compares Jev with a frontier model writing its answer out as text inside TypeSafe's own workflow evals. Most teams run classification on the small tier. Aman Kumar's ladder puts every published comparison on one axis.
Speed gaps follow the same shape. 1.7 to 1.9× against gpt-5.6-luna on small option sets, 6× at 77 options, 1.7 to 5× against gpt-5.4-mini, about 25× against Terra with reasoning, about 25× against Fable 5.1 at high effort in Every's test, where a passage took 0.35 s against 8.83 s and Jev caught six of seven planted defects while Fable caught seven, and about 100× against an agent session, which took 94 s and $120 per thousand emails against about a second and 15¢. An LLM's output tokens cost 4 to 8 times its input, and with reasoning on, most of them are thinking. Jev has none. Keep reasoning low and the answer to a few tokens and most of the headline gap disappears.
TypeSafe's own workflow board grades agreement with the average of GPT-6 Astra and Fable 5.1 rather than ground truth. On that board Jev sits at 67.8% against 74.1% for the best LLM.
The 0% hallucination figure on TypeSafe's chart is there by definition, since a typed answer can't violate its schema. A wrong-but-valid answer at high confidence is still possible.
jev-1.13.0. The jev-latest alias moves on release and silently invalidates tuned thresholds.State you can't say out loud
This week's other story drops the text between two models and hands a KV-cache across instead of a paragraph. Jev drops it at the output. Both bet that much of what we make models say exists because a person had to read it. Take the person out of the loop and the sentence goes with them. What remains is a needle, and the two levers you set on your own labeled outcomes. TypeSafe named Jev after Jevons and the rebound effect, so its bet is more calls and a bigger bill.