The vLLM Semantic Router team has released Decision 3.0, a family of multimodal decision models. Decision 3.0 multimodal decision models read text, JSON and images, then answer typed questions about them. There are 5 sizes, from 0.8B to 27B, all under Apache-2.0. For developers, this is a fast way to classify, route and gate requests without parsing generated text.
TL;DR
- Size: 5 models: d3-lite (0.85B), d3-nano (2.21B), d3-mini (4.54B), d3-flash (8.39B), d3 (26.09B). Context length: not disclosed.
- Runs on: latency measured on 1 AMD Instinct MI325X GPU. BF16 weights; no official quantized variants listed.
- Performance: the 27B d3 leads both the text and vision tables in its card, but on internal evaluation.
- Best: 97.7 on KIE (CORD+FUNSD) document extraction (d3).
- Worst: 34.1 on R-Bench-M (d3).
- Bottom line:
- Best: a 9B model now beats last generation’s 27B.
- Worst: scores are self-reported against live board data.
What is Decision 3.0?
Decision 3.0 is a set of open decision models from vLLM Semantic Router that return probabilities instead of text. You pass a state (text or JSON), optional images, and named questions. Each question is a Choice, a Yes/No, or a Score on a scale. The model answers all questions in one call and returns a probability for every answer.
This is the ‘system one’ pattern for routers and guardrails. Instead of prompting an LLM and parsing its output, you get calibrated scores you can threshold.
How does d3 work?
Each model is a fine-tune of a Qwen base. The 27B d3 is built on Qwen3.8-27B. The smaller 4 build on Qwen3.5 checkpoints at 0.8B, 2B, 4B and 9B.
Every size carries a vision encoder: 0.10B in d3-lite, 0.33B in d3-nano and d3-mini, and 0.46B in d3-flash and d3. Requests accept several PNG, JPEG or WebP images, each read at up to 1.6 megapixels. Every question sees all images.
Each question gets its own forward pass over the input. Install targets transformers==5.17.0, and the optional flash-linear-attention package speeds up the linear-attention layers. Loading needs trust_remote_code=True.
How does Decision 3.0 perform on benchmarks?
Through the model card, the research team state the Jev Decision Index 0.3.1, a board that ranks open reproductions of TypeSafe’s Jev decision system. d3 numbers are the team’s internal evaluation.
On text, d3 scores 64.1, ahead of Perplexity Decider v1.1 (62.8) and Jev (60.1). One caveat: Torchcast Decision 27B posts a higher public-suite score (65.1 vs 64.9). On the vision board, d3 scores 71.6 against 70.6 for Perplexity Decider v1.1.
The size story is the strongest part. d3-flash (9B) scores 59.0, above Decision 2.0’s 27B at 55.9. On the public suite, gains over Decision 2.0 range from +8.0 (27B) to +15.1 (0.8B).
Class leadership is not uniform, though:
- d3-mini (4B) and d3-flash (9B) lead both their text and vision tables.
- d3-lite (0.8B) leads on text but ranks 3rd on vision (41.1, behind JPT-0.8B at 42.1).
- d3-nano (2B) leads its vision table but trails LiquidAI d1-3B on text (35.8 vs 40.1).
On public vision tasks, d3 scores 97.3 on InfographicVQA and 89.9 on Mind2Web, both approximate rebuilds. It is weaker on MMMU-Pro vision (46.2) and Hateful Memes moderation (44.6).
