vllm-sr/d3
- License
- apache-2.0
- Size
- not mirrored yet
No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from vllm-sr/d3
All models by vllm-sr →No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from vllm-sr/d3
All models by vllm-sr →[Image blocked: d3: Decision 3.0]
d3 is the 27B multimodal foundation decision model of Decision 3.0, the decision models of vLLM Semantic Router. Give it an input (text or JSON, optionally with images and videos) and the questions you need answered: pick one of several options, say yes or no, or rate on a scale. It answers them all in one call and returns a probability for every answer, without generating text.
Images go before the text of the request, each read at up to 1.6 megapixels; videos follow the images, read at 2 frames per second (at most 32 frames spread over the whole video, each at up to 0.2 megapixels). Every question of the request sees all of them.
vLLM Semantic Router serves Decision 3.0 natively in Engine mode, which runs one model behind the System One API on your own machine. Its answers match this package's own d3_server.py exactly, for text, images and videos (measured on AMD Instinct MI325X).
The platform is detected automatically; choose one with --platform auto|cpu|cuda|rocm (default auto).
Engine mode and Decision 3.0 are in the development channel (--channel dev) until a stable vLLM Semantic Router release includes them. The first start pulls the image for your machine and downloads the model. Then ask questions about a request:
Send images as base64 data URLs (PNG, JPEG or WebP) in images and videos (MP4, WebM, QuickTime or Matroska) in videos; every question sees them:
vllm-sr stop stops it. See Router and Engine modes for limits and options.
[Image blocked: Jev Decision Index against model size]
[Image blocked: Jev Decision Index by area: d3 and Decision 2.0 (27B)]
d3 on the public vision benchmarks († approximate rebuild):
Multiple-choice video question answering (three options per question, chance 33.3): top-1 accuracy (%), videos read with the defaults above.
d3: internal evaluation. Others: live board data, text 2026-10-10, vision 2026-10-09.
Apache-2.0 (LICENSE [blocked]). Built on Qwen/Qwen3.8-27B (Apache-2.0).
Trained on AMD Instinct MI325X GPUs.
pip install "transformers==5.17.0" torch torchvision pillow opencv-python-headless safetensors acceleratepip install flash-linear-attention # optional: fast GPU kernels for the linear-attention layersimport json
from huggingface_hub import hf_hub_downloadfrom transformers import AutoModel
model = AutoModel.from_pretrained("vllm-sr/d3", trust_remote_code=True)
# Textresult = model.system_one( state="The order arrived damaged yesterday. The customer has a receipt and asks for a replacement today.", questions={ "route": { "type": "choice", "instructions": "Which team should handle this request?", "criteria": { "returns": "Refunds, replacements and damaged deliveries", "billing": "Payments, invoices and charges", "technical": "Product setup and faults" } }, "receipt": { "type": "noul", "instructions": "Does the customer have a receipt?" }, "urgency": { "type": "score", "instructions": "How urgent is this request?", "criteria": [ "Routine", "Soon", "Today" ] } },)print(json.dumps(result["answers"], indent=2))
# Text and an image (or several)receipt = hf_hub_download("vllm-sr/d3", "assets/example-receipt.png")result = model.system_one( state="The customer says the blender arrived cracked and attached the receipt.", images=[receipt], # local paths, http(s) URLs, PIL images or base64 data URLs questions={ "route": { "type": "choice", "instructions": "Which team should handle this request?", "criteria": { "returns": "Refunds, replacements and damaged deliveries", "billing": "Payments, invoices and charges", "technical": "Product setup and faults" } }, "on_receipt": { "type": "noul", "instructions": "Does the receipt list the blender?" }, "payment": { "type": "choice", "instructions": "How was the order paid?", "criteria": { "card": None, "cash": None, "gift card": None } } },)print(json.dumps(result["answers"], indent=2))
# Text and a video (or several)clip = hf_hub_download("vllm-sr/d3", "assets/example-video.mp4")result = model.system_one( state="A short clip from a test camera.", videos=[clip], # local paths, http(s) URLs, base64 data URLs or frame arrays questions={ "direction": { "type": "choice", "instructions": "Which way does the square move?", "criteria": { "right": "From left to right", "left": "From right to left", "still": "It does not move" } }, "color_change": { "type": "noul", "instructions": "Does the square change color?" } },)print(json.dumps(result["answers"], indent=2))
# Or as a pipeline:# transformers.pipeline("decision", model="vllm-sr/d3", trust_remote_code=True)(state=..., questions=..., images=..., videos=...)curl -fsSL https://vllm-sr.ai/install.sh | bash -s -- --channel dev --no-launchexport PATH="$HOME/.local/bin:$PATH"vllm-sr serve -e vllm-sr/d3curl -s localhost:8899/v1/systemone -H 'content-type: application/json' -d '{ "model": "vllm-sr/d3", "state": "Write a Python function that merges two sorted lists.", "questions": { "kind": {"type": "choice", "instructions": "What kind of work is this?", "criteria": {"code": "Writing or fixing code", "math": "Mathematics", "chat": "Anything else"}}, "reasoning": {"type": "noul", "instructions": "Does answering this need multi-step reasoning?"} }}'curl -s localhost:8899/v1/systemone -H 'content-type: application/json' --data-binary @- <<EOF{ "model": "vllm-sr/d3", "state": "What does the attached image show?", "images": ["data:image/png;base64,$(base64 -w0 chart.png)"], "questions": { "kind": {"type": "choice", "instructions": "What kind of image is this?", "criteria": {"chart": "A chart or plot", "photo": "A photograph", "document": "A document"}} }}EOFcurl -s localhost:8899/v1/systemone -H 'content-type: application/json' --data-binary @- <<EOF{ "model": "vllm-sr/d3", "state": "What happens in the clip?", "videos": ["data:video/mp4;base64,$(base64 -w0 clip.mp4)"], "questions": { "moving": {"type": "noul", "instructions": "Does something move across the scene?"} }}EOF@misc{d3_2026, title = {{d3}: A Multimodal Foundation Decision Model}, author = {{vLLM Semantic Router Team}}, year = {2026}, howpublished = {\url{https://huggingface.co/vllm-sr/d3}}}