d3-coreml / README.md
alexwengg's picture
Add d3-edge: Core ML packages + MLX weights and host
78a1f66 verified
|
Raw History Blame Contribute Delete
1.39 kB
metadata
license: apache-2.0
base_model:
  - vllm-sr/d3-lite
  - vllm-sr/d3-nano
  - vllm-sr/d3-mini
  - vllm-sr/d3-edge
library_name: coreml
pipeline_tag: zero-shot-classification
tags:
  - coreml
  - mlx
  - apple-silicon
  - decision-model
  - vision
  - video

Decision 3.0 — Core ML (and MLX)

Decision 3.0 by the vLLM Semantic Router team, converted to Core ML for Apple silicon: text, image and video requests on device. Same contract as upstream: one forward pass per question, the 255-way FP32 readout at the last prompt token, a probability for every option, no text generated.

Folder Upstream Size
lite/ vllm-sr/d3-lite 0.8B
nano/ vllm-sr/d3-nano 2B
mini/ vllm-sr/d3-mini 4B
edge/ vllm-sr/d3-edge 0.6B · also ships mlx/ weights and an MLX host (video looks ~4× faster than Core ML)

Each folder is a full release (text graphs, vision tower, host tables, Python host) with its own README covering files, parity against upstream and speed. Swift: D3VisionManager in FluidUse loads any of them.

License: Apache-2.0, as upstream.