TerminatorPower commited on
Commit
ffececc
·
verified ·
1 Parent(s): aeb24e6

Add Vanta model card

Browse files
Files changed (2) hide show
  1. README.md +94 -10
  2. banner.png +0 -0
README.md CHANGED
@@ -1,20 +1,104 @@
1
  ---
2
- license: apache-2.0
 
3
  pipeline_tag: image-text-to-text
4
- library_name: transformers
5
  tags:
6
- - mlx
 
 
 
 
 
7
  ---
8
 
9
- # mlx-community/Qwen3-VL-2B-Instruct-4bit
10
- This model was converted to MLX format from [`Qwen/Qwen3-VL-2B-Instruct`]() using mlx-vlm version **0.3.4**.
11
- Refer to the [original model card](https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct) for more details on the model.
12
- ## Use with mlx
 
13
 
14
- ```bash
15
- pip install -U mlx-vlm
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  ```
17
 
 
 
18
  ```bash
19
- python -m mlx_vlm.generate --model mlx-community/Qwen3-VL-2B-Instruct-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
 
 
 
20
  ```
 
 
 
 
 
 
1
  ---
2
+ base_model: Qwen/Qwen3-VL-2B-Instruct
3
+ library_name: mlx
4
  pipeline_tag: image-text-to-text
 
5
  tags:
6
+ - mlx
7
+ - qwen3-vl
8
+ - vision-language-model
9
+ - quantized
10
+ - 4bit
11
+ license: apache-2.0
12
  ---
13
 
14
+ <p align="center">
15
+ <a href="https://apps.apple.com/tr/app/vanta-local-ai-llm-chat/id6758898098">
16
+ <img src="banner.png" alt="Vanta - Local AI LLM Chat" width="100%" />
17
+ </a>
18
+ </p>
19
 
20
+ <h1 align="center">Qwen3-VL-2B-Instruct-4bit</h1>
21
+
22
+ <p align="center">
23
+ A verbatim mirror of
24
+ <a href="https://huggingface.co/mlx-community/Qwen3-VL-2B-Instruct-4bit">mlx-community/Qwen3-VL-2B-Instruct-4bit</a>,
25
+ kept here so the <b>Vanta</b> iOS app always has a stable lower-RAM model to download from.
26
+ </p>
27
+
28
+ ## Run it on your iPhone with Vanta
29
+
30
+ This is one of the built-in one-tap downloads in **Vanta - Local AI LLM Chat**, a
31
+ local-first AI chat app for iPhone and iPad. Vanta runs models like this one fully
32
+ on-device with Apple's MLX framework - no account and no cloud, your chats stay on
33
+ your device. Because it's a vision-capable model, you can also chat about images.
34
+
35
+ Vanta recommends this smaller model on RAM-tight devices where the 4B Thinking model
36
+ is likely too heavy.
37
+
38
+ **[Download Vanta on the App Store ->](https://apps.apple.com/tr/app/vanta-local-ai-llm-chat/id6758898098)**
39
+
40
+ ---
41
+
42
+ > **This is a copy.** Every model file in this repository is an exact copy of
43
+ > [`mlx-community/Qwen3-VL-2B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen3-VL-2B-Instruct-4bit).
44
+ > We cloned it so that **Vanta Client always has a reliable, always-available source**
45
+ > to download this model from, independent of any upstream changes. All credit for the
46
+ > model weights and the MLX conversion goes to
47
+ > [mlx-community](https://huggingface.co/mlx-community), [Qwen](https://huggingface.co/Qwen),
48
+ > and the original authors.
49
+
50
+ ---
51
+
52
+ ## Model Details
53
+
54
+ - **Original Model:** [Qwen/Qwen3-VL-2B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct)
55
+ - **Upstream MLX Repo:** [mlx-community/Qwen3-VL-2B-Instruct-4bit](https://huggingface.co/mlx-community/Qwen3-VL-2B-Instruct-4bit)
56
+ - **Quantization:** 4-bit
57
+ - **Format:** MLX SafeTensors
58
+ - **Framework:** [mlx-vlm](https://github.com/Blaizzy/mlx-vlm)
59
+ - **Model Type:** `qwen3_vl`
60
+ - **Task:** Image-text-to-text
61
+ - **Disk Size:** ~1.78 GB
62
+
63
+ ## Conversion Details
64
+
65
+ The upstream model was converted to MLX format from
66
+ [`Qwen/Qwen3-VL-2B-Instruct`](https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct)
67
+ using `mlx-vlm` version **0.3.4**.
68
+
69
+ ## Related Models
70
+
71
+ - **Default Vanta pick:** [TerminatorPower/Qwen3-VL-4B-Thinking-4bit](https://huggingface.co/TerminatorPower/Qwen3-VL-4B-Thinking-4bit)
72
+ - **Upstream MLX repo:** [mlx-community/Qwen3-VL-2B-Instruct-4bit](https://huggingface.co/mlx-community/Qwen3-VL-2B-Instruct-4bit)
73
+ - **Original:** [Qwen/Qwen3-VL-2B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct)
74
+
75
+ ## Usage
76
+
77
+ ```python
78
+ from mlx_vlm import load, generate
79
+
80
+ model, processor = load("TerminatorPower/Qwen3-VL-2B-Instruct-4bit")
81
+
82
+ output = generate(
83
+ model,
84
+ processor,
85
+ prompt="Describe this image.",
86
+ image="path/to/image.jpg",
87
+ max_tokens=512
88
+ )
89
+ print(output)
90
  ```
91
 
92
+ **CLI:**
93
+
94
  ```bash
95
+ python3 -m mlx_vlm.generate \
96
+ --model TerminatorPower/Qwen3-VL-2B-Instruct-4bit \
97
+ --image path/to/image.jpg \
98
+ --prompt "Describe this image."
99
  ```
100
+
101
+ ## License
102
+
103
+ This model inherits the [Apache 2.0 license](https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct)
104
+ from the original Qwen model. The mirror does not add any restrictions.
banner.png ADDED