Spaces:
Running on Zero
Running on Zero
| title: Embedding Quantization CUDA Control | |
| emoji: 🔬 | |
| colorFrom: blue | |
| colorTo: yellow | |
| sdk: gradio | |
| sdk_version: 6.5.1 | |
| app_file: app.py | |
| pinned: false | |
| license: apache-2.0 | |
| # Embedding Quantization CUDA Control | |
| A bounded ZeroGPU control lane for the matched local MLX embedding | |
| quantization experiment. The first milestone reproduces the frozen | |
| Qwen3-Embedding-0.6B BF16 vectors on CUDA and compares them with the saved MLX | |
| BF16 vectors. CUDA results do not reproduce MLX/Metal performance. | |
| The second milestone adds CUDA-native bitsandbytes INT8 and NF4 controls. | |
| They are deliberately reported as separate quantizers and are not treated as | |
| equivalents of MLX Q, oQ, or oQe formats. | |
| Matched BF16 controls are also available for GTE-Qwen2-1.5B and | |
| Qwen3-Embedding-8B. Their CUDA vectors are compared against the corresponding | |
| saved MLX BF16 vectors from the private reproduction bucket. | |