Instructions to use AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit --local-dir AX-Clef-Flash-9B-MLX-AXQ-6bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download axquant_compatibility.json from AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit: direct link, hf CLI and curl.
- Browser
- Download file 1.15 kB
-
https://huggingface.co/AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit/resolve/main/axquant_compatibility.json
- Command line
-
hf download hf://AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit/axquant_compatibility.json
-
curl -L -o axquant_compatibility.json https://huggingface.co/AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit/resolve/main/axquant_compatibility.json
1.15 kB
| { | |
| "binding": { | |
| "config.json": "7404c3d7511c4e672e14cd98b974379a4cfcc9e458bb7adb31b8f91098196074", | |
| "model.safetensors.index.json": "139e642056a7340f5eede16ea07a2473b20cbd9d9ff1a38460aeb7241c454e22", | |
| "tensor_headers_sha256": "68207a057febf56f856b6c2db09ff1dbb559dbc97afebcb593881ed999fc5d2f" | |
| }, | |
| "model_type": "qwen3_5", | |
| "quality_certified": false, | |
| "schema_version": "axquant.runtime-compatibility.v1", | |
| "targets": { | |
| "mtplx": { | |
| "blockers": [ | |
| "No audited mtplx export profile for model_type 'qwen3_5'" | |
| ], | |
| "launch_environment": {}, | |
| "modality_constraints": [], | |
| "model_settings": {}, | |
| "mtp_verified": false, | |
| "profile": null, | |
| "required_actions": [], | |
| "runtime_verified": false, | |
| "status": "unsupported" | |
| }, | |
| "omlx": { | |
| "blockers": [ | |
| "No audited omlx export profile for model_type 'qwen3_5'" | |
| ], | |
| "launch_environment": {}, | |
| "modality_constraints": [], | |
| "model_settings": {}, | |
| "mtp_verified": false, | |
| "profile": null, | |
| "required_actions": [], | |
| "runtime_verified": false, | |
| "status": "unsupported" | |
| } | |
| } | |
| } | |