Instructions to use AutomatosX/AX-Clef-27B-MLX-AXQ-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AutomatosX/AX-Clef-27B-MLX-AXQ-6bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download AutomatosX/AX-Clef-27B-MLX-AXQ-6bit --local-dir AX-Clef-27B-MLX-AXQ-6bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download axquant_compatibility.json from AutomatosX/AX-Clef-27B-MLX-AXQ-6bit: direct link, hf CLI and curl.
- Browser
- Download file 1.15 kB
-
https://huggingface.co/AutomatosX/AX-Clef-27B-MLX-AXQ-6bit/resolve/main/axquant_compatibility.json
- Command line
-
hf download hf://AutomatosX/AX-Clef-27B-MLX-AXQ-6bit/axquant_compatibility.json
-
curl -L -o axquant_compatibility.json https://huggingface.co/AutomatosX/AX-Clef-27B-MLX-AXQ-6bit/resolve/main/axquant_compatibility.json
1.15 kB
| { | |
| "binding": { | |
| "config.json": "aa90f9d0e03274b2be093d0d74b8650a841b75f5a40db60d2581a3c93c360d1d", | |
| "model.safetensors.index.json": "67328c95285e236d1bf821151ac2d50b4c5a080833b6ae4e65599f4048aa5b52", | |
| "tensor_headers_sha256": "a02f382c08f45c0ca3afafff1aaaf8706f71f0666cf8a5db8e90baa265ee3825" | |
| }, | |
| "model_type": "qwen3_5", | |
| "quality_certified": false, | |
| "schema_version": "axquant.runtime-compatibility.v1", | |
| "targets": { | |
| "mtplx": { | |
| "blockers": [ | |
| "No audited mtplx export profile for model_type 'qwen3_5'" | |
| ], | |
| "launch_environment": {}, | |
| "modality_constraints": [], | |
| "model_settings": {}, | |
| "mtp_verified": false, | |
| "profile": null, | |
| "required_actions": [], | |
| "runtime_verified": false, | |
| "status": "unsupported" | |
| }, | |
| "omlx": { | |
| "blockers": [ | |
| "No audited omlx export profile for model_type 'qwen3_5'" | |
| ], | |
| "launch_environment": {}, | |
| "modality_constraints": [], | |
| "model_settings": {}, | |
| "mtp_verified": false, | |
| "profile": null, | |
| "required_actions": [], | |
| "runtime_verified": false, | |
| "status": "unsupported" | |
| } | |
| } | |
| } | |