Text Generation
MLX
Safetensors
English
Chinese
gemma4_unified
gemma4
humanizer
text-rewriting
unofficial-conversion
8-bit precision
Instructions to use npario/humanizer-12b-mlx-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use npario/humanizer-12b-mlx-8bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("npario/humanizer-12b-mlx-8bit") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use npario/humanizer-12b-mlx-8bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "npario/humanizer-12b-mlx-8bit" --prompt "Once upon a time"
- Atomic Chat
Download validation.json from npario/humanizer-12b-mlx-8bit: direct link, hf CLI and curl.
- Browser
- Download file 534 Bytes
-
https://huggingface.co/npario/humanizer-12b-mlx-8bit/resolve/main/validation.json
- Command line
-
hf download hf://npario/humanizer-12b-mlx-8bit/validation.json
-
curl -L -o validation.json https://huggingface.co/npario/humanizer-12b-mlx-8bit/resolve/main/validation.json
534 Bytes
| { | |
| "bf16_logit_parity": "not_evaluated", | |
| "cpu_diagnostics": [], | |
| "created_at": "2026-10-09T03:43:10.734255+00:00", | |
| "float_tensors_checked": 995, | |
| "identity": "134a98b195bd0c11a340ce173b5e3a77069ae01017975ab401746008b6f0fc3a", | |
| "metal_execution": "not_tested", | |
| "prompt_fingerprint": "passed", | |
| "quality": "not_evaluated", | |
| "status": "structural_checks_passed_cpu_smoke_skipped_not_benchmarked", | |
| "strict_load": "passed", | |
| "tokenizer_probe_parity": "passed", | |
| "weight_bytes": 12652452192, | |
| "weight_tensor_count": 1324 | |
| } | |