Text Generation
MLX
Safetensors
English
Chinese
gemma4_unified
gemma4
humanizer
text-rewriting
unofficial-conversion
8-bit precision
Instructions to use npario/humanizer-12b-mlx-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use npario/humanizer-12b-mlx-8bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("npario/humanizer-12b-mlx-8bit") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use npario/humanizer-12b-mlx-8bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "npario/humanizer-12b-mlx-8bit" --prompt "Once upon a time"
- Atomic Chat
File size: 534 Bytes
eb68581 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 | {
"bf16_logit_parity": "not_evaluated",
"cpu_diagnostics": [],
"created_at": "2026-10-09T03:43:10.734255+00:00",
"float_tensors_checked": 995,
"identity": "134a98b195bd0c11a340ce173b5e3a77069ae01017975ab401746008b6f0fc3a",
"metal_execution": "not_tested",
"prompt_fingerprint": "passed",
"quality": "not_evaluated",
"status": "structural_checks_passed_cpu_smoke_skipped_not_benchmarked",
"strict_load": "passed",
"tokenizer_probe_parity": "passed",
"weight_bytes": 12652452192,
"weight_tensor_count": 1324
}
|