AlphaOxO/Poro-34B-chat-4bits-mlx

Poro-34B-chat — MLX 4bit

Quantized to 4 bits per weight.

Converted from LumiOpen/Poro-34B-chat using mlx-lm.

Requirements

The bloom model type is support in my mlx-lm fork(AlphaKure/mlx-lm.

Until test finish. I will send a PR to offical repo.

Update at: 2026/09/11

pip install git+https://github.com/AlphaKure/mlx-lm.git@64c70971dc5cba1220740218b0126369cdb6034a

Use

mlx_lm.generate --model AlphaOxO/Poro-34B-chat-4bits-mlx --prompt "hello"

from mlx_lm import load, generate

model, tokenizer = load("AlphaOxO/Poro-34B-chat-4bits-mlx")
prompt = tokenizer.apply_chat_template(
    [{"role": "user", "content": "hello"}], add_generation_prompt=True
)
print(generate(model, tokenizer, prompt=prompt))