mlx-community

/

SmolLM3-3B-5bit

like 0

Follow

MLX Community 8.53k

This fails on MacBook Pro M4 chip

uv pip freeze |grep mlx
mlx==0.26.2
mlx-lm==0.25.3

Traceback (most recent call last):
  File "/Users/user/Projects/NewSkills/LLM/smol.py", line 3, in <module>
    model, tokenizer = load("mlx-community/SmolLM3-3B-5bit")
  File "/Users/user/Projects/NewSkills/LLM/.venv/lib/python3.10/site-packages/mlx_lm/utils.py", line 241, in load
    model, config = load_model(model_path, lazy)
  File "/Users/user/Projects/NewSkills/LLM/.venv/lib/python3.10/site-packages/mlx_lm/utils.py", line 176, in load_model
    model_class, model_args_class = get_model_classes(config=config)
  File "/Users/user/Projects/NewSkills/LLM/.venv/lib/python3.10/site-packages/mlx_lm/utils.py", line 71, in _get_classes
    raise ValueError(msg)
ValueError: Model type smollm3 not supported.

ModuleNotFoundError: No module named 'mlx_lm.models.smollm3'