README.md

metadata

license: apache-2.0
pipeline_tag: text-generation
library_name: mlx
base_model: 01-ai/Yi-Coder-9B-Chat
base_model_relation: quantized
quantized_by: Outlier-Ai
tags:
  - 01-ai
  - 4-bit
  - 4bit
  - apple-silicon
  - chat
  - code
  - code-generation
  - coding
  - conversational
  - edge-ai
  - instruct
  - local-llm
  - m1
  - m2
  - m3
  - m4
  - mac
  - mac-mini
  - mac-studio
  - macbook-air
  - macbook-pro
  - macos
  - metal
  - mlx
  - mlx-community
  - mlx-lm
  - no-cloud
  - offline
  - on-device
  - outlier
  - outlier-app
  - private
  - private-ai
  - quantized
  - safetensors
  - text-generation
  - yi
  - yi-coder
language:
  - en
  - zh
widget:
  - example_title: Python prime check
    messages:
      - role: user
        content: >-
          Write a Python function that checks if a number is prime, with a short
          docstring and one edge case test.
  - example_title: SQL join
    messages:
      - role: user
        content: >-
          Write a SQL query that returns the top 10 users by total purchase
          value in the last 90 days.
  - example_title: Debug refactor
    messages:
      - role: user
        content: Refactor this for readability and flag one bug.

Run this on your Mac with Outlier — a free macOS app for local MLX inference.

Yi-Coder-9B-Chat (MLX 4-bit)

MLX 4-bit conversion of 01-ai/Yi-Coder-9B-Chat. License and base-model fields inherit from the original — see YAML frontmatter above.

Load with mlx-lm

pip install mlx-lm
python -m mlx_lm.generate --model Outlier-Ai/Yi-Coder-9B-Chat-MLX-4bit --prompt "Hello" --max-tokens 256

What is Outlier?

A free macOS app that runs MLX models locally — no cloud, no API keys, no usage caps.

➡ outlier.host

Other Outlier conversions

• DeepSeek-R1-Distill-Qwen-7B (MLX 4-bit) — MLX 4-bit conversion (1,932 downloads)
• Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,598 downloads)
• Qwen2.5-Coder-7B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,450 downloads)
• Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)
• Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)

License

Inherits from upstream (apache-2.0). See base model card.