Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Outlier-Ai
/
Yi-Coder-9B-Chat-MLX-4bit

Text Generation
MLX
Safetensors
English
Chinese
llama
01-ai
4-bit precision
4bit
apple-silicon
chat
code
code-generation
coding
conversational
edge-ai
instruct
local-llm
m1
m2
m3
m4
mac
mac-mini
mac-studio
macbook-air
macbook-pro
macos
metal
mlx-community
mlx-lm
no-cloud
offline
on-device
outlier
outlier-app
private
private-ai
quantized
yi
yi-coder
Model card Files Files and versions
xet
Community

Instructions to use Outlier-Ai/Yi-Coder-9B-Chat-MLX-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • MLX

    How to use Outlier-Ai/Yi-Coder-9B-Chat-MLX-4bit with MLX:

    # Make sure mlx-lm is installed
    # pip install --upgrade mlx-lm
    
    # Generate text with mlx-lm
    from mlx_lm import load, generate
    
    model, tokenizer = load("Outlier-Ai/Yi-Coder-9B-Chat-MLX-4bit")
    
    prompt = "Write a story about Einstein"
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )
    
    text = generate(model, tokenizer, prompt=prompt, verbose=True)
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • LM Studio
  • MLX LM

    How to use Outlier-Ai/Yi-Coder-9B-Chat-MLX-4bit with MLX LM:

    Generate or start a chat session
    # Install MLX LM
    uv tool install mlx-lm
    # Interactive chat REPL
    mlx_lm.chat --model "Outlier-Ai/Yi-Coder-9B-Chat-MLX-4bit"
    Run an OpenAI-compatible server
    # Install MLX LM
    uv tool install mlx-lm
    # Start the server
    mlx_lm.server --model "Outlier-Ai/Yi-Coder-9B-Chat-MLX-4bit"
    # Calling the OpenAI-compatible server with curl
    curl -X POST "http://localhost:8000/v1/chat/completions" \
       -H "Content-Type: application/json" \
       --data '{
         "model": "Outlier-Ai/Yi-Coder-9B-Chat-MLX-4bit",
         "messages": [
           {"role": "user", "content": "Hello"}
         ]
       }'
Yi-Coder-9B-Chat-MLX-4bit
4.97 GB
Ctrl+K
Ctrl+K
  • 2 contributors
History: 8 commits
Matt
drop banned superlative tags pre-launch
ee3b1e7 about 1 month ago
  • .gitattributes
    1.52 kB
    initial commit 3 months ago
  • README.md
    2.71 kB
    drop banned superlative tags pre-launch about 1 month ago
  • config.json
    943 Bytes
    Initial upload: canonical-named twin of Outlier-Ai/Outlier-YiCoder-9B-MLX-4bit 3 months ago
  • generation_config.json
    132 Bytes
    Initial upload: canonical-named twin of Outlier-Ai/Outlier-YiCoder-9B-MLX-4bit 3 months ago
  • model.safetensors
    4.97 GB
    xet
    Initial upload: canonical-named twin of Outlier-Ai/Outlier-YiCoder-9B-MLX-4bit 3 months ago
  • model.safetensors.index.json
    78.5 kB
    Initial upload: canonical-named twin of Outlier-Ai/Outlier-YiCoder-9B-MLX-4bit 3 months ago
  • tokenizer.json
    6.81 MB
    Initial upload: canonical-named twin of Outlier-Ai/Outlier-YiCoder-9B-MLX-4bit 3 months ago
  • tokenizer_config.json
    6.23 kB
    Initial upload: canonical-named twin of Outlier-Ai/Outlier-YiCoder-9B-MLX-4bit 3 months ago