Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

mlx-community
/
DeepSeek-R1-Distill-Qwen-7B-4bit

MLX
Safetensors
qwen2
4-bit precision
Model card Files Files and versions
xet
Community
2

Instructions to use mlx-community/DeepSeek-R1-Distill-Qwen-7B-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • MLX

    How to use mlx-community/DeepSeek-R1-Distill-Qwen-7B-4bit with MLX:

    # Download the model from the Hub
    pip install huggingface_hub[hf_xet]
    
    huggingface-cli download --local-dir DeepSeek-R1-Distill-Qwen-7B-4bit mlx-community/DeepSeek-R1-Distill-Qwen-7B-4bit
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps
  • LM Studio
DeepSeek-R1-Distill-Qwen-7B-4bit
4.3 GB
Ctrl+K
Ctrl+K
  • 2 contributors
History: 4 commits
awni's picture
awni
Update tokenizer_config.json
21848db verified about 1 year ago
  • .gitattributes
    1.57 kB
    Add files using upload-large-folder tool over 1 year ago
  • README.md
    873 Bytes
    Add files using upload-large-folder tool over 1 year ago
  • config.json
    886 Bytes
    Add files using upload-large-folder tool over 1 year ago
  • model.safetensors
    4.28 GB
    xet
    Add files using upload-large-folder tool over 1 year ago
  • model.safetensors.index.json
    51.7 kB
    Add files using upload-large-folder tool over 1 year ago
  • special_tokens_map.json
    485 Bytes
    Add files using upload-large-folder tool over 1 year ago
  • tokenizer.json
    11.4 MB
    xet
    Add files using upload-large-folder tool over 1 year ago
  • tokenizer_config.json
    6.76 kB
    Update tokenizer_config.json about 1 year ago