Instructions to use rohithsiddhartha/DeepSeek-R1-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use rohithsiddhartha/DeepSeek-R1-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir DeepSeek-R1-4bit rohithsiddhartha/DeepSeek-R1-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
Commit History
Update tokenizer_config.json efe85d9 verified
Update tokenizer_config.json (#3) 3cad899 verified
Update config.json (#2) 85cb9b9 verified
Update configuration_deepseek.py (#1) b12eb46 verified
adding files as per mlx and config from hf repo 01e1f1f
rohith.bheemreddy commited on