Instructions to use mlx-community/DeepSeek-Coder-V2-Lite-Instruct-4bit-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/DeepSeek-Coder-V2-Lite-Instruct-4bit-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir DeepSeek-Coder-V2-Lite-Instruct-4bit-mlx mlx-community/DeepSeek-Coder-V2-Lite-Instruct-4bit-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
The repository for mlx-community/DeepSeek-Coder-V2-Lite-Instruct-4bit-mlx contains custom code which must be executed to correctly load the model
#2
by AlexCheema - opened
Getting the following when downloading the model from HF hub (didn't used to get this):
The repository for mlx-community/DeepSeek-Coder-V2-Lite-Instruct-4bit-mlx contains custom code which must be executed to correctly
load the model. You can inspect the repository content at https://hf.co/mlx-community/DeepSeek-Coder-V2-Lite-Instruct-4bit-mlx.
You can avoid this prompt in future by passing the argument `trust_remote_code=True`.
Do you wish to run the custom code?
