Instructions to use ethicalabs/TowerInstruct-7B-v0.2-mlx-4Bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ethicalabs/TowerInstruct-7B-v0.2-mlx-4Bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download ethicalabs/TowerInstruct-7B-v0.2-mlx-4Bit --local-dir TowerInstruct-7B-v0.2-mlx-4Bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Update tokenizer_config.json
Verified signature3b28ecc -
Update tokenizer_config.json
Verified signaturee3c6255
-
Create generation_config.json
Verified signaturecb8af65
-
Update README.md
Verified signatureb243427 -
Upload README.md with huggingface_hub
Verified signature8d3168f -
Upload config.json with huggingface_hub
Verified signature2617276 -
Upload tokenizer.json with huggingface_hub
Verified signaturea116a31 -
Upload tokenizer.model with huggingface_hub
Verified signaturee1fdaa0 -
Upload added_tokens.json with huggingface_hub
Verified signatureaa771ab -
Upload special_tokens_map.json with huggingface_hub
Verified signature3e1107e -
Upload tokenizer_config.json with huggingface_hub
Verified signaturecad568b -
Upload model.safetensors.index.json with huggingface_hub
Verified signaturea6b4176 -
Upload model.safetensors with huggingface_hub
Verified signature3330e09 -
initial commit
Verified signatureeefaa72