Instructions to use mlx-community/INTELLECT-1-Instruct-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/INTELLECT-1-Instruct-bf16 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("mlx-community/INTELLECT-1-Instruct-bf16") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use mlx-community/INTELLECT-1-Instruct-bf16 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "mlx-community/INTELLECT-1-Instruct-bf16"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "mlx-community/INTELLECT-1-Instruct-bf16" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mlx-community/INTELLECT-1-Instruct-bf16", "messages": [ {"role": "user", "content": "Hello"} ] }' - Atomic Chat
Commit History
-
Upload folder using huggingface_hub (#1)
Verified signature- dbc77e8d34862d52c8671962a72d9fdfeb8b2d993493552a641dcc7010291766 (4339e0af1132c8fc56774e169fc653c251c528e8) - 5017c0dab89db54a7f9a28cf3d61dc663b4d64576c063130553b70183ad4be2f (6ba281f789c57a7d559a282fdf57cce4f9139533) - c7a13b79e1d6e543a83c4e81808aa2cdafb29d09be32dc70c6e740961436bdc9 (204cbb0ad8e2db756c881f3053292f5fe755d95f) - a1ddddd8f11deb2c0c3ace20e241ea7d26641ec1ae4c429b9a2e6b9c376c91b1 (efd2cf0068ff077e5aafb32b66e8d204265290df) - 98570bb4ffc816c035d0bc0746b1fef22fa586b35053a3435afa089ef63f087a (2104327506ded4628a7d2b51601c8bd94297ba64)afbd9e6
-
initial commit
Verified signature05ffde8