Instructions to use ipetrukha/OpenCodeInterpreter-DS-6.7B-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ipetrukha/OpenCodeInterpreter-DS-6.7B-4bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("ipetrukha/OpenCodeInterpreter-DS-6.7B-4bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use ipetrukha/OpenCodeInterpreter-DS-6.7B-4bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "ipetrukha/OpenCodeInterpreter-DS-6.7B-4bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "ipetrukha/OpenCodeInterpreter-DS-6.7B-4bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ipetrukha/OpenCodeInterpreter-DS-6.7B-4bit", "messages": [ {"role": "user", "content": "Hello"} ] }'
Upload folder using huggingface_hub (#1)
Browse files- 3b2866dc0a70dba3f650021bc94c31425594426d14b5f9f90b73debaf4f107dc (20abe8ed2d3feb99230fdc1e7f5c6737978baad2)
- ba07826a2d2de1db0f4b28a69043bea29943c76ef729614bf3f5084b9b2612d3 (857396cedc0a139a58184d37f587480c008b7925)
- 4ab41a2aa8e79142934f454343ecaf919da625ab968ff382d18c686ef5f7f531 (7a6e60509e37d120f520499375d6e94ee7520bd3)
- fa6b51344fec3302e6875a8d6e43865e47c0b7b68e741fc2aec591420332dc9f (bcc47e1da6f3eb30e70db3b63390b6a266ada105)
- 91a625de0abaa4bc4e4112c8970243bbfacf1646aea048a4955d65bd6743d44b (87010ee85277b938d1b4d40392b347f73e9f2985)
- 5259e8efd947c58701d9a790eb3cee4a9132084acdad61010ef9182cb5dc0267 (0327ddba559f4c327468024b12c5bed3a25a4846)
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9bc3b7009a6d6cbb9127e40935635d1a7b6cb376fa2a1e869d776364c26a615c
|
| 3 |
+
size 5345224160
|
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a6c8b155980ac6ee66cbb5b8f0ab84b3c9b9ee214d8d199c6e4a65875d7706f6
|
| 3 |
+
size 5365725356
|
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2c40d77bbfe99238613da535b5a8f5abd77432197718cbfdd976196adcdf200b
|
| 3 |
+
size 5365725320
|
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e7adc0dc35f99cead0f61ec34f2c9ceac03a8aec11fb068decc6241b9c6da204
|
| 3 |
+
size 2680209335
|