instinct / README.md
Adarsh-Iyer's picture
Update README.md
4d15e3c verified
|
raw
history blame
888 Bytes
metadata
license: apache-2.0

Instinct, an Open-Source Next-Edit Predictor

This repo contains the model weights for Instinct, Continue's state-of-the-art open next-edit model. Robustly fine-tuned from Qwen2.5-Coder-7B, Instinct intelligently predicts your next move to keep you in flow.

Serving the model

There are many ways to serve a local model with Continue. If you wish to serve the model using SGLang, as we did internally, you can use the following command, optionally adding --quantization fp8 if desired.

python3 -m sglang.launch_server --model-path continuedev/instinct --load-format safetensors

Learn more

For more information on the work behind Instinct, please refer to our blog.