Update README.md

README.md

@@ -10,7 +10,11 @@ This repo contains the model weights for **Instinct**, [Continue](https://contin
 
 ## Serving the model
 
-There are many ways to plug a local model into Continue; we internally used an endpoint served by [SGLang](https://github.com/sgl-project/sglang), which is one of the options below. We observed no significant performance changes with fp8 quantization, so this may be used if desired.
+We've released a [Q4_K_M GGUF quantization of Instinct](https://huggingface.co/continuedev/instinct-GGUF), for efficient local inference.
+
+[Ollama Instructions coming soon]
+
+Besides Ollama, there are many ways to plug a local model into Continue; we internally used an endpoint served by [SGLang](https://github.com/sgl-project/sglang), which is one of the options below. Quantizing for faster inference is also an option that worked well for us.
 
 * SGLang: `python3 -m sglang.launch_server --model-path continuedev/instinct --load-format safetensors`
 * vLLM  : `vllm serve continuedev/instinct --served-model-name instinct --load-format safetensors`