Create README.md

README.md

@@ -0,0 +1,24 @@
+---
+language:
+- code
+license: llama2
+tags:
+- llama-2
+- mlx
+pipeline_tag: text-generation
+---
+# mlx-community/CodeLlama-70b-Instruct-4bit
+This model was converted to MLX format from [`codellama/CodeLlama-70b-Instruct-hf`]().
+Refer to the [original model card](https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf) for more details on the model.
+## Use with mlx
+
+```bash
+pip install mlx-lm
+```
+
+```python
+from mlx_lm import load, generate
+
+model, tokenizer = load("mlx-community/CodeLlama-70b-Instruct-4bit")
+response = generate(model, tokenizer, prompt="hello", verbose=True)
+```