| | --- |
| | language: |
| | - code |
| | license: llama2 |
| | tags: |
| | - llama-2 |
| | - mlx |
| | - 8-bit |
| | pipeline_tag: text-generation |
| | --- |
| | |
| | # CodeLlama-7b-Python-hf-8bit-mlx |
| |
|
| | This model was converted to MLX format from [`codellama/CodeLlama-7b-Python-hf`](). |
| | Please, refer to the [original model card](https://huggingface.co/codellama/CodeLlama-7b-Python-hf) for more details on the original model. |
| |
|
| | ## Use with mlx |
| |
|
| | ```bash |
| | pip install mlx |
| | git clone https://github.com/ml-explore/mlx-examples.git |
| | |
| | cd mlx-examples/llms/hf_llm |
| | python generate.py --model mlx-community/CodeLlama-7b-Python-hf-8bit-mlx --prompt "My name is" |
| | ``` |
| |
|
