DamienDrash/CodeLlama-70B-Instruct
This model was converted to MLX format from codellama/CodeLlama-70b-Instruct-hf.
Refer to the original model card for more details on the model.
Use with mlx
pip install mlx
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples/llms/hf_llm
python generate.py --model mlx-community/DamienDrash/CodeLlama-70B-Instruct --prompt "My name is"
- Downloads last month
- 13
Hardware compatibility
Log In to add your hardware
Quantized
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("DamienDrash/CodeLlama-70B-Instruct") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True)