mlx-community
/

CodeLlama-7b-Python-4bit-MLX

Text Generation

Model card Files Files and versions

skirano commited on Feb 2, 2024

Commit

b6ecadc

·

verified ·

1 Parent(s): 4c6d8c0

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,5 +22,5 @@ pip install mlx-lm
 from mlx_lm import load, generate
 model, tokenizer = load("mlx-community/CodeLlama-7b-Python-4bit")
-response = generate(model, tokenizer, prompt="hello", verbose=True)
 ```

 from mlx_lm import load, generate
 model, tokenizer = load("mlx-community/CodeLlama-7b-Python-4bit")
+response = generate(model, tokenizer, prompt="<s>[INST] <<SYS>> You are a helpful, respectful, and honest assistant. Always do... If you are unsure about an answer, truthfully say \"I don't know\" <</SYS>> What's the meaning of life [/INST]", verbose=True)
 ```