xrusnack commited on
Commit
76f3896
·
verified ·
1 Parent(s): de15af1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -16,7 +16,9 @@ language:
16
  - **Finetuned from model :** unsloth/gemma-2-9b-bnb-4bit
17
 
18
  This gemma2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
19
- Example Infernce:
 
 
20
  alpaca_prompt = "### Text: {} ### Summary: {}"
21
  FastLanguageModel.for_inference(model) # Enable native 2x faster inference
22
  inputs = tokenizer(
@@ -29,5 +31,6 @@ inputs = tokenizer(
29
 
30
  outputs = model.generate(**inputs, max_new_tokens = 64, use_cache = True)
31
  tokenizer.batch_decode(outputs)
 
32
 
33
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
16
  - **Finetuned from model :** unsloth/gemma-2-9b-bnb-4bit
17
 
18
  This gemma2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
19
+
20
+ ## Example Inference:
21
+ ```python
22
  alpaca_prompt = "### Text: {} ### Summary: {}"
23
  FastLanguageModel.for_inference(model) # Enable native 2x faster inference
24
  inputs = tokenizer(
 
31
 
32
  outputs = model.generate(**inputs, max_new_tokens = 64, use_cache = True)
33
  tokenizer.batch_decode(outputs)
34
+ ```
35
 
36
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)