Update README.md
Browse files
README.md
CHANGED
|
@@ -1,4 +1,4 @@
|
|
| 1 |
-
# LLAMA-3
|
| 2 |
|
| 3 |
```
|
| 4 |
max_seq_length = 2048
|
|
@@ -29,7 +29,7 @@ text_streamer = TextStreamer(tokenizer)
|
|
| 29 |
_ = model.generate(input_ids = inputs, streamer = text_streamer, max_new_tokens = 128, use_cache = True)
|
| 30 |
```
|
| 31 |
|
| 32 |
-
Example:
|
| 33 |
```
|
| 34 |
<|begin_of_text|><|start_header_id|>user<|end_header_id|>
|
| 35 |
|
|
|
|
| 1 |
+
# LLAMA-3 Inference
|
| 2 |
|
| 3 |
```
|
| 4 |
max_seq_length = 2048
|
|
|
|
| 29 |
_ = model.generate(input_ids = inputs, streamer = text_streamer, max_new_tokens = 128, use_cache = True)
|
| 30 |
```
|
| 31 |
|
| 32 |
+
## Example:
|
| 33 |
```
|
| 34 |
<|begin_of_text|><|start_header_id|>user<|end_header_id|>
|
| 35 |
|