Update README.md
Browse files
README.md
CHANGED
|
@@ -35,6 +35,10 @@ Throughout this process, there are many challenges that need to be addressed and
|
|
| 35 |
<|endoftext|>
|
| 36 |
```
|
| 37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
```py
|
| 39 |
|
| 40 |
!pip install -qqq transformers>=4.39.0 mamba-ssm causal-conv1d>=1.2.0 accelerate bitsandbytes --progress-bar off
|
|
|
|
| 35 |
<|endoftext|>
|
| 36 |
```
|
| 37 |
|
| 38 |
+
# Inference
|
| 39 |
+
|
| 40 |
+
*※ - This code automatically appends the "<|startoftext|>" special token to any input. Appending this to all inputs is required for inference, as initial testing shows that leaving it out leads to output errors.*
|
| 41 |
+
|
| 42 |
```py
|
| 43 |
|
| 44 |
!pip install -qqq transformers>=4.39.0 mamba-ssm causal-conv1d>=1.2.0 accelerate bitsandbytes --progress-bar off
|