Note the CUDA assumption in the Python example
Browse files
README.md
CHANGED
|
@@ -62,6 +62,9 @@ pip install mamba_ssm causal_conv1d --no-build-isolation
|
|
| 62 |
|
| 63 |
## Running the classifier in Python
|
| 64 |
|
|
|
|
|
|
|
|
|
|
| 65 |
```python
|
| 66 |
import torch
|
| 67 |
from transformers import AutoModelForSequenceClassification, AutoTokenizer
|
|
|
|
| 62 |
|
| 63 |
## Running the classifier in Python
|
| 64 |
|
| 65 |
+
The example assumes a CUDA GPU (the base checkpoint is stored in bfloat16). On CPU, cast the
|
| 66 |
+
model with `model.float()` and run the forward pass without the autocast block.
|
| 67 |
+
|
| 68 |
```python
|
| 69 |
import torch
|
| 70 |
from transformers import AutoModelForSequenceClassification, AutoTokenizer
|