gnikesh commited on
Commit
1cab52f
·
verified ·
1 Parent(s): 91a51ad

Note the CUDA assumption in the Python example

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -62,6 +62,9 @@ pip install mamba_ssm causal_conv1d --no-build-isolation
62
 
63
  ## Running the classifier in Python
64
 
 
 
 
65
  ```python
66
  import torch
67
  from transformers import AutoModelForSequenceClassification, AutoTokenizer
 
62
 
63
  ## Running the classifier in Python
64
 
65
+ The example assumes a CUDA GPU (the base checkpoint is stored in bfloat16). On CPU, cast the
66
+ model with `model.float()` and run the forward pass without the autocast block.
67
+
68
  ```python
69
  import torch
70
  from transformers import AutoModelForSequenceClassification, AutoTokenizer