Commit ·
0ebf828
1
Parent(s): 2089d8a
Update README.md
Browse files
README.md
CHANGED
|
@@ -60,8 +60,8 @@ codgen-16B-mono-toolbench should NOT be used for purpose other than API based ac
|
|
| 60 |
```python
|
| 61 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 62 |
|
| 63 |
-
tokenizer = AutoTokenizer.from_pretrained("sambanovasystems/codegen-
|
| 64 |
-
model = AutoModelForCausalLM.from_pretrained("sambanovasystems/codegen-
|
| 65 |
```
|
| 66 |
|
| 67 |
### Suggested Inference Parameters
|
|
|
|
| 60 |
```python
|
| 61 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 62 |
|
| 63 |
+
tokenizer = AutoTokenizer.from_pretrained("sambanovasystems/codegen-16B-mono-toolbench")
|
| 64 |
+
model = AutoModelForCausalLM.from_pretrained("sambanovasystems/codegen-16B-mono-toolbench", device_map="auto", torch_dtype="auto")
|
| 65 |
```
|
| 66 |
|
| 67 |
### Suggested Inference Parameters
|