Clarify Transformers version requirements
Browse files
README.md
CHANGED
|
@@ -15,32 +15,25 @@ Mistral-7B-v0.1 outperforms Llama 2 13B on all benchmarks we tested.
|
|
| 15 |
|
| 16 |
For full details of this model please read our [Release blog post](https://mistral.ai/news/announcing-mistral-7b/)
|
| 17 |
|
| 18 |
-
## Model Architecture
|
|
|
|
| 19 |
Mistral-7B-v0.1 is a transformer model, with the following architecture choices:
|
| 20 |
- Grouped-Query Attention
|
| 21 |
- Sliding-Window Attention
|
| 22 |
- Byte-fallback BPE tokenizer
|
| 23 |
|
| 24 |
## Troubleshooting
|
|
|
|
| 25 |
- If you see the following error:
|
| 26 |
```
|
| 27 |
-
Traceback (most recent call last):
|
| 28 |
-
File "", line 1, in
|
| 29 |
-
File "/transformers/models/auto/auto_factory.py", line 482, in from_pretrained
|
| 30 |
-
config, kwargs = AutoConfig.from_pretrained(
|
| 31 |
-
File "/transformers/models/auto/configuration_auto.py", line 1022, in from_pretrained
|
| 32 |
-
config_class = CONFIG_MAPPING[config_dict["model_type"]]
|
| 33 |
-
File "/transformers/models/auto/configuration_auto.py", line 723, in getitem
|
| 34 |
-
raise KeyError(key)
|
| 35 |
KeyError: 'mistral'
|
| 36 |
```
|
| 37 |
-
|
| 38 |
-
Installing transformers from source should solve the issue:
|
| 39 |
```
|
| 40 |
-
|
| 41 |
```
|
| 42 |
-
This should not be required after transformers-v4.33.4.
|
| 43 |
|
|
|
|
| 44 |
|
| 45 |
## Notice
|
| 46 |
|
|
|
|
| 15 |
|
| 16 |
For full details of this model please read our [Release blog post](https://mistral.ai/news/announcing-mistral-7b/)
|
| 17 |
|
| 18 |
+
## Model Architecture
|
| 19 |
+
|
| 20 |
Mistral-7B-v0.1 is a transformer model, with the following architecture choices:
|
| 21 |
- Grouped-Query Attention
|
| 22 |
- Sliding-Window Attention
|
| 23 |
- Byte-fallback BPE tokenizer
|
| 24 |
|
| 25 |
## Troubleshooting
|
| 26 |
+
|
| 27 |
- If you see the following error:
|
| 28 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
KeyError: 'mistral'
|
| 30 |
```
|
| 31 |
+
- Or:
|
|
|
|
| 32 |
```
|
| 33 |
+
NotImplementedError: Cannot copy out of meta tensor; no data!
|
| 34 |
```
|
|
|
|
| 35 |
|
| 36 |
+
Ensure you are utilizing a stable version of Transformers, 4.34.0 or newer.
|
| 37 |
|
| 38 |
## Notice
|
| 39 |
|