Instructions to use TheBloke/MPT-7B-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/MPT-7B-GGML with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/MPT-7B-GGML", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -20,7 +20,7 @@ This is GGML format quantised 4-bit, 5-bit and 8-bit GGML models of [MosaicML's
|
|
| 20 |
|
| 21 |
This repo is the result of converting to GGML and quantising.
|
| 22 |
|
| 23 |
-
Please note that these MPT GGMLs are **not compatbile with llama.cpp**.
|
| 24 |
|
| 25 |
## Repositories available
|
| 26 |
|
|
|
|
| 20 |
|
| 21 |
This repo is the result of converting to GGML and quantising.
|
| 22 |
|
| 23 |
+
Please note that these MPT GGMLs are **not compatbile with llama.cpp**. Please see below for a list of tools known to work with these model files.
|
| 24 |
|
| 25 |
## Repositories available
|
| 26 |
|