Instructions to use TheBloke/mpt-30B-chat-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/mpt-30B-chat-GGML with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/mpt-30B-chat-GGML", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Setting max_seq_len even higher
#7 opened almost 3 years ago
by
RonanMcGovern
Why not llama.cpp ?
1
#5 opened about 3 years ago
by
lazyiitian
Complete prompt template
6
#4 opened about 3 years ago
by
Nightcall
koboldcpp thinks it is a GPT-NEO-X model?
2
#3 opened about 3 years ago
by
TornButter
HF upload bugged out again?
1
#2 opened about 3 years ago
by
nisten
Are GPTQ version of the mpt models possible?
1
#1 opened about 3 years ago
by
latent-variable