Instructions to use NeoDim/starchat-alpha-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use NeoDim/starchat-alpha-GGML with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("NeoDim/starchat-alpha-GGML", dtype="auto") - Notebooks
- Google Colab
- Kaggle
demo space
#4
by matthoffner - opened
I've put together a demo using the 4 bit quantized version running on a CPU upgrade space.
UI - https://huggingface.co/spaces/matthoffner/starchat-alpha-ui
API - https://huggingface.co/spaces/matthoffner/starchat-alpha
Thanks!
Cool! Will try it.
Looks very nice, thank you!