Instructions to use TheBloke/WizardCoder-15B-1.0-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/WizardCoder-15B-1.0-GGML with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/WizardCoder-15B-1.0-GGML", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Very Useful
#2
by boricuapab - opened
update : i have used the model with koboldcpp_1.30.2.exe , it is working
Best,
Great to hear!
@boricuapab I have tested your prompt on WizardLM-1.0-Uncensored-CodeLlama-34B-GGUF and it did much better job, it recognized fruits from desserts:
Then I asked it to make it possible to choose from them and this is the result:
It seams the WizardLM-1.0-Uncensored-CodeLlama-34B-GGUF can make better codes but it is very slow on my CPU.





