Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
CodeLlama-7B-Instruct-GGUF

Text Generation
Transformers
GGUF
code
llama
llama-2
Model card Files Files and versions
xet
Community
4
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Very slow response on LM Studio with these settings

3
#4 opened almost 2 years ago by
yassersharaf

Quantized Quality Bad?

1
#3 opened almost 2 years ago by
imrohankataria

The Q4_0 file has "output.weight" quantized with Q6_K.

#2 opened over 2 years ago by
mukel

Prompt Template

❤️ 3
#1 opened over 2 years ago by
tonymacx86PRO
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs