Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
TheBloke
/
orca_mini_7B-GPTQ
like
12
Text Generation
Transformers
Safetensors
psmathur/alpaca_orca
psmathur/dolly-v2_orca
psmathur/WizardLM_Orca
English
llama
text-generation-inference
4-bit precision
gptq
arxiv:
2306.02707
License:
mit
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
main
orca_mini_7B-GPTQ
4.52 GB
1 contributor
History:
13 commits
TheBloke
Update for Transformers GPTQ support
7413c35
over 2 years ago
.gitattributes
1.52 kB
initial commit
over 2 years ago
README.md
15.6 kB
Update for Transformers GPTQ support
over 2 years ago
config.json
782 Bytes
Update for Transformers GPTQ support
over 2 years ago
generation_config.json
132 Bytes
Initial GPTQ model commit
over 2 years ago
model.safetensors
4.52 GB
xet
Update for Transformers GPTQ support
over 2 years ago
quantize_config.json
158 Bytes
Update for Transformers GPTQ support
over 2 years ago
special_tokens_map.json
208 Bytes
Initial GPTQ model commit
over 2 years ago
tokenizer.json
1.98 MB
Initial GPTQ model commit
over 2 years ago
tokenizer.model
534 kB
xet
Initial GPTQ model commit
over 2 years ago
tokenizer_config.json
700 Bytes
Initial GPTQ model commit
over 2 years ago