Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

TheBloke
/

cassandra-6.9B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

cassandra-6.9B-GPTQ

4.72 GB

Ctrl+K

Ctrl+K

1 contributor

History: 12 commits

TheBloke's picture

Update for Transformers GPTQ support

4a7bb89 over 2 years ago

.gitattributes

1.52 kB
initial commit almost 3 years ago
README.md

7.89 kB
Update for Transformers GPTQ support over 2 years ago
config.json

962 Bytes
Update for Transformers GPTQ support over 2 years ago
generation_config.json

154 Bytes
Initial GPTQ model commit almost 3 years ago
model.safetensors

4.71 GB
xet

Update for Transformers GPTQ support over 2 years ago
quantize_config.json

188 Bytes
Update for Transformers GPTQ support over 2 years ago
tokenizer.json

2.11 MB
Initial GPTQ model commit almost 3 years ago