manu02
/

VulnLLM-R-7B-bnb-4bit-nf4-dq

Feature Extraction

text-embeddings-inference

4-bit precision

Model card Files Files and versions

VulnLLM-R-7B-bnb-4bit-nf4-dq

4.47 GB

1 contributor

History: 2 commits

manu02's picture

Upload 4-bit quantized version of UCSB-SURFI/VulnLLM-R-7B with 71.4% memory reduction

8a3d4f1 verified 5 days ago

.gitattributes
1.57 kB

Upload 4-bit quantized version of UCSB-SURFI/VulnLLM-R-7B with 71.4% memory reduction 5 days ago
README.md
1.06 kB

Upload 4-bit quantized version of UCSB-SURFI/VulnLLM-R-7B with 71.4% memory reduction 5 days ago
chat_template.jinja
2.56 kB

Upload 4-bit quantized version of UCSB-SURFI/VulnLLM-R-7B with 71.4% memory reduction 5 days ago
config.json
1.93 kB

Upload 4-bit quantized version of UCSB-SURFI/VulnLLM-R-7B with 71.4% memory reduction 5 days ago
model.safetensors
4.46 GB
xet

Upload 4-bit quantized version of UCSB-SURFI/VulnLLM-R-7B with 71.4% memory reduction 5 days ago
tokenizer.json
11.4 MB
xet

Upload 4-bit quantized version of UCSB-SURFI/VulnLLM-R-7B with 71.4% memory reduction 5 days ago
tokenizer_config.json
391 Bytes

Upload 4-bit quantized version of UCSB-SURFI/VulnLLM-R-7B with 71.4% memory reduction 5 days ago