Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
miike-ai
/
LeanLlama-8B-INT4
like
0
Safetensors
llama
custom_code
4-bit precision
bitsandbytes
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
LeanLlama-8B-INT4
5.72 GB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
miike-ai
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
e7f5bc0
verified
6 months ago
__pycache__
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
6 months ago
.gitattributes
Safe
1.57 kB
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
6 months ago
README.md
Safe
2.07 kB
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
6 months ago
chat_template.jinja
Safe
4.61 kB
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
6 months ago
config.json
Safe
2.44 kB
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
6 months ago
generation_config.json
Safe
183 Bytes
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
6 months ago
model.safetensors
5.7 GB
xet
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
6 months ago
modeling_lean_llama.py
Safe
13 kB
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
6 months ago
tokenizer.json
Safe
17.2 MB
xet
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
6 months ago
tokenizer_config.json
Safe
296 Bytes
Initial upload: LeanLlama-8B-INT4 (NF4 + KV cache compression)
6 months ago
