Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Spaces:
NyxKrage
/
LLM-Model-VRAM-Calculator
like
507
Running
App
Files
Files
Community
11
New cache sizes
#5
by
Anthonyg5005
- opened
Jun 9, 2024
Discussion
Anthonyg5005
Jun 9, 2024
exllamav2 now has new cache sizes, Q6 and Q8. FP8 may be removed soon
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
