Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
xaskasdf
/
llama-3.1-70b-instruct-gguf
like
0
GGUF
imatrix
conversational
License:
llama3.1
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
README.md exists but content is empty.
Downloads last month
3
GGUF
Model size
71B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to add your hardware
1-bit
IQ1_M
18.1 GB
2-bit
IQ2_XXS
20.5 GB
IQ2_S
23.6 GB
Q2_K
27.6 GB
4-bit
Q4_0
41.2 GB
5-bit
Q5_0
49.9 GB
6-bit
Q6_K
59.1 GB
8-bit
Q8_0
76 GB
16-bit
F16
141 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Collection including
xaskasdf/llama-3.1-70b-instruct-gguf
llama-3
Collection
Meta's Llama-3 models in gguf format
•
4 items
•
Updated
Sep 11, 2024