Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Meta-Llama-3.1-8B-Instruct-FP8-dynamic
like
9
Follow
Red Hat AI
2.02k
Text Generation
Transformers
Safetensors
8 languages
llama
facebook
meta
llama-3
fp8
vllm
chat
neuralmagic
llmcompressor
conversational
8-bit precision
compressed-tensors
text-generation-inference
License:
llama3.1
Model card
Files
Files and versions
xet
Community
4
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (2)
Sort: Recently created
Sparse Instruct model
#2 opened about 1 year ago by
Eryk-Chmielewski
What is the difference between this and "neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8"
1
#1 opened over 1 year ago by
RonanMcGovern