Text Generation
Safetensors
PyTorch
llama
facebook
unsloth
meta
llama-3
conversational
compressed-tensors
Instructions to use unsloth/Llama-3.1-8B-Instruct-FP8-Block with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Desktop
FP8-Block > FP8-Dynamic - This Quant of Llama-3.1-8B-Instruct is 🔥
#1 opened 9 months ago
by
Joseph717171