Hugging Face's logo

RedHatAI
/
Llama-3.2-1B-Instruct-FP8-dynamic

Text Generation
Safetensors
llama
fp8
vllm
conversational
compressed-tensors
Model card Files
xet
 Community
2

Install & run this model easily using llmpm

#1
by sarthak-saxena - opened
Discussion
sarthak-saxena

Install & run any hugging face model using llmpm

  • pip install llmpm
  • llmpm install RedHatAI/Llama-3.2-1B-Instruct-FP8-dynamic
  • llmpm serve RedHatAI/Llama-3.2-1B-Instruct-FP8-dynamic

LLMPMDemo_fuckwk

Website: https://llmpm.co

Sign up or log in to comment