FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 42 items • Updated • 80
Adib
notadib
AI & ML interests
None yet
Recent Activity
liked a dataset 3 days ago
notadib/ACYD updated a dataset 3 days ago
notadib/ACYD new activity about 2 months ago
Ericwang/nemotron-nano2-safety-distill-gptoss:Request to update the link to HarmfulTasks datasetOrganizations
None yet
upvoted a collection almost 2 years ago