FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 42 items • Updated
• 78
宁鹏涛
ningpengtao
AI & ML interests
None yet
Recent Activity
liked
a model 9 days ago
jinaai/jina-embeddings-v5-text-nano liked
a model 14 days ago
jinaai/reader-lm-0.5b liked
a model 14 days ago
jinaai/ReaderLM-v2 Organizations
None yet
upvoted a collection over 1 year ago