Article
Transformers now runs llama.cpp quants
- +1
marcsun13, ArthurZ, lysandre
• • 121
Varada Santosh
varadasantosh
·
AI & ML interests
Deep Learning, Generative AI, MLOps, LLMOps
Recent Activity
upvoted an article 1 day ago
Transformers now runs llama.cpp quants upvoted an article 1 day ago
1.3: The Two Phases Defined — Prefill and Decode upvoted an article 9 months ago
MLA: Redefining KV-Cache Through Low-Rank Projections and On-Demand DecompressionOrganizations
None yet
upvoted 2
articles 1 day ago
Article
1.3: The Two Phases Defined — Prefill and Decode
atharv6f
• • 7 upvoted an article 9 months ago
Article
MLA: Redefining KV-Cache Through Low-Rank Projections and On-Demand Decompression
NormalUhr
• • 25 upvoted an article over 1 year ago
Article
My Journey to a serverless transformers pipeline on Google Cloud
Maxence
• • 2