Article
Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs
- +7
wenhuach, Haihao, weiweiz1, n1ck-guo, isaacmac, kding1, IlyasMoutawwakil, marcsun13, medmekk
• • 45
Francesco Baldassarri
fbaldassarri
AI & ML interests
Text Generation, Entity extraction, Entity Recognition, Categorization, Data Mining, Natural Language Understanging and Processing
Recent Activity
updated a model about 12 hours ago
fbaldassarri/ibm-granite_granite-3.2-2b-instruct-auto_awq-int4-gs64-sym published a model about 13 hours ago
fbaldassarri/ibm-granite_granite-3.2-2b-instruct-auto_awq-int4-gs64-sym updated a model about 13 hours ago
fbaldassarri/ibm-granite_granite-3.2-2b-instruct-auto_awq-int4-gs64-asymOrganizations
None yet
upvoted an article 15 days ago
upvoted a collection over 1 year ago
upvoted an article about 2 years ago
Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
- +3
ybelkada, timdettmers, artidoro, sgugger, smangrul
• • 180 upvoted 2
collections about 2 years ago
upvoted an article about 2 years ago
Article
Making LLMs lighter with AutoGPTQ and transformers
- +4
marcsun13, fxmarty, PanEa, qwopqwop, ybelkada, TheBloke
• • 64