Haihao Shen

Haihao's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted an article 4 months ago

view article

Article

Getting More from Your Test-Time Compute Budget with Portfolio Beam Search

• 

danelbaz

•

Feb 24

• 8

upvoted a paper 7 months ago

SignRoundV2: Closing the Performance Gap in Extremely Low-Bit Post-Training Quantization for LLMs

Paper • 2512.04746 • Published Dec 4, 2025 • 15

upvoted an article about 1 year ago

view article

Article

Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs

• 
• 
• +7

wenhuach, Haihao, weiweiz1, n1ck-guo, isaacmac, kding1, IlyasMoutawwakil, marcsun13, medmekk

•

Apr 29, 2025

• 45

upvoted a paper over 1 year ago

Faster Inference of LLMs using FP8 on the Intel Gaudi

Paper • 2503.09975 • Published Mar 13, 2025 • 1

upvoted a collection over 1 year ago

DeepSeek

Collection

16 items • Updated Mar 2 • 3

upvoted 3 papers over 1 year ago

Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models

Paper • 2501.11873 • Published Jan 21, 2025 • 68

A dynamic parallel method for performance optimization on hybrid CPUs

Paper • 2411.19542 • Published Nov 29, 2024 • 5

Effective Quantization for Diffusion Models on CPUs

Paper • 2311.16133 • Published Nov 2, 2023 • 5

upvoted an article almost 2 years ago

view article

Article

Building Cost-Efficient Enterprise RAG applications with Intel Gaudi 2 and Intel Xeon

• 
• 
• +6

juliensimon, Haihao, antonyvance, MatrixYao, lianglv, gserochi, Debbh, kding1

•

May 9, 2024

• 12

upvoted an article about 2 years ago

view article

Article

Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding

• 
• 
• +9

ofirzaf, echarlaix, imargulis, danielkorat, jmamou, guybd, orenpereg, moshew, Haihao, aayasin, FanZhao

•

Jan 30, 2024

• 9

upvoted a collection over 2 years ago

Intel Neural Chat

Collection

Fine-tuned 7B parameter LLM models, one of which made it to the top of the 7B HF LLM Leaderboard • 15 items • Updated Aug 23, 2024 • 3

upvoted 3 papers over 2 years ago

Efficient LLM Inference on CPUs

Paper • 2311.00502 • Published Nov 1, 2023 • 7

TEQ: Trainable Equivalent Transformation for Quantization of LLMs

Paper • 2310.10944 • Published Oct 17, 2023 • 10

Efficient Post-training Quantization with FP8 Formats

Paper • 2309.14592 • Published Sep 26, 2023 • 11

upvoted 2 papers almost 3 years ago

Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs

Paper • 2309.05516 • Published Sep 11, 2023 • 12

An Efficient Sparse Inference Software Accelerator for Transformer-based Language Models on CPUs

Paper • 2306.16601 • Published Jun 28, 2023 • 4