Frank Liu

fliu1998's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in meta-llama/Llama-Guard-3-8B-INT8 over 1 year ago

I Found Inference Speed for INT8 Quantized Model is Slower Than Non-Quantized Version

➕ 1

1

#9 opened over 1 year ago by

fliu1998

I Found Inference Speed for INT8 Quantized Model is Slower Than Non-Quantized Version

➕ 1

1

#9 opened over 1 year ago by

fliu1998