Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

turboderp
/
Llama-3.2-3B-Instruct-exl2

Model card Files Files and versions
xet
Community
Llama-3.2-3B-Instruct-exl2 / README.md
turboderp's picture
turboderp
Update README.md
680ce44 verified almost 2 years ago
preview code
|
Raw
History Blame Contribute Delete
1.05 kB
metadata
license: llama3.2

EXL2 quants of Llama-3.2 3B Instruct

2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json