Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
cymic 's Collections
QuaRot GPTQ Models
Qwen3-GPTQ-SmoothQuant
Llama3.1-GPTQ-SmoothQuant
Llama2-GPTQ-SmoothQuant

QuaRot GPTQ Models

updated 6 days ago

GPTQ models quantized with QuaRot.

Upvote
-

  • cymic/llama2-13b-quarot-w3

    13B • Updated 6 days ago • 9

  • cymic/llama2-13b-quarot-w4

    13B • Updated 6 days ago • 7

  • cymic/llama2-13b-quarot-w8

    13B • Updated 6 days ago • 7

  • cymic/llama2-7b-quarot-w3

    7B • Updated 6 days ago • 10

  • cymic/llama2-7b-quarot-w4

    7B • Updated 6 days ago • 8

  • cymic/llama2-7b-quarot-w8

    7B • Updated 6 days ago • 9
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs