Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
fsaudm 's Collections
ai-timeline
Meta-Llama-3.1-Quantized

Meta-Llama-3.1-Quantized

updated Aug 28, 2024

Collection of quantized Llama 3.1 models (8B & 70B versions for now), using bitsandbites.

Upvote
1

  • fsaudm/Meta-Llama-3.1-8B-Instruct-NF4

    Text Generation • 8B • Updated Sep 27, 2024 • 17

  • fsaudm/Meta-Llama-3.1-70B-Instruct-NF4

    Text Generation • 73B • Updated Oct 5, 2024 • 11

  • fsaudm/Meta-Llama-3.1-8B-Instruct-INT8

    Text Generation • 8B • Updated Aug 21, 2024 • 5

  • fsaudm/Meta-Llama-3.1-70B-Instruct-INT8

    Text Generation • 71B • Updated Aug 21, 2024 • 7
Upvote
1
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs