Hugging Face's logo

RedHatAI
/
Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation
Safetensors
llama
llama-3
neuralmagic
llmcompressor
conversational
8-bit precision
compressed-tensors
Model card Files
xet
 Community
1
Llama-3.2-3B-Instruct-quantized.w8a8

Commit History

  1. Update config.json with the correct state (#1)⁠

    mgoin +1: dsikka
    Verified signature
    505dad2

  1. Update README.md

    alexmarques
    Verified signature
    fb5da44

  1. Updated compression_config to quantization_config

    mgoin
    Verified signature
    59e165b

  1. Update README.md

    alexmarques
    Verified signature
    0f32e45

  2. Create README.md

    alexmarques
    Verified signature
    518b068

  1. Upload folder using huggingface_hub

    alexmarques
    Verified signature
    1c42cac

  2. initial commit

    alexmarques
    Verified signature
    664ba2b