Hugging Face's logo

aws-neuron
/
optimum-neuron-cache

Model card Files
xet
 Community
711
optimum-neuron-cache / inference-cache-config

Commit History

  1. Add batch size 4 configurations for LLama 1B and 3B models

    dacorvo HF Staff
    Verified signature
    3b6312a

  1. Rename inference-cache-config/pixart_sigma_xl_512x512.json to inference-cache-config/pixart-sigma-xl-512x512.json

    Jingya HF Staff
    Verified signature
    1d662ce

  2. Create pixart_sigma_xl_512x512.json

    Jingya HF Staff
    Verified signature
    13f78a6

  3. Rename inference-cache-config/pixart-xl-2-512x512.json to inference-cache-config/pixart-alpha-xl-512x512.json

    Jingya HF Staff
    Verified signature
    cb11624

  4. Rename inference-cache-config/pixArt-XL-2-512x512.json to inference-cache-config/pixart-xl-2-512x512.json

    Jingya HF Staff
    Verified signature
    c7f992d

  5. Create pixArt-XL-2-512x512.json

    Jingya HF Staff
    Verified signature
    600ade6

  6. Create sdxl-turbo.json

    Jingya HF Staff
    Verified signature
    591ea52

  7. Create stable-diffusion-xl-refiner-1.0.json

    Jingya HF Staff
    Verified signature
    aa72a1a

  8. Create stable-diffusion-xl-base-1.0.json

    Jingya HF Staff
    Verified signature
    1554744

  9. Create stable-diffusion-2-1.json

    Jingya HF Staff
    Verified signature
    e4e1333

  10. Rename inference-cache-config/diffusion.json to inference-cache-config/stable-diffusion-v1-5.json

    Jingya HF Staff
    Verified signature
    4a034bb

  1. add pixart and remove deprecated

    Jingya HF Staff
    Verified signature
    e5f06c7

  1. Added TinyLlama as requested by Jim burtoft

    dacorvo HF Staff
    Verified signature
    d9640f4

  1. Add phi4 cached configurations

    dacorvo HF Staff
    Verified signature
    c564534

  1. Add DeepSeek distilled versions of LLama 8B

    dacorvo HF Staff
    Verified signature
    509e6bf

  2. Add DeepSeek distilled model

    dacorvo HF Staff
    Verified signature
    4d1e615

  1. Update inference-cache-config/qwen2.5-large.json

    dacorvo HF Staff
    Verified signature
    84982b8

  2. Add DeepSeek distilled models

    dacorvo HF Staff
    Verified signature
    f4f3dcd

  1. Update inference-cache-config/mistral.json

    dacorvo HF Staff
    Verified signature
    01e1fe9

  2. Update inference-cache-config/mistral.json

    dacorvo HF Staff
    Verified signature
    7191bac

  1. Update inference-cache-config/mistral.json

    dacorvo HF Staff
    Verified signature
    6b536dc

  1. Add configuration for granite models

    dacorvo HF Staff
    Verified signature
    687da09

  1. Rename inference-cache-config/qwen-2.5-large.json to inference-cache-config/qwen2.5-large.json

    dacorvo HF Staff
    Verified signature
    2aa52ac

  2. Create qwen-2.5-large.json

    dacorvo HF Staff
    Verified signature
    a8df9db

  3. Rename inference-cache-config/qwen2.5 to inference-cache-config/qwen2.5.json

    dacorvo HF Staff
    Verified signature
    b9f1fde

  4. Add qwen2.5 config for models up to 14B params

    dacorvo HF Staff
    Verified signature
    4e25bb0

  1. Remove obsolete mistral variants

    dacorvo HF Staff
    Verified signature
    e60c569

  2. Remove obsolete llama variants

    dacorvo HF Staff
    Verified signature
    eee32f0

  1. Rename inference-cache-config/Llama3.1-70b.json to inference-cache-config/llama3.1-70b.json

    dacorvo HF Staff
    Verified signature
    563ba38

  2. Update inference-cache-config/Llama3.1-70b.json

    dacorvo HF Staff
    Verified signature
    7b0370b

  3. Update inference-cache-config/mistral.json

    dacorvo HF Staff
    Verified signature
    8ea3b57

  1. Update inference-cache-config/llama.json

    dacorvo HF Staff
    Verified signature
    d05f579

  2. Rename inference-cache-config/Llama3.1-70B.json to inference-cache-config/Llama3.1-70b.json

    dacorvo HF Staff
    Verified signature
    a92cfe3

  3. Update inference-cache-config/mixtral.json

    dacorvo HF Staff
    Verified signature
    7342c16

  4. Rename inference-cache-config/Llama-3.1-70B.json to inference-cache-config/Llama3.1-70B.json

    dacorvo HF Staff
    Verified signature
    b41e94c

  5. Create Llama-3.1-70B.json

    dacorvo HF Staff
    Verified signature
    b1279f9

  6. Delete inference-cache-config/llama3-8b.json

    dacorvo HF Staff
    Verified signature
    5b0b2de

  7. Update inference-cache-config/llama.json

    dacorvo HF Staff
    Verified signature
    0548cd2

  8. Delete inference-cache-config/llama2-7b-13b.json

    dacorvo HF Staff
    Verified signature
    219c5fd

  9. Update inference-cache-config/llama.json

    dacorvo HF Staff
    Verified signature
    afb9fe6

  10. Rename inference-cache-config/llama-3.1-8B.json to inference-cache-config/llama.json

    dacorvo HF Staff
    Verified signature
    14844a0

  11. Update inference-cache-config/mistral.json

    dacorvo HF Staff
    Verified signature
    6c4c814

  12. Create llama-3.1-8B.json

    dacorvo HF Staff
    Verified signature
    320841a

  13. Update inference-cache-config/llama3-8b.json

    dacorvo HF Staff
    Verified signature
    de9e259

  14. Update inference-cache-config/llama3-70b.json

    dacorvo HF Staff
    Verified signature
    5694f75

  1. Update inference-cache-config/stable-diffusion.json

    Jingya HF Staff
    Verified signature
    5272eb2

  1. Temporarily remove SD 1.5 from Runway⁠

    Jingya HF Staff
    Verified signature
    a74d412

  1. Update inference-cache-config/llama-variants.json

    dacorvo HF Staff
    Verified signature
    e7179a3

  2. Rename inference-cache-config/llama2.json to inference-cache-config/llama2-7b-13b.json

    dacorvo HF Staff
    Verified signature
    be28bda

  3. Create llama2-70b.json

    dacorvo HF Staff
    Verified signature
    6fe6ee4