aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions

optimum-neuron-cache / inference-cache-config

15.6 kB

Ctrl+K

Ctrl+K

4 contributors

History: 63 commits

This model has 320 files scanned as suspicious.

dacorvo's picture

dacorvo HF Staff

Added TinyLlama as requested by Jim burtoft

d9640f4 verified over 1 year ago

gpt2.json

398 Bytes
Add more gpt2 configurations over 2 years ago
granite.json

1.3 kB
Add configuration for granite models almost 2 years ago
llama-variants.json

1.45 kB
Add DeepSeek distilled versions of LLama 8B almost 2 years ago
llama.json

1.84 kB
Added TinyLlama as requested by Jim burtoft over 1 year ago
llama2-70b.json

287 Bytes
Create llama2-70b.json over 2 years ago
llama3-70b.json

584 Bytes
Add DeepSeek distilled model almost 2 years ago
llama3.1-70b.json

289 Bytes
Rename inference-cache-config/Llama3.1-70b.json to inference-cache-config/llama3.1-70b.json about 2 years ago
mistral-variants.json

1.04 kB
Remove obsolete mistral variants about 2 years ago
mistral.json

1.87 kB
Update inference-cache-config/mistral.json almost 2 years ago
mixtral.json

583 Bytes
Update inference-cache-config/mixtral.json about 2 years ago
phi4.json

556 Bytes
Add phi4 cached configurations over 1 year ago
qwen2.5-large.json

849 Bytes
Update inference-cache-config/qwen2.5-large.json almost 2 years ago
qwen2.5.json

2.69 kB
Add DeepSeek distilled models almost 2 years ago
stable-diffusion.json

1.91 kB
Update inference-cache-config/stable-diffusion.json about 2 years ago