YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Build with onnxruntime-genai at head of commit: da58e20df8b33e4ea8638798232720c834d798c1
python builder.py -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 -o TinyLlama-1.1B-Chat-v1.0-webgpu-v2 -c honry-cache-dir -p int4 -e webgpu --extra_options int4_block_size=32 int4_accuracy_level=4 int4_op_types_to_quantize=MatMul/Gather enable_webgpu_graph=true
- Downloads last month
- 5
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support