Hugging Face's logo

aneforge
/
llm-text-generation

Text Generation
aneforge
apple-neural-engine
ane
coreml-free
on-device
apple-silicon
llama
qwen
Model card Files
xet
 Community
llm-text-generation / README.md

Commit History

Add measured M5 Pro decode (~62 tok/s, TinyLlama-1.1B fp16)
afe3ae5
verified

sbryngelson commited on

LLM text-generation on the ANE (usage card)
f18bcfb
verified

sbryngelson commited on