How to use amd/kimi-k2.5-eagle3-fp8 with Transformers:
# Load model directly from transformers import AutoTokenizer, LlamaForCausalLMEagle3 tokenizer = AutoTokenizer.from_pretrained("amd/kimi-k2.5-eagle3-fp8") model = LlamaForCausalLMEagle3.from_pretrained("amd/kimi-k2.5-eagle3-fp8")
chaoli-amd commited on 
