This model is copied from https://huggingface.co/linborui/EAGLE-Llama-3.2-3B-Instruct with the following modifications to make it compatible with SGLang:
- Modify the architecture in config.json to LlamaForCausalLMEagle
- Downloads last month
- 2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for linborui/sglang-EAGLE-Llama-3.2-3B-Instruct
Base model
linborui/EAGLE-Llama-3.2-3B-Instruct