|
|
--- |
|
|
language: |
|
|
- en |
|
|
- de |
|
|
- fr |
|
|
- it |
|
|
- pt |
|
|
- hi |
|
|
- es |
|
|
- th |
|
|
license: llama3.1 |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- facebook |
|
|
- meta |
|
|
- pytorch |
|
|
- llama |
|
|
- llama-3 |
|
|
- neuralmagic |
|
|
- redhat |
|
|
- speculators |
|
|
- eagle3 |
|
|
--- |
|
|
|
|
|
# Llama-3.1-8B-Instruct-speculator.eagle3-converted |
|
|
|
|
|
## Model Overview |
|
|
- **Verifier:** meta-llama/Llama-3.1-8B-Instruct |
|
|
- **Speculative Decoding Algorithm:** EAGLE-3 |
|
|
- **Model Architecture:** Eagle3Speculator |
|
|
- **Release Date:** 07/27/2025 |
|
|
- **Version:** 1.0 |
|
|
- **Model Developers:** RedHat |
|
|
|
|
|
This is a speculator model designed for use with [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct). |
|
|
This model was obtaneid by converting the [yuhuili/EAGLE3-LLaMA3.1-Instruct-8B](https://huggingface.co/yuhuili/EAGLE3-LLaMA3.1-Instruct-8B) model into the format defined by the [speculators](https://github.com/neuralmagic/speculators) library. |
|
|
|