Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,30 @@
+---
+library_name: transformers
+tags:
+- speculative-decoding
+- early-exit
+- dynamic-inference
+base_model: meta-llama/Meta-Llama-3-8B
+---
+
+# DSSD Auxiliary Heads for Llama 3 8B
+
+This repository contains the trained **auxiliary early-exit heads** for **meta-llama/Meta-Llama-3-8B**. 
+These heads are used for **Dynamic Self-Speculative Decoding (DSSD)**, enabling faster inference with guaranteed identical output to the full model.
+
+## 🚀 Usage
+
+These heads are designed to be used with the **DSSD Demo**.
+
+- **GitHub Repository**: [FlorianVal/DSSD_demo](https://github.com/FlorianVal/DSSD_demo)
+- **Live Demo**: [HuggingFace Space](https://huggingface.co/spaces/valcore/Dssd_Demo)
+
+## 📦 Contents
+
+- `aux_heads.pt`: State dictionary of the trained auxiliary heads (Layers 8, 16, 24).
+- `config.json`: Configuration file specifying head layers and parameters.
+- `calibration.json`: Calibrated thresholds for different accuracy levels.
+
+## 🔧 How it Works
+
+The auxiliary heads allow the model to exit early at intermediate layers if confidence thresholds are met. If the drafted tokens are not verified by the full model, they are corrected, ensuring 100% output match.