File size: 784 Bytes
9fe3c7d 0ea0590 cf3681b 0ea0590 f005f14 0ea0590 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 |
---
license: apache-2.0
datasets:
- iamtarun/python_code_instructions_18k_alpaca
- angie-chen55/python-github-code
- jtatman/python-code-dataset-500k
language:
- en
base_model:
- facebook/layerskip-llama3.2-1B
library_name: transformers
tags:
- code
---
# Model Card for CodeDrafter-500M
A draft model for Llama3.1/3.2/3.3 series models, specialized in python coding. This model is finetuned from the first 4 layers of facebook/layerskip-llama3.2-1B.
## Citation
```bibtex
@article{chen2024sequoia,
title={Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding},
author={Chen, Zhuoming and May, Avner and Svirschevski, Ruslan and Huang, Yuhsun and Ryabinin, Max and Jia, Zhihao and Chen, Beidi},
journal={arXiv preprint arXiv:2402.12374},
year={2024}
}
```
|