Instructions to use ynFeng/approximate-speculative-decoding with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ynFeng/approximate-speculative-decoding with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ynFeng/approximate-speculative-decoding", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download .gitignore from ynFeng/approximate-speculative-decoding: direct link, hf CLI and curl.
- Browser
- Download file 250 Bytes
-
https://huggingface.co/ynFeng/approximate-speculative-decoding/resolve/main/.gitignore
- Command line
-
hf download hf://ynFeng/approximate-speculative-decoding/.gitignore
-
curl -L -o .gitignore https://huggingface.co/ynFeng/approximate-speculative-decoding/resolve/main/.gitignore
250 Bytes
| __pycache__/ | |
| *.py[cod] | |
| *$py.class | |
| *.so | |
| .Python | |
| build/ | |
| develop-eggs/ | |
| dist/ | |
| downloads/ | |
| eggs/ | |
| .eggs/ | |
| lib/ | |
| lib64/ | |
| parts/ | |
| sdist/ | |
| var/ | |
| wheels/ | |
| *.egg-info/ | |
| .installed.cfg | |
| *.egg | |
| .pytest_cache/ | |
| .ipynb_checkpoints | |
| *.log | |
| *.pt | |
| *.safetensors | |
| checkpoints/ | |
| models/ | |