Instructions to use facebook/llm-compiler-13b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use facebook/llm-compiler-13b with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("facebook/llm-compiler-13b", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Are there plans to use LLM-compiler for performance optimization?
#4
by coong2 - opened