Instructions to use ruikangliu/FlatQuant with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ruikangliu/FlatQuant with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="ruikangliu/FlatQuant")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ruikangliu/FlatQuant", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
Update README.md 4133e63 verified
ruikang liu commited on
Update README.md 556dd7a verified
ruikang liu commited on
Update README.md fed6b67 verified
ruikang liu commited on
Initial commit bb08c6d
initial commit eb35c43 verified
ruikang liu commited on