Transformers
Safetensors
t5
text2text-generation
text-generation-inference
4-bit precision
bitsandbytes
Instructions to use Professor/davlan-small-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Professor/davlan-small-4bit with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("Professor/davlan-small-4bit") model = AutoModelForSeq2SeqLM.from_pretrained("Professor/davlan-small-4bit", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Upload tokenizer
Verified signaturef4fb9db -
Upload T5ForConditionalGeneration
Verified signature4d34e80
-
Upload tokenizer
Verified signature63e1f80 -
Upload T5ForConditionalGeneration
Verified signature0dc60da -
Upload T5ForConditionalGeneration
Verified signature56356a5 -
Upload tokenizer
Verified signature7858596
-
Upload T5ForConditionalGeneration
Verified signature25a409c -
initial commit
Verified signature4011a25