Instructions to use falan42/llama-tiny-int4-medical_ps with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use falan42/llama-tiny-int4-medical_ps with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("emir12/tinyllama-medical-1.1b") model = PeftModel.from_pretrained(base_model, "falan42/llama-tiny-int4-medical_ps") - Notebooks
- Google Colab
- Kaggle
Ctrl+K