Instructions to use ggml-org-dev/tiny-lev-for-testing with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use ggml-org-dev/tiny-lev-for-testing with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("ggml-org-dev/tiny-Qwen3.5-4B-for-testing") model = PeftModel.from_pretrained(base_model, "ggml-org-dev/tiny-lev-for-testing") - Notebooks
- Google Colab
- Kaggle
File size: 603 Bytes
d59d6cb | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 | {
"temperatures": {
"score:A": 1.8687166685806083,
"choice:A:small": 1.466031501359245,
"choice:A": 1.4606453602789027,
"noul:A": 1.282162150839547,
"choice:A:mid": 1.3228486325144098,
"choice:A:large": 1.4983293579095338,
"choice:B:large": 0.5794711375492776,
"choice:B": 0.5794711375492776
},
"fitted_on": "calibration (transfer-selected)",
"n_samples": {
"score:A": 12258,
"choice:A:small": 11480,
"choice:A": 14133,
"noul:A": 12073,
"choice:A:mid": 1138,
"choice:A:large": 1515,
"choice:B:large": 10227,
"choice:B": 10227
}
} |