Instructions to use ggml-org-dev/tiny-lev-for-testing with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use ggml-org-dev/tiny-lev-for-testing with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("ggml-org-dev/tiny-Qwen3.5-4B-for-testing") model = PeftModel.from_pretrained(base_model, "ggml-org-dev/tiny-lev-for-testing") - Notebooks
- Google Colab
- Kaggle
Download lev_release.json from ggml-org-dev/tiny-lev-for-testing: direct link, hf CLI and curl.
- Browser
- Download file 527 Bytes
-
https://huggingface.co/ggml-org-dev/tiny-lev-for-testing/resolve/main/lev_release.json
- Command line
-
hf download hf://ggml-org-dev/tiny-lev-for-testing/lev_release.json
-
curl -L -o lev_release.json https://huggingface.co/ggml-org-dev/tiny-lev-for-testing/resolve/main/lev_release.json
527 Bytes
| { | |
| "name": "lev", | |
| "preset": "4b-instruct", | |
| "step": 18750, | |
| "base_model": "ggml-org-dev/tiny-Qwen3.5-4B-for-testing", | |
| "lora_rank": 32, | |
| "mode_b_head": true, | |
| "calibrated": true, | |
| "noul_readout": "rating", | |
| "prompt_style": "chat", | |
| "files": [ | |
| "adapter_config.json", | |
| "adapter_model.safetensors", | |
| "chat_template.jinja", | |
| "mode_b_head.pt", | |
| "tokenizer.json", | |
| "tokenizer_config.json", | |
| "calibration.json" | |
| ], | |
| "metrics": {}, | |
| "created": "2026-09-24T06:29:31+00:00", | |
| "adapter_scale": 0.25 | |
| } | |