File size: 1,106 Bytes
11c29a6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 | ---
base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct
library_name: peft
pipeline_tag: text-generation
license: apache-2.0
datasets:
- nvidia/OpenCodeInstruct
tags:
- qwen3-coder
- coding
- software-engineering
- lora
- moe
- tiny-pickle
---
# Tiny Pickle v3 Coder — LoRA
Tiny Pickle v3 Coder is a coding-focused LoRA adaptation of
`Qwen/Qwen3-Coder-30B-A3B-Instruct`.
It was trained for ten hours on examples from OpenCodeInstruct for which
the recorded average test score was perfect and every recorded test
passed.
## Training
- Optimizer steps: 9,920
- Approximate packed sequences: 39,680
- Training context: 4,096 tokens
- LoRA rank: 64
- Learning rate: 2e-5
- Hardware: one NVIDIA H200
- Training duration: ten hours
## Intended use
Code generation, debugging, implementation planning, code review,
algorithmic problem solving and test generation.
## Limitations
This is an experimental specialization. It has not yet been demonstrated
to outperform the unmodified base model on independent benchmarks.
Generated code may be incorrect, insecure or incomplete and must be
reviewed and tested.
|