| base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct | |
| library_name: peft | |
| pipeline_tag: text-generation | |
| license: apache-2.0 | |
| datasets: | |
| - nvidia/OpenCodeInstruct | |
| tags: | |
| - qwen3-coder | |
| - coding | |
| - software-engineering | |
| - lora | |
| - moe | |
| - tiny-pickle | |
| # Tiny Pickle v3 Coder — LoRA | |
| Tiny Pickle v3 Coder is a coding-focused LoRA adaptation of | |
| `Qwen/Qwen3-Coder-30B-A3B-Instruct`. | |
| It was trained for ten hours on examples from OpenCodeInstruct for which | |
| the recorded average test score was perfect and every recorded test | |
| passed. | |
| ## Training | |
| - Optimizer steps: 9,920 | |
| - Approximate packed sequences: 39,680 | |
| - Training context: 4,096 tokens | |
| - LoRA rank: 64 | |
| - Learning rate: 2e-5 | |
| - Hardware: one NVIDIA H200 | |
| - Training duration: ten hours | |
| ## Intended use | |
| Code generation, debugging, implementation planning, code review, | |
| algorithmic problem solving and test generation. | |
| ## Limitations | |
| This is an experimental specialization. It has not yet been demonstrated | |
| to outperform the unmodified base model on independent benchmarks. | |
| Generated code may be incorrect, insecure or incomplete and must be | |
| reviewed and tested. | |