NavCoder LoRA v1

A coding-focused LoRA fine-tune of Qwen/Qwen2.5-Coder-0.5B-Instruct.

Training configuration

  • Dataset: CodeAlpaca-20k
  • Training examples: 1,800
  • Validation examples: 180
  • LoRA rank: 8
  • LoRA alpha: 16
  • LoRA dropout: 0.05
  • Learning rate: 2e-4
  • Epochs: 1
  • GPU: NVIDIA T4

Results

  • Final reported training loss: 0.678341
  • Evaluation loss: 0.588350

Coding correctness benchmarks have not yet been run.

Usage

Load the adapter with PEFT and the original Qwen base model.

Downloads last month
22
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Navaneeth123456789/NavCoder-LoRA-v1

Adapter
(97)
this model

Dataset used to train Navaneeth123456789/NavCoder-LoRA-v1