README.md

---
language:
- en
license: apache-2.0
base_model: Qwen/Qwen3-0.6B
tags:
- qwen3
- fine-tuned
- web-development
- coding
- sft
pipeline_tag: text-generation
---

# qwen3-webdev-0.6b

A fine-tuned version of [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B) on a curated dataset of real-world web development Q&A.

## Model Description

This model is fine-tuned to answer junior-to-mid-level web development questions covering HTML, CSS, JavaScript, React, APIs, and common frontend/backend concepts.

- **Base model:** Qwen/Qwen3-0.6B
- **Fine-tuning method:** Supervised Fine-Tuning (SFT) with TRL
- **Dataset:** 307 real web development Q&A pairs (interview-style)
- **Training:** 3 epochs, final loss 0.7072
- **Hardware:** NVIDIA RTX 4090 Mobile (16GB)

## Intended Use

- Learning tool for web development concepts
- Junior dev quick-reference assistant
- Demo of efficient small-model fine-tuning pipeline

## Training Details

| Parameter | Value |
|---|---|
| Base model | Qwen3-0.6B |
| Dataset size | 307 examples |
| Epochs | 3 |
| Final train loss | 0.7072 |
| Precision | bfloat16 |

## Usage

```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model = AutoModelForCausalLM.from_pretrained("PacificDev/qwen3-webdev-0.6b", dtype=torch.bfloat16)
tokenizer = AutoTokenizer.from_pretrained("PacificDev/qwen3-webdev-0.6b")

prompt = "What is the difference between flexbox and CSS grid?"
inputs = tokenizer(f"Question: {prompt}\nAnswer:", return_tensors="pt")
output = model.generate(**inputs, max_new_tokens=300, temperature=0.7, do_sample=True)
print(tokenizer.decode(output[0], skip_special_tokens=True))
```

## Limitations

- Small model (0.6B params) — answers are concise/simplified
- Dataset is limited to 307 examples — may not cover all topics
- Outputs `<think>` reasoning tags (Qwen3 chain-of-thought)
- Not suitable for production use without further evaluation

## License

Apache 2.0 (same as base model)