ForgottenAreeb's picture
Upload folder using huggingface_hub
378976c verified
metadata
language:
  - ta
base_model: Qwen/Qwen3-1.7B
tags:
  - fine-tuned
  - indian-languages
  - rajasthan
  - lora
  - ai4bharat
license: apache-2.0

AI4Bharat State Expert — Rajasthan

Fine-tuned Qwen3-1.7B on AI4Bharat Indic Languages dataset for Rajasthan. Trained at SRMIST Vadapalani AI4Bharat Tune-Athon (Feb 26, 2026). Checkpoint: saved.

Training

Param Value
Base Qwen3-1.7B 4-bit
Modules q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
Splits indic + conv + cult

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("ForgottenAreeb/AI4Bharat-State-Expert-Rajasthan")
tok = AutoTokenizer.from_pretrained("ForgottenAreeb/AI4Bharat-State-Expert-Rajasthan")

Merged FP16 model — no PEFT required.