license: cc-by-nc-4.0
datasets:
- PhysicsWallahAI/JEE-Main-2025-Math
language:
- en
base_model:
- distilbert/distilbert-base-uncased
pipeline_tag: question-answering
tags:
- math
- PhysicsWallah
- JEE
- mathematics
library_name: transformers
DistilBERT JEE MCQ Classifier
This model is a fine-tuned DistilBERT (base uncased) designed to classify correct answers for JEE-style multiple-choice math questions. It selects the correct option among four choices (A, B, C, D).
Training Data
Source: PhysicsWallahAI JEE Main 2025 Math dataset (Jan + Apr shifts)
Filtered: Only multiple-choice questions (MCQs) were used.
Size: Combined January and April shifts, split into 80% train and 20% test.
Training Details
Base model: distilbert-base-uncased
Epochs: 10
Batch size: 4
Learning rate: 1e-5
Weight decay: 0.1
Results
Evaluation accuracy: 40%
Evaluation loss: ~1.42
Limitations
Accuracy is higher than random guess (25%) but not suitable for real exam preparation.
Trained only on Math MCQs from JEE Main 2025 dataset.
Does not handle numerical/subjective questions.
Intended Use
Research and experimentation with MCQ-style classification.
Baseline model for further fine-tuning or impro
License: cc-by-nc-4.0