shivs28 commited on
Commit
5ca12b8
·
verified ·
1 Parent(s): 583cb50

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +171 -206
README.md CHANGED
@@ -1,207 +1,172 @@
1
- ---
2
- base_model: shivs28/jee_nujan_mix_v2_base
3
- library_name: peft
4
- pipeline_tag: text-generation
5
- tags:
6
- - base_model:adapter:shivs28/jee_nujan_mix_v2_base
7
- - lora
8
- - transformers
9
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
- # Model Card for Model ID
12
-
13
- <!-- Provide a quick summary of what the model is/does. -->
14
-
15
-
16
-
17
- ## Model Details
18
-
19
- ### Model Description
20
-
21
- <!-- Provide a longer summary of what this model is. -->
22
-
23
-
24
-
25
- - **Developed by:** [More Information Needed]
26
- - **Funded by [optional]:** [More Information Needed]
27
- - **Shared by [optional]:** [More Information Needed]
28
- - **Model type:** [More Information Needed]
29
- - **Language(s) (NLP):** [More Information Needed]
30
- - **License:** [More Information Needed]
31
- - **Finetuned from model [optional]:** [More Information Needed]
32
-
33
- ### Model Sources [optional]
34
-
35
- <!-- Provide the basic links for the model. -->
36
-
37
- - **Repository:** [More Information Needed]
38
- - **Paper [optional]:** [More Information Needed]
39
- - **Demo [optional]:** [More Information Needed]
40
-
41
- ## Uses
42
-
43
- <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
-
45
- ### Direct Use
46
-
47
- <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
-
49
- [More Information Needed]
50
-
51
- ### Downstream Use [optional]
52
-
53
- <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
-
55
- [More Information Needed]
56
-
57
- ### Out-of-Scope Use
58
-
59
- <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
60
-
61
- [More Information Needed]
62
-
63
- ## Bias, Risks, and Limitations
64
-
65
- <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
-
67
- [More Information Needed]
68
-
69
- ### Recommendations
70
-
71
- <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
-
73
- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
-
75
- ## How to Get Started with the Model
76
-
77
- Use the code below to get started with the model.
78
-
79
- [More Information Needed]
80
-
81
- ## Training Details
82
-
83
- ### Training Data
84
-
85
- <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
-
87
- [More Information Needed]
88
-
89
- ### Training Procedure
90
-
91
- <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
-
93
- #### Preprocessing [optional]
94
-
95
- [More Information Needed]
96
-
97
-
98
- #### Training Hyperparameters
99
-
100
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
-
102
- #### Speeds, Sizes, Times [optional]
103
-
104
- <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
-
106
- [More Information Needed]
107
-
108
- ## Evaluation
109
-
110
- <!-- This section describes the evaluation protocols and provides the results. -->
111
-
112
- ### Testing Data, Factors & Metrics
113
-
114
- #### Testing Data
115
-
116
- <!-- This should link to a Dataset Card if possible. -->
117
-
118
- [More Information Needed]
119
-
120
- #### Factors
121
-
122
- <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
-
124
- [More Information Needed]
125
-
126
- #### Metrics
127
-
128
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
-
130
- [More Information Needed]
131
-
132
- ### Results
133
-
134
- [More Information Needed]
135
-
136
- #### Summary
137
-
138
-
139
-
140
- ## Model Examination [optional]
141
-
142
- <!-- Relevant interpretability work for the model goes here -->
143
-
144
- [More Information Needed]
145
-
146
- ## Environmental Impact
147
-
148
- <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
-
150
- Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
-
152
- - **Hardware Type:** [More Information Needed]
153
- - **Hours used:** [More Information Needed]
154
- - **Cloud Provider:** [More Information Needed]
155
- - **Compute Region:** [More Information Needed]
156
- - **Carbon Emitted:** [More Information Needed]
157
-
158
- ## Technical Specifications [optional]
159
-
160
- ### Model Architecture and Objective
161
-
162
- [More Information Needed]
163
-
164
- ### Compute Infrastructure
165
-
166
- [More Information Needed]
167
-
168
- #### Hardware
169
-
170
- [More Information Needed]
171
-
172
- #### Software
173
-
174
- [More Information Needed]
175
-
176
- ## Citation [optional]
177
-
178
- <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
-
180
- **BibTeX:**
181
-
182
- [More Information Needed]
183
-
184
- **APA:**
185
-
186
- [More Information Needed]
187
-
188
- ## Glossary [optional]
189
-
190
- <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
-
192
- [More Information Needed]
193
-
194
- ## More Information [optional]
195
-
196
- [More Information Needed]
197
-
198
- ## Model Card Authors [optional]
199
-
200
- [More Information Needed]
201
-
202
- ## Model Card Contact
203
-
204
- [More Information Needed]
205
- ### Framework versions
206
-
207
- - PEFT 0.17.0
 
1
+ # JEE NUJAN Math Expert 🎯📚
2
+
3
+ **The Ultimate JEE Mathematics AI Tutor - Fine-tuned Specialist**
4
+
5
+ This is a fine-tuned version of [JEE NUJAN Mix v2 Base](https://huggingface.co/shivs28/jee_nujan_mix_v2_base) specifically trained on JEE-style mathematics problems to excel at Indian competitive exam mathematics.
6
+
7
+ ## 🏆 Model Details
8
+
9
+ - **Base Model**: `shivs28/jee_nujan_mix_v2_base`
10
+ - **Fine-tuning Dataset**: 500+ JEE-relevant mathematics problems from MATH dataset
11
+ - **Training Steps**: 150 (optimized for mathematical reasoning)
12
+ - **LoRA Configuration**: Rank 32, Alpha 64 (high-performance setup)
13
+ - **Specialization**: JEE Main & Advanced mathematics problems
14
+
15
+ ## 🎯 Mathematical Capabilities
16
+
17
+ This model excels at:
18
+
19
+ ### Core JEE Topics
20
+ - **Algebra**: Quadratic equations, inequalities, sequences & series
21
+ - **Calculus**: Limits, derivatives, integrals, applications
22
+ - **Coordinate Geometry**: Lines, circles, parabolas, ellipses, hyperbolas
23
+ - **Trigonometry**: Identities, equations, inverse functions
24
+ - **Probability**: Conditional probability, distributions, combinatorics
25
+ - **Number Theory**: Divisibility, modular arithmetic, prime numbers
26
+ - **Vector Algebra**: Dot product, cross product, scalar triple product
27
+
28
+ ### Problem-Solving Approach
29
+ - **Step-by-step Solutions**: Clear mathematical progression
30
+ - **Multiple Methods**: Shows different approaches when applicable
31
+ - **Error Prevention**: Highlights common JEE mistakes
32
+ - **Time-Efficient**: Optimized for exam conditions
33
+
34
+ ## 🚀 Usage Examples
35
+
36
+ ### Basic Usage
37
+ ```python
38
+ from transformers import AutoTokenizer, AutoModelForCausalLM
39
+
40
+ model_name = "shivs28/jee_nujan_math_expert"
41
+ tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
42
+ model = AutoModelForCausalLM.from_pretrained(model_name, trust_remote_code=True)
43
+
44
+ # JEE problem format
45
+ jee_prompt = '''<|problem|>
46
+ Find the number of real solutions of the equation x³ - 3x² + 2x - 1 = 0 in the interval [0, 3].
47
+
48
+ <|solution|>'''
49
+
50
+ inputs = tokenizer(jee_prompt, return_tensors="pt")
51
+ outputs = model.generate(
52
+ **inputs,
53
+ max_length=800,
54
+ temperature=0.1, # Low temperature for mathematical accuracy
55
+ do_sample=True,
56
+ pad_token_id=tokenizer.pad_token_id,
57
+ repetition_penalty=1.05
58
+ )
59
+
60
+ solution = tokenizer.decode(outputs[0], skip_special_tokens=True)
61
+ print(solution)
62
+ ```
63
+
64
+ ### Advanced JEE Problem
65
+ ```python
66
+ complex_problem = '''<|problem|>
67
+ In triangle ABC, if a = 7, b = 8, c = 9, find:
68
+ 1. The area of triangle ABC
69
+ 2. The radius of the circumscribed circle
70
+ 3. The radius of the inscribed circle
71
+
72
+ <|solution|>'''
73
+
74
+ # Generate comprehensive solution
75
+ inputs = tokenizer(complex_problem, return_tensors="pt")
76
+ outputs = model.generate(
77
+ **inputs,
78
+ max_length=1200,
79
+ temperature=0.05, # Very low for multi-step problems
80
+ top_p=0.95,
81
+ do_sample=True,
82
+ pad_token_id=tokenizer.pad_token_id
83
+ )
84
+ ```
85
+
86
+ ## ⚙️ Recommended Generation Settings
87
+
88
+ ### For JEE Main Problems
89
+ ```python
90
+ generation_config = {
91
+ "max_length": 800,
92
+ "temperature": 0.1,
93
+ "top_p": 0.95,
94
+ "do_sample": True,
95
+ "repetition_penalty": 1.05,
96
+ "pad_token_id": tokenizer.pad_token_id
97
+ }
98
+ ```
99
+
100
+ ### For JEE Advanced Problems
101
+ ```python
102
+ advanced_config = {
103
+ "max_length": 1200, # Longer for complex solutions
104
+ "temperature": 0.05, # Very low for accuracy
105
+ "top_p": 0.9,
106
+ "do_sample": True,
107
+ "repetition_penalty": 1.1,
108
+ "pad_token_id": tokenizer.pad_token_id
109
+ }
110
+ ```
111
+
112
+ ## 🎯 Training Details
113
+
114
+ - **Architecture**: LoRA fine-tuning on base model
115
+ - **Training Data**: Carefully curated JEE-relevant problems
116
+ - **Optimization**: Focused on mathematical reasoning patterns
117
+ - **Validation**: Tested on held-out JEE problems
118
+
119
+ ### LoRA Configuration
120
+ - **Rank (r)**: 32
121
+ - **Alpha**: 64
122
+ - **Dropout**: 0.1
123
+ - **Target Modules**: All attention and MLP layers
124
+ - **Trainable Parameters**: ~2.1% of total parameters
125
+
126
+ ## 🏅 Best Practices for JEE Preparation
127
+
128
+ 1. **Use specific problem format**: Always use `<|problem|>` and `<|solution|>` tags
129
+ 2. **Low temperature**: Use 0.05-0.1 for mathematical accuracy
130
+ 3. **Adequate length**: Set max_length based on problem complexity
131
+ 4. **Multiple attempts**: Try different seeds for various solution approaches
132
+ 5. **Verify results**: Always cross-check mathematical calculations
133
+
134
+ ## 📈 Use Cases
135
+
136
+ ### For Students
137
+ - **Practice Problems**: Generate solutions with explanations
138
+ - **Concept Clarification**: Understand mathematical reasoning
139
+ - **Exam Preparation**: Practice with JEE-style problems
140
+ - **Error Analysis**: Learn from common mistakes
141
+
142
+ ### For Educators
143
+ - **Solution Generation**: Create detailed problem solutions
144
+ - **Teaching Aid**: Step-by-step mathematical explanations
145
+ - **Problem Variation**: Generate similar problems for practice
146
+ - **Assessment**: Evaluate student understanding
147
+
148
+ ## 🔧 Technical Specifications
149
+
150
+ - **Base Architecture**: Transformer-based language model
151
+ - **Fine-tuning Method**: LoRA (Low-Rank Adaptation)
152
+ - **Precision**: 16-bit floating point
153
+ - **Context Length**: 768 tokens (optimized for detailed solutions)
154
+ - **Vocabulary**: Extended with mathematical notation
155
+
156
+ ## 📝 Citation
157
+
158
+ If you use this model in your research or educational content, please cite:
159
+
160
+ ```bibtex
161
+ @model{jee_nujan_math_expert,
162
+ title={JEE NUJAN Math Expert: Fine-tuned Mathematics Specialist},
163
+ author={shivs28},
164
+ year={2025},
165
+ url={https://huggingface.co/shivs28/jee_nujan_math_expert}
166
+ }
167
+ ```
168
+
169
+ ## 🤝 Contributing
170
+
171
+ Found an issue or have suggestions? Open an issue on the model repository!
172