Text Generation
Transformers
Safetensors
English
qwen2
conversational
text-generation-inference
krogoldAI commited on
Commit
35c60e9
·
verified ·
1 Parent(s): 52c7873

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -165,14 +165,21 @@ $$ -\frac{1}{\log n}\sum_{j=1}^n p_j \log(p_j+\delta) $$
165
 
166
  where \\( (p_j)_{1\leq j\leq n} \\) are the confidence scores, \\( n \\) is the number of confidence scores, \\( \log n \\) is the maximum possible entropy and \\( \delta = 10^{-8} \\) is a small regularization constant. This penalizes overly skewed distributions (e.g., `0.9`/`0.1` splits) in favor of more balanced confidence allocations when multiple interpretations are plausible. Additional penalties were applied for structural issues (missing attributes) and for outputs that attempted to answer queries rather than analyze them.
167
 
 
 
168
  ### Phase 2: Breadth-Focused Supervised Fine-Tuning
 
169
  Following structural learning through GRPO, the model underwent supervised fine-tuning on the complete [krogoldAI/rag-query-analysis](https://huggingface.co/datasets/krogoldAI/rag-query-analysis) dataset (7,305 examples) for 2 epochs with a learning rate of 2e-5. This phase captured broad semantic patterns across diverse query types and domains.
170
 
 
 
171
  ### Phase 3: Depth-Focused Supervised Fine-Tuning
 
172
  The final phase focused on precision refinement using only the highest-quality 3,660 examples from [krogoldAI/rag-query-analysis](https://huggingface.co/datasets/krogoldAI/rag-query-analysis), i.e., those examples where the judge LLM assigned perfect scores. This "polish" phase was trained for 3 epochs with a learning rate of 2e-5 to maximize learning from gold-standard examples.
173
 
174
  This progressive training approach ensures the model achieves both reliable formatting and nuanced semantic understanding. All training was performed on an NVIDIA A100 SXM GPU.
175
 
 
176
 
177
  ## Model Capabilities
178
 
 
165
 
166
  where \\( (p_j)_{1\leq j\leq n} \\) are the confidence scores, \\( n \\) is the number of confidence scores, \\( \log n \\) is the maximum possible entropy and \\( \delta = 10^{-8} \\) is a small regularization constant. This penalizes overly skewed distributions (e.g., `0.9`/`0.1` splits) in favor of more balanced confidence allocations when multiple interpretations are plausible. Additional penalties were applied for structural issues (missing attributes) and for outputs that attempted to answer queries rather than analyze them.
167
 
168
+ The training code and the reward function code can be found <ins>here</ins> and <ins>here</ins>, respectively.
169
+
170
  ### Phase 2: Breadth-Focused Supervised Fine-Tuning
171
+
172
  Following structural learning through GRPO, the model underwent supervised fine-tuning on the complete [krogoldAI/rag-query-analysis](https://huggingface.co/datasets/krogoldAI/rag-query-analysis) dataset (7,305 examples) for 2 epochs with a learning rate of 2e-5. This phase captured broad semantic patterns across diverse query types and domains.
173
 
174
+ The training code can be found <ins>here</ins>.
175
+
176
  ### Phase 3: Depth-Focused Supervised Fine-Tuning
177
+
178
  The final phase focused on precision refinement using only the highest-quality 3,660 examples from [krogoldAI/rag-query-analysis](https://huggingface.co/datasets/krogoldAI/rag-query-analysis), i.e., those examples where the judge LLM assigned perfect scores. This "polish" phase was trained for 3 epochs with a learning rate of 2e-5 to maximize learning from gold-standard examples.
179
 
180
  This progressive training approach ensures the model achieves both reliable formatting and nuanced semantic understanding. All training was performed on an NVIDIA A100 SXM GPU.
181
 
182
+ The training code can be found <ins>here</ins>.
183
 
184
  ## Model Capabilities
185