AhmedMostafa commited on
Commit
7f6e762
·
verified ·
1 Parent(s): 2ad4762

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -46,7 +46,7 @@ Key features include:
46
  - **Number of Parameters**: 32.8B
47
  - **Number of Parameters (Non-Embedding)**: 31.2B
48
  - **Context Length**: 32,768 tokens natively, extensible to 131,072 with YaRN
49
- - **Training Data**: 107,033 synthetic medical reasoning examples + MedReason dataset (32,682 examples)
50
  - **Fine-tuning Method**: DoRA + rsLoRA (Parameter-Efficient Fine-Tuning)
51
  - **Alignment**: Group Relative Policy Optimization (GRPO)
52
 
@@ -152,7 +152,7 @@ Step 6: Plan immediate management - dual antiplatelet, anticoagulation, cath lab
152
  ## Training Methodology
153
 
154
  ### Stage 1: Supervised Fine-Tuning (SFT)
155
- - **Dataset**: 107,033 synthetic medical reasoning examples + MedReason dataset
156
  - **Techniques**: DoRA + rsLoRA with rank 256
157
  - **Focus**: Structured clinical reasoning across diagnostic, therapeutic, and prognostic scenarios
158
 
@@ -246,7 +246,6 @@ This model is released under the Apache 2.0 License. Please review the license t
246
 
247
  For questions about Gazal-R1, please contact:
248
  - **Research Team**: TachyHealth
249
- - **Primary Contact**: Ahmed M. Adly (amostafa@tachyhealth.com)
250
  - **Website**: [https://tachyhealth.com/](https://tachyhealth.com/)
251
 
252
  ---
 
46
  - **Number of Parameters**: 32.8B
47
  - **Number of Parameters (Non-Embedding)**: 31.2B
48
  - **Context Length**: 32,768 tokens natively, extensible to 131,072 with YaRN
49
+ - **Training Data**: 107,033 synthetic medical reasoning examples + [MedReason dataset](https://huggingface.co/datasets/UCSC-VLAA/MedReason) (32,682 examples)
50
  - **Fine-tuning Method**: DoRA + rsLoRA (Parameter-Efficient Fine-Tuning)
51
  - **Alignment**: Group Relative Policy Optimization (GRPO)
52
 
 
152
  ## Training Methodology
153
 
154
  ### Stage 1: Supervised Fine-Tuning (SFT)
155
+ - **Dataset**: 107,033 synthetic medical reasoning examples + [MedReason dataset](https://huggingface.co/datasets/UCSC-VLAA/MedReason)
156
  - **Techniques**: DoRA + rsLoRA with rank 256
157
  - **Focus**: Structured clinical reasoning across diagnostic, therapeutic, and prognostic scenarios
158
 
 
246
 
247
  For questions about Gazal-R1, please contact:
248
  - **Research Team**: TachyHealth
 
249
  - **Website**: [https://tachyhealth.com/](https://tachyhealth.com/)
250
 
251
  ---