Update README.md
Browse files
README.md
CHANGED
|
@@ -46,7 +46,7 @@ Key features include:
|
|
| 46 |
- **Number of Parameters**: 32.8B
|
| 47 |
- **Number of Parameters (Non-Embedding)**: 31.2B
|
| 48 |
- **Context Length**: 32,768 tokens natively, extensible to 131,072 with YaRN
|
| 49 |
-
- **Training Data**: 107,033 synthetic medical reasoning examples + MedReason dataset (32,682 examples)
|
| 50 |
- **Fine-tuning Method**: DoRA + rsLoRA (Parameter-Efficient Fine-Tuning)
|
| 51 |
- **Alignment**: Group Relative Policy Optimization (GRPO)
|
| 52 |
|
|
@@ -152,7 +152,7 @@ Step 6: Plan immediate management - dual antiplatelet, anticoagulation, cath lab
|
|
| 152 |
## Training Methodology
|
| 153 |
|
| 154 |
### Stage 1: Supervised Fine-Tuning (SFT)
|
| 155 |
-
- **Dataset**: 107,033 synthetic medical reasoning examples + MedReason dataset
|
| 156 |
- **Techniques**: DoRA + rsLoRA with rank 256
|
| 157 |
- **Focus**: Structured clinical reasoning across diagnostic, therapeutic, and prognostic scenarios
|
| 158 |
|
|
@@ -246,7 +246,6 @@ This model is released under the Apache 2.0 License. Please review the license t
|
|
| 246 |
|
| 247 |
For questions about Gazal-R1, please contact:
|
| 248 |
- **Research Team**: TachyHealth
|
| 249 |
-
- **Primary Contact**: Ahmed M. Adly (amostafa@tachyhealth.com)
|
| 250 |
- **Website**: [https://tachyhealth.com/](https://tachyhealth.com/)
|
| 251 |
|
| 252 |
---
|
|
|
|
| 46 |
- **Number of Parameters**: 32.8B
|
| 47 |
- **Number of Parameters (Non-Embedding)**: 31.2B
|
| 48 |
- **Context Length**: 32,768 tokens natively, extensible to 131,072 with YaRN
|
| 49 |
+
- **Training Data**: 107,033 synthetic medical reasoning examples + [MedReason dataset](https://huggingface.co/datasets/UCSC-VLAA/MedReason) (32,682 examples)
|
| 50 |
- **Fine-tuning Method**: DoRA + rsLoRA (Parameter-Efficient Fine-Tuning)
|
| 51 |
- **Alignment**: Group Relative Policy Optimization (GRPO)
|
| 52 |
|
|
|
|
| 152 |
## Training Methodology
|
| 153 |
|
| 154 |
### Stage 1: Supervised Fine-Tuning (SFT)
|
| 155 |
+
- **Dataset**: 107,033 synthetic medical reasoning examples + [MedReason dataset](https://huggingface.co/datasets/UCSC-VLAA/MedReason)
|
| 156 |
- **Techniques**: DoRA + rsLoRA with rank 256
|
| 157 |
- **Focus**: Structured clinical reasoning across diagnostic, therapeutic, and prognostic scenarios
|
| 158 |
|
|
|
|
| 246 |
|
| 247 |
For questions about Gazal-R1, please contact:
|
| 248 |
- **Research Team**: TachyHealth
|
|
|
|
| 249 |
- **Website**: [https://tachyhealth.com/](https://tachyhealth.com/)
|
| 250 |
|
| 251 |
---
|