File size: 737 Bytes
294a61f
5c6190a
 
 
 
 
 
 
 
 
294a61f
5c6190a
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
---
license: llama3
base_model: aaditya/Llama3-OpenBioLLM-8B
tags:
  - medical
  - llama
  - merged
  - lora
language:
  - en
---

# MediSimplifier — Merged OpenBioLLM-8B

Merged LoRA adapter (r=32, all_attn, rsLoRA) into `aaditya/Llama3-OpenBioLLM-8B` for medical text simplification.

**Built with Meta Llama 3.** Released under the [Llama 3 Community License](https://llama.meta.com/llama3/license/).

Base model: `aaditya/Llama3-OpenBioLLM-8B` (Llama-3-based)
Fine-tuning: LoRA r=32, target modules Q/K/V/O, 3 epochs on GuyDor007/medisimplifier-dataset
Evaluation: ROUGE-L 0.6638 on 1,001-sample test split

For details, see [github.com/deepset01-sys/medisimplifier-nebius](https://github.com/deepset01-sys/medisimplifier-nebius).