chambul's picture
Upload README.md with huggingface_hub
5c6190a verified
|
Raw
History Blame Contribute Delete
737 Bytes
---
license: llama3
base_model: aaditya/Llama3-OpenBioLLM-8B
tags:
- medical
- llama
- merged
- lora
language:
- en
---
# MediSimplifier — Merged OpenBioLLM-8B
Merged LoRA adapter (r=32, all_attn, rsLoRA) into `aaditya/Llama3-OpenBioLLM-8B` for medical text simplification.
**Built with Meta Llama 3.** Released under the [Llama 3 Community License](https://llama.meta.com/llama3/license/).
Base model: `aaditya/Llama3-OpenBioLLM-8B` (Llama-3-based)
Fine-tuning: LoRA r=32, target modules Q/K/V/O, 3 epochs on GuyDor007/medisimplifier-dataset
Evaluation: ROUGE-L 0.6638 on 1,001-sample test split
For details, see [github.com/deepset01-sys/medisimplifier-nebius](https://github.com/deepset01-sys/medisimplifier-nebius).