File size: 578 Bytes
2ae7d39 56d8582 0b79738 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 | ---
base_model:
- meta-llama/Llama-3.1-8B-Instruct
license: llama3
---
This repo contains RiskAgent model finetuned from meta-llama/Llama-3.1-8B-Instruct model using risk prediction data. More detail can be found from the [Github](https://github.com/AI-in-Health/RiskAgent)
The model was trained with the following hypermeters:
- cutoff_len: 3096
- num_train_epochs: 5
- learning_rate: 1.0e-4
- warnup_ratio: 0.1
- batch_size: 32
- finetuning_type: lora
Prior to utilizing our model, please ensure you have obtained the Llama licensing and access rights to the Llama model. |