Spaces:
Sleeping
Sleeping
File size: 356 Bytes
30ce988 2cb3f2b 30ce988 2cb3f2b 30ce988 2cb3f2b 30ce988 2cb3f2b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
---
title: CONOZ DPO Project
emoji: 🦆
# red, yellow, green, blue, indigo, purple, pink, gray
colorFrom: blue
colorTo: yellow
sdk: docker
app_port: 8501
pinned: false
short_description: DPO from meta-llama/Llama-3
tags:
- DPO
- RLHF
- Finetuning
- Llama-3.2-1B
- CONOZ
---
# CONOZ DPO Project
meta-llama/Llama-3.1-8B -> choco-conoz/TwinLlama-3.2-1B-DPO |