rshwndsz/ambrosia-binary
Viewer
•
Updated
•
154k
•
1
Janus
Analysing the RLHF pipeline
-
-
rshwndsz/ambrosia-binary-formatted
Viewer • Updated • 154k • 2 -
rshwndsz/ambrosia-binary-formatted-grpo
Viewer • Updated • 154k • 2 -
rshwndsz/ambrosia-binarymagn
Viewer • Updated • 119k • 1 -
rshwndsz/ambrosia-binarymagn-formatted
Viewer • Updated • 119k • 4 -
rshwndsz/ambrosia-binarymagn-formatted-grpo
Viewer • Updated • 119k • 3 -
rshwndsz/ambrosia-single
Viewer • Updated • 125k -
rshwndsz/ambrosia-single-formatted
Viewer • Updated • 251k • 3 -
rshwndsz/ambrosia-single-formatted-grpo
Viewer • Updated • 251k • 5 -
rshwndsz/ambrosia-single-formatted-extended
Viewer • Updated • 250k • 5 -
rshwndsz/ambrosia-ranking
Viewer • Updated • 25k • 2 -
rshwndsz/ambrosia-ranking-formatted
Viewer • Updated • 250k • 9 -
rshwndsz/ambrosia-ranking-formatted-grpo
Viewer • Updated • 250k • 5 -
rshwndsz/tulu-3-sft-mixture-en-2048
Viewer • Updated • 748k • 8 -
rshwndsz/nectar-k5-binarized-noswap
Viewer • Updated • 1.83M • 3 -
rshwndsz/Llama-3.2-1B-SFT
1B • Updated -
rshwndsz/Llama-3.2-3B-SFT
3B • Updated • 1 • 1 -
rshwndsz/Llama-3.1-8B-SFT
8B • Updated • 16 • 1 -
rshwndsz/gemma-3-1b-pt-SFT
1.0B • Updated -
rshwndsz/gemma-3-4b-pt-SFT
4B • Updated -
rshwndsz/gemma-3-12b-pt-SFT
12B • Updated -
rshwndsz/Qwen2.5-0.5B-SFT
0.5B • Updated • 1 -
rshwndsz/Qwen2.5-1.5B-SFT
2B • Updated -
rshwndsz/Qwen2.5-3B-SFT
3B • Updated -
rshwndsz/Qwen2.5-7B-SFT
8B • Updated -
rshwndsz/Llama-3.2-1B-SFT-DPO-bi
1B • Updated -
rshwndsz/Llama-3.2-1B-SFT-DPO-bm
1B • Updated -
rshwndsz/Llama-3.2-1B-SFT-DPO-si
1B • Updated -
rshwndsz/Llama-3.2-1B-SFT-DPO-ra
1B • Updated -
rshwndsz/Llama-3.2-3B-SFT-DPO-bi
3B • Updated • 8 -
rshwndsz/Llama-3.2-3B-SFT-DPO-bm
3B • Updated -
rshwndsz/Llama-3.2-3B-SFT-DPO-si
3B • Updated -
rshwndsz/Llama-3.2-3B-SFT-DPO-ra
3B • Updated -
rshwndsz/Llama-3.1-8B-SFT-DPO-bi
8B • Updated -
rshwndsz/Llama-3.1-8B-SFT-DPO-bm
8B • Updated -
rshwndsz/Llama-3.1-8B-SFT-DPO-si
8B • Updated -
rshwndsz/Llama-3.1-8B-SFT-DPO-ra
8B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-DPO-bi
1.0B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-DPO-bm
1.0B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-DPO-si
1.0B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-DPO-ra
1.0B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-DPO-bm
4B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-DPO-bi
4B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-DPO-si
4B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-DPO-ra
Updated -
rshwndsz/gemma-3-12b-pt-SFT-DPO-bi
12B • Updated -
rshwndsz/gemma-3-12b-pt-SFT-DPO-bm
12B • Updated -
rshwndsz/gemma-3-12b-pt-SFT-DPO-si
12B • Updated -
rshwndsz/gemma-3-12b-pt-SFT-DPO-ra
12B • Updated -
rshwndsz/Llama-3.2-1B-SFT-RM-bi
1B • Updated -
rshwndsz/Llama-3.2-1B-SFT-RM-bm
1B • Updated -
rshwndsz/Llama-3.2-1B-SFT-RM_MRG-bm
1B • Updated • 3 -
rshwndsz/Llama-3.2-1B-SFT-RM-si
1B • Updated -
rshwndsz/Llama-3.2-1B-SFT-RM_MRG-si
1B • Updated • 3 -
rshwndsz/Llama-3.2-1B-SFT-RM-ra
1B • Updated -
rshwndsz/Llama-3.2-1B-SFT-RM_MRG-ra
1B • Updated -
rshwndsz/Llama-3.2-3B-SFT-RM-bi
3B • Updated • 3 -
rshwndsz/Llama-3.2-3B-SFT-RM-bm
3B • Updated -
rshwndsz/Llama-3.2-3B-SFT-RM_MRG-bm
3B • Updated -
rshwndsz/Llama-3.2-3B-SFT-RM-si
3B • Updated -
rshwndsz/Llama-3.2-3B-SFT-RM_MRG-si
3B • Updated • 3 -
rshwndsz/Llama-3.2-3B-SFT-RM-ra
3B • Updated -
rshwndsz/Llama-3.2-3B-SFT-RM_MRG-ra
3B • Updated -
rshwndsz/Llama-3.1-8B-SFT-RM-bi
8B • Updated -
rshwndsz/Llama-3.1-8B-SFT-RM-bm
8B • Updated -
rshwndsz/Llama-3.1-8B-SFT-RM_MRG-bm
8B • Updated -
rshwndsz/Llama-3.1-8B-SFT-RM-si
8B • Updated -
rshwndsz/Llama-3.1-8B-SFT-RM_MRG-si
8B • Updated -
rshwndsz/Llama-3.1-8B-SFT-RM-ra
8B • Updated • 2 -
rshwndsz/Llama-3.1-8B-SFT-RM_MRG-ra
8B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-RM-bi
1.0B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-RM-bm
1.0B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-RM_MRG-bm
1.0B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-RM-si
1.0B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-RM_MRG-si
1.0B • Updated • 1 -
rshwndsz/gemma-3-1b-pt-SFT-RM-ra
1.0B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-RM_MRG-ra
1.0B • Updated -
rshwndsz/Llama-3.2-1B-SFT-DPO-bm-v2
1B • Updated -
rshwndsz/Llama-3.1-8B-SFT-DPO-bm-v2
8B • Updated -
rshwndsz/Llama-3.2-3B-SFT-DPO-si-v2
3B • Updated -
rshwndsz/Llama-3.1-8B-SFT-DPO-si-v2
8B • Updated -
rshwndsz/Llama-3.2-1B-SFT-DPO-si-v2
1B • Updated -
rshwndsz/Llama-3.1-8B-SFT-DPO-ra-v2
8B • Updated -
rshwndsz/Llama-3.2-1B-SFT-DPO-ra-v2
1B • Updated -
rshwndsz/Llama-3.1-8B-SFT-DPO-bi-v2
8B • Updated -
rshwndsz/Llama-3.2-1B-SFT-DPO-bi-v2
1B • Updated -
rshwndsz/Llama-3.2-3B-SFT-DPO-ra-v2
3B • Updated -
rshwndsz/Llama-3.2-3B-SFT-DPO-bi-v2
3B • Updated -
rshwndsz/Llama-3.2-3B-SFT-DPO-bm-v2
3B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-DPO-bm-v2
1.0B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-DPO-bi-v2
1.0B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-DPO-si-v2
1.0B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-DPO-bi-v2
4B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-DPO-bm-v2
4B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-DPO-ra-v2
4B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-DPO-si-v2
4B • Updated -
rshwndsz/gemma-3-1b-pt-SFT-DPO-ra-v2
1.0B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-RM_MRG-bm
4B • Updated • 1 -
rshwndsz/gemma-3-4b-pt-SFT-RM_MRG-ra
4B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-RM-bm
4B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-RM-ra
4B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-RM-si
4B • Updated -
rshwndsz/gemma-3-4b-pt-SFT-RM-bi
4B • Updated -
rshwndsz/nectar-cleaned-r3
Viewer • Updated • 183k • 3 -
rshwndsz/nectar-cleaned-r4
Viewer • Updated • 183k • 3 -
rshwndsz/nectar-cleaned-r5
Viewer • Updated • 183k • 4 -
rshwndsz/nectar-cleaned-r6
Viewer • Updated • 183k • 2 -
rshwndsz/nectar-cleaned-r7
Viewer • Updated • 183k • 3 -
rshwndsz/nectar-cleaned-r3-binarized
Viewer • Updated • 549k • 5 -
rshwndsz/nectar-cleaned-r4-binarized
Viewer • Updated • 1.1M • 2 -
rshwndsz/nectar-cleaned-r5-binarized
Viewer • Updated • 1.83M • 4 -
rshwndsz/nectar-cleaned-r6-binarized
Viewer • Updated • 2.74M • 4 -
rshwndsz/nectar-cleaned-r7-binarized
Viewer • Updated • 3.84M • 3