spankevich commited on
Commit
c30957a
·
verified ·
1 Parent(s): 2d33196

spankevich/llm-hw-2-reward-model

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -1,6 +1,5 @@
1
  ---
2
  base_model: HuggingFaceTB/SmolLM-135M-Instruct
3
- datasets: HumanLLMs/Human-Like-DPO-Dataset
4
  library_name: transformers
5
  model_name: trainer_output
6
  tags:
@@ -12,7 +11,7 @@ licence: license
12
 
13
  # Model Card for trainer_output
14
 
15
- This model is a fine-tuned version of [HuggingFaceTB/SmolLM-135M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM-135M-Instruct) on the [HumanLLMs/Human-Like-DPO-Dataset](https://huggingface.co/datasets/HumanLLMs/Human-Like-DPO-Dataset) dataset.
16
  It has been trained using [TRL](https://github.com/huggingface/trl).
17
 
18
  ## Quick start
 
1
  ---
2
  base_model: HuggingFaceTB/SmolLM-135M-Instruct
 
3
  library_name: transformers
4
  model_name: trainer_output
5
  tags:
 
11
 
12
  # Model Card for trainer_output
13
 
14
+ This model is a fine-tuned version of [HuggingFaceTB/SmolLM-135M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM-135M-Instruct).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start