Hugging Face's logo

UW-Madison-Lee-Lab
/
VersaPRM

PEFT
Safetensors
Generated from Trainer
Model card Files
xet
Community
1
UW-Madison-Lee-Lab commited on
Commit
9a0804a
·
verified ·
1 Parent(s): b033e37

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [UW-Madison-Lee-Lab/Llama-PRM800K](https://huggingface.co/UW-Madison-Lee-Lab/Llama-PRM800K) on [UW-Madison-Lee-Lab/MMLU-Pro-CoT-Train-Labeled](https://huggingface.co/datasets/UW-Madison-Lee-Lab/MMLU-Pro-CoT-Train-Labeled).
18
 
19
- # Get rewards
20
  ```python
21
  import torch
22
  from transformers import AutoModelForCausalLM, AutoTokenizer
 
16
 
17
  This model is a fine-tuned version of [UW-Madison-Lee-Lab/Llama-PRM800K](https://huggingface.co/UW-Madison-Lee-Lab/Llama-PRM800K) on [UW-Madison-Lee-Lab/MMLU-Pro-CoT-Train-Labeled](https://huggingface.co/datasets/UW-Madison-Lee-Lab/MMLU-Pro-CoT-Train-Labeled).
18
 
19
+ ## Get rewards
20
  ```python
21
  import torch
22
  from transformers import AutoModelForCausalLM, AutoTokenizer