Add pipeline tag, library name, and paper link

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +12 -4
README.md CHANGED
@@ -1,12 +1,20 @@
1
  ---
2
  base_model: openai/gpt-oss-20b
3
- datasets: [hewittlab/monitor_cot_for_hack-coding]
4
- tags: [tinker, lora, reward-hacking, chain-of-thought, monitorability]
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  # monitor_cot_for_hack-baseline-coding-explicit_intent-gpt-oss-20b
8
 
9
- LoRA checkpoints from *Reward Misspecification Degrades Chain-of-Thought Monitorability* ([code](https://github.com/Lorenayannnnn/reward-misspecification-degrades-cot-monitorability)).
10
 
11
  - **Base model**: [`openai/gpt-oss-20b`](https://huggingface.co/openai/gpt-oss-20b) (LoRA rank 32)
12
  - **Training**: Baseline training with GRPO
@@ -52,4 +60,4 @@ weights.build_hf_model(base_model=snapshot_download("openai/gpt-oss-20b", ignore
52
 
53
  tokenizer = AutoTokenizer.from_pretrained("./merged_model")
54
  model = AutoModelForCausalLM.from_pretrained("./merged_model", dtype="auto", device_map="auto")
55
- ```
 
1
  ---
2
  base_model: openai/gpt-oss-20b
3
+ datasets:
4
+ - hewittlab/monitor_cot_for_hack-coding
5
+ tags:
6
+ - tinker
7
+ - lora
8
+ - reward-hacking
9
+ - chain-of-thought
10
+ - monitorability
11
+ library_name: transformers
12
+ pipeline_tag: text-generation
13
  ---
14
 
15
  # monitor_cot_for_hack-baseline-coding-explicit_intent-gpt-oss-20b
16
 
17
+ LoRA checkpoints from *[Reward Misspecification Degrades Chain-of-Thought Monitorability](https://huggingface.co/papers/2610.28303)* ([code](https://github.com/Lorenayannnnn/reward-misspecification-degrades-cot-monitorability)).
18
 
19
  - **Base model**: [`openai/gpt-oss-20b`](https://huggingface.co/openai/gpt-oss-20b) (LoRA rank 32)
20
  - **Training**: Baseline training with GRPO
 
60
 
61
  tokenizer = AutoTokenizer.from_pretrained("./merged_model")
62
  model = AutoModelForCausalLM.from_pretrained("./merged_model", dtype="auto", device_map="auto")
63
+ ```