Safetensors
English
qwen3_5
RickySkywalkerAWS commited on
Commit
c80a70a
·
verified ·
1 Parent(s): 9d32ec9

Add LAR-9B model card and performance figure

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +78 -0
  3. assets/ResultPlot.png +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/ResultPlot.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,81 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ datasets:
4
+ - nebius/SWE-rebench
5
+ language:
6
+ - en
7
+ base_model:
8
+ - Qwen/Qwen3.5-9B
9
  ---
10
+
11
+ # LAR-9B
12
+
13
+ This is the official model repository for **Agentic RL Model with Process Reward with Lean 4 (LAR)**.
14
+ ## Model performance
15
+
16
+ ## Main Results
17
+
18
+ ![ResultPlot](./assets/ResultPlot.png)
19
+
20
+ | Model | Size | SWE-Bench-Verified | TB-2.0 | TB-2.1 |
21
+ |:------|:----:|--------------------:|---------:|---------:|
22
+ | **LAR-9B** | 9B | **64.2%** | **32.8%** | **29.5%** |
23
+ | **LAR-27B** | 27B | **84.2%** | **68.2%** | **77.3%** |
24
+
25
+
26
+ ### 1. Install dependencies
27
+ #### 1.1 Install environment
28
+ ```bash
29
+ # Install the corresponding environment
30
+ # (run from the repository root; needs python3.12 + venv, git, docker with compose v2 (user in the docker group), sudo,
31
+ # an NVIDIA driver and CUDA toolkit for CUDA 13; MODEL = local LAR-9B checkpoint, WORK = work dir on a fast local disk)
32
+ export MODEL=/path/to/LAR-9B WORK=/path/to/local/disk/tb21
33
+ python3.12 -m venv ~/.venvs/lar-serve
34
+ ~/.venvs/lar-serve/bin/pip install -r PSWF/EvaluationKit/TB-2.1/requirements/serve.txt ./PSWF/EvaluationKit/TB-2.1
35
+ python3.12 -m venv ~/.venvs/lar-eval
36
+ ~/.venvs/lar-eval/bin/pip install -r PSWF/EvaluationKit/TB-2.1/requirements/eval.txt ./PSWF/Harness/Terminus-2 ./PSWF/EvaluationKit/TB-2.1
37
+ ~/.venvs/lar-eval/bin/python -m pswf_harbor_patches --tokenizer-dir $MODEL
38
+ ```
39
+
40
+ #### 1.2 Init TB-2.1 containers
41
+
42
+ ```bash
43
+ # Initialize the TB-2.1 containers
44
+ ~/.venvs/lar-eval/bin/python -m tb21_eval.prepare --work-dir $WORK
45
+ sudo ~/.venvs/lar-eval/bin/python -m tb21_eval.netguard up --work-dir $WORK
46
+ ~/.venvs/lar-eval/bin/python -m tb21_eval.netguard probe --work-dir $WORK
47
+ ```
48
+
49
+ ### 2. Run TB-2.1 evaluation using PSWF with Terminus-2
50
+
51
+ ```bash
52
+ # Run the evaluation
53
+ ~/.venvs/lar-serve/bin/python -m tb21_eval.serve up --model $MODEL --work-dir $WORK
54
+ ~/.venvs/lar-eval/bin/python -m tb21_eval.make_job --model $MODEL --work-dir $WORK --run-dir $WORK/runs/x5 --n-attempts 5 --n-concurrent 40
55
+ setsid nohup ~/.venvs/lar-eval/bin/harbor run -c $WORK/runs/x5/job.json --env-file $WORK/runs/x5/harbor.env > $WORK/runs/x5/harbor.log 2>&1 &
56
+ # ~16 h in the background; score at any time (if harbor was interrupted: ~/.venvs/lar-eval/bin/python -m tb21_eval.resume --run-dir $WORK/runs/x5)
57
+ ~/.venvs/lar-eval/bin/python -m tb21_eval.score $WORK/runs/x5
58
+ ```
59
+
60
+ ## Training Data and Methodology
61
+
62
+ The released checkpoint is post-trained from `Qwen/Qwen3.5-9B` (licensed under Apache License 2.0) using Lean4AgenticRL process reward methods. This version was trained only on a filtered subset of SWE-Rebench containing software-engineering task examples from public code repositories. The underlying repository licenses were verified at the pinned base commits, and only examples meeting the license-filtering criteria were retained.
63
+
64
+ ## Responsible AI Considerations
65
+
66
+ At Amazon, we are committed to developing AI responsibly and take a people-centric approach that prioritizes education, science, and our customers, to integrate responsible AI across the end-to-end AI lifecycle. We believe the use of AI must respect the rule of law and human rights, and we encourage the safe and responsible development of AI. When downloaded or used in accordance with [AWS Responsible AI Policy](https://aws.amazon.com/ai/responsible-ai/policy/), developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.
67
+
68
+ Please report model quality, risk, security vulnerabilities or Amazon AI Concerns [here](https://pages.awscloud.com/global-ln-gc-400-ai-service-cards-contact-us-registration.html).
69
+
70
+ ## Reference
71
+
72
+ If you find our work useful, please cite it using the BibTeX entry below. This entry currently links to the PDF hosted on GitHub and will be updated once the arXiv version is available.
73
+
74
+ ```bibtex
75
+ @misc{wang2026lean4agenticrl,
76
+ title={{Lean4AgenticRL}: Advancing Agentic {RL} with Verifiable Multi-level Process Rewards},
77
+ author={Ruida Wang and Gerald Friedland and Tong Zhang and Chris Kong},
78
+ year={2026},
79
+ note={Preprint},
80
+ }
81
+ ```
assets/ResultPlot.png ADDED

Git LFS Details

  • SHA256: c8e749678f845091fb73dbf53930be14d5f87133beb94e03e7640b146ec1fa2f
  • Pointer size: 131 Bytes
  • Size of remote file: 627 kB