Improve model card: Add pipeline tag, paper link, code link, and sample usage

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +25 -3
README.md CHANGED
@@ -1,10 +1,32 @@
1
  ---
2
- library_name: transformers
3
- license: llama3.2
4
  base_model: meta-llama/Llama-3.2-1B-Instruct
5
  datasets:
6
  - whynlp/gsm8k-aug
 
 
7
  tags: []
 
8
  ---
9
 
10
- Built with Llama
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
 
2
  base_model: meta-llama/Llama-3.2-1B-Instruct
3
  datasets:
4
  - whynlp/gsm8k-aug
5
+ library_name: transformers
6
+ license: llama3.2
7
  tags: []
8
+ pipeline_tag: text-generation
9
  ---
10
 
11
+ # Learning When to Stop: Adaptive Latent Reasoning via Reinforcement Learning
12
+
13
+ This repository contains the `Llama-adaLR-model-latent-6_rl` model, developed as part of the paper [Learning When to Stop: Adaptive Latent Reasoning via Reinforcement Learning](https://huggingface.co/papers/2511.21581).
14
+
15
+ This model introduces adaptive-length latent reasoning models and a post-SFT reinforcement-learning methodology to optimize latent reasoning length by minimizing reasoning length while maintaining accuracy, demonstrating a significant drop in total reasoning length with no penalty to accuracy on the Llama 3.2 1B model and the GSM8K-Aug dataset.
16
+
17
+ Code: https://github.com/apning/adaptive-latent-reasoning
18
+
19
+ ## Sample Usage
20
+
21
+ You can load these models using the function `automodelforcausallm_from_pretrained_latent` from `src.model_creation`, as demonstrated below:
22
+
23
+ ```python
24
+ from transformers import AutoTokenizer
25
+ from src.model_creation import automodelforcausallm_from_pretrained_latent
26
+
27
+ repo_id = "Lapisbird/Llama-adaLR-model-latent-6" # or use "Lapisbird/Llama-adaLR-model-latent-6_rl" for the RL-tuned version
28
+
29
+ model = automodelforcausallm_from_pretrained_latent(repo_id)
30
+ tokenizer = AutoTokenizer.from_pretrained(repo_id)
31
+ ```
32
+ For more detailed instructions and other model checkpoints, please refer to the [GitHub repository](https://github.com/apning/adaptive-latent-reasoning).