CIA-4B / README.md
iaa01's picture
Update README.md
6cc86e6 verified
---
license: mit
base_model:
- Klingspor/lta_singleturn_hard_sft_qwen3-4b
---
# ∆Belief-RL Post-trained Model
This model is a reinforcement learning (RL) post-trained language model optimized with the ∆Belief reward signal introduced in [∆Belief-RL](https://bethgelab.github.io/delta-belief-rl/).
Instead of relying solely on sparse success signals, the model is rewarded for reducing its own belief uncertainty over time. This enables dense feedback and turn-level credit assignment in long-horizon, open-ended information-seeking tasks.
The model was trained in the *Twenty Questions* environment and learns general information-seeking strategies that generalize beyond the training horizon.
## Resources
- 🌐 Project page: https://bethgelab.github.io/delta-belief-rl/
- 💻 Code repository: https://github.com/bethgelab/delta-belief-rl