Text Generation
PEFT
Safetensors
Transformers
English
grpo
lora
trl
unsloth

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Model Card for Raven-reasoning

LLM-orchetrasted agents for the autonomous discovery of novel materials with agentic reasoning. This LLM model is a fine-tuned version of unsloth/qwen2.5-32b-bnb-4bit and post-trained wit GRPO.

Model Details

Model Description

  • Developed by: Renjie Li
  • Funded by [optional]: IIDAI, IBM
  • Shared by [optional]: [More Information Needed]
  • Model type: LoRA
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Finetuned from model [optional]: Qwen2.5-32B-Instruct

Model Sources [optional]

Quick start

from transformers import pipeline

question = "You are Raven's inverse polymer design model.\nGiven target material properties, reason about the molecular features needed,\nthen propose one chemically plausible candidate."
generator = pipeline("text-generation", model="None", device="cuda")
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
print(output["generated_text"])

Training procedure

This model was trained with GRPO on the QuantumChem-200k dataset, a method introduced in DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models.

Framework versions

  • PEFT 0.19.1
  • TRL: 0.23.0
  • Transformers: 4.57.1
  • Pytorch: 2.6.0
  • Datasets: 4.3.0
  • Tokenizers: 0.22.1

Citations

Cite GRPO as:

@article{shao2024deepseekmath,
    title        = {{DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models}},
    author       = {Zhihong Shao and Peiyi Wang and Qihao Zhu and Runxin Xu and Junxiao Song and Mingchuan Zhang and Y. K. Li and Y. Wu and Daya Guo},
    year         = 2024,
    eprint       = {arXiv:2402.03300},
}

Cite TRL as:

@misc{vonwerra2022trl,
    title        = {{TRL: Transformer Reinforcement Learning}},
    author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
    year         = 2020,
    journal      = {GitHub repository},
    publisher    = {GitHub},
    howpublished = {\url{https://github.com/huggingface/trl}}
}
Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train arcadianlee/Raven-reasoning-1.0

Papers for arcadianlee/Raven-reasoning-1.0