README.md

---
license: apache-2.0
library_name: transformers
pipeline_tag: text-generation
---

# GRACE: Discriminator-Guided Chain-of-Thought Reasoning

This repository contains a fine-tuned FLAN-T5 model as presented in the paper [GRACE: Discriminator-Guided Chain-of-Thought Reasoning](https://huggingface.co/papers/2305.14934).

## Model Description
GRACE (Guiding chain-of-thought ReAsoning with a CorrectnEss Discriminator) is a stepwise decoding approach that steers the decoding process towards producing correct reasoning steps. It employs a step-level verifier or discriminator trained with a contrastive loss over correct and incorrect steps, which is used during decoding to score next-step candidates based on their correctness. This specific checkpoint serves as the generator model fine-tuned for reasoning tasks.

- **Repository:** https://github.com/mukhal/grace
- **Paper:** [GRACE: Discriminator-Guided Chain-of-Thought Reasoning](https://huggingface.co/papers/2305.14934)

## Citation
If you use this model or code, please consider citing the following paper:
```bibtex
@article{khalifa2023grace,
  title={Grace: Discriminator-guided chain-of-thought reasoning},
  author={Khalifa, Muhammad and Logeswaran, Lajanugen and Lee, Moontae and Lee, Honglak and Wang, Lu},
  journal={arXiv preprint arXiv:2305.14934},
  year={2023}
}
```