PRISM / README.md
nguyenthanhasia's picture
Upload 116 files
9aad4d7 verified
|
Raw
History Blame Contribute Delete
1.5 kB
---
title: PRISM Benchmark
emoji: ๐Ÿ“Š
colorFrom: purple
colorTo: indigo
sdk: docker
pinned: false
---
# PRISM: A Multi-Dimensional Benchmark for Evaluating LLM Peer Reviewers
This is a Hugging Face Space hosting the official project page for **PRISM**, a comprehensive benchmark for evaluating Large Language Models (LLMs) as peer reviewers.
## About PRISM
PRISM is a multi-dimensional benchmark designed to evaluate how well LLMs can perform peer review tasks. The benchmark covers multiple aspects of academic review including:
- **Constructiveness**: Evaluating the quality and helpfulness of feedback
- **Novelty Assessment**: Identifying novel contributions in research papers
- **Flaw Detection**: Identifying weaknesses and issues in academic work
- **Evidence-Based Reasoning**: Assessing how well reviewers ground their feedback
## Links
- **Project Page**: [https://prism-benchmark.github.io](https://prism-benchmark.github.io)
- **Demo**: [https://prism-benchmark.github.io/demo/](https://prism-benchmark.github.io/demo/)
- **ArXiv Paper**: [https://arxiv.org/abs/2605.26730](https://arxiv.org/abs/2605.26730)
- **Hugging Face Paper**: [https://huggingface.co/papers/2605.26730](https://huggingface.co/papers/2605.26730)
- **Full Code Repository**: [https://github.com/prism-benchmark/prism](https://github.com/prism-benchmark/prism)
- **Website Repository**: [https://github.com/prism-benchmark/prism-benchmark.github.io](https://github.com/prism-benchmark/prism-benchmark.github.io)