Welcome to CompUGE

What is Comparative Question Answering?

Comparative question answering (CQA) is a specialized field within natural language processing (NLP) focused on generating responses to questions that require comparing two or more entities across specific attributes or dimensions. This involves identifying the entities and attributes in the query, retrieving relevant information from various sources, and synthesizing this data into a coherent comparison. CQA systems are particularly useful in domains such as e-commerce, healthcare, education, and technology, where users seek detailed comparisons to make informed decisions. These systems face challenges such as handling ambiguous queries, understanding context, ensuring data quality, and developing robust evaluation metrics to assess the accuracy and relevance of the comparisons generated.



What is CompUGE?

CompUGE is an acronym for Comparative Understanding and Generation Evaluation, a platform designed to facilitate research and development in the field of comparative question answering (CQA). The platform provides access to benchmark datasets, evaluation metrics, leaderboards, and submission guidelines for researchers and practitioners working on CQA systems. By offering a centralized hub for sharing resources and comparing performance across different models, CompUGE aims to advance the state of the art in CQA and foster collaboration within the research community.

Here's an example of a comparative question being processes by the CAM 2.0 System introduced in the paper "CAM 2.0: End-to-End Open Domain Comparative Question Answering System" by our team which was presented at LREC-Coling 2024.

What is better: Harry Potter or Lord of the Rings?
Image 1
Image 2
Image 3
Image 4