YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Multi-Agent MMLU Review Board

This repository contains a multi-agent debate and consensus framework evaluated on the MMLU benchmark.

The system runs multiple agents using the same base LLM with different temperatures, iteratively sharing reasoning across rounds and producing a consensus answer via majority vote.

Features

Configurable number of agents and debate rounds
Supports Hugging Face Transformers pipelines
Works with gated models (e.g. LLaMA)
Outputs per-agent responses and consensus accuracy

Usage (Colab)

Open multiagent_mmlu.ipynb
Install dependencies
Login to Hugging Face
Configure model, rounds, and questions
Run evaluation

Notes

This repo does not contain model weights
Users must accept gated model licenses and provide a Hugging Face token
MMLU data is downloaded from the official source at runtime

Credits

Based on the multi-agent debate idea from: https://github.com/composable-models/llm_multiagent_debate

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support