| --- |
| title: Judge-GPT |
| emoji: ⚖️ |
| colorFrom: yellow |
| colorTo: red |
| sdk: gradio |
| sdk_version: 6.17.3 |
| app_file: app.py |
| pinned: false |
| license: mit |
| short_description: AI-native miniature trials under 32B. |
| --- |
| |
| # Judge-GPT |
|
|
| Judge-GPT is a cinematic Gradio Space for the Build Small Hackathon's Thousand Token Wood track. It runs two-minute AI-native miniature trials where small-model agents act as advocates, judge, jurors, clerk, and evidence auditor. |
|
|
| The app is built to stay under the 32B named-model budget: |
|
|
| - `openai/gpt-oss-20b` for primary legal reasoning. |
| - `openbmb/AgentCPM-Explore` for clerk/stage/verdict style. |
| - `nvidia/Nemotron-Orchestrator-8B` for juror and evidence-auditor review. |
|
|
| Total named budget: 32B parameters. |
|
|
| ## What the app can do |
|
|
| - Run cached trials for the Socrates and Barnaby demo cases without network search. |
| - Run the Live Search Tribunal path, which builds a search packet from a user query and stops if live material is too weak to support a trial. |
| - Add a hypothetical sidebar to shift the framing of a trial without editing cached case files. |
| - Switch trial pacing between swift, measured, and ceremonial speeds. |
| - Stage the courtroom with phase-specific visuals, agent puppets, evidence props, captions, and browser audio cues. |
| - Show the Mind Layer as a compact JSON trace of agent turns and phase metadata. |
| - Call a Modal streaming endpoint when `MODAL_TRIAL_URL` is configured. Endpoint or model failures stop the trial instead of substituting cached dialogue. |
| - Retain decree and agent-trace export helpers in `sovereign_bench/export.py` for future UI restoration. |
|
|
| ## Limitations |
|
|
| - Judge-GPT is not legal advice and should not be used for real legal decisions. |
| - Live search snippets are not independently verified by the app. |
| - Output quality depends on Modal GPU availability, token limits, and the configured Hugging Face models. |
| - Model, Modal, or live retrieval failures stop the current trial rather than returning substitute courtroom dialogue. |
| - Trial results are not persisted across sessions. |
| - Export generation remains in the codebase, but the visible download UI is currently hidden. |
|
|
| ## Run locally |
|
|
| ```powershell |
| python -m pip install -r requirements.txt |
| python app.py |
| ``` |
|
|
| ## Modal backend |
|
|
| The Gradio app works locally without Modal. If `MODAL_TRIAL_URL` is set, the Space calls the Modal streaming endpoint and stops the trial if the endpoint is unavailable. |
|
|
| The deployed Modal endpoint runs each role prompt through a GPU-backed vLLM class on H100 by default. Traces mark successful GPU calls with `runtime: modal-gpu-vllm`, `provider: modal-gpu-vllm`, and `gpu: H100`. If a GPU/model load fails, the trial stops; the app does not substitute provider or cached dialogue. |
|
|
| ```powershell |
| python -m modal deploy modal_app.py |
| ``` |
|
|
| Keep the deployed endpoint URL as a Hugging Face Space variable named `MODAL_TRIAL_URL`. |
|
|
| ## Project targets |
|
|
| Workspace connected to: |
|
|
| - GitHub: `https://github.com/aliiqbal24/BuildSmallfinal.git` |
| - Modal profile: `ali-j-iqbal24` |
| - Hugging Face user: `AliIqbal05` |
|
|
| ## Secrets |
|
|
| Credentials are not committed to this repo. |
|
|
| - Local Hugging Face CLI auth is stored in the Hugging Face cache. |
| - Modal auth is stored in the local Modal profile. |
| - Modal has a secret named `huggingface` with `HF_TOKEN`. |
|
|
| Use the Modal secret in functions like this: |
|
|
| ```python |
| @app.function(secrets=[modal.Secret.from_name("huggingface")]) |
| def run_model(): |
| token = os.getenv("HF_TOKEN") |
| ``` |
|
|
| ## Developer guide |
|
|
| - `app.py`: Gradio UI, CSS, JavaScript audio hooks, HTML renderers, and Modal/local streaming switch. |
| - `sovereign_bench/engine.py`: trial phases, agent orchestration, verdict assembly, and trace construction. |
| - `sovereign_bench/llm.py`: Hugging Face calls, strict model error handling, and prompt building. |
| - `sovereign_bench/retrieval.py`: live search packet construction. |
| - `sovereign_bench/models.py`: Pydantic schemas for cases, evidence, events, turns, votes, and verdicts. |
| - `sovereign_bench/cases.py`: cached demo case packets. |
| - `sovereign_bench/export.py`: dormant decree and trace writers. |
| - `modal_app.py`: Modal deployment and GPU-backed streaming endpoint. |
| - `tests/`: engine, case, and rendering regression coverage. |
|
|
| ## Verify Modal to Hugging Face |
|
|
| ```powershell |
| python -m modal run modal_app.py |
| ``` |
|
|
