Spaces:
Sleeping
A newer version of the Gradio SDK is available: 6.13.0
title: ECHOscore
emoji: π
colorFrom: blue
colorTo: pink
sdk: gradio
sdk_version: 5.30.0
app_file: app.py
pinned: false
license: cc-by-nc-sa-4.0
short_description: Evaluator Cockpit for Harmony Outcomes
β οΈ This is a demo version of ECHOscore.
Data contribution, uploads, and edits are not supported.
To try the full version, please download the desktop release.
π§ ECHOscore: Evaluator Cockpit for Harmony Outcomes
ECHOscore is a modular evaluation cockpit designed to measure not just the correctness of outputs, but the harmony between prompts and responsesβthe resonance that defines meaningful alignment.
π Why ECHOscore?
ECHOscore is a lightweight, modular evaluation tool for LLM prompts and outputs.
π Features
- β Supports OpenAI, ChatCompletion, LaaJ, DeepEval, OVAL...
- π§ Alternative to LangSmith, but simpler and more customizable
- π¦ Plug-and-play scoring rubrics
- π Structured CSV export for QA teams
- π οΈ Python-native, easy integration with
eval.pyscripts
π₯ ECHOscore = Fast + Flexible + Free
β¨ Features
- π§ͺ Tri-system scoring: Human, OVAL, and DeepEval
- π Radar chart visualization with Plotly
- π§ Stable score hashing for consistent outputs
- π§Ό Network slang annotation (placeholder-ready)
- πΎ Export evaluation results as CSV
- π§© Modular architecture for easy customization
π¦ Modules Overview
| Module | Description |
|---|---|
app.py |
Gradio-based UI interface |
eval_core.py |
Main orchestrator: scoring, charting, export |
scoring_utils.py |
Stable scoring + explanation generators |
radar_chart.py |
Radar chart creation (Plotly) |
export_utils.py |
CSV generation |
config.py |
Dimensions, system lists, color map |
slang_parser.py |
Network slang cleaner (user notes) |
π‘ Philosophy
ECHOscore reflects the principle of human-machine complementarity. It doesn't replace human judgment but amplifies it β allowing humans and models to evaluate collaboratively with clarity, granularity, and oversight.
π‘ License
MIT or cc-by-nc-sa-4.0 (as defined in LICENSE file).
For development and commercial usage inquiries, please contact the author.
π€ Acknowledgments
Built with β€οΈ by a human-AI co-pilot team.
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference