Spaces:
Sleeping
Sleeping
| title: Brainbench | |
| emoji: 🦀 | |
| colorFrom: gray | |
| colorTo: purple | |
| sdk: docker | |
| pinned: false | |
| short_description: Implementing the braingpt model | |
| Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference | |
| This app currently uses **GPT-2** as the model engine for generating and evaluating abstracts. | |
| --- | |
| ## 🚀 Features | |
| - 🧪 Presents users with neuroscience abstracts (either original or altered). | |
| - ✅ Users decide if an abstract is AI-modified and rate their confidence. | |
| - 🤖 GPT-2 model evaluates the same abstract. | |
| - 📊 Results compare user guesses vs model output in a clear, styled interface. | |
| - 📂 Backed by a curated dataset hosted on Hugging Face Datasets. | |
| - 🛠️ Fully Dockerized FastAPI application deployed via Hugging Face Spaces. | |
| --- | |
| ## 📦 Tech Stack | |
| - **Frontend**: Jinja2 + Tailwind-style CSS | |
| - **Backend**: FastAPI | |
| - **Model**: `gpt2` via Hugging Face Transformers | |
| - **Hosting**: Hugging Face Spaces (Docker SDK) | |
| - **Dataset**: Custom neuroscience benchmark (Parquet format) | |
| --- | |
| ## 🔧 Endpoints | |
| - `/`: Home page | |
| - `/start`: Begin a new session (random abstract trials) | |
| - `/trial`: Active abstract assessment | |
| - `/submit-trial`: Submit a response, compare with model | |
| - `/results`: View summary of performance | |
| - `/predict`: POST endpoint used internally to get GPT-2 output | |
| --- | |
| ## 🧠 Example Use Case | |
| 1. A neuroscience researcher lands on the app. | |
| 2. They read an abstract and guess whether it’s been altered. | |
| 3. They rate their confidence. | |
| 4. GPT-2 also analyzes the abstract. | |
| 5. After 3 rounds, the app displays a comparison: who got what right? | |
| --- | |
| ## 📌 Current Model | |
| - Model: [`gpt2`](https://huggingface.co/gpt2) | |
| - Reason: Fast, lightweight, deployable in CPU-only Spaces | |
| - Coming Soon: `BrainGPT` (a PEFT fine-tuned model on neuroscience texts) | |
| --- | |
| ## 🗺️ Roadmap | |
| - [x] Replace GPT-2 with BrainGPT once optimized | |
| - [ ] Add leaderboard tracking | |
| - [ ] Improve GPT model alignment with truth labels | |
| - [ ] Expand dataset with more domains | |
| --- | |
| ## 🧪 Try It Live | |
| 👉 [BrainBench on Hugging Face Spaces](https://huggingface.co/spaces/AndaiMD/brainbench) | |
| --- | |
| ## 🙌 Credits | |
| Built by **Dr. David Andai** — a general practitioner & data scientist passionate about mental health and AI. |