Spaces:
Sleeping
Sleeping
File size: 2,293 Bytes
4febfbc 5dfbe24 4febfbc 5dfbe24 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 |
---
title: Brainbench
emoji: 🦀
colorFrom: gray
colorTo: purple
sdk: docker
pinned: false
short_description: Implementing the braingpt model
---
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
This app currently uses **GPT-2** as the model engine for generating and evaluating abstracts.
---
## 🚀 Features
- 🧪 Presents users with neuroscience abstracts (either original or altered).
- ✅ Users decide if an abstract is AI-modified and rate their confidence.
- 🤖 GPT-2 model evaluates the same abstract.
- 📊 Results compare user guesses vs model output in a clear, styled interface.
- 📂 Backed by a curated dataset hosted on Hugging Face Datasets.
- 🛠️ Fully Dockerized FastAPI application deployed via Hugging Face Spaces.
---
## 📦 Tech Stack
- **Frontend**: Jinja2 + Tailwind-style CSS
- **Backend**: FastAPI
- **Model**: `gpt2` via Hugging Face Transformers
- **Hosting**: Hugging Face Spaces (Docker SDK)
- **Dataset**: Custom neuroscience benchmark (Parquet format)
---
## 🔧 Endpoints
- `/`: Home page
- `/start`: Begin a new session (random abstract trials)
- `/trial`: Active abstract assessment
- `/submit-trial`: Submit a response, compare with model
- `/results`: View summary of performance
- `/predict`: POST endpoint used internally to get GPT-2 output
---
## 🧠 Example Use Case
1. A neuroscience researcher lands on the app.
2. They read an abstract and guess whether it’s been altered.
3. They rate their confidence.
4. GPT-2 also analyzes the abstract.
5. After 3 rounds, the app displays a comparison: who got what right?
---
## 📌 Current Model
- Model: [`gpt2`](https://huggingface.co/gpt2)
- Reason: Fast, lightweight, deployable in CPU-only Spaces
- Coming Soon: `BrainGPT` (a PEFT fine-tuned model on neuroscience texts)
---
## 🗺️ Roadmap
- [x] Replace GPT-2 with BrainGPT once optimized
- [ ] Add leaderboard tracking
- [ ] Improve GPT model alignment with truth labels
- [ ] Expand dataset with more domains
---
## 🧪 Try It Live
👉 [BrainBench on Hugging Face Spaces](https://huggingface.co/spaces/AndaiMD/brainbench)
---
## 🙌 Credits
Built by **Dr. David Andai** — a general practitioner & data scientist passionate about mental health and AI. |