File size: 766 Bytes
8b6fc74
 
642190e
 
 
8b6fc74
642190e
8b6fc74
 
 
642190e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
---
title: Interior Edit Study
emoji: 🛋️
colorFrom: indigo
colorTo: green
sdk: docker
app_port: 7860
pinned: false
---

# Interior Edit Study

2AFC annotation app for an image-editing user study. Access is gated by a
study code; judgments are POSTed to the app and synced every 2 minutes to the
private dataset set in `JUDGMENTS_DATASET` (files under `judgments/`, one per
rater×boot session).

Secrets/variables required:

- `HF_TOKEN` (secret): write token for the judgments dataset
- `STUDY_CODE` (secret): the code participants must enter (empty = no gate)
- `JUDGMENTS_DATASET` (variable): e.g. `Elfsong/matreplace_human_eval_judgments`

The annotation bundle lives in `bundle/` (built by
`scripts/human_eval_build_manifest.py` in the ImageFactory repo).