File size: 2,736 Bytes
a611633
88d98bf
a611633
88d98bf
a611633
 
 
88d98bf
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
---
title: Math Tutor Response Annotation Demo
sdk: docker
app_port: 7860
pinned: false
---

# Math Tutor Response Annotation Demo

This folder is a self-contained Potato annotation demo for:

`annotated_data/math_annotator_train&test_sets_simple_2q_train_2q_test.xlsx`

It follows the same broad structure as Kseniia's Hugging Face Space: a Potato
`config.yaml`, prepared CSV data with an HTML display field, and Docker files
for Hugging Face Spaces.

## Files

- `config.yaml`: Potato task configuration and the 10 tutor-evaluation dimensions.
- `layouts/task_layout.html`: Potato-generated annotation form layout for the 10 dimensions.
- `scripts/prepare_potato_data.py`: Converts the Excel workbook into Potato CSV/JSON.
- `scripts/check_data.py`: Validates generated CSV/JSON files.
- `my-annotation-task/data/math_annotator_demo_all_with_id_text2show.csv`: Combined train/test demo data.
- `my-annotation-task/data/math_annotator_training_set_with_id_text2show.csv`: Training split only.
- `my-annotation-task/data/math_annotator_testing_set_with_id_text2show.csv`: Testing split only.
- `my-annotation-task/data/training_questions.json`: Known-label training items generated from the train sheet.
- `my-annotation-task/data/gold_standards.json`: Known-label gold items generated from the test sheet.
- `Dockerfile`, `requirements.txt`, `hf_start.py`: Hugging Face Spaces runtime.

## Regenerate Data

From the repository root:

```bash
python3 math_potato_annotation_demo/scripts/prepare_potato_data.py
python3 math_potato_annotation_demo/scripts/check_data.py
```

Expected generated counts:

- 14 train items
- 14 test items
- 28 combined demo items

## Run Locally

```bash
cd math_potato_annotation_demo
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
python hf_start.py
```

Then open:

`http://localhost:7860`

## Deploy to Hugging Face Spaces

1. Create a new Hugging Face Space with SDK type `Docker`.
2. Upload or push the contents of this folder to the Space repository.
3. Let the Space build from `Dockerfile`.
4. For persistent annotation backups, set an `HF_TOKEN` Space secret and enable a
   backup/export workflow before collecting real annotations.

## Notes

- The first demo uses `math_annotator_demo_all_with_id_text2show.csv`, so both
  train and test examples are visible in one annotation queue.
- `training_questions.json` and `gold_standards.json` are generated and ready
  for a later qualification/QC pass, but the blocks in `config.yaml` are kept
  commented for the first UI demo to reduce startup risk.
- The UI itself is Potato's built-in UI. The custom part here is only CSS/JS in
  `custom_footer_html` to show one dimension at a time, similar to the screenshot.