Spaces:
Running
Running
Commit ·
bc7ad85
1
Parent(s): f96988d
CONTRIBUTING: document the stationhouse CLI for finding and claiming work (#156)
Browse files- CONTRIBUTING: document the stationhouse CLI for finding and claiming work (4071a7ec7495272b01ac4bd61af05f2a9d48795b)
- CONTRIBUTING.md +24 -0
CONTRIBUTING.md
CHANGED
|
@@ -100,6 +100,30 @@
|
|
| 100 |
A maintainer will review for factual accuracy of the ground truth before merging.
|
| 101 |
This is the part that matters most, since the whole benchmark's grading depends on it.
|
| 102 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 103 |
## Contributing an experiment that needs a model or compute
|
| 104 |
|
| 105 |
If your experiment requires access to a model or compute you don't have, you don't need
|
|
|
|
| 100 |
A maintainer will review for factual accuracy of the ground truth before merging.
|
| 101 |
This is the part that matters most, since the whole benchmark's grading depends on it.
|
| 102 |
|
| 103 |
+
## Finding and claiming work with the `stationhouse` CLI
|
| 104 |
+
|
| 105 |
+
The [`stationhouse` CLI](https://github.com/likelytobelaura/stationhouse-cli) (alias `sth`)
|
| 106 |
+
is the quickest way to navigate Station House from the terminal: see which tasks are open,
|
| 107 |
+
who is already on one, and put yourself on it. It signs in with your Station House account
|
| 108 |
+
(the same one you use on the website), and many people can share a task, so claiming never
|
| 109 |
+
locks it.
|
| 110 |
+
|
| 111 |
+
```bash
|
| 112 |
+
pip install git+https://github.com/likelytobelaura/stationhouse-cli
|
| 113 |
+
stationhouse login # your Station House email and password, entered locally
|
| 114 |
+
stationhouse unclaimed # open tasks nobody is on
|
| 115 |
+
stationhouse who <task-id> # who is on a task, and whether they're active or stale
|
| 116 |
+
stationhouse claim <task-id> # put yourself on it
|
| 117 |
+
stationhouse mine # your own claims
|
| 118 |
+
stationhouse release <task-id> # take yourself off it
|
| 119 |
+
```
|
| 120 |
+
|
| 121 |
+
Add `--json` to any command for output a script or agent can parse. `stationhouse
|
| 122 |
+
skills-install` installs a skill that lets a Claude Code agent run these commands for you;
|
| 123 |
+
it will ask you to run `login` yourself and only claims a task once you agree. Check `who`
|
| 124 |
+
before claiming so you can coordinate with anyone already on the task. The CLI only covers
|
| 125 |
+
finding and claiming work; submitting is still steps 1-9 above.
|
| 126 |
+
|
| 127 |
## Contributing an experiment that needs a model or compute
|
| 128 |
|
| 129 |
If your experiment requires access to a model or compute you don't have, you don't need
|