Notebook: corrected card text
Browse files- tiny_computer_agent_app.py +12 -9
tiny_computer_agent_app.py
CHANGED
|
@@ -37,7 +37,6 @@ with app.setup:
|
|
| 37 |
from tiny_computer_agent.trace import Scenario, benchmark
|
| 38 |
|
| 39 |
|
| 40 |
-
|
| 41 |
@app.cell(hide_code=True)
|
| 42 |
def readme():
|
| 43 |
readme_md = r'''
|
|
@@ -66,7 +65,7 @@ def readme():
|
|
| 66 |
|
| 67 |
> **Status 0.3.0: it drives a real desktop — on Linux and on Windows.** Screen capture,
|
| 68 |
> an OCR element index with real coordinates, a real mouse click, and a *verified*
|
| 69 |
-
> outcome. **All
|
| 70 |
> The loop can be driven from a [marimo console](#the-marimo-console) with a live preview, an
|
| 71 |
> action log and pause / resume / step; elements can come from the
|
| 72 |
> [accessibility tree](#what-the-machine-already-knows-the-accessibility-tree) instead of OCR;
|
|
@@ -313,6 +312,12 @@ def readme():
|
|
| 313 |
and the harness installed inside it, on a headless Linux host with **no KVM** — the same
|
| 314 |
kind of sandbox the Linux runs above were produced in.
|
| 315 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 316 |
**What was built.**
|
| 317 |
|
| 318 |
```
|
|
@@ -627,11 +632,11 @@ def readme():
|
|
| 627 |
|
| 628 |
## Capability gallery
|
| 629 |
|
| 630 |
-
**
|
| 631 |
|
| 632 |
Nothing here is a mock-up. Each picture is produced by [`showcase.py`](showcase.py): a command or a call is run for real, and its actual output - or the real desktop it acted on - is what you see. The desktop shots are real screen captures on a real X server (Xvfb, 1280x800), including a real mouse click verified by the target application's own reaction.
|
| 633 |
|
| 634 |
-
> **An honest note on the platform.** These were captured on Linux, because the sandbox that builds this card has no Windows: no KVM, no QEMU and no Windows image. The harness is OS-agnostic (pyautogui uses `SendInput` on Windows, and `GrabScreen` falls back to Pillow's `ImageGrab`), so these are the same code paths - but they are not Windows pixels.
|
| 635 |
|
| 636 |
Regenerate it with `python showcase.py` (`--list` to see the ids, `--only <id>` for a subset, `--card` to rewrite this section). It runs the calls for real, so a broken capability fails loudly instead of shipping a stale picture.
|
| 637 |
|
|
@@ -1290,7 +1295,9 @@ def readme():
|
|
| 1290 |
- [ ] Windows run of the *live desktop* test: the workflow is committed, but it needs a
|
| 1291 |
GitHub mirror with Actions enabled — Hugging Face does not run GitHub Actions
|
| 1292 |
- [ ] A **Windows** run of the gallery: the workflow builds it on `windows-latest` (job
|
| 1293 |
-
`gallery-windows`), with the same GitHub-mirror caveat
|
|
|
|
|
|
|
| 1294 |
|
| 1295 |
## License
|
| 1296 |
|
|
@@ -1506,7 +1513,6 @@ def card_preview(readme_md):
|
|
| 1506 |
]
|
| 1507 |
)
|
| 1508 |
)
|
| 1509 |
-
|
| 1510 |
return
|
| 1511 |
|
| 1512 |
|
|
@@ -1626,7 +1632,6 @@ def scoreboard():
|
|
| 1626 |
),
|
| 1627 |
]
|
| 1628 |
)
|
| 1629 |
-
|
| 1630 |
return
|
| 1631 |
|
| 1632 |
|
|
@@ -1658,7 +1663,6 @@ def console_setup():
|
|
| 1658 |
"signature": None,
|
| 1659 |
"kill": str(Path(tempfile.gettempdir()) / "tiny-computer-agent.console.STOP"),
|
| 1660 |
}
|
| 1661 |
-
|
| 1662 |
return (
|
| 1663 |
console_brain,
|
| 1664 |
console_goal,
|
|
@@ -1778,7 +1782,6 @@ def console(
|
|
| 1778 |
mo.image(_preview) if _preview is not None else mo.md("_no frame yet_"),
|
| 1779 |
mo.ui.table(_rows, selection=None) if _rows else mo.md("_no actions yet_"),
|
| 1780 |
])
|
| 1781 |
-
|
| 1782 |
return
|
| 1783 |
|
| 1784 |
|
|
|
|
| 37 |
from tiny_computer_agent.trace import Scenario, benchmark
|
| 38 |
|
| 39 |
|
|
|
|
| 40 |
@app.cell(hide_code=True)
|
| 41 |
def readme():
|
| 42 |
readme_md = r'''
|
|
|
|
| 65 |
|
| 66 |
> **Status 0.3.0: it drives a real desktop — on Linux and on Windows.** Screen capture,
|
| 67 |
> an OCR element index with real coordinates, a real mouse click, and a *verified*
|
| 68 |
+
> outcome. **All 74 capabilities have a real screenshot** in the [capability gallery](#capability-gallery) (Linux captures).
|
| 69 |
> The loop can be driven from a [marimo console](#the-marimo-console) with a live preview, an
|
| 70 |
> action log and pause / resume / step; elements can come from the
|
| 71 |
> [accessibility tree](#what-the-machine-already-knows-the-accessibility-tree) instead of OCR;
|
|
|
|
| 312 |
and the harness installed inside it, on a headless Linux host with **no KVM** — the same
|
| 313 |
kind of sandbox the Linux runs above were produced in.
|
| 314 |
|
| 315 |
+
> **Provenance.** The numbers below are quoted from that run, not re-measured here, and no
|
| 316 |
+
> picture from it survives: the guest, its disk image and its screenshots went with the
|
| 317 |
+
> container that had produced them. Everything above - the gallery, the live click, the
|
| 318 |
+
> traces - is reproducible from this repository; the Windows results below are a record of
|
| 319 |
+
> what that guest reported.
|
| 320 |
+
|
| 321 |
**What was built.**
|
| 322 |
|
| 323 |
```
|
|
|
|
| 632 |
|
| 633 |
## Capability gallery
|
| 634 |
|
| 635 |
+
**74 capabilities, one screenshot each - and every one of the 141 public callables in the package (functions, methods, classes and protocols) appears in at least one of them**, together with 6 of its public constants.
|
| 636 |
|
| 637 |
Nothing here is a mock-up. Each picture is produced by [`showcase.py`](showcase.py): a command or a call is run for real, and its actual output - or the real desktop it acted on - is what you see. The desktop shots are real screen captures on a real X server (Xvfb, 1280x800), including a real mouse click verified by the target application's own reaction.
|
| 638 |
|
| 639 |
+
> **An honest note on the platform.** These were captured on Linux, because the sandbox that builds this card has no Windows: no KVM, no QEMU and no Windows image. The harness is OS-agnostic (pyautogui uses `SendInput` on Windows, and `GrabScreen` falls back to Pillow's `ImageGrab`), so these are the same code paths - but they are not Windows pixels. There are no Windows pictures here, and that workflow does not by itself produce any: its `windows-latest` job does build the same gallery on real Windows pixels, but it uploads them as a CI **artifact** (`gallery-windows`) - nothing downloads it, re-prefixes the files `win-*`, or appends a section to this card, so an artifact is as far as they get. The Windows screenshots from the guest described [below](#verified-on-real-windows) were lost with the build container that produced them.
|
| 640 |
|
| 641 |
Regenerate it with `python showcase.py` (`--list` to see the ids, `--only <id>` for a subset, `--card` to rewrite this section). It runs the calls for real, so a broken capability fails loudly instead of shipping a stale picture.
|
| 642 |
|
|
|
|
| 1295 |
- [ ] Windows run of the *live desktop* test: the workflow is committed, but it needs a
|
| 1296 |
GitHub mirror with Actions enabled — Hugging Face does not run GitHub Actions
|
| 1297 |
- [ ] A **Windows** run of the gallery: the workflow builds it on `windows-latest` (job
|
| 1298 |
+
`gallery-windows`), with the same GitHub-mirror caveat - and when it runs, its
|
| 1299 |
+
artifact still has to be imported into `gallery/` as `win-*` and spliced in here;
|
| 1300 |
+
no step does that yet
|
| 1301 |
|
| 1302 |
## License
|
| 1303 |
|
|
|
|
| 1513 |
]
|
| 1514 |
)
|
| 1515 |
)
|
|
|
|
| 1516 |
return
|
| 1517 |
|
| 1518 |
|
|
|
|
| 1632 |
),
|
| 1633 |
]
|
| 1634 |
)
|
|
|
|
| 1635 |
return
|
| 1636 |
|
| 1637 |
|
|
|
|
| 1663 |
"signature": None,
|
| 1664 |
"kill": str(Path(tempfile.gettempdir()) / "tiny-computer-agent.console.STOP"),
|
| 1665 |
}
|
|
|
|
| 1666 |
return (
|
| 1667 |
console_brain,
|
| 1668 |
console_goal,
|
|
|
|
| 1782 |
mo.image(_preview) if _preview is not None else mo.md("_no frame yet_"),
|
| 1783 |
mo.ui.table(_rows, selection=None) if _rows else mo.md("_no actions yet_"),
|
| 1784 |
])
|
|
|
|
| 1785 |
return
|
| 1786 |
|
| 1787 |
|