hkblockchaintechnology commited on
Commit
4ed9d79
·
verified ·
1 Parent(s): f3bbd6b

Notebook: corrected card text

Browse files
Files changed (1) hide show
  1. tiny_computer_agent_app.py +12 -9
tiny_computer_agent_app.py CHANGED
@@ -37,7 +37,6 @@ with app.setup:
37
  from tiny_computer_agent.trace import Scenario, benchmark
38
 
39
 
40
-
41
  @app.cell(hide_code=True)
42
  def readme():
43
  readme_md = r'''
@@ -66,7 +65,7 @@ def readme():
66
 
67
  > **Status 0.3.0: it drives a real desktop — on Linux and on Windows.** Screen capture,
68
  > an OCR element index with real coordinates, a real mouse click, and a *verified*
69
- > outcome. **All 73 capabilities have a real screenshot** in the [capability gallery](#capability-gallery).
70
  > The loop can be driven from a [marimo console](#the-marimo-console) with a live preview, an
71
  > action log and pause / resume / step; elements can come from the
72
  > [accessibility tree](#what-the-machine-already-knows-the-accessibility-tree) instead of OCR;
@@ -313,6 +312,12 @@ def readme():
313
  and the harness installed inside it, on a headless Linux host with **no KVM** — the same
314
  kind of sandbox the Linux runs above were produced in.
315
 
 
 
 
 
 
 
316
  **What was built.**
317
 
318
  ```
@@ -627,11 +632,11 @@ def readme():
627
 
628
  ## Capability gallery
629
 
630
- **68 capabilities, one screenshot each - and every one of the 141 public callables in the package (functions, methods, classes and protocols) appears in at least one of them**, together with 6 of its public constants.
631
 
632
  Nothing here is a mock-up. Each picture is produced by [`showcase.py`](showcase.py): a command or a call is run for real, and its actual output - or the real desktop it acted on - is what you see. The desktop shots are real screen captures on a real X server (Xvfb, 1280x800), including a real mouse click verified by the target application's own reaction.
633
 
634
- > **An honest note on the platform.** These were captured on Linux, because the sandbox that builds this card has no Windows: no KVM, no QEMU and no Windows image. The harness is OS-agnostic (pyautogui uses `SendInput` on Windows, and `GrabScreen` falls back to Pillow's `ImageGrab`), so these are the same code paths - but they are not Windows pixels. The Windows twins are generated by the same script in [`.github/workflows/live-desktop.yml`](.github/workflows/live-desktop.yml).
635
 
636
  Regenerate it with `python showcase.py` (`--list` to see the ids, `--only <id>` for a subset, `--card` to rewrite this section). It runs the calls for real, so a broken capability fails loudly instead of shipping a stale picture.
637
 
@@ -1290,7 +1295,9 @@ def readme():
1290
  - [ ] Windows run of the *live desktop* test: the workflow is committed, but it needs a
1291
  GitHub mirror with Actions enabled — Hugging Face does not run GitHub Actions
1292
  - [ ] A **Windows** run of the gallery: the workflow builds it on `windows-latest` (job
1293
- `gallery-windows`), with the same GitHub-mirror caveat
 
 
1294
 
1295
  ## License
1296
 
@@ -1506,7 +1513,6 @@ def card_preview(readme_md):
1506
  ]
1507
  )
1508
  )
1509
-
1510
  return
1511
 
1512
 
@@ -1626,7 +1632,6 @@ def scoreboard():
1626
  ),
1627
  ]
1628
  )
1629
-
1630
  return
1631
 
1632
 
@@ -1658,7 +1663,6 @@ def console_setup():
1658
  "signature": None,
1659
  "kill": str(Path(tempfile.gettempdir()) / "tiny-computer-agent.console.STOP"),
1660
  }
1661
-
1662
  return (
1663
  console_brain,
1664
  console_goal,
@@ -1778,7 +1782,6 @@ def console(
1778
  mo.image(_preview) if _preview is not None else mo.md("_no frame yet_"),
1779
  mo.ui.table(_rows, selection=None) if _rows else mo.md("_no actions yet_"),
1780
  ])
1781
-
1782
  return
1783
 
1784
 
 
37
  from tiny_computer_agent.trace import Scenario, benchmark
38
 
39
 
 
40
  @app.cell(hide_code=True)
41
  def readme():
42
  readme_md = r'''
 
65
 
66
  > **Status 0.3.0: it drives a real desktop — on Linux and on Windows.** Screen capture,
67
  > an OCR element index with real coordinates, a real mouse click, and a *verified*
68
+ > outcome. **All 74 capabilities have a real screenshot** in the [capability gallery](#capability-gallery) (Linux captures).
69
  > The loop can be driven from a [marimo console](#the-marimo-console) with a live preview, an
70
  > action log and pause / resume / step; elements can come from the
71
  > [accessibility tree](#what-the-machine-already-knows-the-accessibility-tree) instead of OCR;
 
312
  and the harness installed inside it, on a headless Linux host with **no KVM** — the same
313
  kind of sandbox the Linux runs above were produced in.
314
 
315
+ > **Provenance.** The numbers below are quoted from that run, not re-measured here, and no
316
+ > picture from it survives: the guest, its disk image and its screenshots went with the
317
+ > container that had produced them. Everything above - the gallery, the live click, the
318
+ > traces - is reproducible from this repository; the Windows results below are a record of
319
+ > what that guest reported.
320
+
321
  **What was built.**
322
 
323
  ```
 
632
 
633
  ## Capability gallery
634
 
635
+ **74 capabilities, one screenshot each - and every one of the 141 public callables in the package (functions, methods, classes and protocols) appears in at least one of them**, together with 6 of its public constants.
636
 
637
  Nothing here is a mock-up. Each picture is produced by [`showcase.py`](showcase.py): a command or a call is run for real, and its actual output - or the real desktop it acted on - is what you see. The desktop shots are real screen captures on a real X server (Xvfb, 1280x800), including a real mouse click verified by the target application's own reaction.
638
 
639
+ > **An honest note on the platform.** These were captured on Linux, because the sandbox that builds this card has no Windows: no KVM, no QEMU and no Windows image. The harness is OS-agnostic (pyautogui uses `SendInput` on Windows, and `GrabScreen` falls back to Pillow's `ImageGrab`), so these are the same code paths - but they are not Windows pixels. There are no Windows pictures here, and that workflow does not by itself produce any: its `windows-latest` job does build the same gallery on real Windows pixels, but it uploads them as a CI **artifact** (`gallery-windows`) - nothing downloads it, re-prefixes the files `win-*`, or appends a section to this card, so an artifact is as far as they get. The Windows screenshots from the guest described [below](#verified-on-real-windows) were lost with the build container that produced them.
640
 
641
  Regenerate it with `python showcase.py` (`--list` to see the ids, `--only <id>` for a subset, `--card` to rewrite this section). It runs the calls for real, so a broken capability fails loudly instead of shipping a stale picture.
642
 
 
1295
  - [ ] Windows run of the *live desktop* test: the workflow is committed, but it needs a
1296
  GitHub mirror with Actions enabled — Hugging Face does not run GitHub Actions
1297
  - [ ] A **Windows** run of the gallery: the workflow builds it on `windows-latest` (job
1298
+ `gallery-windows`), with the same GitHub-mirror caveat - and when it runs, its
1299
+ artifact still has to be imported into `gallery/` as `win-*` and spliced in here;
1300
+ no step does that yet
1301
 
1302
  ## License
1303
 
 
1513
  ]
1514
  )
1515
  )
 
1516
  return
1517
 
1518
 
 
1632
  ),
1633
  ]
1634
  )
 
1635
  return
1636
 
1637
 
 
1663
  "signature": None,
1664
  "kill": str(Path(tempfile.gettempdir()) / "tiny-computer-agent.console.STOP"),
1665
  }
 
1666
  return (
1667
  console_brain,
1668
  console_goal,
 
1782
  mo.image(_preview) if _preview is not None else mo.md("_no frame yet_"),
1783
  mo.ui.table(_rows, selection=None) if _rows else mo.md("_no actions yet_"),
1784
  ])
 
1785
  return
1786
 
1787