hkblockchaintechnology commited on
Commit
f3bbd6b
·
verified ·
1 Parent(s): cd22c89

Card exactness: no Windows pixels are pictured, and say why

Browse files
Files changed (1) hide show
  1. README.md +12 -4
README.md CHANGED
@@ -24,7 +24,7 @@ Python standard library.
24
 
25
  > **Status 0.3.0: it drives a real desktop — on Linux and on Windows.** Screen capture,
26
  > an OCR element index with real coordinates, a real mouse click, and a *verified*
27
- > outcome. **All 73 capabilities have a real screenshot** in the [capability gallery](#capability-gallery).
28
  > The loop can be driven from a [marimo console](#the-marimo-console) with a live preview, an
29
  > action log and pause / resume / step; elements can come from the
30
  > [accessibility tree](#what-the-machine-already-knows-the-accessibility-tree) instead of OCR;
@@ -271,6 +271,12 @@ The Windows claims in this card are not taken on faith. A full Windows guest was
271
  and the harness installed inside it, on a headless Linux host with **no KVM** — the same
272
  kind of sandbox the Linux runs above were produced in.
273
 
 
 
 
 
 
 
274
  **What was built.**
275
 
276
  ```
@@ -585,11 +591,11 @@ eleven tasks are a sample, not a survey.
585
 
586
  ## Capability gallery
587
 
588
- **68 capabilities, one screenshot each - and every one of the 141 public callables in the package (functions, methods, classes and protocols) appears in at least one of them**, together with 6 of its public constants.
589
 
590
  Nothing here is a mock-up. Each picture is produced by [`showcase.py`](showcase.py): a command or a call is run for real, and its actual output - or the real desktop it acted on - is what you see. The desktop shots are real screen captures on a real X server (Xvfb, 1280x800), including a real mouse click verified by the target application's own reaction.
591
 
592
- > **An honest note on the platform.** These were captured on Linux, because the sandbox that builds this card has no Windows: no KVM, no QEMU and no Windows image. The harness is OS-agnostic (pyautogui uses `SendInput` on Windows, and `GrabScreen` falls back to Pillow's `ImageGrab`), so these are the same code paths - but they are not Windows pixels. The Windows twins are generated by the same script in [`.github/workflows/live-desktop.yml`](.github/workflows/live-desktop.yml).
593
 
594
  Regenerate it with `python showcase.py` (`--list` to see the ids, `--only <id>` for a subset, `--card` to rewrite this section). It runs the calls for real, so a broken capability fails loudly instead of shipping a stale picture.
595
 
@@ -1248,7 +1254,9 @@ when no verifier is given.
1248
  - [ ] Windows run of the *live desktop* test: the workflow is committed, but it needs a
1249
  GitHub mirror with Actions enabled — Hugging Face does not run GitHub Actions
1250
  - [ ] A **Windows** run of the gallery: the workflow builds it on `windows-latest` (job
1251
- `gallery-windows`), with the same GitHub-mirror caveat
 
 
1252
 
1253
  ## License
1254
 
 
24
 
25
  > **Status 0.3.0: it drives a real desktop — on Linux and on Windows.** Screen capture,
26
  > an OCR element index with real coordinates, a real mouse click, and a *verified*
27
+ > outcome. **All 74 capabilities have a real screenshot** in the [capability gallery](#capability-gallery) (Linux captures).
28
  > The loop can be driven from a [marimo console](#the-marimo-console) with a live preview, an
29
  > action log and pause / resume / step; elements can come from the
30
  > [accessibility tree](#what-the-machine-already-knows-the-accessibility-tree) instead of OCR;
 
271
  and the harness installed inside it, on a headless Linux host with **no KVM** — the same
272
  kind of sandbox the Linux runs above were produced in.
273
 
274
+ > **Provenance.** The numbers below are quoted from that run, not re-measured here, and no
275
+ > picture from it survives: the guest, its disk image and its screenshots went with the
276
+ > container that had produced them. Everything above - the gallery, the live click, the
277
+ > traces - is reproducible from this repository; the Windows results below are a record of
278
+ > what that guest reported.
279
+
280
  **What was built.**
281
 
282
  ```
 
591
 
592
  ## Capability gallery
593
 
594
+ **74 capabilities, one screenshot each - and every one of the 141 public callables in the package (functions, methods, classes and protocols) appears in at least one of them**, together with 6 of its public constants.
595
 
596
  Nothing here is a mock-up. Each picture is produced by [`showcase.py`](showcase.py): a command or a call is run for real, and its actual output - or the real desktop it acted on - is what you see. The desktop shots are real screen captures on a real X server (Xvfb, 1280x800), including a real mouse click verified by the target application's own reaction.
597
 
598
+ > **An honest note on the platform.** These were captured on Linux, because the sandbox that builds this card has no Windows: no KVM, no QEMU and no Windows image. The harness is OS-agnostic (pyautogui uses `SendInput` on Windows, and `GrabScreen` falls back to Pillow's `ImageGrab`), so these are the same code paths - but they are not Windows pixels. There are no Windows pictures here, and that workflow does not by itself produce any: its `windows-latest` job does build the same gallery on real Windows pixels, but it uploads them as a CI **artifact** (`gallery-windows`) - nothing downloads it, re-prefixes the files `win-*`, or appends a section to this card, so an artifact is as far as they get. The Windows screenshots from the guest described [below](#verified-on-real-windows) were lost with the build container that produced them.
599
 
600
  Regenerate it with `python showcase.py` (`--list` to see the ids, `--only <id>` for a subset, `--card` to rewrite this section). It runs the calls for real, so a broken capability fails loudly instead of shipping a stale picture.
601
 
 
1254
  - [ ] Windows run of the *live desktop* test: the workflow is committed, but it needs a
1255
  GitHub mirror with Actions enabled — Hugging Face does not run GitHub Actions
1256
  - [ ] A **Windows** run of the gallery: the workflow builds it on `windows-latest` (job
1257
+ `gallery-windows`), with the same GitHub-mirror caveat - and when it runs, its
1258
+ artifact still has to be imported into `gallery/` as `win-*` and spliced in here;
1259
+ no step does that yet
1260
 
1261
  ## License
1262