Sync model repo (text/metadata)

.python-version

@@ -0,0 +1 @@
+3.12

README.md

@@ -52,10 +52,14 @@ This version demonstrates efficient inference on Arm-based platforms while prese
 | `deit-tiny_ethos_ethosu_optimized.pte` | Arm-optimized model for deployment |
 | `config.yaml` | Model I/O contract used by the example |
 | `benchmarks/` | FP32 baseline and Arm-optimized benchmark records |
+| `example.py` | Minimal inference example |
+| `pyproject.toml` | Pinned runtime dependencies and deployment metadata |
+| `uv.lock` | Locked dependency versions, sources, and hashes for `uv sync --frozen` |
+| `install_ethos_u85_graviton.sh` | Standalone installer that builds the Ethos-U85 execution stack (Arm GNU toolchain, ExecuTorch bare-metal runtime, `arm_executor_runner`, Corstone-320 FVP) required to run `example.py`. Installs into a shared, cross-model directory if `sudo` is available, otherwise falls back to a local install for this bundle only |
 
 ## Performance
 
-Performance was measured on the reference configuration below. Results make the optimization reproducible but do not guarantee identical performance on every Arm-based system.
+Performance was measured on the reference configuration below.
 
 **Reference configuration**
 
@@ -83,6 +87,8 @@ The "Original / baseline" model size is the FP32 PyTorch state dict.
 
 Because the Ethos-U85 NPU architecture natively processes integer workloads and does not support floating-point execution, the FP32 baseline cannot be compiled into an Ethos-U85 delegate `.pte` file, making NPU-accelerated baseline latency and throughput figures non-applicable.
 
+The Graviton environment documented for `example.py` verifies portability of the inference flow but does not provide or imply equivalent Graviton performance.
+
 ## Accuracy
 
 Accuracy was evaluated on the ImageNet-1k validation split, comparing the FP32 baseline against the Arm-optimized INT8 model via a PyTorch FP32-vs-PT2E INT8 simulation, not on the exported `.pte` running on Ethos-U85.
@@ -127,6 +133,41 @@ Most quantized layers use INT8 activations and INT8 weights (a8w8). Selected out
 
 The goal of this process is to improve deployment characteristics such as latency, memory use, model size, and runtime compatibility while preserving the model's intended behavior. Detailed conversion scripts, calibration configuration, or backend-specific implementation details may be provided separately where appropriate.
 
+## Using this model
+
+Run the standalone installer to build the Ethos-U85 execution stack that the example needs:
+
+The installer uses a shared /opt/ethos-u85-graviton runtime when sudo is available, reusing existing builds across model bundles. Without sudo, it automatically falls back to a local runtime/ installation. A custom location can be set with ETHOS_RUNTIME_DIR, and existing installations are detected before rebuilding.
+
+```bash
+bash install_ethos_u85_graviton.sh
+```
+
+This is necessary because the `.pte` cannot run on a plain Python/ExecuTorch install — it requires Ethos-U85 hardware or the Corstone-320 FVP (see Limitations). The script installs the Arm GNU toolchain, the ExecuTorch 1.1.0 bare-metal runtime libraries (built from source), the Ethos-U85 semihosting runner (`arm_executor_runner`), and the Arm Corstone-320 FVP that `example.py` uses to simulate the Cortex-M55 + Ethos-U85 target.
+
+Dependencies are declared in `pyproject.toml`, which ships with this repository. Resolve and install them into a local virtual environment with uv:
+
+```bash
+uv python install
+uv sync --frozen
+```
+
+### Run the example
+
+```bash
+uv run example.py
+```
+
+The default run prints predictions without overwriting the reference `predictions.json`. To save a separate result for comparison, pass an explicit destination:
+
+```bash
+uv run example.py --output /tmp/deit-predictions.json
+```
+
+The reference `predictions.json` records the known-good result for the committed `sample_input.jpg`. The example uses the FVP to validate the Ethos-U85 runtime path; it is not a Python-native inference path for this PTE.
+
+Note: The Python/uv example runs on AWS Graviton (Ubuntu arm64) to confirm runtime compatibility only and is intended as a guideline for building an equivalent run script for Arm-based edge systems equipped with an Ethos-U85 NPU.
+
 ### Expected input
 
 | Property | Value |
@@ -156,11 +197,14 @@ This model is intended for developers evaluating image classification workloads
 - This repository is not a replacement for the original model documentation.
 - The `.pte` requires Ethos-U85 hardware or the Corstone-320 FVP to execute; it cannot run on a standard desktop/CPU ExecuTorch Python runtime because the Ethos-U backend delegate is not registered there.
 - The model uses a fixed input size of 224x224 and batch size 1; dynamic shapes are not supported.
+- The semihosting runner uses ExecuTorch's `Sram_Only` memory profile with a 16 MiB temporary allocator configured by the installer.
 
 ## Additional notes
 
 - SmoothQuant activation smoothing was applied before observer insertion to reduce activation outliers ahead of static PT2E quantization. Most quantized layers use INT8 activations and INT8 weights (a8w8), while output.dense (the MLP-down projection in each transformer block) uses INT16 activations and INT8 weights (a16w8) to preserve accuracy within acceptable ranges.
 - Flash deployment configuration: the on-device benchmark loaded the 4,935,568-byte `.pte` from the Alif DK-E8's OSPI1 flash at `0xc0000000`. OSPI1 was configured as an 8-line Octal SPI DDR interface at 100 MHz, using XIP (linear memory-mapped) reads. The artifact occupies 4.7069 MiB (14.71%) of the board's 32 MiB OSPI1 flash. Note: 200 MB/s is the theoretical raw interface bandwidth; measured flash bandwidth was not collected.
+- EULA notice: `install_ethos_u85_graviton.sh` installs the Arm Corstone-320 Fixed Virtual Platform (FVP) by invoking ExecuTorch's upstream `examples/arm/setup.sh` with `--i-agree-to-the-contained-eula`. Running the installer accepts Arm's End User License Agreement (EULA) for the Fixed Virtual Platforms on your behalf. Review Arm's FVP EULA terms before running the script if you have not already agreed to them.
+- Sample input: `sample_input.jpg` is derived from [Samoyed on Beach](https://commons.wikimedia.org/wiki/File:Samoyed_on_Beach.jpg) by Appleinfl, via Wikimedia Commons (public domain).
 
 ## About this version
 

example.py

@@ -0,0 +1,198 @@
+"""Run an exported image-classification Ethos-U85 PTE on Corstone-320."""
+
+from __future__ import annotations
+
+import argparse
+import json
+import os
+import shutil
+import subprocess
+import uuid
+from pathlib import Path
+
+import numpy as np
+from PIL import Image
+
+
+BUNDLE_DIR = Path(__file__).resolve().parent
+SHARED_RUNTIME_DIR = Path("/opt/ethos-u85-graviton")
+LOCAL_RUNTIME_DIR = BUNDLE_DIR / "runtime"
+
+
+def _default_runtime_dir() -> Path:
+    """Mirror install_ethos_u85_graviton.sh's own fallback: it prefers the
+    shared /opt install, but silently falls back to a local, per-bundle one
+    when sudo isn't available. Detect whichever one actually got built."""
+    override = os.environ.get("ETHOS_RUNTIME_DIR")
+    if override:
+        return Path(override)
+    if (SHARED_RUNTIME_DIR / "bin" / "arm_executor_runner").exists():
+        return SHARED_RUNTIME_DIR
+    return LOCAL_RUNTIME_DIR
+
+
+RUNTIME_DIR = _default_runtime_dir()
+DEFAULT_MODEL = BUNDLE_DIR / "deit-tiny_ethos_ethosu_optimized.pte"
+DEFAULT_IMAGE = BUNDLE_DIR / "sample_input.jpg"
+DEFAULT_FVP = RUNTIME_DIR / "bin" / "FVP_Corstone_SSE-320"
+DEFAULT_RUNNER = RUNTIME_DIR / "bin" / "arm_executor_runner"
+DEFAULT_WORKDIR = RUNTIME_DIR / "output" / "fvp"
+MEAN = np.array([0.485, 0.456, 0.406], dtype=np.float32)
+STD = np.array([0.229, 0.224, 0.225], dtype=np.float32)
+IMAGENET_CLASSES = json.loads((BUNDLE_DIR / "imagenet_classes.json").read_text(encoding="utf-8"))
+
+
+def parse_args() -> argparse.Namespace:
+    parser = argparse.ArgumentParser(
+        description="Execute an Ethos-U85 image-classification PTE on Corstone-320."
+    )
+    parser.add_argument("--model", type=Path, default=DEFAULT_MODEL)
+    parser.add_argument(
+        "--image",
+        type=Path,
+        default=DEFAULT_IMAGE,
+        help="RGB image to classify (default: sample_input.jpg next to this script).",
+    )
+    parser.add_argument("--fvp-bin", type=Path, default=DEFAULT_FVP)
+    parser.add_argument("--runner-elf", type=Path, default=DEFAULT_RUNNER)
+    parser.add_argument("--workdir", type=Path, default=DEFAULT_WORKDIR)
+    parser.add_argument(
+        "--output",
+        type=Path,
+        help="Optional JSON destination; omit to only print predictions.",
+    )
+    parser.add_argument("--timelimit", type=int, default=1800)
+    return parser.parse_args()
+
+
+def load_image(path: Path) -> Image.Image:
+    print(f"Using image: {path}")
+    return Image.open(path).convert("RGB")
+
+
+def preprocess(path: Path) -> np.ndarray:
+    image = load_image(path)
+    width, height = image.size
+    if width < height:
+        new_width, new_height = 256, round(height * 256 / width)
+    else:
+        new_height, new_width = 256, round(width * 256 / height)
+    image = image.resize((new_width, new_height), Image.Resampling.BICUBIC)
+    left = (new_width - 224) // 2
+    top = (new_height - 224) // 2
+    image = image.crop((left, top, left + 224, top + 224))
+    array = np.asarray(image, dtype=np.float32) / 255.0
+    array = array.transpose(2, 0, 1)
+    array = (array - MEAN[:, None, None]) / STD[:, None, None]
+    return np.expand_dims(array.astype(np.float32), axis=0)
+
+
+def fvp_environment(fvp: Path) -> dict[str, str]:
+    env = os.environ.copy()
+    resolved = fvp.resolve()
+    for ancestor in resolved.parents:
+        candidate = ancestor / "python" / "lib"
+        if candidate.is_dir() and any(candidate.glob("libpython*.so*")):
+            current = env.get("LD_LIBRARY_PATH")
+            env["LD_LIBRARY_PATH"] = f"{candidate}:{current}" if current else str(candidate)
+            break
+    return env
+
+
+def main() -> None:
+    args = parse_args()
+    model = args.model.resolve()
+    fvp = args.fvp_bin.resolve()
+    runner = args.runner_elf.resolve()
+    for kind, path in (("model", model), ("FVP", fvp), ("runner", runner)):
+        if not path.exists():
+            raise FileNotFoundError(f"Missing {kind}: {path}")
+    if not args.image.is_file():
+        raise FileNotFoundError(f"Missing image: {args.image}")
+
+    workdir = args.workdir.resolve()
+    workdir.mkdir(parents=True, exist_ok=True)
+    run_id = uuid.uuid4().hex[:8]
+    # workdir defaults under the SHARED ETHOS_RUNTIME_DIR, so a fixed
+    # "model.pte" name would collide with a concurrent run of another model
+    # bundle. Keep it unique per run_id like the input/output files.
+    staged_model = workdir / f"model_{run_id}.pte"
+    input_path = workdir / f"input_{run_id}.bin"
+    output_base = f"out_{run_id}"
+    output_path = workdir / f"{output_base}-0.bin"
+    shutil.copyfile(model, staged_model)
+    input_path.write_bytes(preprocess(args.image).tobytes())
+
+    command_line = (
+        f"arm_executor_runner -m {staged_model.name} -i {input_path.name} -o {output_base}"
+    )
+    command = [
+        str(fvp),
+        "-C", "mps4_board.subsystem.ethosu.num_macs=256",
+        "-C", "mps4_board.visualisation.disable-visualisation=1",
+        "-C", "vis_hdlcd.disable_visualisation=1",
+        "-C", "mps4_board.telnetterminal0.start_telnet=0",
+        "-C", "mps4_board.uart0.out_file=-",
+        "-C", "mps4_board.uart0.shutdown_on_eot=1",
+        "-C", "mps4_board.subsystem.cpu0.semihosting-enable=1",
+        "-C", "mps4_board.subsystem.ethosu.extra_args='--fast'",
+        "-C", "mps4_board.subsystem.cpu0.semihosting-stack_base=0",
+        "-C", "mps4_board.subsystem.cpu0.semihosting-heap_limit=0",
+        "-C", f"mps4_board.subsystem.cpu0.semihosting-cwd={workdir}",
+        "-C", f"mps4_board.subsystem.cpu0.semihosting-cmd_line='{command_line}'",
+        "-a", str(runner),
+        "--timelimit", str(args.timelimit),
+    ]
+    result = subprocess.run(
+        command,
+        capture_output=True,
+        text=True,
+        timeout=args.timelimit + 30,
+        check=False,
+        env=fvp_environment(fvp),
+    )
+    print(result.stdout, end="")
+    if result.returncode != 0:
+        raise RuntimeError(
+            f"FVP exited with {result.returncode}\n{result.stderr[-2048:]}"
+        )
+    if not output_path.is_file():
+        raise RuntimeError(f"FVP did not produce {output_path}")
+
+    logits = np.fromfile(output_path, dtype=np.float32)
+    if logits.size != 1000:
+        raise ValueError(f"Expected 1000 float32 logits, got {logits.size}")
+    probabilities = np.exp(logits.astype(np.float64) - logits.max())
+    probabilities /= probabilities.sum()
+    top5 = np.argsort(probabilities)[::-1][:5]
+    predictions = [
+        {
+            "rank": rank,
+            "class_index": int(index),
+            "class_name": IMAGENET_CLASSES[int(index)],
+            "probability": float(probabilities[index]),
+        }
+        for rank, index in enumerate(top5, 1)
+    ]
+
+    print("Top-5 ImageNet predictions:")
+    for prediction in predictions:
+        print(
+            f"  {prediction['rank']}. index={prediction['class_index']}, "
+            f"class={prediction['class_name']}, "
+            f"probability={prediction['probability']:.6f}"
+        )
+
+    print(f"Raw output: {output_path}")
+    if args.output is not None:
+        predictions_path = args.output.resolve()
+        predictions_path.parent.mkdir(parents=True, exist_ok=True)
+        predictions_path.write_text(
+            json.dumps(predictions, indent=2, ensure_ascii=False) + "\n",
+            encoding="utf-8",
+        )
+        print(f"Predictions JSON: {predictions_path}")
+
+
+if __name__ == "__main__":
+    main()

imagenet_classes.json

@@ -0,0 +1,1002 @@
+[
+  "tench",
+  "goldfish",
+  "great white shark",
+  "tiger shark",
+  "hammerhead",
+  "electric ray",
+  "stingray",
+  "cock",
+  "hen",
+  "ostrich",
+  "brambling",
+  "goldfinch",
+  "house finch",
+  "junco",
+  "indigo bunting",
+  "robin",
+  "bulbul",
+  "jay",
+  "magpie",
+  "chickadee",
+  "water ouzel",
+  "kite",
+  "bald eagle",
+  "vulture",
+  "great grey owl",
+  "European fire salamander",
+  "common newt",
+  "eft",
+  "spotted salamander",
+  "axolotl",
+  "bullfrog",
+  "tree frog",
+  "tailed frog",
+  "loggerhead",
+  "leatherback turtle",
+  "mud turtle",
+  "terrapin",
+  "box turtle",
+  "banded gecko",
+  "common iguana",
+  "American chameleon",
+  "whiptail",
+  "agama",
+  "frilled lizard",
+  "alligator lizard",
+  "Gila monster",
+  "green lizard",
+  "African chameleon",
+  "Komodo dragon",
+  "African crocodile",
+  "American alligator",
+  "triceratops",
+  "thunder snake",
+  "ringneck snake",
+  "hognose snake",
+  "green snake",
+  "king snake",
+  "garter snake",
+  "water snake",
+  "vine snake",
+  "night snake",
+  "boa constrictor",
+  "rock python",
+  "Indian cobra",
+  "green mamba",
+  "sea snake",
+  "horned viper",
+  "diamondback",
+  "sidewinder",
+  "trilobite",
+  "harvestman",
+  "scorpion",
+  "black and gold garden spider",
+  "barn spider",
+  "garden spider",
+  "black widow",
+  "tarantula",
+  "wolf spider",
+  "tick",
+  "centipede",
+  "black grouse",
+  "ptarmigan",
+  "ruffed grouse",
+  "prairie chicken",
+  "peacock",
+  "quail",
+  "partridge",
+  "African grey",
+  "macaw",
+  "sulphur-crested cockatoo",
+  "lorikeet",
+  "coucal",
+  "bee eater",
+  "hornbill",
+  "hummingbird",
+  "jacamar",
+  "toucan",
+  "drake",
+  "red-breasted merganser",
+  "goose",
+  "black swan",
+  "tusker",
+  "echidna",
+  "platypus",
+  "wallaby",
+  "koala",
+  "wombat",
+  "jellyfish",
+  "sea anemone",
+  "brain coral",
+  "flatworm",
+  "nematode",
+  "conch",
+  "snail",
+  "slug",
+  "sea slug",
+  "chiton",
+  "chambered nautilus",
+  "Dungeness crab",
+  "rock crab",
+  "fiddler crab",
+  "king crab",
+  "American lobster",
+  "spiny lobster",
+  "crayfish",
+  "hermit crab",
+  "isopod",
+  "white stork",
+  "black stork",
+  "spoonbill",
+  "flamingo",
+  "little blue heron",
+  "American egret",
+  "bittern",
+  "crane bird",
+  "limpkin",
+  "European gallinule",
+  "American coot",
+  "bustard",
+  "ruddy turnstone",
+  "red-backed sandpiper",
+  "redshank",
+  "dowitcher",
+  "oystercatcher",
+  "pelican",
+  "king penguin",
+  "albatross",
+  "grey whale",
+  "killer whale",
+  "dugong",
+  "sea lion",
+  "Chihuahua",
+  "Japanese spaniel",
+  "Maltese dog",
+  "Pekinese",
+  "Shih-Tzu",
+  "Blenheim spaniel",
+  "papillon",
+  "toy terrier",
+  "Rhodesian ridgeback",
+  "Afghan hound",
+  "basset",
+  "beagle",
+  "bloodhound",
+  "bluetick",
+  "black-and-tan coonhound",
+  "Walker hound",
+  "English foxhound",
+  "redbone",
+  "borzoi",
+  "Irish wolfhound",
+  "Italian greyhound",
+  "whippet",
+  "Ibizan hound",
+  "Norwegian elkhound",
+  "otterhound",
+  "Saluki",
+  "Scottish deerhound",
+  "Weimaraner",
+  "Staffordshire bullterrier",
+  "American Staffordshire terrier",
+  "Bedlington terrier",
+  "Border terrier",
+  "Kerry blue terrier",
+  "Irish terrier",
+  "Norfolk terrier",
+  "Norwich terrier",
+  "Yorkshire terrier",
+  "wire-haired fox terrier",
+  "Lakeland terrier",
+  "Sealyham terrier",
+  "Airedale",
+  "cairn",
+  "Australian terrier",
+  "Dandie Dinmont",
+  "Boston bull",
+  "miniature schnauzer",
+  "giant schnauzer",
+  "standard schnauzer",
+  "Scotch terrier",
+  "Tibetan terrier",
+  "silky terrier",
+  "soft-coated wheaten terrier",
+  "West Highland white terrier",
+  "Lhasa",
+  "flat-coated retriever",
+  "curly-coated retriever",
+  "golden retriever",
+  "Labrador retriever",
+  "Chesapeake Bay retriever",
+  "German short-haired pointer",
+  "vizsla",
+  "English setter",
+  "Irish setter",
+  "Gordon setter",
+  "Brittany spaniel",
+  "clumber",
+  "English springer",
+  "Welsh springer spaniel",
+  "cocker spaniel",
+  "Sussex spaniel",
+  "Irish water spaniel",
+  "kuvasz",
+  "schipperke",
+  "groenendael",
+  "malinois",
+  "briard",
+  "kelpie",
+  "komondor",
+  "Old English sheepdog",
+  "Shetland sheepdog",
+  "collie",
+  "Border collie",
+  "Bouvier des Flandres",
+  "Rottweiler",
+  "German shepherd",
+  "Doberman",
+  "miniature pinscher",
+  "Greater Swiss Mountain dog",
+  "Bernese mountain dog",
+  "Appenzeller",
+  "EntleBucher",
+  "boxer",
+  "bull mastiff",
+  "Tibetan mastiff",
+  "French bulldog",
+  "Great Dane",
+  "Saint Bernard",
+  "Eskimo dog",
+  "malamute",
+  "Siberian husky",
+  "dalmatian",
+  "affenpinscher",
+  "basenji",
+  "pug",
+  "Leonberg",
+  "Newfoundland",
+  "Great Pyrenees",
+  "Samoyed",
+  "Pomeranian",
+  "chow",
+  "keeshond",
+  "Brabancon griffon",
+  "Pembroke",
+  "Cardigan",
+  "toy poodle",
+  "miniature poodle",
+  "standard poodle",
+  "Mexican hairless",
+  "timber wolf",
+  "white wolf",
+  "red wolf",
+  "coyote",
+  "dingo",
+  "dhole",
+  "African hunting dog",
+  "hyena",
+  "red fox",
+  "kit fox",
+  "Arctic fox",
+  "grey fox",
+  "tabby",
+  "tiger cat",
+  "Persian cat",
+  "Siamese cat",
+  "Egyptian cat",
+  "cougar",
+  "lynx",
+  "leopard",
+  "snow leopard",
+  "jaguar",
+  "lion",
+  "tiger",
+  "cheetah",
+  "brown bear",
+  "American black bear",
+  "ice bear",
+  "sloth bear",
+  "mongoose",
+  "meerkat",
+  "tiger beetle",
+  "ladybug",
+  "ground beetle",
+  "long-horned beetle",
+  "leaf beetle",
+  "dung beetle",
+  "rhinoceros beetle",
+  "weevil",
+  "fly",
+  "bee",
+  "ant",
+  "grasshopper",
+  "cricket",
+  "walking stick",
+  "cockroach",
+  "mantis",
+  "cicada",
+  "leafhopper",
+  "lacewing",
+  "dragonfly",
+  "damselfly",
+  "admiral",
+  "ringlet",
+  "monarch",
+  "cabbage butterfly",
+  "sulphur butterfly",
+  "lycaenid",
+  "starfish",
+  "sea urchin",
+  "sea cucumber",
+  "wood rabbit",
+  "hare",
+  "Angora",
+  "hamster",
+  "porcupine",
+  "fox squirrel",
+  "marmot",
+  "beaver",
+  "guinea pig",
+  "sorrel",
+  "zebra",
+  "hog",
+  "wild boar",
+  "warthog",
+  "hippopotamus",
+  "ox",
+  "water buffalo",
+  "bison",
+  "ram",
+  "bighorn",
+  "ibex",
+  "hartebeest",
+  "impala",
+  "gazelle",
+  "Arabian camel",
+  "llama",
+  "weasel",
+  "mink",
+  "polecat",
+  "black-footed ferret",
+  "otter",
+  "skunk",
+  "badger",
+  "armadillo",
+  "three-toed sloth",
+  "orangutan",
+  "gorilla",
+  "chimpanzee",
+  "gibbon",
+  "siamang",
+  "guenon",
+  "patas",
+  "baboon",
+  "macaque",
+  "langur",
+  "colobus",
+  "proboscis monkey",
+  "marmoset",
+  "capuchin",
+  "howler monkey",
+  "titi",
+  "spider monkey",
+  "squirrel monkey",
+  "Madagascar cat",
+  "indri",
+  "Indian elephant",
+  "African elephant",
+  "lesser panda",
+  "giant panda",
+  "barracouta",
+  "eel",
+  "coho",
+  "rock beauty",
+  "anemone fish",
+  "sturgeon",
+  "gar",
+  "lionfish",
+  "puffer",
+  "abacus",
+  "abaya",
+  "academic gown",
+  "accordion",
+  "acoustic guitar",
+  "aircraft carrier",
+  "airliner",
+  "airship",
+  "altar",
+  "ambulance",
+  "amphibian",
+  "analog clock",
+  "apiary",
+  "apron",
+  "ashcan",
+  "assault rifle",
+  "backpack",
+  "bakery",
+  "balance beam",
+  "balloon",
+  "ballpoint",
+  "Band Aid",
+  "banjo",
+  "bannister",
+  "barbell",
+  "barber chair",
+  "barbershop",
+  "barn",
+  "barometer",
+  "barrel",
+  "barrow",
+  "baseball",
+  "basketball",
+  "bassinet",
+  "bassoon",
+  "bathing cap",
+  "bath towel",
+  "bathtub",
+  "beach wagon",
+  "beacon",
+  "beaker",
+  "bearskin",
+  "beer bottle",
+  "beer glass",
+  "bell cote",
+  "bib",
+  "bicycle-built-for-two",
+  "bikini",
+  "binder",
+  "binoculars",
+  "birdhouse",
+  "boathouse",
+  "bobsled",
+  "bolo tie",
+  "bonnet",
+  "bookcase",
+  "bookshop",
+  "bottlecap",
+  "bow",
+  "bow tie",
+  "brass",
+  "brassiere",
+  "breakwater",
+  "breastplate",
+  "broom",
+  "bucket",
+  "buckle",
+  "bulletproof vest",
+  "bullet train",
+  "butcher shop",
+  "cab",
+  "caldron",
+  "candle",
+  "cannon",
+  "canoe",
+  "can opener",
+  "cardigan",
+  "car mirror",
+  "carousel",
+  "carpenter's kit",
+  "carton",
+  "car wheel",
+  "cash machine",
+  "cassette",
+  "cassette player",
+  "castle",
+  "catamaran",
+  "CD player",
+  "cello",
+  "cellular telephone",
+  "chain",
+  "chainlink fence",
+  "chain mail",
+  "chain saw",
+  "chest",
+  "chiffonier",
+  "chime",
+  "china cabinet",
+  "Christmas stocking",
+  "church",
+  "cinema",
+  "cleaver",
+  "cliff dwelling",
+  "cloak",
+  "clog",
+  "cocktail shaker",
+  "coffee mug",
+  "coffeepot",
+  "coil",
+  "combination lock",
+  "computer keyboard",
+  "confectionery",
+  "container ship",
+  "convertible",
+  "corkscrew",
+  "cornet",
+  "cowboy boot",
+  "cowboy hat",
+  "cradle",
+  "crane",
+  "crash helmet",
+  "crate",
+  "crib",
+  "Crock Pot",
+  "croquet ball",
+  "crutch",
+  "cuirass",
+  "dam",
+  "desk",
+  "desktop computer",
+  "dial telephone",
+  "diaper",
+  "digital clock",
+  "digital watch",
+  "dining table",
+  "dishrag",
+  "dishwasher",
+  "disk brake",
+  "dock",
+  "dogsled",
+  "dome",
+  "doormat",
+  "drilling platform",
+  "drum",
+  "drumstick",
+  "dumbbell",
+  "Dutch oven",
+  "electric fan",
+  "electric guitar",
+  "electric locomotive",
+  "entertainment center",
+  "envelope",
+  "espresso maker",
+  "face powder",
+  "feather boa",
+  "file",
+  "fireboat",
+  "fire engine",
+  "fire screen",
+  "flagpole",
+  "flute",
+  "folding chair",
+  "football helmet",
+  "forklift",
+  "fountain",
+  "fountain pen",
+  "four-poster",
+  "freight car",
+  "French horn",
+  "frying pan",
+  "fur coat",
+  "garbage truck",
+  "gasmask",
+  "gas pump",
+  "goblet",
+  "go-kart",
+  "golf ball",
+  "golfcart",
+  "gondola",
+  "gong",
+  "gown",
+  "grand piano",
+  "greenhouse",
+  "grille",
+  "grocery store",
+  "guillotine",
+  "hair slide",
+  "hair spray",
+  "half track",
+  "hammer",
+  "hamper",
+  "hand blower",
+  "hand-held computer",
+  "handkerchief",
+  "hard disc",
+  "harmonica",
+  "harp",
+  "harvester",
+  "hatchet",
+  "holster",
+  "home theater",
+  "honeycomb",
+  "hook",
+  "hoopskirt",
+  "horizontal bar",
+  "horse cart",
+  "hourglass",
+  "iPod",
+  "iron",
+  "jack-o'-lantern",
+  "jean",
+  "jeep",
+  "jersey",
+  "jigsaw puzzle",
+  "jinrikisha",
+  "joystick",
+  "kimono",
+  "knee pad",
+  "knot",
+  "lab coat",
+  "ladle",
+  "lampshade",
+  "laptop",
+  "lawn mower",
+  "lens cap",
+  "letter opener",
+  "library",
+  "lifeboat",
+  "lighter",
+  "limousine",
+  "liner",
+  "lipstick",
+  "Loafer",
+  "lotion",
+  "loudspeaker",
+  "loupe",
+  "lumbermill",
+  "magnetic compass",
+  "mailbag",
+  "mailbox",
+  "maillot",
+  "maillot tank suit",
+  "manhole cover",
+  "maraca",
+  "marimba",
+  "mask",
+  "matchstick",
+  "maypole",
+  "maze",
+  "measuring cup",
+  "medicine chest",
+  "megalith",
+  "microphone",
+  "microwave",
+  "military uniform",
+  "milk can",
+  "minibus",
+  "miniskirt",
+  "minivan",
+  "missile",
+  "mitten",
+  "mixing bowl",
+  "mobile home",
+  "Model T",
+  "modem",
+  "monastery",
+  "monitor",
+  "moped",
+  "mortar",
+  "mortarboard",
+  "mosque",
+  "mosquito net",
+  "motor scooter",
+  "mountain bike",
+  "mountain tent",
+  "mouse",
+  "mousetrap",
+  "moving van",
+  "muzzle",
+  "nail",
+  "neck brace",
+  "necklace",
+  "nipple",
+  "notebook",
+  "obelisk",
+  "oboe",
+  "ocarina",
+  "odometer",
+  "oil filter",
+  "organ",
+  "oscilloscope",
+  "overskirt",
+  "oxcart",
+  "oxygen mask",
+  "packet",
+  "paddle",
+  "paddlewheel",
+  "padlock",
+  "paintbrush",
+  "pajama",
+  "palace",
+  "panpipe",
+  "paper towel",
+  "parachute",
+  "parallel bars",
+  "park bench",
+  "parking meter",
+  "passenger car",
+  "patio",
+  "pay-phone",
+  "pedestal",
+  "pencil box",
+  "pencil sharpener",
+  "perfume",
+  "Petri dish",
+  "photocopier",
+  "pick",
+  "pickelhaube",
+  "picket fence",
+  "pickup",
+  "pier",
+  "piggy bank",
+  "pill bottle",
+  "pillow",
+  "ping-pong ball",
+  "pinwheel",
+  "pirate",
+  "pitcher",
+  "plane",
+  "planetarium",
+  "plastic bag",
+  "plate rack",
+  "plow",
+  "plunger",
+  "Polaroid camera",
+  "pole",
+  "police van",
+  "poncho",
+  "pool table",
+  "pop bottle",
+  "pot",
+  "potter's wheel",
+  "power drill",
+  "prayer rug",
+  "printer",
+  "prison",
+  "projectile",
+  "projector",
+  "puck",
+  "punching bag",
+  "purse",
+  "quill",
+  "quilt",
+  "racer",
+  "racket",
+  "radiator",
+  "radio",
+  "radio telescope",
+  "rain barrel",
+  "recreational vehicle",
+  "reel",
+  "reflex camera",
+  "refrigerator",
+  "remote control",
+  "restaurant",
+  "revolver",
+  "rifle",
+  "rocking chair",
+  "rotisserie",
+  "rubber eraser",
+  "rugby ball",
+  "rule",
+  "running shoe",
+  "safe",
+  "safety pin",
+  "saltshaker",
+  "sandal",
+  "sarong",
+  "sax",
+  "scabbard",
+  "scale",
+  "school bus",
+  "schooner",
+  "scoreboard",
+  "screen",
+  "screw",
+  "screwdriver",
+  "seat belt",
+  "sewing machine",
+  "shield",
+  "shoe shop",
+  "shoji",
+  "shopping basket",
+  "shopping cart",
+  "shovel",
+  "shower cap",
+  "shower curtain",
+  "ski",
+  "ski mask",
+  "sleeping bag",
+  "slide rule",
+  "sliding door",
+  "slot",
+  "snorkel",
+  "snowmobile",
+  "snowplow",
+  "soap dispenser",
+  "soccer ball",
+  "sock",
+  "solar dish",
+  "sombrero",
+  "soup bowl",
+  "space bar",
+  "space heater",
+  "space shuttle",
+  "spatula",
+  "speedboat",
+  "spider web",
+  "spindle",
+  "sports car",
+  "spotlight",
+  "stage",
+  "steam locomotive",
+  "steel arch bridge",
+  "steel drum",
+  "stethoscope",
+  "stole",
+  "stone wall",
+  "stopwatch",
+  "stove",
+  "strainer",
+  "streetcar",
+  "stretcher",
+  "studio couch",
+  "stupa",
+  "submarine",
+  "suit",
+  "sundial",
+  "sunglass",
+  "sunglasses",
+  "sunscreen",
+  "suspension bridge",
+  "swab",
+  "sweatshirt",
+  "swimming trunks",
+  "swing",
+  "switch",
+  "syringe",
+  "table lamp",
+  "tank",
+  "tape player",
+  "teapot",
+  "teddy",
+  "television",
+  "tennis ball",
+  "thatch",
+  "theater curtain",
+  "thimble",
+  "thresher",
+  "throne",
+  "tile roof",
+  "toaster",
+  "tobacco shop",
+  "toilet seat",
+  "torch",
+  "totem pole",
+  "tow truck",
+  "toyshop",
+  "tractor",
+  "trailer truck",
+  "tray",
+  "trench coat",
+  "tricycle",
+  "trimaran",
+  "tripod",
+  "triumphal arch",
+  "trolleybus",
+  "trombone",
+  "tub",
+  "turnstile",
+  "typewriter keyboard",
+  "umbrella",
+  "unicycle",
+  "upright",
+  "vacuum",
+  "vase",
+  "vault",
+  "velvet",
+  "vending machine",
+  "vestment",
+  "viaduct",
+  "violin",
+  "volleyball",
+  "waffle iron",
+  "wall clock",
+  "wallet",
+  "wardrobe",
+  "warplane",
+  "washbasin",
+  "washer",
+  "water bottle",
+  "water jug",
+  "water tower",
+  "whiskey jug",
+  "whistle",
+  "wig",
+  "window screen",
+  "window shade",
+  "Windsor tie",
+  "wine bottle",
+  "wing",
+  "wok",
+  "wooden spoon",
+  "wool",
+  "worm fence",
+  "wreck",
+  "yawl",
+  "yurt",
+  "web site",
+  "comic book",
+  "crossword puzzle",
+  "street sign",
+  "traffic light",
+  "book jacket",
+  "menu",
+  "plate",
+  "guacamole",
+  "consomme",
+  "hot pot",
+  "trifle",
+  "ice cream",
+  "ice lolly",
+  "French loaf",
+  "bagel",
+  "pretzel",
+  "cheeseburger",
+  "hotdog",
+  "mashed potato",
+  "head cabbage",
+  "broccoli",
+  "cauliflower",
+  "zucchini",
+  "spaghetti squash",
+  "acorn squash",
+  "butternut squash",
+  "cucumber",
+  "artichoke",
+  "bell pepper",
+  "cardoon",
+  "mushroom",
+  "Granny Smith",
+  "strawberry",
+  "orange",
+  "lemon",
+  "fig",
+  "pineapple",
+  "banana",
+  "jackfruit",
+  "custard apple",
+  "pomegranate",
+  "hay",
+  "carbonara",
+  "chocolate sauce",
+  "dough",
+  "meat loaf",
+  "pizza",
+  "potpie",
+  "burrito",
+  "red wine",
+  "espresso",
+  "cup",
+  "eggnog",
+  "alp",
+  "bubble",
+  "cliff",
+  "coral reef",
+  "geyser",
+  "lakeside",
+  "promontory",
+  "sandbar",
+  "seashore",
+  "valley",
+  "volcano",
+  "ballplayer",
+  "groom",
+  "scuba diver",
+  "rapeseed",
+  "daisy",
+  "yellow lady's slipper",
+  "corn",
+  "acorn",
+  "hip",
+  "buckeye",
+  "coral fungus",
+  "agaric",
+  "gyromitra",
+  "stinkhorn",
+  "earthstar",
+  "hen-of-the-woods",
+  "bolete",
+  "ear",
+  "toilet tissue"
+]

install_ethos_u85_graviton.sh

@@ -0,0 +1,398 @@
+#!/usr/bin/env bash
+# Standalone Ethos-U85 + Corstone-320 installer for AWS Graviton.
+#
+# Prefers a SHARED runtime directory (default: /opt/ethos-u85-graviton) so
+# every model bundle that needs Ethos-U85 + Corstone-320 can reuse the same
+# ExecuTorch build, arm_executor_runner and FVP instead of rebuilding its own
+# copy. Using /opt requires sudo once, to create and chown it.
+#
+# If sudo is not available (no password, user not in sudoers, non-interactive
+# session with no way to prompt), the installer automatically falls back to a
+# LOCAL, per-bundle install under <this-bundle-dir>/runtime instead. No sudo
+# is needed for that, but the install is then private to this model bundle
+# and will be rebuilt from scratch by any other bundle that needs it.
+#
+# Force a specific location (bypassing the sudo probe entirely) with
+# ETHOS_RUNTIME_DIR=/some/other/path.
+
+set -euo pipefail
+
+BUNDLE_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
+SHARED_RUNTIME_DIR="/opt/ethos-u85-graviton"
+LOCAL_RUNTIME_DIR="${BUNDLE_DIR}/runtime"
+EXECUTORCH_VERSION="1.1.0"
+SKIP_SYSTEM_PACKAGES=0
+FORCE_REINSTALL=0
+
+log() { printf '\033[0;32m[ethos-graviton]\033[0m %s\n' "$*"; }
+die() { printf '\033[0;31m[ethos-graviton]\033[0m %s\n' "$*" >&2; exit 1; }
+
+usage() {
+    printf '%s\n' \
+        "Usage: bash install_ethos_u85_graviton.sh [--skip-system-packages] [--force-reinstall]" \
+        "" \
+        "Installs the Ethos-U85 + Corstone-320 execution stack into either:" \
+        "  - ${SHARED_RUNTIME_DIR}  (shared across model bundles), if sudo works, or" \
+        "  - ${LOCAL_RUNTIME_DIR}  (this bundle only), if it does not." \
+        "Force a specific location (skips the sudo probe) with" \
+        "ETHOS_RUNTIME_DIR=/some/other/path." \
+        "" \
+        "Options:" \
+        "  --skip-system-packages  Do not invoke apt-get/dnf/yum." \
+        "  --force-reinstall       Wipe and rebuild an already-installed runtime" \
+        "                          without prompting." \
+        "  -h, --help              Show this help."
+}
+
+while [[ $# -gt 0 ]]; do
+    case "$1" in
+        --skip-system-packages) SKIP_SYSTEM_PACKAGES=1 ;;
+        --force-reinstall) FORCE_REINSTALL=1 ;;
+        -h|--help) usage; exit 0 ;;
+        *) usage >&2; die "Unknown argument: $1" ;;
+    esac
+    shift
+done
+
+[[ "$(id -u)" -ne 0 ]] \
+    || die "Do not run this script with sudo. Run 'bash install_ethos_u85_graviton.sh' as the normal user; it requests sudo itself only for system packages and the shared /opt install."
+[[ "$(uname -s)" == "Linux" ]] || die "This installer supports Linux only."
+case "$(uname -m)" in
+    aarch64|arm64) ;;
+    *) die "Expected an arm64/aarch64 Graviton host; found $(uname -m)." ;;
+esac
+
+run_as_root() {
+    if [[ "$(id -u)" -eq 0 ]]; then
+        "$@"
+    elif command -v sudo >/dev/null 2>&1; then
+        sudo "$@"
+    else
+        die "Root privileges are required (sudo not found)."
+    fi
+}
+
+install_system_packages() {
+    if command -v apt-get >/dev/null 2>&1; then
+        # Ubuntu may start unattended-upgrades immediately after boot. Let
+        # apt/dpkg finish instead of failing because lock-frontend is busy.
+        run_as_root apt-get -o DPkg::Lock::Timeout=600 update
+        run_as_root apt-get -o DPkg::Lock::Timeout=600 install -y \
+            build-essential cmake curl git ninja-build patch pkg-config \
+            python3 tar unzip xz-utils
+    elif command -v dnf >/dev/null 2>&1; then
+        run_as_root dnf install -y \
+            cmake curl gcc gcc-c++ git make ninja-build patch pkgconf-pkg-config \
+            python3 tar unzip xz
+    elif command -v yum >/dev/null 2>&1; then
+        run_as_root yum install -y \
+            cmake curl gcc gcc-c++ git make ninja-build patch pkgconfig \
+            python3 tar unzip xz
+    else
+        die "No supported package manager found. Install Git, CMake, curl, make, a C/C++ compiler, Python 3 and unzip; then use --skip-system-packages."
+    fi
+}
+
+# --- Decide where to install: shared /opt (needs sudo) or a local,
+# per-bundle fallback (no sudo needed) ---------------------------------------
+# An explicit ETHOS_RUNTIME_DIR always wins and skips the sudo probe below;
+# HAVE_ROOT then just tracks whether we're allowed to sudo-bootstrap it if
+# it turns out to need elevated privileges too.
+HAVE_ROOT=0
+if [[ -n "${ETHOS_RUNTIME_DIR:-}" ]]; then
+    RUNTIME_DIR="${ETHOS_RUNTIME_DIR}"
+    log "ETHOS_RUNTIME_DIR set: installing into ${RUNTIME_DIR}."
+elif command -v sudo >/dev/null 2>&1; then
+    log "Checking sudo access (used for system packages and for the shared ${SHARED_RUNTIME_DIR} install; you may be prompted for your password)..."
+    if sudo -v; then
+        HAVE_ROOT=1
+        RUNTIME_DIR="${SHARED_RUNTIME_DIR}"
+        log "Sudo access confirmed: installing the shared runtime at ${RUNTIME_DIR}."
+    else
+        log "Sudo access denied or unavailable: falling back to a local, per-bundle install at ${LOCAL_RUNTIME_DIR}."
+        log "This bundle will build its own copy of the Ethos-U85 stack instead of sharing one under ${SHARED_RUNTIME_DIR}. System package installation will also be skipped (it needs sudo too) — install them manually if they are missing."
+        RUNTIME_DIR="${LOCAL_RUNTIME_DIR}"
+        SKIP_SYSTEM_PACKAGES=1
+    fi
+else
+    log "sudo is not installed: falling back to a local, per-bundle install at ${LOCAL_RUNTIME_DIR}."
+    RUNTIME_DIR="${LOCAL_RUNTIME_DIR}"
+    SKIP_SYSTEM_PACKAGES=1
+fi
+
+ET_SRC="${RUNTIME_DIR}/executorch"
+BIN_DIR="${RUNTIME_DIR}/bin"
+ET_BUILD_ROOT="${ET_SRC}/arm_test"
+BUILD_VENV="${RUNTIME_DIR}/build-venv"
+INSTALL_MARKER="${RUNTIME_DIR}/.ethos-u85-graviton-install-complete-v1"
+
+# Detect a previously completed installation before doing any more work (uv,
+# ExecuTorch build, ...). Other model bundles may already have installed the
+# shared runtime, so surface that instead of silently re-running or silently
+# skipping.
+if [[ -f "${INSTALL_MARKER}" ]]; then
+    log "Ethos-U85 + Corstone-320 runtime already installed at ${RUNTIME_DIR}:"
+    sed 's/^/    /' "${INSTALL_MARKER}"
+    if [[ "${FORCE_REINSTALL}" -eq 1 ]]; then
+        log "--force-reinstall given: removing ${RUNTIME_DIR} and rebuilding..."
+        rm -rf "${RUNTIME_DIR}"
+    elif [[ -t 0 ]]; then
+        read -r -p "Reinstall from scratch? This removes and rebuilds the runtime. [y/N] " reply
+        case "${reply}" in
+            [yY]|[yY][eE][sS])
+                log "Reinstalling: removing ${RUNTIME_DIR}..."
+                rm -rf "${RUNTIME_DIR}"
+                ;;
+            *)
+                log "Keeping the existing installation. Nothing to do."
+                exit 0
+                ;;
+        esac
+    else
+        log "Non-interactive session: keeping the existing installation."
+        log "Re-run with --force-reinstall to rebuild it. Nothing to do."
+        exit 0
+    fi
+fi
+
+if [[ "${SKIP_SYSTEM_PACKAGES}" -eq 0 ]]; then
+    log "Installing system packages..."
+    install_system_packages
+fi
+
+for command_name in git cmake curl make python3; do
+    command -v "${command_name}" >/dev/null 2>&1 \
+        || die "Missing required command: ${command_name}"
+done
+
+if ! command -v uv >/dev/null 2>&1 || ! uv --version >/dev/null 2>&1; then
+    log "Installing uv..."
+    curl -LsSf https://astral.sh/uv/install.sh | sh
+fi
+UV=""
+if [[ -x "${HOME}/.local/bin/uv" ]] \
+   && "${HOME}/.local/bin/uv" --version >/dev/null 2>&1; then
+    UV="${HOME}/.local/bin/uv"
+elif command -v uv >/dev/null 2>&1 && uv --version >/dev/null 2>&1; then
+    UV="$(command -v uv)"
+fi
+[[ -n "${UV}" ]] || die "uv installation failed."
+if ! command -v uv >/dev/null 2>&1 || ! uv --version >/dev/null 2>&1; then
+    if [[ "${HAVE_ROOT}" -eq 1 ]]; then
+        log "Making uv available as /usr/local/bin/uv..."
+        run_as_root ln -sf "${UV}" /usr/local/bin/uv
+    else
+        log "uv is available at ${UV} but not on the system PATH; skipping the /usr/local/bin/uv symlink (no sudo access). This script uses ${UV} directly, so it still works."
+    fi
+fi
+
+# Bootstrap RUNTIME_DIR. Plain mkdir covers the local, per-bundle fallback
+# (already user-writable); the shared /opt location typically needs sudo the
+# first time, handled here lazily via run_as_root.
+if [[ ! -e "${RUNTIME_DIR}" ]]; then
+    if ! mkdir -p "${RUNTIME_DIR}" 2>/dev/null; then
+        log "${RUNTIME_DIR} requires elevated privileges to create..."
+        run_as_root mkdir -p "${RUNTIME_DIR}"
+        run_as_root chown "$(id -un):$(id -gn)" "${RUNTIME_DIR}"
+    fi
+elif [[ ! -w "${RUNTIME_DIR}" ]]; then
+    die "${RUNTIME_DIR} is not writable. A previous run under a different user may own it. Run: sudo chown -R \"$(id -un):$(id -gn)\" \"${RUNTIME_DIR}\""
+fi
+mkdir -p "${RUNTIME_DIR}" "${BIN_DIR}"
+
+# ExecuTorch's CMake code-generation scripts import PyYAML and torchgen while
+# building the portable, quantized and Cortex-M operator registries. torchgen
+# is distributed as part of PyTorch. ExecuTorch 1.1 also requires CMake 3.29+
+# and does not support CMake 4, so use a pinned copy in this environment. Keep
+# these build-only dependencies separate from the inference pyproject.toml.
+if [[ ! -x "${BUILD_VENV}/bin/python" ]]; then
+    log "Creating the Python environment used by ExecuTorch code generation..."
+    "${UV}" venv "${BUILD_VENV}" --python 3.12
+fi
+if ! "${BUILD_VENV}/bin/python" -c \
+        'import importlib.metadata as m, torchgen, yaml; assert tuple(map(int, m.version("torch").split("+")[0].split(".")[:2])) == (2, 10)' \
+        2>/dev/null \
+   || [[ ! -x "${BUILD_VENV}/bin/cmake" ]] \
+   || ! "${BUILD_VENV}/bin/python" -c \
+        'import subprocess, sys; v=tuple(map(int, subprocess.check_output([sys.argv[1], "--version"], text=True).split()[2].split(".")[:2])); assert (3, 29) <= v < (4, 0)' \
+        "${BUILD_VENV}/bin/cmake" 2>/dev/null; then
+    log "Installing the pinned CMake and Python code-generation dependencies..."
+    "${UV}" pip install --python "${BUILD_VENV}/bin/python" \
+        "cmake>=3.29,<4" "PyYAML>=6,<7" "torch>=2.10,<2.11"
+fi
+export PATH="${BUILD_VENV}/bin:${PATH}"
+
+if [[ ! -d "${ET_SRC}/.git" ]]; then
+    log "Cloning ExecuTorch ${EXECUTORCH_VERSION}..."
+    git clone --branch "v${EXECUTORCH_VERSION}" --recurse-submodules \
+        https://github.com/pytorch/executorch.git "${ET_SRC}"
+fi
+# Some nested dependency fetches require an identity. Keep the fallback local
+# to this generated checkout and do not modify the user's global Git config.
+if ! git -C "${ET_SRC}" config user.name >/dev/null; then
+    git -C "${ET_SRC}" config user.name "Ethos standalone installer"
+fi
+if ! git -C "${ET_SRC}" config user.email >/dev/null; then
+    git -C "${ET_SRC}" config user.email "ethos-installer@localhost"
+fi
+
+ARM_SETUP="${ET_SRC}/examples/arm/setup.sh"
+PATCH_SENTINEL='# STANDALONE-RUNTIME-ONLY-PATCH-V1'
+if ! grep -q "${PATCH_SENTINEL}" "${ARM_SETUP}"; then
+    log "Configuring ExecuTorch setup for runtime-only installation..."
+    sed -i.bak \
+        "/# Setup the TOSA reference model and serialization dependencies/i\\
+    log_step \"main\" \"Runtime-only setup complete; skipping TOSA and Vela.\"\\
+    exit 0  ${PATCH_SENTINEL}" \
+        "${ARM_SETUP}"
+fi
+
+# The upstream helper installs Corstone-300 and Corstone-320 together. This
+# bundle only targets Ethos-U85, so avoid downloading the unused Corstone-300.
+FVP_UTILS="${ET_SRC}/backends/arm/scripts/fvp_utils.sh"
+if grep -q 'fvps=("corstone300" "corstone320")' "${FVP_UTILS}"; then
+    sed -i.bak \
+        's/fvps=("corstone300" "corstone320")/fvps=("corstone320")/g' \
+        "${FVP_UTILS}"
+fi
+
+SETUP_PATH="${ET_SRC}/examples/arm/arm-scratch/setup_path.sh"
+if [[ ! -f "${SETUP_PATH}" ]]; then
+    log "Installing the Arm GNU toolchain and Corstone FVP (Arm EULA accepted)..."
+    (
+        cd "${ET_SRC}"
+        bash examples/arm/setup.sh --i-agree-to-the-contained-eula \
+            --enable-baremetal-toolchain --enable-fvps
+    )
+fi
+[[ -f "${SETUP_PATH}" ]] || die "Arm setup did not create ${SETUP_PATH}."
+# setup_path.sh unconditionally hashes all three Corstone FVP names, but this
+# bundle only installs corstone320. Under `set -e`, sourcing it would abort
+# here on the first missing FVP's failing `hash` call, so drop those lines.
+sed -i.bak '/^hash FVP_Corstone_SSE-300_Ethos-U55$/d;/^hash FVP_Corstone_SSE-300_Ethos-U65$/d' \
+    "${SETUP_PATH}"
+# shellcheck disable=SC1090
+source "${SETUP_PATH}"
+# setup_path.sh adds Arm tools to PATH. Put the code-generation Python back at
+# the front so CMake does not discover a stale system/Snap Python instead.
+export PATH="${BUILD_VENV}/bin:${PATH}"
+unset PYTHONHOME
+unset PYTHONPATH
+# Expose only ExecuTorch's source-package layout. This lets both `python -m
+# codegen...` and the runner's direct `python codegen/...py` invocation resolve
+# imports without inheriting unrelated Snap paths from the login environment.
+export PYTHONPATH="${ET_SRC}/src"
+command -v arm-none-eabi-gcc >/dev/null 2>&1 \
+    || die "Arm GNU toolchain is missing after setup. Remove ${SETUP_PATH} and rerun the installer."
+command -v FVP_Corstone_SSE-320 >/dev/null 2>&1 \
+    || die "Corstone-320 FVP is missing after setup. Remove ${SETUP_PATH} and rerun the installer."
+
+# build_executorch.sh normally lets CMake discover Python through PATH. Make
+# the interpreter explicit as well, so neither a Snap Python nor a previous
+# CMake discovery can leak into generated dependency rules.
+ET_BUILD_SCRIPT="${ET_SRC}/backends/arm/scripts/build_executorch.sh"
+if ! grep -q 'STANDALONE_CODEGEN_PYTHON' "${ET_BUILD_SCRIPT}"; then
+    sed -i.bak \
+        '/-DCMAKE_BUILD_TYPE=${build_type}/i\
+-DPYTHON_EXECUTABLE="${STANDALONE_CODEGEN_PYTHON}" \\' \
+        "${ET_BUILD_SCRIPT}"
+fi
+export STANDALONE_CODEGEN_PYTHON="${BUILD_VENV}/bin/python"
+
+log "Checking the ExecuTorch code-generation Python environment..."
+(
+    cd "${ET_SRC}"
+    cmake_version="$(cmake --version | head -n 1)"
+    "${STANDALONE_CODEGEN_PYTHON}" -c \
+        'import subprocess; v=tuple(map(int, subprocess.check_output(["cmake", "--version"], text=True).split()[2].split(".")[:2])); assert (3, 29) <= v < (4, 0), v' \
+        || die "Expected CMake >=3.29,<4; found: ${cmake_version}"
+    "${STANDALONE_CODEGEN_PYTHON}" -c \
+        'import torchgen, yaml; from executorch.codegen.tools import gen_oplist'
+)
+
+CMAKE_BUILD_DIR="${ET_BUILD_ROOT}/cmake-out"
+BUILD_COMPLETE_MARKER="${ET_BUILD_ROOT}/.runtime-libs-complete-v2"
+if [[ ! -f "${BUILD_COMPLETE_MARKER}" ]]; then
+    # The CMake package config is produced before compilation finishes. It
+    # therefore cannot be used as a success marker. Always clear an incomplete
+    # tree so Make cannot retain dependencies on a removed Snap.
+    log "Removing any incomplete CMake build before compiling ExecuTorch..."
+    rm -rf "${CMAKE_BUILD_DIR}"
+    log "Building the ExecuTorch bare-metal libraries..."
+    (
+        cd "${ET_SRC}"
+        bash "${ET_BUILD_SCRIPT}" \
+            --et_build_root="${ET_BUILD_ROOT}" \
+            --build_type=Release \
+            --toolchain=arm-none-eabi-gcc
+    )
+    [[ -f "${CMAKE_BUILD_DIR}/lib/cmake/ExecuTorch/executorch-config.cmake" ]] \
+        || die "ExecuTorch build finished without installing executorch-config.cmake."
+    find "${CMAKE_BUILD_DIR}" -type f -name 'libexecutorch.a' -print -quit \
+        | grep -q . || die "ExecuTorch build finished without libexecutorch.a."
+    printf 'python=%s\ncompleted_at=%s\n' \
+        "$(realpath "${STANDALONE_CODEGEN_PYTHON}")" \
+        "$(date -u +%Y-%m-%dT%H:%M:%SZ)" > "${BUILD_COMPLETE_MARKER}"
+fi
+
+# The delegate can require more than the 2 MiB (0x200000) default temporary
+# allocator, so the CMake constant is set to 16 MiB before building.
+RUNNER_TEMP_POOL="0x1000000"
+RUNNER_CMAKE="${ET_SRC}/examples/arm/executor_runner/CMakeLists.txt"
+if [[ -f "${RUNNER_CMAKE}" ]] && ! grep -q "# AMO-POOL-PATCHED" "${RUNNER_CMAKE}"; then
+    log "Patching ${RUNNER_CMAKE} to use ${RUNNER_TEMP_POOL} temp pool..."
+    grep -q "set(ET_ARM_BAREMETAL_SCRATCH_TEMP_ALLOCATOR_POOL_SIZE 0x200000)" "${RUNNER_CMAKE}" \
+        || die "Expected upstream 'set(...0x200000)' line in ${RUNNER_CMAKE} — version drift?"
+    sed -i.bak \
+        "s|set(ET_ARM_BAREMETAL_SCRATCH_TEMP_ALLOCATOR_POOL_SIZE 0x200000)|set(ET_ARM_BAREMETAL_SCRATCH_TEMP_ALLOCATOR_POOL_SIZE ${RUNNER_TEMP_POOL}) # AMO-POOL-PATCHED|" \
+        "${RUNNER_CMAKE}"
+fi
+
+RUNNER_LINK="${BIN_DIR}/arm_executor_runner"
+RUNNER_BUILD_DIR="${ET_BUILD_ROOT}/ethos-u85-256_semihosting/cmake-out"
+RUNNER_PROFILE_MARKER="${RUNNER_BUILD_DIR}/.sram-only-pool-${RUNNER_TEMP_POOL}-complete-v1"
+if [[ ! -x "${RUNNER_LINK}" || ! -f "${RUNNER_PROFILE_MARKER}" ]]; then
+    # The upstream script defaults --output to the current directory for a
+    # semihosting runner. Always use a dedicated build tree and discard it if
+    # the previous attempt did not produce a runner.
+    rm -rf "${RUNNER_BUILD_DIR}"
+    log "Building the Ethos-U85 semihosting runner (Sram_Only, scratch=${RUNNER_TEMP_POOL})..."
+    (
+        cd "${ET_SRC}"
+        bash backends/arm/scripts/build_executor_runner.sh \
+            --et_build_root="${ET_BUILD_ROOT}" \
+            --pte=semihosting \
+            --target=ethos-u85-256 \
+            --system_config=Ethos_U85_SYS_DRAM_Mid \
+            --memory_mode=Sram_Only \
+            --ethosu_tools_dir="${ET_SRC}/examples/arm/arm-scratch" \
+            --output="${RUNNER_BUILD_DIR}" \
+            --toolchain=arm-none-eabi-gcc
+    )
+    RUNNER_FOUND="$(find "${RUNNER_BUILD_DIR}" -type f \
+        -name arm_executor_runner -not -path '*/CMakeFiles/*' | head -n 1)"
+    [[ -n "${RUNNER_FOUND}" ]] || die "Runner build finished but no ELF was found."
+    ln -sf "${RUNNER_FOUND}" "${RUNNER_LINK}"
+    printf 'runner=%s\ncompleted_at=%s\n' \
+        "$(realpath "${RUNNER_FOUND}")" \
+        "$(date -u +%Y-%m-%dT%H:%M:%SZ)" > "${RUNNER_PROFILE_MARKER}"
+fi
+
+FVP_FOUND="$(find "${ET_SRC}/examples/arm/arm-scratch" -type f \
+    -name FVP_Corstone_SSE-320 -perm -u+x | head -n 1)"
+[[ -n "${FVP_FOUND}" ]] || die "Corstone-320 FVP was not found."
+ln -sf "${FVP_FOUND}" "${BIN_DIR}/FVP_Corstone_SSE-320"
+
+[[ -x "${RUNNER_LINK}" ]] || die "Runner verification failed."
+[[ -x "${BIN_DIR}/FVP_Corstone_SSE-320" ]] || die "FVP verification failed."
+
+RUNTIME_KIND="local"
+[[ "${RUNTIME_DIR}" == "${SHARED_RUNTIME_DIR}" ]] && RUNTIME_KIND="shared"
+printf 'installed_at=%s\nexecutorch_version=%s\nmemory_mode=Sram_Only\nruntime_kind=%s\ninstalled_by_bundle=%s\n' \
+    "$(date -u +%Y-%m-%dT%H:%M:%SZ)" "${EXECUTORCH_VERSION}" "${RUNTIME_KIND}" "${BUNDLE_DIR}" > "${INSTALL_MARKER}"
+
+log "Standalone installation completed in ${RUNTIME_DIR}."
+log "Next commands:"
+log "  cd ${BUNDLE_DIR}"
+log "  uv sync --frozen"
+log "  uv run example.py"

predictions.json

@@ -0,0 +1,32 @@
+[
+  {
+    "rank": 1,
+    "class_index": 258,
+    "class_name": "Samoyed",
+    "probability": 0.8419339539799012
+  },
+  {
+    "rank": 2,
+    "class_index": 248,
+    "class_name": "Eskimo dog",
+    "probability": 0.017925628222684828
+  },
+  {
+    "rank": 3,
+    "class_index": 224,
+    "class_name": "groenendael",
+    "probability": 0.015007706192767745
+  },
+  {
+    "rank": 4,
+    "class_index": 270,
+    "class_name": "white wolf",
+    "probability": 0.015007706192767745
+  },
+  {
+    "rank": 5,
+    "class_index": 259,
+    "class_name": "Pomeranian",
+    "probability": 0.006949499845333793
+  }
+]

pyproject.toml

@@ -0,0 +1,26 @@
+[project]
+name = "ethos-u85-graviton-runner"
+version = "0.1.0"
+description = "Minimal host-side dependencies for Corstone-320 FVP inference"
+requires-python = ">=3.12,<3.13"
+dependencies = [
+    "numpy==2.5.3",
+    "pillow==12.3.0",
+]
+
+[tool.uv]
+package = false
+
+[tool.ai-portal.deployment]
+schema-version = "1"
+runtime = "executorch"
+required-capabilities = ["EthosUBackend"]
+
+[tool.ai-portal.deployment.ubuntu]
+packages = []
+
+[tool.ai-portal.deployment.raspbian]
+packages = []
+
+[tool.ai-portal.deployment.files]
+expected = ["predictions.json"]

uv.lock

@@ -0,0 +1,54 @@
+version = 1
+revision = 3
+requires-python = "==3.12.*"
+
+[[package]]
+name = "ethos-u85-graviton-runner"
+version = "0.1.0"
+source = { virtual = "." }
+dependencies = [
+    { name = "numpy" },
+    { name = "pillow" },
+]
+
+[package.metadata]
+requires-dist = [
+    { name = "numpy", specifier = "==2.5.3" },
+    { name = "pillow", specifier = "==12.3.0" },
+]
+
+[[package]]
+name = "numpy"
+version = "2.5.3"
+source = { registry = "https://pypi.org/simple" }
+sdist = { url = "https://files.pythonhosted.org/packages/13/01/11703282db468b85f6f7b8c7f22d058de5970d5c7e60a3a8aaa313c3de36/numpy-2.5.3.tar.gz", hash = "sha256:df2d5874ff183595a4ba404edd04f6bd9b5505c1d7708573f6a6c17489a67563", size = 20791231, upload-time = "2026-09-06T16:27:47.073Z" }
+wheels = [
+    { url = "https://files.pythonhosted.org/packages/d6/50/8fdbb16af64895706a45f06a4068e29db732ec180f3c1375f14123359138/numpy-2.5.3-cp312-cp312-macosx_10_13_x86_64.whl", hash = "sha256:cb189f09db39283b26bfd061ec16189e14f71c6755207f72a0f7540867afe5b9", size = 16994982, upload-time = "2026-09-06T16:24:29.244Z" },
+    { url = "https://files.pythonhosted.org/packages/60/39/789131c1188c078dcb3a1692e72e1e050c68b88ffe72c9ccaac9bcd7a9cd/numpy-2.5.3-cp312-cp312-macosx_11_0_arm64.whl", hash = "sha256:f59a878c33d6b88122d80d239bb3b845d58708750b0cb06a09aebb9b18ec696c", size = 12009327, upload-time = "2026-09-06T16:24:32.491Z" },
+    { url = "https://files.pythonhosted.org/packages/9c/59/a312e95696e5f601914dd8b6dd844692ba61670807417e24b68e337b5c70/numpy-2.5.3-cp312-cp312-macosx_14_0_arm64.whl", hash = "sha256:a72f874bc9e10e4b8f80426fb49716d5141f64442a0c8418065093ec8017fbb0", size = 5445405, upload-time = "2026-09-06T16:24:35.071Z" },
+    { url = "https://files.pythonhosted.org/packages/30/d0/5623a1707ed4fe16e3909fe3cf5ee3da004ae677ad23d83bbf3adf1a6faf/numpy-2.5.3-cp312-cp312-macosx_14_0_x86_64.whl", hash = "sha256:fc36dc566135b5eceec4cf89758fcb719266a019ef07dae1754ae7c9f617ef3e", size = 6783213, upload-time = "2026-09-06T16:24:37.253Z" },
+    { url = "https://files.pythonhosted.org/packages/f1/32/84146fc020ad3c25f805f70ab60da46fe3c540a21369754a7e4369754b6f/numpy-2.5.3-cp312-cp312-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl", hash = "sha256:76c2c1e6bfa5c84adc6434dfbf013aa92096a7985221762c8f11fedfd20fff58", size = 15687872, upload-time = "2026-09-06T16:24:39.751Z" },
+    { url = "https://files.pythonhosted.org/packages/65/af/aa78d1a88805456e212b65461354cd943197fb9acecc4c90fd12295123a3/numpy-2.5.3-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl", hash = "sha256:b7e18c623bb5c95acb3b3328861272816ba199fb531921c5d6d0b675f1fde9e3", size = 16717410, upload-time = "2026-09-06T16:24:42.745Z" },
+    { url = "https://files.pythonhosted.org/packages/3b/24/faa79d865e69a97ba17473b23a1b74094b2259c03e820c70297293b9ea49/numpy-2.5.3-cp312-cp312-musllinux_1_2_aarch64.whl", hash = "sha256:4f8929ee6c96bfbd7b4ed2032e0c03af86fe1826740ab61ddabf9072d06e57ff", size = 17040975, upload-time = "2026-09-06T16:24:45.961Z" },
+    { url = "https://files.pythonhosted.org/packages/62/4a/8877e629445a7176297dffcaf9c485faa96a95d81728a62521ad55bd4c0f/numpy-2.5.3-cp312-cp312-musllinux_1_2_x86_64.whl", hash = "sha256:b5d93cf48f687479941d12b69c873ad2cc76bbd487f0091c2200636497f34034", size = 18476479, upload-time = "2026-09-06T16:24:49.35Z" },
+    { url = "https://files.pythonhosted.org/packages/c8/db/35e1c2d38b04cbd5b731f9d71495e055e813197669d22b612f11748d2ff9/numpy-2.5.3-cp312-cp312-win32.whl", hash = "sha256:bf63afbe037eb5d2fe87fbcc7778e61da53ebaf21d938a4515aa73b62532a5d4", size = 6133378, upload-time = "2026-09-06T16:24:51.915Z" },
+    { url = "https://files.pythonhosted.org/packages/3c/a1/accf6d4f0c80c5d9ba9735d6b1550e444180599f34dec69ca01360f717ad/numpy-2.5.3-cp312-cp312-win_amd64.whl", hash = "sha256:0a59a421a32580a009e8a1751345bf829631b990dc1794b80514ab722b435def", size = 12567828, upload-time = "2026-09-06T16:24:54.255Z" },
+    { url = "https://files.pythonhosted.org/packages/22/43/1764aff32e4652526ae2f71fa8b3efd8d25c8a3d6926914454e47138ed1e/numpy-2.5.3-cp312-cp312-win_arm64.whl", hash = "sha256:ccb32e0525d29e8b0572eb84c9a57af0e7a4e615726927506f55063c62414034", size = 10485432, upload-time = "2026-09-06T16:24:57.278Z" },
+]
+
+[[package]]
+name = "pillow"
+version = "12.3.0"
+source = { registry = "https://pypi.org/simple" }
+sdist = { url = "https://files.pythonhosted.org/packages/1c/3d/bb7fca845737cf9d7dbde16ed1843984665ff2e0a518f5db43e77ec540b9/pillow-12.3.0.tar.gz", hash = "sha256:3b8182a766685eaa002637e28b4ec8d6b18819a0c71f579bf0dbaa5830297cce", size = 47025035, upload-time = "2026-07-01T11:56:38.965Z" }
+wheels = [
+    { url = "https://files.pythonhosted.org/packages/37/bf/fb3ebff8ddcb76aac5a01389251bbbb9519922a9b520d8247c1ca864a25d/pillow-12.3.0-cp312-cp312-macosx_10_13_x86_64.whl", hash = "sha256:ba09209fbe443b4acccebe845d8a138b89a8f4fbaeedd44953490b5315d5e965", size = 5345969, upload-time = "2026-07-01T11:54:06.397Z" },
+    { url = "https://files.pythonhosted.org/packages/d8/66/9a386a92561f402389a4fc70c18838bf6d35eb5eb5c6850b4b2dc64f5048/pillow-12.3.0-cp312-cp312-macosx_11_0_arm64.whl", hash = "sha256:ffd0c5368496f41b0944be820fcb7a838aa6e623d250b01acf2643939c3f99d7", size = 4780323, upload-time = "2026-07-01T11:54:09.351Z" },
+    { url = "https://files.pythonhosted.org/packages/25/27/ac8f99618ffd3dde21db0f4d4b1d2ab00c0880595bfd17df103f7f39fd0c/pillow-12.3.0-cp312-cp312-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl", hash = "sha256:d9c7f76c0673154f044e9d78c8655fb4213f6ca31a836df48b40fe5d187717b9", size = 6266838, upload-time = "2026-07-01T11:54:11.71Z" },
+    { url = "https://files.pythonhosted.org/packages/84/21/a35af28dcc61f37ed850a2d64c65c701321dfbf25085e469d5559360cbbf/pillow-12.3.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl", hash = "sha256:78cb2c6865a35ab8ff8b75fd122f6033b92a62c82801110e48ddd6c936a45d91", size = 6940830, upload-time = "2026-07-01T11:54:13.732Z" },
+    { url = "https://files.pythonhosted.org/packages/eb/51/8b08617af3ad95e33ce6d7dd2c99ed6c8298f7fb131636303956be022e25/pillow-12.3.0-cp312-cp312-musllinux_1_2_aarch64.whl", hash = "sha256:e491916b378fba47242221bb9ead245211b70d504f495d105d17b14a24b4907c", size = 6344383, upload-time = "2026-07-01T11:54:15.756Z" },
+    { url = "https://files.pythonhosted.org/packages/1d/72/cf78ac9780bb93c28328f408973845a309d4d145041665f734572ced1b52/pillow-12.3.0-cp312-cp312-musllinux_1_2_x86_64.whl", hash = "sha256:0dd2064cbc55aaec028ef5fbb60fa47bb6c3e7918e07ff17935284b227a9d2df", size = 7052934, upload-time = "2026-07-01T11:54:17.721Z" },
+    { url = "https://files.pythonhosted.org/packages/20/20/25e0f4dc178a6bc0696793720055519a0de89e7661dae886992decbd2f81/pillow-12.3.0-cp312-cp312-win32.whl", hash = "sha256:dbce0b29841537a2fa4a214c2bbf14de3587c9680caa9b4e217568472490b28f", size = 6472684, upload-time = "2026-07-01T11:54:19.839Z" },
+    { url = "https://files.pythonhosted.org/packages/45/89/da2f7971a317f83d807fdd4065c0af40208e59e692cc43d315a71a0e96d1/pillow-12.3.0-cp312-cp312-win_amd64.whl", hash = "sha256:a2b55dd6b2a4c4b7d87ffa56bdb33fdc5fdb9a462173861a7bc097f17d91cb09", size = 7227137, upload-time = "2026-07-01T11:54:22.025Z" },
+    { url = "https://files.pythonhosted.org/packages/de/47/4845a0a6c0dbf1db8456bd9fc791f13c5ced7ced20606d08a0aacfd25b49/pillow-12.3.0-cp312-cp312-win_arm64.whl", hash = "sha256:331b624368d4f1d069149002f25f44bc61c8919ce8ddb3c45bdad8f6e2d89510", size = 2568267, upload-time = "2026-07-01T11:54:24.051Z" },
+]