Spaces:
Configuration error
Configuration error
File size: 4,216 Bytes
e5ec008 8028cdf e5ec008 8028cdf e5ec008 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 | <div align="center">
<img src="https://raw.githubusercontent.com/apairo-robotics/apairo/main/docs/resources/apairo_logo_full.png" alt="apairo" width="380">
**One numpy-in / numpy-out API for robotics sensor datasets.**
[](https://apairo-robotics.github.io/)
[](https://apairo-robotics.github.io/apairo/)
[](https://pypi.org/project/apairo/)
</div>
---
## What is apairo?
**apairo** is a unified loader for robotics sensor datasets — lidar, cameras,
poses, IMU, labels — with one chainable API across **synchronous** (KITTI-style)
and **asynchronous** (multi-rate) layouts. No bespoke `glob + np.load` loaders,
no hand-written timestamp matching: everything is a dataset you `filter`,
`select`, `cache`, `synchronize`, `concat` and feed straight to a PyTorch
`DataLoader`.
- **numpy in, numpy out** — `ds[i].data["lidar"] -> np.ndarray`; convert to
torch/tf at the edge, never inside the dataset.
- **everything is a dataset** — `filter / select / cache / join / concat /
synchronize / split / transform` all return chainable, lazy views.
- **`.apairo` is the source of truth on disk** — channels (raw + derived) are
declared in a sidecar; expensive preprocess output is persisted and reloaded
transparently.
```python
import apairo
ds = (apairo.RawDataset("/data/mission", keys=["lidar", "image", "gps"])
.synchronize(reference="lidar", method="nearest", tolerance=0.05)
.filter(lambda s: s.data["lidar"].shape[0] > 1000))
ds[0].data # {"lidar": (N, 4), "image": (H, W, 3), "gps": (3,)}
# an apairo dataset *is* a torch Dataset -> DataLoader(ds, collate_fn=...), no adapter
```
Point `RawDataset` at a directory and it loads — no code. When a channel's clock
lives in its **filenames**, declare it right there and apairo reads it in memory,
never writing into your data. See
[Bring your own dataset](https://apairo-robotics.github.io/apairo/datasets/bring-your-own-dataset/).
---
## The ecosystem
> Mechanisms live in the **core**; collections live in **satellites**. The core
> never gains a dependency beyond numpy + PyYAML.
| Repo | What it does |
|---|---|
| **[apairo](https://github.com/apairo-robotics/apairo)** | The core — load / synchronize / filter / cache / preprocess robotics datasets, one API for sync + async layouts. |
| **[apairo_transform](https://github.com/apairo-robotics/apairo_transform)** | Access-time numpy transforms & augmentations (range/box filters, voxelization, rotations, interpolators). |
| **[apairo_preprocess](https://github.com/apairo-robotics/apairo_preprocess)** | Heavy offline preprocessors, persisted as derived `.apairo` channels and reloaded transparently. |
| **[apairo_extractor](https://github.com/apairo-robotics/apairo_extractor)** | Turn ROS bags into the apairo / KITTI on-disk layout, with optional preprocessing. |
| **[apairo_rr](https://github.com/apairo-robotics/apairo_rr)** | Rerun-based lidar / multi-sensor visualization of apairo datasets. |
| **[apairo_huggingface](https://github.com/apairo-robotics/apairo_huggingface)** | Label apairo datasets and export them to the HuggingFace `LeRobotDataset` format. |
---
## Getting started
```bash
pip install apairo # Python >= 3.11
pip install apairo[vision] # optional: image loading (Pillow)
```
- **[Documentation](https://apairo-robotics.github.io/apairo/)** — quickstart, the `.apairo` schema, synchronizing async sensors, preprocessing.
- **[Bring your own dataset](https://apairo-robotics.github.io/apairo/datasets/bring-your-own-dataset/)** — YAML profiles, thin subclasses, filename-encoded keys.
- **[apairo-robotics/apairo](https://github.com/apairo-robotics/apairo)** — source, issues, contributing.
|