LibreRAFTl-flow-sintel

RAFT (large, 5.3M parameters) optical flow, upstream checkpoint raft-sintel.pth, repackaged for LibreYOLO. Training schedule: C+T, then fine-tuned on the MPI Sintel mix (C+T+S+K+H).

from libreyolo import LibreYOLO

model = LibreYOLO("LibreRAFTl-flow-sintel.pt")
r = model(["frame_000.png", "frame_001.png"])[0]
r.flow.data        # (H, W, 2) float32, (dx, dy) in pixels, frame 0 to frame 1
r.flow.to_rgb()    # Middlebury colour wheel

Inference runs at native resolution, padded to a multiple of 8 as upstream InputPadder, with 20 refinement iterations (upstream demo.py).

Source

Derived from princeton-vl/RAFT at commit 2888e15, file raft-sintel.pth from the release models.zip (sha256 90630d2e7d488a0d3ccb5e8194524850c4c05c732ea4ff99799822c7fa5c5cbf). Copyright (c) 2020, princeton-vl. Licensed under the BSD 3-Clause License.

Modifications

The DataParallel module. key prefix is stripped and LibreYOLO checkpoint metadata is added (task: flow). Learned parameters are unchanged. See weights/convert_raft_weights.py in the LibreYOLO source repository. On 9 Sintel demo pairs (1024x436) the LibreYOLO output matches upstream RAFT bit for bit in fp32 (max abs difference 0.0 px).

License

BSD 3-Clause License. See the LICENSE and NOTICE files in this repository.