LibreFlowSeekm-flow

FlowSeek optical flow (ResNet-34 context and feature networks, Depth Anything V2 ViT-B (Base) encoder, 4 refinement iterations), repackaged for LibreYOLO's flow task.

Non-commercial use only. This checkpoint embeds the Depth Anything V2 Base encoder, whose weights are CC BY-NC 4.0. The t and s sizes (LibreFlowSeekt-flow, LibreFlowSeeks-flow) embed the Apache-2.0 Small encoder and carry no such restriction.

Source

Derived from mattpoggi/flowseek at commit ba6407370bceeb96244cad4d60d37489f6eb471e, checkpoint flowseek_M_TartanCT_TSKH.pth (TartanAir, then Chairs and Things, then the Sintel + KITTI + HD1K + Things mixed fine-tune: the generalist checkpoint upstream evaluates on Spring and LayeredFlow). Copyright (c) 2025 Matteo Poggi and Fabio Tosi (University of Bologna). FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Bases, ICCV 2025.

The checkpoint embeds the frozen Depth Anything V2 ViT-B (Base) encoder (DepthAnything/Depth-Anything-V2), so this file is self-contained. FlowSeek builds on SEA-RAFT (BSD 3-Clause).

Upstream trains two networks. This size uses the same weights as LibreFlowSeekl-flow with a different iteration count, as in upstream config/eval/flowseek-M.json.

Modifications

Metadata wrap only (LibreYOLO checkpoint schema v1.0). Learned parameters are unchanged. See weights/convert_flowseek_weights.py in the LibreYOLO source repository.

Usage

from libreyolo import LibreYOLO

model = LibreYOLO("LibreFlowSeekm-flow.pt")
results = model(["frame_000.png", "frame_001.png"])  # N frames give N - 1 flows
flow = results[0].flow.data  # (H, W, 2) float32, pixels, (dx, dy)

License

FlowSeek parameters: Apache License 2.0 (implied by the releasing repository). Embedded Depth Anything V2 Base encoder: CC BY-NC 4.0. Commercial use is not permitted.

See the LICENSE and NOTICE files in this repository.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support