sam2-mlx / README.md
SceneWorks's picture
Upload README.md with huggingface_hub
cbafeb9 verified
metadata
license: apache-2.0
tags:
  - mlx
  - sam2
  - segmentation
  - segment-anything

SceneWorks/sam2-mlx

MLX-converted SAM2.1 (Segment Anything 2) checkpoints for the native-MLX mlx-gen-sam2 segmenter (SceneWorks engine, epic 3704). No Python in the runtime or weight path — these load directly into the Rust mlx-rs model.

Provenance

file source (official Meta) source sha256 output sha256
sam2.1_hiera_large.safetensors facebook/sam2.1-hiera-large / sam2.1_hiera_large.pt 2647878d5dfa5098f2f8649825738a9345572bae2d4350a2468587ece47dd318 bbbd94abd316a0867d906c6cdf2d51c780c3fd3e804ab47bdcdc9b29763628e1

Converted from the canonical Meta .pt (Apache-2.0) with mlx-gen tools/convert_sam2_to_mlx.py (Torch OIHW→MLX OHWI conv transposes; learned pos_embed bicubic-interpolated + window-pos fused into trunk.pos_embed_full). f32. Full segmenter (encoder + prompt encoder + mask decoder + memory).

Key layout matches mlx-gen-sam2 (trunk. / neck. / sam_prompt_encoder. / sam_mask_decoder. / memory / obj-ptr); bit-identical to avbiswas/sam2.1-hiera-large-mlx (same conversion).