cooper_robot Cursor commited on
Commit ·
96b6362
1
Parent(s): eb43f24
Add release note for v1.3.0
Browse filesCo-authored-by: Cursor <cursoragent@cursor.com>
LICENSE
ADDED
|
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
MIT License
|
| 2 |
+
|
| 3 |
+
Copyright (c) Microsoft Corporation.
|
| 4 |
+
|
| 5 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
| 6 |
+
of this software and associated documentation files (the "Software"), to deal
|
| 7 |
+
in the Software without restriction, including without limitation the rights
|
| 8 |
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
| 9 |
+
copies of the Software, and to permit persons to whom the Software is
|
| 10 |
+
furnished to do so, subject to the following conditions:
|
| 11 |
+
|
| 12 |
+
The above copyright notice and this permission notice shall be included in all
|
| 13 |
+
copies or substantial portions of the Software.
|
| 14 |
+
|
| 15 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
| 16 |
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
| 17 |
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
| 18 |
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
| 19 |
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
| 20 |
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
| 21 |
+
SOFTWARE
|
README.md
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: pytorch
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+

|
| 6 |
+
|
| 7 |
+
X-CLIP extends the CLIP framework from images to videos by incorporating temporal modeling, enabling aligned video–text representations for efficient video understanding and recognition.
|
| 8 |
+
|
| 9 |
+
Original paper: [Expanding Language-Image Pretrained Models for General Video Recognition (X-CLIP)](https://arxiv.org/abs/2208.02816)
|
| 10 |
+
|
| 11 |
+
# XCLIP-B32F8
|
| 12 |
+
|
| 13 |
+
This model uses the **X-CLIP Base-Patch32-8Frames** variant, which combines a ViT-Base backbone with 32×32 image patches and processes 8 video frames to capture both appearance and motion information. It is well suited for applications such as video classification, video retrieval, video-text matching, and zero-shot video understanding where efficient spatiotemporal reasoning is required.
|
| 14 |
+
|
| 15 |
+
Model Configuration:
|
| 16 |
+
- Reference implementation: [Official X-CLIP source code](https://github.com/microsoft/VideoX/tree/master/X-CLIP)
|
| 17 |
+
- Original Weight: [XCLIP-B32F8](https://huggingface.co/microsoft/xclip-base-patch32/blob/main/model.safetensors)
|
| 18 |
+
- Resolution: 8x3x224x224
|
| 19 |
+
- Support Cooper version:
|
| 20 |
+
- Cooper SDK: [2.5.4]
|
| 21 |
+
- Cooper Foundry: [2.3]
|
| 22 |
+
|
| 23 |
+
|
| 24 |
+
| Model | Device | Compression | Model Link |
|
| 25 |
+
| :-----: | :-----: | :-----: | ------- |
|
| 26 |
+
| XCLIP-B32F8 Video encoder | N1-655 | Activation_fp16 | [Model_Link](https://huggingface.co/Ambarella/XCLIP/blob/main/n1-655_xclip_b32f8_video_encoder_act16.bin) |
|
| 27 |
+
| XCLIP-B32F8 Text encoder | N1-655 | Activation_fp16 | [Model_Link](https://huggingface.co/Ambarella/XCLIP/blob/main/n1-655_xclip_b32f8_text_encoder_act16.bin) |
|
| 28 |
+
| XCLIP-B32F8 Post Predictor | N1-655 | Activation_fp16 | [Model_Link](https://huggingface.co/Ambarella/XCLIP/blob/main/n1-655_xclip_b32f8_post_predictor_act16.bin) |
|
n1-655_xclip_b32f8_post_predictor_act16.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cb3a5e707e5afadc7856b06ad8428e9ff8acc298212b3285146e741220573fd7
|
| 3 |
+
size 9657222
|
n1-655_xclip_b32f8_text_encoder_act16.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b9484e8219b19a5ed83b47c6e9487ceb0c79603da702fa0f71557a2df78c3829
|
| 3 |
+
size 39060901
|
n1-655_xclip_b32f8_video_encoder_act16.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cf0c49d0d5d35e0ed9d72ed45446fff9b46c7657d31620eb0962bfc70e8ad608
|
| 3 |
+
size 126759450
|
resource/XCLIP_base_patch32_frames8.png
ADDED
|
Git LFS Details
|
tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a75dc79c6ec004a7e2d346c20e0af8d29aa2b251ea356964718aef8b8f052e80
|
| 3 |
+
size 2224041
|
xclip_b32f8_token_embedding_weight.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8c39d737a6c79f047f0d847ed07e77873ba35d038a0fb57048cf1810675fd18c
|
| 3 |
+
size 101187584
|