PyTorch
cooper_robot Cursor commited on
Commit
96b6362
·
1 Parent(s): eb43f24

Add release note for v1.3.0

Browse files

Co-authored-by: Cursor <cursoragent@cursor.com>

LICENSE ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+
3
+ Copyright (c) Microsoft Corporation.
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE
README.md ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: pytorch
3
+ ---
4
+
5
+ ![xclip_logo](resource/XCLIP_base_patch32_frames8.png)
6
+
7
+ X-CLIP extends the CLIP framework from images to videos by incorporating temporal modeling, enabling aligned video–text representations for efficient video understanding and recognition.
8
+
9
+ Original paper: [Expanding Language-Image Pretrained Models for General Video Recognition (X-CLIP)](https://arxiv.org/abs/2208.02816)
10
+
11
+ # XCLIP-B32F8
12
+
13
+ This model uses the **X-CLIP Base-Patch32-8Frames** variant, which combines a ViT-Base backbone with 32×32 image patches and processes 8 video frames to capture both appearance and motion information. It is well suited for applications such as video classification, video retrieval, video-text matching, and zero-shot video understanding where efficient spatiotemporal reasoning is required.
14
+
15
+ Model Configuration:
16
+ - Reference implementation: [Official X-CLIP source code](https://github.com/microsoft/VideoX/tree/master/X-CLIP)
17
+ - Original Weight: [XCLIP-B32F8](https://huggingface.co/microsoft/xclip-base-patch32/blob/main/model.safetensors)
18
+ - Resolution: 8x3x224x224
19
+ - Support Cooper version:
20
+ - Cooper SDK: [2.5.4]
21
+ - Cooper Foundry: [2.3]
22
+
23
+
24
+ | Model | Device | Compression | Model Link |
25
+ | :-----: | :-----: | :-----: | ------- |
26
+ | XCLIP-B32F8 Video encoder | N1-655 | Activation_fp16 | [Model_Link](https://huggingface.co/Ambarella/XCLIP/blob/main/n1-655_xclip_b32f8_video_encoder_act16.bin) |
27
+ | XCLIP-B32F8 Text encoder | N1-655 | Activation_fp16 | [Model_Link](https://huggingface.co/Ambarella/XCLIP/blob/main/n1-655_xclip_b32f8_text_encoder_act16.bin) |
28
+ | XCLIP-B32F8 Post Predictor | N1-655 | Activation_fp16 | [Model_Link](https://huggingface.co/Ambarella/XCLIP/blob/main/n1-655_xclip_b32f8_post_predictor_act16.bin) |
n1-655_xclip_b32f8_post_predictor_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb3a5e707e5afadc7856b06ad8428e9ff8acc298212b3285146e741220573fd7
3
+ size 9657222
n1-655_xclip_b32f8_text_encoder_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9484e8219b19a5ed83b47c6e9487ceb0c79603da702fa0f71557a2df78c3829
3
+ size 39060901
n1-655_xclip_b32f8_video_encoder_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf0c49d0d5d35e0ed9d72ed45446fff9b46c7657d31620eb0962bfc70e8ad608
3
+ size 126759450
resource/XCLIP_base_patch32_frames8.png ADDED

Git LFS Details

  • SHA256: 00e736ff34569fde1321ca0612028b5efe0d670c042cc220f0ce62967c3d2f34
  • Pointer size: 132 Bytes
  • Size of remote file: 1.34 MB
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a75dc79c6ec004a7e2d346c20e0af8d29aa2b251ea356964718aef8b8f052e80
3
+ size 2224041
xclip_b32f8_token_embedding_weight.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c39d737a6c79f047f0d847ed07e77873ba35d038a0fb57048cf1810675fd18c
3
+ size 101187584