jinaai
/

jina-clip-implementation

🇪🇺 Region: EU

Model card Files Files and versions

support use_flash_attn in from_pretrained

#2

by michael-guenther - opened May 30, 2024

base: refs/heads/main

←

from: refs/pr/2

Discussion Files changed

michael-guenther

Jina AI org May 30, 2024

•

edited Jun 3, 2024

This adds a shortcut to enable flash attention and xformer attention.

support flash attn in from_pretrainedd7c984ce

change use_flash_attn and add x_attention attributeab448a5f

set use_flash_attn at different positiona3f5a600

remove imports used for testing853dc7d4

michael-guenther changed pull request status to open Jun 3, 2024

gmastrapas changed pull request status to merged Jun 3, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment