dariakryvosheieva commited on
Commit
e31b922
·
verified ·
1 Parent(s): c4395ff

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen2.5-Coder-0.5B
4
+ ---
5
+
6
+ <br><br>
7
+
8
+ <p align="center">
9
+ <img src="https://huggingface.co/datasets/jinaai/documentation-images/resolve/main/logo.webp" alt="Jina AI: Your Search Foundation, Supercharged!" width="150px">
10
+ </p>
11
+
12
+ <p align="center">
13
+ <b>The code embedding model trained by <a href="https://jina.ai/"><b>Jina AI</b></a>.</b>
14
+ </p>
15
+
16
+ # Jina Embeddings c1: A Small but Performant Code Embedding Model
17
+
18
+ ## Intended Usage & Model Info
19
+ `jina-embeddings-c1` is an embedding model for code retrieval.
20
+ The model supports natural language-to-code, code-to-code, and code-to-natural language retrieval across 15+ programming languages.
21
+
22
+
23
+ Built on [Qwen/Qwen2.5-Coder-0.5B](https://huggingface.co/Qwen/Qwen2.5-Coder-0.5B), `jina-embeddings-c1` features:
24
+
25
+ - **Multilingual support** (15+ programming languages) and compatibility with a wide range of domains, including web development, machine learning, [...].
26
+ - **Task-specific instruction prefixes** for NL2Code, Code2Code, Code2NL, Technical QA, and Code2Completion retrieval, which can be selected at inference time.
27
+ - **Flexible embedding size**: dense embeddings are 896-dimensional by default but can be truncated to as low as 64 with minimal performance loss.
28
+
29
+
30
+ Summary of features:
31
+
32
+ | Feature | Jina Embeddings C1 |
33
+ |------------|------------|
34
+ | Base Model | Qwen2.5-Coder-0.5B |
35
+ | Supported Tasks | `nl2code`, `code2code`, `code2nl`, `qa`, `code2completion` |
36
+ | Model DType | BFloat 16 |
37
+ | Max Sequence Length | 32768 |
38
+ | Embedding Vector Dimension | 896 |
39
+ | Matryoshka dimensions | 64, 128, 256, 512, 896 |
40
+ | Pooling Strategy | Last-token pooling |
41
+ | Attention Mechanism | FlashAttention2 |
42
+
43
+
44
+
45
+ ## Training & Evaluation
46
+
47
+ Please refer to our technical report of jina-embeddings-c1 for training details and benchmarks.
48
+
49
+ ## Contact
50
+
51
+ Join our [Discord community](https://discord.jina.ai) and chat with other community members about ideas.
52
+ ```