Roytsai27 commited on
Commit
2ec5cbe
·
verified ·
1 Parent(s): 832fbe5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -1,3 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # GIRCSE: Generative Iterative Refinement for Contrastive Sentence Embeddings
2
 
3
  **GIRCSE** is a novel generative embedding framework that transforms Large Language Models (LLMs) into text encoders by leveraging their autoregressive generative capabilities. Unlike traditional encoder-only embeddings, GIRCSE generates a sequence of **"soft refinement tokens"** and utilizes an **Iterative Contrastive Refinement (ICR)** objective to progressively distill semantics into high-quality embeddings.
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ base_model: mistralai/Mistral-7B-v0.1
6
+ library_name: peft
7
+ tags:
8
+ - text-embeddings
9
+ - sentence-transformers
10
+ - contrastive-learning
11
+ - generative-embeddings
12
+ - mteb
13
+ datasets:
14
+ - MS-MARCO
15
+ - NLI
16
+ metrics:
17
+ - mteb
18
+ pipeline_tag: feature-extraction
19
+ ---
20
  # GIRCSE: Generative Iterative Refinement for Contrastive Sentence Embeddings
21
 
22
  **GIRCSE** is a novel generative embedding framework that transforms Large Language Models (LLMs) into text encoders by leveraging their autoregressive generative capabilities. Unlike traditional encoder-only embeddings, GIRCSE generates a sequence of **"soft refinement tokens"** and utilizes an **Iterative Contrastive Refinement (ICR)** objective to progressively distill semantics into high-quality embeddings.