coderian commited on
Commit
558166c
·
verified ·
1 Parent(s): 9c16d2b

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. README.md +43 -1
  2. veytra-embed-base.pt +3 -0
README.md CHANGED
@@ -1,3 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
- license: mit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ <div align="center">
2
+
3
+ # ✦ Veytra ✦
4
+
5
+ **From words to vectors, from vectors to meaning.**
6
+
7
+ A lightweight, elegant **sentence embedding model**, built from scratch.
8
+
9
+ [![Params](https://img.shields.io/badge/params-3.3M-blue)](https://github.com/coderian/veytra)
10
+ [![Embedding](https://img.shields.io/badge/embedding-64d-green)](https://github.com/coderian/veytra)
11
+ [![Dataset](https://img.shields.io/badge/dataset-STS--B-orange)](https://huggingface.co/datasets/sentence-transformers/stsb)
12
+ [![GitHub](https://img.shields.io/badge/GitHub-coderian%2Fveytra-black?logo=github)](https://github.com/coderian/veytra)
13
+
14
+ </div>
15
+
16
  ---
17
+
18
+ Trained with a Transformer architecture, Veytra maps sentences into **64-dimensional vectors** and measures the **semantic closeness** between two sentences via cosine similarity. Small yet ambitious — designed for those who believe in the power of simplicity.
19
+
20
+ <div align="center">
21
+
22
+ | ⚙️ Architecture | |
23
+ |---|---|
24
+ | **Total Parameters** | ~3.3M (3,316,544) |
25
+ | **Tokenizer** | GPT-2 (50,257 vocab) |
26
+ | **Model** | Transformer Encoder (2 layers, 4 heads) |
27
+ | **Embedding Dimension** | 64 |
28
+ | **Max Length** | 64 tokens |
29
+ | **Pooling** | Mean Pooling + L2 Normalization |
30
+
31
+ </div>
32
+
33
  ---
34
+
35
+ ## ⚡ Usage
36
+
37
+ ```bash
38
+ python3 train.py
39
+ ```
40
+
41
+ <div align="center">
42
+
43
+ *Veytra — encoding meaning.*
44
+
45
+ </div>
veytra-embed-base.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:524034658ea46453fff7ea1ec160be04fc6254912df7781ddf1f8340680149a4
3
+ size 13293539