gedeonmate commited on
Commit
469280b
·
verified ·
1 Parent(s): 10a643e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -3
README.md CHANGED
@@ -1,3 +1,29 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - hu
5
+ base_model:
6
+ - SZTAKI-HLT/hubert-base-cc
7
+ - FacebookAI/xlm-roberta-base
8
+ ---
9
+
10
+ # 🧠 Static Word Embeddings for Hungarian (huBERT & XLM-RoBERTa)
11
+
12
+ This repository contains static word embedding models extracted from the following BERT-based models:
13
+
14
+ - [`SZTAKI-HLT/hubert-base-cc`](https://huggingface.co/SZTAKI-HLT/hubert-base-cc)
15
+ - [`FacebookAI/xlm-roberta-base`](https://huggingface.co/FacebookAI/xlm-roberta-base)
16
+
17
+ ## 📦 Available Embedding Variants
18
+
19
+ Each model is provided in three static embedding variants:
20
+
21
+ - **Decontextualized**: Token embeddings extracted without any surrounding context.
22
+ - **Aggregate**: Static embeddings computed by averaging token representations of different contexts the word appears in.
23
+ - **X2Static**: Learned static embeddings trained via the **X2Static** method, designed to optimize static representations from contextual models.
24
+
25
+ ## 🧪 Use Case
26
+
27
+ These embeddings were developed and evaluated as part of the paper: **_A Comparative Analysis of Static Word Embeddings for Hungarian_** by *Máté Gedeon*.
28
+
29
+ They can be used for intrinsic tasks (e.g., word analogies) and extrinsic tasks (e.g., POS tagging, NER) in Hungarian NLP applications.