andreiradu2102 commited on
Commit
b13850c
·
verified ·
1 Parent(s): ba7c2a3

Upload folder using huggingface_hub

Browse files
README.md ADDED
@@ -0,0 +1,96 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: microsoft/deberta-v3-base
3
+ library_name: peft
4
+ pipeline_tag: text-classification
5
+ language:
6
+ - en
7
+ tags:
8
+ - misinformation-detection
9
+ - social-media
10
+ - fakett
11
+ - peft
12
+ - lora
13
+ - transformers
14
+ - base_model:adapter:microsoft/deberta-v3-base
15
+ ---
16
+
17
+ # DeBERTa — Text-Only Misinformation Detection on FakeTT
18
+
19
+ **Developed by Andrei-Gabriel Radu.**
20
+
21
+ Bachelor thesis supervised by **Ciprian-Octavian Truică and Elena-Simona Apostol**,
22
+ **National University of Science and Technology POLITEHNICA Bucharest**.
23
+
24
+ LoRA adapter fine-tuned from `microsoft/deberta-v3-base` for binary **text-only misinformation classification** on the FakeTT social-media video dataset.
25
+
26
+ This model accompanies the bachelor thesis *Misinformation Detection in Social Media Videos*.
27
+
28
+
29
+ ## Results
30
+
31
+ | Dataset | Modality | Macro-F1 |
32
+ |---|---|---:|
33
+ | FakeTT | Text-only | 0.7776 |
34
+
35
+ ## Model
36
+
37
+ - **Base model:** `microsoft/deberta-v3-base`
38
+ - **Task:** Binary misinformation classification
39
+ - **Modality:** Text-only
40
+ - **Fine-tuning:** LoRA / PEFT
41
+ - **Dataset:** FakeTT
42
+ - **Number of classes:** 2
43
+ - **Primary metric:** Macro-F1
44
+
45
+ ## Training
46
+
47
+ - **LoRA rank (`r`):** 8
48
+ - **LoRA alpha:** 32
49
+ - **LoRA dropout:** 0.05
50
+ - **Target modules:** `key_proj`, `query_proj`, `value_proj`, `dense`
51
+ - **Bias:** none
52
+
53
+ ## Usage
54
+
55
+ ```python
56
+ import torch
57
+ from peft import PeftModel
58
+ from transformers import AutoTokenizer, AutoModelForSequenceClassification
59
+
60
+ repo_id = "DS4AI-UPB/deberta-misinfo-lora"
61
+ base_model_id = "microsoft/deberta-v3-base"
62
+
63
+ tokenizer = AutoTokenizer.from_pretrained(repo_id)
64
+ base_model = AutoModelForSequenceClassification.from_pretrained(base_model_id, num_labels=2)
65
+ model = PeftModel.from_pretrained(base_model, repo_id).eval()
66
+
67
+ text = "Example social media video description."
68
+ inputs = tokenizer(text, return_tensors="pt", truncation=True, padding=True)
69
+
70
+ with torch.no_grad():
71
+ logits = model(**inputs).logits
72
+
73
+ print(logits.argmax(dim=-1).item())
74
+ ```
75
+
76
+ > Use the class-to-label mapping from the original FakeTT training pipeline.
77
+
78
+ ## Intended Use
79
+
80
+ Research and benchmarking of English-language text-only misinformation detection for social-media video content.
81
+
82
+ ## Limitations
83
+
84
+ This is a classification model, not a factual verification system. It cannot inspect the associated video and can degrade under domain shift.
85
+
86
+ ## Citation
87
+
88
+ ```bibtex
89
+ @thesis{radu2026misinformation,
90
+ title = {Misinformation Detection in Social Media Videos},
91
+ author = {Radu, Andrei-Gabriel},
92
+ school = {National University of Science and Technology POLITEHNICA Bucharest},
93
+ year = {2026}
94
+ }
95
+ ```
96
+
adapter_config.json ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {},
4
+ "arrow_config": null,
5
+ "auto_mapping": null,
6
+ "base_model_name_or_path": "microsoft/deberta-v3-base",
7
+ "bias": "none",
8
+ "corda_config": null,
9
+ "ensure_weight_tying": false,
10
+ "eva_config": null,
11
+ "exclude_modules": null,
12
+ "fan_in_fan_out": false,
13
+ "inference_mode": true,
14
+ "init_lora_weights": true,
15
+ "layer_replication": null,
16
+ "layers_pattern": null,
17
+ "layers_to_transform": null,
18
+ "loftq_config": {},
19
+ "lora_alpha": 32,
20
+ "lora_bias": false,
21
+ "lora_dropout": 0.05,
22
+ "megatron_config": null,
23
+ "megatron_core": "megatron.core",
24
+ "modules_to_save": [
25
+ "classifier",
26
+ "score"
27
+ ],
28
+ "peft_type": "LORA",
29
+ "peft_version": "0.18.1",
30
+ "qalora_group_size": 16,
31
+ "r": 8,
32
+ "rank_pattern": {},
33
+ "revision": null,
34
+ "target_modules": [
35
+ "key_proj",
36
+ "query_proj",
37
+ "value_proj",
38
+ "dense"
39
+ ],
40
+ "target_parameters": null,
41
+ "task_type": "SEQ_CLS",
42
+ "trainable_token_indices": null,
43
+ "use_dora": false,
44
+ "use_qalora": false,
45
+ "use_rslora": false
46
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e43abe4d7f255a475f76e0e56df972604d13f4c37e48ffc2c0c53c1fc076d77e
3
+ size 5384856
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": true,
3
+ "backend": "tokenizers",
4
+ "bos_token": "[CLS]",
5
+ "cls_token": "[CLS]",
6
+ "do_lower_case": false,
7
+ "eos_token": "[SEP]",
8
+ "extra_special_tokens": [
9
+ "[PAD]",
10
+ "[CLS]",
11
+ "[SEP]"
12
+ ],
13
+ "is_local": false,
14
+ "mask_token": "[MASK]",
15
+ "model_max_length": 1000000000000000019884624838656,
16
+ "pad_token": "[PAD]",
17
+ "sep_token": "[SEP]",
18
+ "split_by_punct": false,
19
+ "tokenizer_class": "DebertaV2Tokenizer",
20
+ "unk_id": 3,
21
+ "unk_token": "[UNK]",
22
+ "vocab_type": "spm"
23
+ }