LH-Tech-AI commited on
Commit
77fef64
·
verified ·
1 Parent(s): 4deb5e2

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: mit
4
+ library_name: transformers
5
+ tags:
6
+ - sentiment-analysis
7
+ - classification
8
+ - from-scratch
9
+ datasets:
10
+ - imdb
11
+ metrics:
12
+ - accuracy
13
+ model-index:
14
+ - name: CritiqueCore-v1
15
+ results:
16
+ - task:
17
+ type: text-classification
18
+ name: Sentiment Analysis
19
+ dataset:
20
+ name: imdb
21
+ type: imdb
22
+ metrics:
23
+ - type: accuracy
24
+ value: 0.9
25
+ pipeline_tag: text-classification
26
+ ---
27
+
28
+ # CritiqueCore v1
29
+
30
+ CritiqueCore v1 is a compact Transformer model trained **from scratch** for sentiment analysis. Unlike models that use transfer learning, this model was initialized with random weights and learned the nuances of language (including sarcasm and basic cross-lingual sentiment) exclusively from the IMDb movie reviews dataset.
31
+
32
+ ## Model Description
33
+ - **Architecture:** Custom Mini-Transformer (DistilBERT-based configuration)
34
+ - **Parameters:** ~9.06 Million
35
+ - **Layers:** 2
36
+ - **Attention Heads:** 4
37
+ - **Hidden Dimension:** 256
38
+ - **Training Data:** IMDb Movie Reviews (25,000 samples)
39
+ - **Training Duration:** ~10 minutes on NVIDIA T4 GPU
40
+
41
+ ## Capabilities
42
+ - **Sentiment Detection:** Strong performance on positive/negative English text.
43
+ - **Sarcasm Awareness:** Recognizes negative intent even when positive words are used (e.g., "CGI vomit").
44
+ - **Robustness:** Handles minor typos and maintains high confidence on structured feedback.
45
+
46
+ ## Limitations
47
+ - **Domain Specificity:** Optimized for reviews. May struggle with complex multi-turn dialogues.
48
+ - **Multilingual:** While it shows some intuition for German, it was not explicitly trained on non-English data.
49
+
50
+ ## How to use (Inference Script)
51
+
52
+ Use `inference.py` from this repos' files list. Have fun :D