uf-aice-lab commited on
Commit
fe843a3
Β·
verified Β·
1 Parent(s): 21de1ae

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +57 -0
README.md ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # BERT-based Multi-label Cognitive Load Classifier
2
+
3
+ This model is a fine-tuned `bert-base-uncased` transformer trained to classify **students' cognitive and psychological states** (e.g., cognitive load, confidence, anxiety) from naturalistic **human-AI educational dialogues** in K-12 settings.
4
+
5
+ ## 🧠 What does the model do?
6
+
7
+ The model performs **multi-label classification** on student-AI conversations, identifying whether a given interaction reflects one or more of the following cognitive and affective states:
8
+
9
+ - Math Confidence / Math Anxiety
10
+ - AI Confidence / AI Concerns
11
+ - Intrinsic Cognitive Load
12
+ - Extraneous Cognitive Load
13
+ - Germane Cognitive Load
14
+
15
+ Each input text (a single conversation) may correspond to **multiple labels simultaneously**.
16
+
17
+ ---
18
+
19
+ ## πŸ“š Training Data
20
+
21
+ The model was trained on a custom dataset collected from a large-scale empirical study involving **160 K-12 students** interacting with an AI-powered teachable agent in a math learning platform (ALTER-Math, name anonymized for review).
22
+
23
+ - **Dialogues**: 1,440 student-agent interactions over 10 days
24
+ - **Labels**: Derived from pre- and post-questionnaires grounded in Cognitive Load Theory and affective constructs
25
+ - **Label types**: Binary indicators (0/1) per psychological factor
26
+ - **Preprocessing**: Tokenized using Hugging Face's `AutoTokenizer`, padded to max length of 128
27
+
28
+ ---
29
+
30
+ ## πŸ‹οΈβ€β™‚οΈ Training Setup
31
+
32
+ - Model: `bert-base-uncased`
33
+ - Task: Multi-label text classification
34
+ - Loss: BCEWithLogitsLoss
35
+ - Optimizer: AdamW
36
+ - Batch Size: 16
37
+ - Epochs: 5
38
+ - Learning Rate: 1e-5
39
+ - Evaluation Strategy: Hold-out test set (20%)
40
+
41
+ ---
42
+
43
+ ## πŸš€ Intended Use
44
+
45
+ This model is designed to support **AI-based unobtrusive assessment of cognitive load** in education, enabling:
46
+
47
+ - Researchers to monitor how students respond cognitively and emotionally to AI tutors
48
+ - Developers to build more adaptive, trustworthy AI learning agents
49
+ - Teachers to gain insight into student engagement and overload without invasive devices
50
+
51
+ ---
52
+
53
+ ## πŸ“Œ Limitations
54
+
55
+ - The dataset size is modest (N=160), and model generalization to other domains or age groups is not guaranteed.
56
+ - Labels are inferred from questionnaire-aligned criteria, which may include subjectivity.
57
+ - The model does not currently handle out-of-distribution input or code-switching effectively.