MartinRodrigo commited on
Commit
2fdb9ef
·
verified ·
1 Parent(s): 5b66e28

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ training_history.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,163 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: apache-2.0
4
+ tags:
5
+ - sentiment-analysis
6
+ - transformers
7
+ - unknown
8
+ - text-classification
9
+ datasets:
10
+ - unknown
11
+ metrics:
12
+ - accuracy
13
+ - f1
14
+ - precision
15
+ - recall
16
+ model-index:
17
+ - name: unknown-sentiment
18
+ results:
19
+ - task:
20
+ type: text-classification
21
+ name: Sentiment Analysis
22
+ dataset:
23
+ name: UNKNOWN
24
+ type: unknown
25
+ metrics:
26
+ - type: accuracy
27
+ value: 0.0000
28
+ name: Test Accuracy
29
+ - type: f1
30
+ value: 0.0000
31
+ name: F1 Score
32
+ - type: precision
33
+ value: 0.0000
34
+ name: Precision
35
+ - type: recall
36
+ value: 0.0000
37
+ name: Recall
38
+ ---
39
+
40
+ # UNKNOWN Fine-tuned for Sentiment Analysis
41
+
42
+ ## 📊 Model Description
43
+
44
+ This model is a fine-tuned version of `unknown` for sentiment analysis on the UNKNOWN dataset.
45
+
46
+ **Model Architecture:** unknown
47
+ **Task:** Binary Sentiment Classification (Positive/Negative)
48
+ **Language:** English
49
+ **Training Date:** N/A
50
+
51
+ ## 🎯 Performance Metrics
52
+
53
+ | Metric | Score |
54
+ |--------|-------|
55
+ | **Accuracy** | 0.0000 |
56
+ | **F1 Score** | 0.0000 |
57
+ | **Precision** | 0.0000 |
58
+ | **Recall** | 0.0000 |
59
+ | **Loss** | 0.0000 |
60
+
61
+ ## 🔧 Training Details
62
+
63
+ ### Hyperparameters
64
+
65
+ ```json
66
+ {}
67
+ ```
68
+
69
+ ### Dataset
70
+ - **Training samples:** N/A
71
+ - **Validation samples:** N/A
72
+ - **Test samples:** N/A
73
+
74
+ ## 🚀 Usage
75
+
76
+ ### With Transformers Pipeline
77
+
78
+ ```python
79
+ from transformers import pipeline
80
+
81
+ # Load the model
82
+ classifier = pipeline("sentiment-analysis", model="YOUR_USERNAME/YOUR_MODEL_NAME")
83
+
84
+ # Predict
85
+ result = classifier("I love this movie!")
86
+ print(result)
87
+ # [{'label': 'POSITIVE', 'score': 0.9998}]
88
+ ```
89
+
90
+ ### Manual Usage
91
+
92
+ ```python
93
+ from transformers import AutoTokenizer, AutoModelForSequenceClassification
94
+ import torch
95
+
96
+ # Load model and tokenizer
97
+ model_name = "YOUR_USERNAME/YOUR_MODEL_NAME"
98
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
99
+ model = AutoModelForSequenceClassification.from_pretrained(model_name)
100
+
101
+ # Prepare input
102
+ text = "This is an amazing product!"
103
+ inputs = tokenizer(text, return_tensors="pt", truncation=True, max_length=512)
104
+
105
+ # Predict
106
+ with torch.no_grad():
107
+ outputs = model(**inputs)
108
+ predictions = torch.nn.functional.softmax(outputs.logits, dim=-1)
109
+
110
+ # Get result
111
+ label_id = torch.argmax(predictions).item()
112
+ score = predictions[0][label_id].item()
113
+
114
+ labels = ["NEGATIVE", "POSITIVE"]
115
+ print(f"Label: {labels[label_id]}, Score: {score:.4f}")
116
+ ```
117
+
118
+ ## 📈 Training Curves
119
+
120
+ Training history visualization is available in the model files.
121
+
122
+ ## 🏷️ Label Mapping
123
+
124
+ ```
125
+ 0: NEGATIVE
126
+ 1: POSITIVE
127
+ ```
128
+
129
+ ## ⚙️ Model Configuration
130
+
131
+ ```json
132
+ {}
133
+ ```
134
+
135
+ ## 📝 Citation
136
+
137
+ If you use this model, please cite:
138
+
139
+ ```bibtex
140
+ @misc{sentiment-model-unknown,
141
+ author = {Your Name},
142
+ title = {unknown Fine-tuned for Sentiment Analysis},
143
+ year = {2025},
144
+ publisher = {Hugging Face},
145
+ howpublished = {\url{https://huggingface.co/YOUR_USERNAME/YOUR_MODEL_NAME}}
146
+ }
147
+ ```
148
+
149
+ ## 🤝 Contact
150
+
151
+ For questions or feedback, please open an issue in the repository.
152
+
153
+ ## 📄 License
154
+
155
+ Apache 2.0
156
+
157
+ ## 🔗 Related Models
158
+
159
+ - [unknown](https://huggingface.co/unknown)
160
+
161
+ ---
162
+
163
+ **Generated with MLflow tracking** 🚀
checkpoint-1000/config.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "activation": "gelu",
3
+ "architectures": [
4
+ "DistilBertForSequenceClassification"
5
+ ],
6
+ "attention_dropout": 0.1,
7
+ "dim": 768,
8
+ "dropout": 0.1,
9
+ "dtype": "float32",
10
+ "hidden_dim": 3072,
11
+ "initializer_range": 0.02,
12
+ "max_position_embeddings": 512,
13
+ "model_type": "distilbert",
14
+ "n_heads": 12,
15
+ "n_layers": 6,
16
+ "pad_token_id": 0,
17
+ "problem_type": "single_label_classification",
18
+ "qa_dropout": 0.1,
19
+ "seq_classif_dropout": 0.2,
20
+ "sinusoidal_pos_embds": false,
21
+ "tie_weights_": true,
22
+ "transformers_version": "4.57.1",
23
+ "vocab_size": 30522
24
+ }
checkpoint-1000/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3964c1d4be890e85123c158baa9cac253288570c2c5083634890be87c5bf04c1
3
+ size 267832560
checkpoint-1000/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6adcb6bf2c8c9793579925b306eb5cc34fb6c11b37f65f16b410924a3f49a942
3
+ size 535724875
checkpoint-1000/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f1e0d31acc437fbbd16411d0d11d500c5f4dbbc7561671dab7dbf23eb0f2c43
3
+ size 14455
checkpoint-1000/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:130cffffc7979a0d2b8ed9eb9e4e3acd2a313e096a319925fba2ed8345492f55
3
+ size 1465
checkpoint-1000/special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
checkpoint-1000/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-1000/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": false,
45
+ "cls_token": "[CLS]",
46
+ "do_lower_case": true,
47
+ "extra_special_tokens": {},
48
+ "mask_token": "[MASK]",
49
+ "model_max_length": 512,
50
+ "pad_token": "[PAD]",
51
+ "sep_token": "[SEP]",
52
+ "strip_accents": null,
53
+ "tokenize_chinese_chars": true,
54
+ "tokenizer_class": "DistilBertTokenizer",
55
+ "unk_token": "[UNK]"
56
+ }
checkpoint-1000/trainer_state.json ADDED
@@ -0,0 +1,133 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 1000,
3
+ "best_metric": 0.877,
4
+ "best_model_checkpoint": "./trained_model/checkpoint-1000",
5
+ "epoch": 2.0,
6
+ "eval_steps": 500,
7
+ "global_step": 1000,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.2,
14
+ "grad_norm": 19.170202255249023,
15
+ "learning_rate": 1.8680000000000004e-05,
16
+ "loss": 0.4772,
17
+ "step": 100
18
+ },
19
+ {
20
+ "epoch": 0.4,
21
+ "grad_norm": 18.27229881286621,
22
+ "learning_rate": 1.7346666666666668e-05,
23
+ "loss": 0.3614,
24
+ "step": 200
25
+ },
26
+ {
27
+ "epoch": 0.6,
28
+ "grad_norm": 3.4699323177337646,
29
+ "learning_rate": 1.6013333333333335e-05,
30
+ "loss": 0.3736,
31
+ "step": 300
32
+ },
33
+ {
34
+ "epoch": 0.8,
35
+ "grad_norm": 17.60018539428711,
36
+ "learning_rate": 1.4680000000000002e-05,
37
+ "loss": 0.3418,
38
+ "step": 400
39
+ },
40
+ {
41
+ "epoch": 1.0,
42
+ "grad_norm": 27.09922981262207,
43
+ "learning_rate": 1.3346666666666667e-05,
44
+ "loss": 0.3215,
45
+ "step": 500
46
+ },
47
+ {
48
+ "epoch": 1.0,
49
+ "eval_accuracy": 0.82,
50
+ "eval_f1": 0.8161193592140474,
51
+ "eval_loss": 0.5520513653755188,
52
+ "eval_runtime": 50.3487,
53
+ "eval_samples_per_second": 19.861,
54
+ "eval_steps_per_second": 1.251,
55
+ "step": 500
56
+ },
57
+ {
58
+ "epoch": 1.2,
59
+ "grad_norm": 29.522594451904297,
60
+ "learning_rate": 1.2013333333333334e-05,
61
+ "loss": 0.2891,
62
+ "step": 600
63
+ },
64
+ {
65
+ "epoch": 1.4,
66
+ "grad_norm": 50.437538146972656,
67
+ "learning_rate": 1.0680000000000001e-05,
68
+ "loss": 0.206,
69
+ "step": 700
70
+ },
71
+ {
72
+ "epoch": 1.6,
73
+ "grad_norm": 0.3681044578552246,
74
+ "learning_rate": 9.346666666666666e-06,
75
+ "loss": 0.2191,
76
+ "step": 800
77
+ },
78
+ {
79
+ "epoch": 1.8,
80
+ "grad_norm": 4.929210662841797,
81
+ "learning_rate": 8.013333333333333e-06,
82
+ "loss": 0.1967,
83
+ "step": 900
84
+ },
85
+ {
86
+ "epoch": 2.0,
87
+ "grad_norm": 0.25087302923202515,
88
+ "learning_rate": 6.680000000000001e-06,
89
+ "loss": 0.1687,
90
+ "step": 1000
91
+ },
92
+ {
93
+ "epoch": 2.0,
94
+ "eval_accuracy": 0.877,
95
+ "eval_f1": 0.8765589700871793,
96
+ "eval_loss": 0.429619163274765,
97
+ "eval_runtime": 49.6341,
98
+ "eval_samples_per_second": 20.147,
99
+ "eval_steps_per_second": 1.269,
100
+ "step": 1000
101
+ }
102
+ ],
103
+ "logging_steps": 100,
104
+ "max_steps": 1500,
105
+ "num_input_tokens_seen": 0,
106
+ "num_train_epochs": 3,
107
+ "save_steps": 500,
108
+ "stateful_callbacks": {
109
+ "EarlyStoppingCallback": {
110
+ "args": {
111
+ "early_stopping_patience": 2,
112
+ "early_stopping_threshold": 0.0
113
+ },
114
+ "attributes": {
115
+ "early_stopping_patience_counter": 0
116
+ }
117
+ },
118
+ "TrainerControl": {
119
+ "args": {
120
+ "should_epoch_stop": false,
121
+ "should_evaluate": false,
122
+ "should_log": false,
123
+ "should_save": true,
124
+ "should_training_stop": false
125
+ },
126
+ "attributes": {}
127
+ }
128
+ },
129
+ "total_flos": 1059739189248000.0,
130
+ "train_batch_size": 8,
131
+ "trial_name": null,
132
+ "trial_params": null
133
+ }
checkpoint-1000/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdc171376ed6a59d58c310ea00b74472cce43086596094b233f1856d9bc55a1b
3
+ size 5841
checkpoint-1000/vocab.txt ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-1500/config.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "activation": "gelu",
3
+ "architectures": [
4
+ "DistilBertForSequenceClassification"
5
+ ],
6
+ "attention_dropout": 0.1,
7
+ "dim": 768,
8
+ "dropout": 0.1,
9
+ "dtype": "float32",
10
+ "hidden_dim": 3072,
11
+ "initializer_range": 0.02,
12
+ "max_position_embeddings": 512,
13
+ "model_type": "distilbert",
14
+ "n_heads": 12,
15
+ "n_layers": 6,
16
+ "pad_token_id": 0,
17
+ "problem_type": "single_label_classification",
18
+ "qa_dropout": 0.1,
19
+ "seq_classif_dropout": 0.2,
20
+ "sinusoidal_pos_embds": false,
21
+ "tie_weights_": true,
22
+ "transformers_version": "4.57.1",
23
+ "vocab_size": 30522
24
+ }
checkpoint-1500/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c34c0866fe1f54735459b6f599366d927e8ead1fe24f0a2315ff493f5f7dbe3a
3
+ size 267832560
checkpoint-1500/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd954bbf1225cce904630a28e0278e2b2bbb863b7ee50158ad84daee23995e8e
3
+ size 535724875
checkpoint-1500/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:391d01d3aeb4a35151817d446e4ba0b9c8a04084ae1b1b66eda188a30729da0a
3
+ size 14455
checkpoint-1500/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:748cd50395dac6ec1a3d9e7b31c2867f4867e0ff24162e6ca580fe4a3fabef19
3
+ size 1465
checkpoint-1500/special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
checkpoint-1500/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-1500/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": false,
45
+ "cls_token": "[CLS]",
46
+ "do_lower_case": true,
47
+ "extra_special_tokens": {},
48
+ "mask_token": "[MASK]",
49
+ "model_max_length": 512,
50
+ "pad_token": "[PAD]",
51
+ "sep_token": "[SEP]",
52
+ "strip_accents": null,
53
+ "tokenize_chinese_chars": true,
54
+ "tokenizer_class": "DistilBertTokenizer",
55
+ "unk_token": "[UNK]"
56
+ }
checkpoint-1500/trainer_state.json ADDED
@@ -0,0 +1,178 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 1500,
3
+ "best_metric": 0.898,
4
+ "best_model_checkpoint": "./trained_model/checkpoint-1500",
5
+ "epoch": 3.0,
6
+ "eval_steps": 500,
7
+ "global_step": 1500,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.2,
14
+ "grad_norm": 19.170202255249023,
15
+ "learning_rate": 1.8680000000000004e-05,
16
+ "loss": 0.4772,
17
+ "step": 100
18
+ },
19
+ {
20
+ "epoch": 0.4,
21
+ "grad_norm": 18.27229881286621,
22
+ "learning_rate": 1.7346666666666668e-05,
23
+ "loss": 0.3614,
24
+ "step": 200
25
+ },
26
+ {
27
+ "epoch": 0.6,
28
+ "grad_norm": 3.4699323177337646,
29
+ "learning_rate": 1.6013333333333335e-05,
30
+ "loss": 0.3736,
31
+ "step": 300
32
+ },
33
+ {
34
+ "epoch": 0.8,
35
+ "grad_norm": 17.60018539428711,
36
+ "learning_rate": 1.4680000000000002e-05,
37
+ "loss": 0.3418,
38
+ "step": 400
39
+ },
40
+ {
41
+ "epoch": 1.0,
42
+ "grad_norm": 27.09922981262207,
43
+ "learning_rate": 1.3346666666666667e-05,
44
+ "loss": 0.3215,
45
+ "step": 500
46
+ },
47
+ {
48
+ "epoch": 1.0,
49
+ "eval_accuracy": 0.82,
50
+ "eval_f1": 0.8161193592140474,
51
+ "eval_loss": 0.5520513653755188,
52
+ "eval_runtime": 50.3487,
53
+ "eval_samples_per_second": 19.861,
54
+ "eval_steps_per_second": 1.251,
55
+ "step": 500
56
+ },
57
+ {
58
+ "epoch": 1.2,
59
+ "grad_norm": 29.522594451904297,
60
+ "learning_rate": 1.2013333333333334e-05,
61
+ "loss": 0.2891,
62
+ "step": 600
63
+ },
64
+ {
65
+ "epoch": 1.4,
66
+ "grad_norm": 50.437538146972656,
67
+ "learning_rate": 1.0680000000000001e-05,
68
+ "loss": 0.206,
69
+ "step": 700
70
+ },
71
+ {
72
+ "epoch": 1.6,
73
+ "grad_norm": 0.3681044578552246,
74
+ "learning_rate": 9.346666666666666e-06,
75
+ "loss": 0.2191,
76
+ "step": 800
77
+ },
78
+ {
79
+ "epoch": 1.8,
80
+ "grad_norm": 4.929210662841797,
81
+ "learning_rate": 8.013333333333333e-06,
82
+ "loss": 0.1967,
83
+ "step": 900
84
+ },
85
+ {
86
+ "epoch": 2.0,
87
+ "grad_norm": 0.25087302923202515,
88
+ "learning_rate": 6.680000000000001e-06,
89
+ "loss": 0.1687,
90
+ "step": 1000
91
+ },
92
+ {
93
+ "epoch": 2.0,
94
+ "eval_accuracy": 0.877,
95
+ "eval_f1": 0.8765589700871793,
96
+ "eval_loss": 0.429619163274765,
97
+ "eval_runtime": 49.6341,
98
+ "eval_samples_per_second": 20.147,
99
+ "eval_steps_per_second": 1.269,
100
+ "step": 1000
101
+ },
102
+ {
103
+ "epoch": 2.2,
104
+ "grad_norm": 0.0790085569024086,
105
+ "learning_rate": 5.346666666666667e-06,
106
+ "loss": 0.0971,
107
+ "step": 1100
108
+ },
109
+ {
110
+ "epoch": 2.4,
111
+ "grad_norm": 11.744353294372559,
112
+ "learning_rate": 4.013333333333334e-06,
113
+ "loss": 0.0952,
114
+ "step": 1200
115
+ },
116
+ {
117
+ "epoch": 2.6,
118
+ "grad_norm": 0.05501548573374748,
119
+ "learning_rate": 2.68e-06,
120
+ "loss": 0.1343,
121
+ "step": 1300
122
+ },
123
+ {
124
+ "epoch": 2.8,
125
+ "grad_norm": 0.061339035630226135,
126
+ "learning_rate": 1.3466666666666668e-06,
127
+ "loss": 0.0971,
128
+ "step": 1400
129
+ },
130
+ {
131
+ "epoch": 3.0,
132
+ "grad_norm": 0.04910397157073021,
133
+ "learning_rate": 1.3333333333333334e-08,
134
+ "loss": 0.1523,
135
+ "step": 1500
136
+ },
137
+ {
138
+ "epoch": 3.0,
139
+ "eval_accuracy": 0.898,
140
+ "eval_f1": 0.897973886328725,
141
+ "eval_loss": 0.46152323484420776,
142
+ "eval_runtime": 33.7071,
143
+ "eval_samples_per_second": 29.667,
144
+ "eval_steps_per_second": 1.869,
145
+ "step": 1500
146
+ }
147
+ ],
148
+ "logging_steps": 100,
149
+ "max_steps": 1500,
150
+ "num_input_tokens_seen": 0,
151
+ "num_train_epochs": 3,
152
+ "save_steps": 500,
153
+ "stateful_callbacks": {
154
+ "EarlyStoppingCallback": {
155
+ "args": {
156
+ "early_stopping_patience": 2,
157
+ "early_stopping_threshold": 0.0
158
+ },
159
+ "attributes": {
160
+ "early_stopping_patience_counter": 0
161
+ }
162
+ },
163
+ "TrainerControl": {
164
+ "args": {
165
+ "should_epoch_stop": false,
166
+ "should_evaluate": false,
167
+ "should_log": false,
168
+ "should_save": true,
169
+ "should_training_stop": true
170
+ },
171
+ "attributes": {}
172
+ }
173
+ },
174
+ "total_flos": 1589608783872000.0,
175
+ "train_batch_size": 8,
176
+ "trial_name": null,
177
+ "trial_params": null
178
+ }
checkpoint-1500/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdc171376ed6a59d58c310ea00b74472cce43086596094b233f1856d9bc55a1b
3
+ size 5841
checkpoint-1500/vocab.txt ADDED
The diff for this file is too large to render. See raw diff
 
config.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "activation": "gelu",
3
+ "architectures": [
4
+ "DistilBertForSequenceClassification"
5
+ ],
6
+ "attention_dropout": 0.1,
7
+ "dim": 768,
8
+ "dropout": 0.1,
9
+ "dtype": "float32",
10
+ "hidden_dim": 3072,
11
+ "initializer_range": 0.02,
12
+ "max_position_embeddings": 512,
13
+ "model_type": "distilbert",
14
+ "n_heads": 12,
15
+ "n_layers": 6,
16
+ "pad_token_id": 0,
17
+ "problem_type": "single_label_classification",
18
+ "qa_dropout": 0.1,
19
+ "seq_classif_dropout": 0.2,
20
+ "sinusoidal_pos_embds": false,
21
+ "tie_weights_": true,
22
+ "transformers_version": "4.57.1",
23
+ "vocab_size": 30522
24
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c34c0866fe1f54735459b6f599366d927e8ead1fe24f0a2315ff493f5f7dbe3a
3
+ size 267832560
model_info.json ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_config": {
3
+ "model": {
4
+ "name": "distilbert-base-uncased",
5
+ "num_labels": 2,
6
+ "max_length": 512
7
+ },
8
+ "training": {
9
+ "output_dir": "./trained_model",
10
+ "learning_rate": 2e-05,
11
+ "per_device_train_batch_size": 8,
12
+ "per_device_eval_batch_size": 16,
13
+ "num_train_epochs": 3,
14
+ "weight_decay": 0.01,
15
+ "eval_strategy": "epoch",
16
+ "save_strategy": "epoch",
17
+ "logging_steps": 100,
18
+ "save_total_limit": 2,
19
+ "load_best_model_at_end": true,
20
+ "metric_for_best_model": "eval_accuracy",
21
+ "greater_is_better": true
22
+ },
23
+ "data": {
24
+ "dataset_name": "imdb",
25
+ "train_size": 4000,
26
+ "eval_size": 1000,
27
+ "test_size": 500
28
+ },
29
+ "mlflow": {
30
+ "enabled": true,
31
+ "tracking_uri": null,
32
+ "experiment_name": "sentiment-analysis-training",
33
+ "artifact_location": null,
34
+ "registered_model_prefix": "sentiment-model"
35
+ },
36
+ "api": {
37
+ "host": "0.0.0.0",
38
+ "port": 8000,
39
+ "max_batch_size": 32
40
+ }
41
+ },
42
+ "training_metrics": {
43
+ "eval_loss": 0.3413584530353546,
44
+ "eval_accuracy": 0.92,
45
+ "eval_f1": 0.919953893442623,
46
+ "eval_runtime": 19.0635,
47
+ "eval_samples_per_second": 26.228,
48
+ "eval_steps_per_second": 1.679,
49
+ "epoch": 3.0
50
+ },
51
+ "model_path": "./trained_model"
52
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": false,
45
+ "cls_token": "[CLS]",
46
+ "do_lower_case": true,
47
+ "extra_special_tokens": {},
48
+ "mask_token": "[MASK]",
49
+ "model_max_length": 512,
50
+ "pad_token": "[PAD]",
51
+ "sep_token": "[SEP]",
52
+ "strip_accents": null,
53
+ "tokenize_chinese_chars": true,
54
+ "tokenizer_class": "DistilBertTokenizer",
55
+ "unk_token": "[UNK]"
56
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdc171376ed6a59d58c310ea00b74472cce43086596094b233f1856d9bc55a1b
3
+ size 5841
training_history.png ADDED

Git LFS Details

  • SHA256: 1ffa4fa0f0b9b6ada6f71f10d3671a8c3e17a7c1c08fb47e1141ef4e4c04198d
  • Pointer size: 131 Bytes
  • Size of remote file: 201 kB
vocab.txt ADDED
The diff for this file is too large to render. See raw diff