Initial upload - mBERT fine-tuned on r/Singapore

README.md

@@ -0,0 +1,88 @@
+---
+language: en
+tags:
+- sentiment-analysis
+- singapore
+- singlish
+- regression
+license: mit
+---
+
+# Singapore Sentiment Analyzer - MULTILINGUAL_BERT (Calibrated)
+
+Fine-tuned sentiment analysis model for Singapore social media, **with post-training calibration** for improved accuracy.
+
+## 🎯 Performance
+
+| Metric | Before Calibration | After Calibration | Improvement |
+|--------|-------------------|-------------------|-------------|
+| **Accuracy** | 52.6% | **64.0%** | **+11.4%** |
+| **MAE** | 0.126 | **0.104** | **-0.022** |
+| **RMSE** | 0.168 | **0.141** | **-0.027** |
+
+## 📊 Sentiment Scale
+
+| Score | Category |
+|-------|----------|
+| 0.00 - 0.20 | Very Negative |
+| 0.21 - 0.40 | Negative |
+| 0.41 - 0.60 | Neutral |
+| 0.61 - 0.80 | Positive |
+| 0.81 - 1.00 | Very Positive |
+
+## 🚀 Quick Start
+
+```python
+from transformers import AutoTokenizer
+from modeling_calibrated import CalibratedRegressionModel
+
+# Load model (calibration is automatic!)
+model_name = "your-username/multilingual_bert-singapore-sentiment"
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = CalibratedRegressionModel.from_pretrained(model_name)
+
+# Predict sentiment
+text = "This chicken rice is damn shiok sia!"
+result = model.predict_sentiment(text, tokenizer)
+
+print(f"Score: {result['score']:.3f}")      # 0.875
+print(f"Category: {result['category']}")   # "Very Positive"
+```
+
+## 💡 What is Calibration?
+
+After fine-tuning, we applied **isotonic regression calibration** on a validation set. This corrects systematic bias patterns where the model was:
+- Over-predicting on negative examples
+- Under-predicting on positive examples
+- Struggling with boundary cases (e.g., neutral vs negative)
+
+The calibration layer is built into the model - you get calibrated predictions automatically!
+
+## 📚 Training Details
+
+- **Base model**: `cardiffnlp/twitter-roberta-base-sentiment-latest`
+- **Training data**: 49,521 Singapore Reddit posts/comments
+- **Fine-tuning**: 5 epochs, MSE loss, learning rate 2e-5
+- **Calibration**: Isotonic regression on 500-sample validation set
+
+## 🌏 Singapore Context
+
+This model understands Singlish patterns and Singapore-specific terminology:
+- Particles: lah, lor, leh, sia
+- Slang: shiok, sian, jialat, paiseh
+- Local context: HDB, MRT, hawker, kopitiam
+
+## 📝 Citation
+
+```bibtex
+@misc{multilingual_bert-singapore-calibrated,
+  title = {Singapore Sentiment Analyzer - MULTILINGUAL_BERT (Calibrated)},
+  year = {2026},
+  publisher = {HuggingFace},
+  url = {https://huggingface.co/your-username/multilingual_bert-singapore-sentiment}
+}
+```
+
+## 📄 License
+
+MIT License - Free for commercial and non-commercial use.

calibrator_config.json

@@ -0,0 +1,212 @@
+{
+  "method": "isotonic",
+  "version": "1.0",
+  "mapping": {
+    "input_scores": [
+      0.0,
+      0.01,
+      0.02,
+      0.03,
+      0.04,
+      0.05,
+      0.06,
+      0.07,
+      0.08,
+      0.09,
+      0.1,
+      0.11,
+      0.12,
+      0.13,
+      0.14,
+      0.15,
+      0.16,
+      0.17,
+      0.18,
+      0.19,
+      0.2,
+      0.21,
+      0.22,
+      0.23,
+      0.24,
+      0.25,
+      0.26,
+      0.27,
+      0.28,
+      0.29,
+      0.3,
+      0.31,
+      0.32,
+      0.33,
+      0.34,
+      0.35000000000000003,
+      0.36,
+      0.37,
+      0.38,
+      0.39,
+      0.4,
+      0.41000000000000003,
+      0.42,
+      0.43,
+      0.44,
+      0.45,
+      0.46,
+      0.47000000000000003,
+      0.48,
+      0.49,
+      0.5,
+      0.51,
+      0.52,
+      0.53,
+      0.54,
+      0.55,
+      0.56,
+      0.5700000000000001,
+      0.58,
+      0.59,
+      0.6,
+      0.61,
+      0.62,
+      0.63,
+      0.64,
+      0.65,
+      0.66,
+      0.67,
+      0.68,
+      0.6900000000000001,
+      0.7000000000000001,
+      0.71,
+      0.72,
+      0.73,
+      0.74,
+      0.75,
+      0.76,
+      0.77,
+      0.78,
+      0.79,
+      0.8,
+      0.81,
+      0.8200000000000001,
+      0.8300000000000001,
+      0.84,
+      0.85,
+      0.86,
+      0.87,
+      0.88,
+      0.89,
+      0.9,
+      0.91,
+      0.92,
+      0.93,
+      0.9400000000000001,
+      0.9500000000000001,
+      0.96,
+      0.97,
+      0.98,
+      0.99,
+      1.0
+    ],
+    "output_scores": [
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.24555555555555555,
+      0.2823202749545064,
+      0.3233333333333333,
+      0.3245833333333333,
+      0.3245833333333333,
+      0.3245833333333333,
+      0.3245833333333333,
+      0.3245833333333333,
+      0.3245833333333333,
+      0.3245833333333333,
+      0.3695652173913043,
+      0.3695652173913043,
+      0.3695652173913043,
+      0.3695652173913043,
+      0.3917777777777778,
+      0.3917777777777778,
+      0.42019607843137247,
+      0.42019607843137247,
+      0.42019607843137247,
+      0.4494183260117991,
+      0.4502631578947368,
+      0.4502631578947368,
+      0.4502631578947368,
+      0.4502631578947368,
+      0.4502631578947368,
+      0.4578931542068387,
+      0.468095238095238,
+      0.468095238095238,
+      0.48166666666666663,
+      0.48166666666666663,
+      0.48423076923076924,
+      0.48423076923076924,
+      0.48423076923076924,
+      0.48423076923076924,
+      0.48423076923076924,
+      0.48423076923076924,
+      0.48599999999999993,
+      0.4973170731707317,
+      0.4973170731707317,
+      0.4973170731707317,
+      0.4973170731707317,
+      0.4973170731707317,
+      0.4973170731707317,
+      0.4973170731707317,
+      0.4973170731707317,
+      0.4973170731707317,
+      0.4973170731707317,
+      0.4973170731707317,
+      0.4985785251534141,
+      0.55,
+      0.55,
+      0.55,
+      0.5504437504275843,
+      0.5744712331299685,
+      0.5775,
+      0.5775,
+      0.5777953204369858,
+      0.5783333333333334,
+      0.5783333333333334,
+      0.5783333333333334,
+      0.5783333333333334,
+      0.6029676926947565,
+      0.6063636363636363,
+      0.6063636363636363,
+      0.6063636363636363,
+      0.6162275664506803,
+      0.63,
+      0.63,
+      0.63,
+      0.63,
+      0.63,
+      0.63,
+      0.63,
+      0.63,
+      0.63,
+      0.63,
+      0.63,
+      0.63,
+      0.63,
+      0.63
+    ]
+  }
+}

checkpoint-3095/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1db69d2b442fc7f8cdb617daf9d036f153d2a86c40944a6e42c6990cebf0f1ca
+size 669452284

checkpoint-3095/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7429a9084c27376bb5b91e918deb9da87d4d85b61be6ebf4660b5cad13c60fc3
+size 1339025658

checkpoint-3095/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec1d5b7b9bf8eb4b2f98128c10f9a0ee63e3904bb1961798817eb980b35e8d1e
+size 14244

checkpoint-3095/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e35985b879f4b585e684547e7247dd8e9b77300766a13ccad5bdde2533af4a17
+size 988

checkpoint-3095/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:afc0cd0e8762e5186308c8d34c7058e9ae393685de75555013c5819fcdb77637
+size 1064

checkpoint-3095/tokenizer_config.json

@@ -0,0 +1,15 @@
+{
+  "backend": "tokenizers",
+  "cls_token": "[CLS]",
+  "do_lower_case": true,
+  "is_local": false,
+  "mask_token": "[MASK]",
+  "max_len": 512,
+  "model_max_length": 512,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}

checkpoint-3095/trainer_state.json

@@ -0,0 +1,244 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.0,
+  "eval_steps": 500,
+  "global_step": 3095,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03231017770597738,
+      "grad_norm": 2.219433546066284,
+      "learning_rate": 3.166397415185784e-06,
+      "loss": 0.13468141555786134,
+      "step": 100
+    },
+    {
+      "epoch": 0.06462035541195477,
+      "grad_norm": 1.7088854312896729,
+      "learning_rate": 6.397415185783522e-06,
+      "loss": 0.08345352172851563,
+      "step": 200
+    },
+    {
+      "epoch": 0.09693053311793215,
+      "grad_norm": 1.8784979581832886,
+      "learning_rate": 9.62843295638126e-06,
+      "loss": 0.07643356323242187,
+      "step": 300
+    },
+    {
+      "epoch": 0.12924071082390953,
+      "grad_norm": 3.160496234893799,
+      "learning_rate": 1.2859450726979e-05,
+      "loss": 0.07728703022003174,
+      "step": 400
+    },
+    {
+      "epoch": 0.16155088852988692,
+      "grad_norm": 1.793244481086731,
+      "learning_rate": 1.609046849757674e-05,
+      "loss": 0.0715451717376709,
+      "step": 500
+    },
+    {
+      "epoch": 0.1938610662358643,
+      "grad_norm": 0.49027326703071594,
+      "learning_rate": 1.9321486268174476e-05,
+      "loss": 0.07877041339874268,
+      "step": 600
+    },
+    {
+      "epoch": 0.22617124394184168,
+      "grad_norm": 0.728702962398529,
+      "learning_rate": 1.999007830695722e-05,
+      "loss": 0.07102310180664062,
+      "step": 700
+    },
+    {
+      "epoch": 0.25848142164781907,
+      "grad_norm": 2.55074405670166,
+      "learning_rate": 1.9949097313414066e-05,
+      "loss": 0.074349045753479,
+      "step": 800
+    },
+    {
+      "epoch": 0.29079159935379645,
+      "grad_norm": 3.9224605560302734,
+      "learning_rate": 1.9876486114300215e-05,
+      "loss": 0.07766849994659424,
+      "step": 900
+    },
+    {
+      "epoch": 0.32310177705977383,
+      "grad_norm": 0.9257252216339111,
+      "learning_rate": 1.9772475555398188e-05,
+      "loss": 0.0694255781173706,
+      "step": 1000
+    },
+    {
+      "epoch": 0.3554119547657512,
+      "grad_norm": 0.8081497550010681,
+      "learning_rate": 1.9637396307446846e-05,
+      "loss": 0.07494896411895752,
+      "step": 1100
+    },
+    {
+      "epoch": 0.3877221324717286,
+      "grad_norm": 2.14691424369812,
+      "learning_rate": 1.9471677814871786e-05,
+      "loss": 0.0675746250152588,
+      "step": 1200
+    },
+    {
+      "epoch": 0.420032310177706,
+      "grad_norm": 0.38400450348854065,
+      "learning_rate": 1.927584693049412e-05,
+      "loss": 0.07241044998168945,
+      "step": 1300
+    },
+    {
+      "epoch": 0.45234248788368336,
+      "grad_norm": 0.580016553401947,
+      "learning_rate": 1.9050526240558083e-05,
+      "loss": 0.07040606498718262,
+      "step": 1400
+    },
+    {
+      "epoch": 0.48465266558966075,
+      "grad_norm": 1.0501762628555298,
+      "learning_rate": 1.8796432085402662e-05,
+      "loss": 0.07063678741455078,
+      "step": 1500
+    },
+    {
+      "epoch": 0.5169628432956381,
+      "grad_norm": 0.9808917045593262,
+      "learning_rate": 1.8514372282069805e-05,
+      "loss": 0.067080078125,
+      "step": 1600
+    },
+    {
+      "epoch": 0.5492730210016155,
+      "grad_norm": 0.8777210116386414,
+      "learning_rate": 1.8205243556089643e-05,
+      "loss": 0.06770069122314454,
+      "step": 1700
+    },
+    {
+      "epoch": 0.5815831987075929,
+      "grad_norm": 1.6874562501907349,
+      "learning_rate": 1.7870028690607476e-05,
+      "loss": 0.07079707622528077,
+      "step": 1800
+    },
+    {
+      "epoch": 0.6138933764135702,
+      "grad_norm": 1.3245418071746826,
+      "learning_rate": 1.7509793401916104e-05,
+      "loss": 0.06404186248779296,
+      "step": 1900
+    },
+    {
+      "epoch": 0.6462035541195477,
+      "grad_norm": 0.3585558831691742,
+      "learning_rate": 1.7125682951326795e-05,
+      "loss": 0.06824737071990966,
+      "step": 2000
+    },
+    {
+      "epoch": 0.678513731825525,
+      "grad_norm": 0.8804681897163391,
+      "learning_rate": 1.671891850415046e-05,
+      "loss": 0.07004157543182372,
+      "step": 2100
+    },
+    {
+      "epoch": 0.7108239095315024,
+      "grad_norm": 0.6549601554870605,
+      "learning_rate": 1.629079324736454e-05,
+      "loss": 0.06939639568328858,
+      "step": 2200
+    },
+    {
+      "epoch": 0.7431340872374798,
+      "grad_norm": 1.4602007865905762,
+      "learning_rate": 1.584266827830838e-05,
+      "loss": 0.06469368457794189,
+      "step": 2300
+    },
+    {
+      "epoch": 0.7754442649434572,
+      "grad_norm": 1.0985392332077026,
+      "learning_rate": 1.537596827747772e-05,
+      "loss": 0.07550141334533692,
+      "step": 2400
+    },
+    {
+      "epoch": 0.8077544426494345,
+      "grad_norm": 0.9523833394050598,
+      "learning_rate": 1.4892176979175388e-05,
+      "loss": 0.06276164531707763,
+      "step": 2500
+    },
+    {
+      "epoch": 0.840064620355412,
+      "grad_norm": 0.4565122723579407,
+      "learning_rate": 1.4392832454417938e-05,
+      "loss": 0.0644590950012207,
+      "step": 2600
+    },
+    {
+      "epoch": 0.8723747980613893,
+      "grad_norm": 2.104994058609009,
+      "learning_rate": 1.387952222109479e-05,
+      "loss": 0.06694219589233398,
+      "step": 2700
+    },
+    {
+      "epoch": 0.9046849757673667,
+      "grad_norm": 1.4507120847702026,
+      "learning_rate": 1.3353878196925727e-05,
+      "loss": 0.059137086868286136,
+      "step": 2800
+    },
+    {
+      "epoch": 0.9369951534733441,
+      "grad_norm": 1.1051520109176636,
+      "learning_rate": 1.2817571511262256e-05,
+      "loss": 0.06713937282562256,
+      "step": 2900
+    },
+    {
+      "epoch": 0.9693053311793215,
+      "grad_norm": 1.7327321767807007,
+      "learning_rate": 1.2272307192227245e-05,
+      "loss": 0.0657884407043457,
+      "step": 3000
+    }
+  ],
+  "logging_steps": 100,
+  "max_steps": 6190,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 2,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 0.0,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-3095/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2181dd01650d66d3bf665d833ec71debd0d4333d3bb123add14eb6c07cff376f
+size 4856

checkpoint-6190/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d23f493e78965a0daa82d228ec41d363f64b452fda8c540d4abff4eabce5d3db
+size 669452284

checkpoint-6190/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26baef79c4adaee5f18a372262d1f87d77cc6de95ecbe8481b131c0379593c75
+size 1339025658

checkpoint-6190/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28ce47c620300bd9f2ffa8d5f2e1bae45452602cfdd4d5fc78dfcc639890e3ae
+size 14244

checkpoint-6190/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3bf7294856853e1a36d7af9256daa01a485d2e36a958b03789542891ac993896
+size 988

checkpoint-6190/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b914bc6c2f6a2bf6812cf6f7dca6bf8a0b74e343fa07103bd9c0a9d6d0fa956e
+size 1064

checkpoint-6190/tokenizer_config.json

@@ -0,0 +1,15 @@
+{
+  "backend": "tokenizers",
+  "cls_token": "[CLS]",
+  "do_lower_case": true,
+  "is_local": false,
+  "mask_token": "[MASK]",
+  "max_len": 512,
+  "model_max_length": 512,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}

checkpoint-6190/trainer_state.json

@@ -0,0 +1,461 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 2.0,
+  "eval_steps": 500,
+  "global_step": 6190,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03231017770597738,
+      "grad_norm": 2.219433546066284,
+      "learning_rate": 3.166397415185784e-06,
+      "loss": 0.13468141555786134,
+      "step": 100
+    },
+    {
+      "epoch": 0.06462035541195477,
+      "grad_norm": 1.7088854312896729,
+      "learning_rate": 6.397415185783522e-06,
+      "loss": 0.08345352172851563,
+      "step": 200
+    },
+    {
+      "epoch": 0.09693053311793215,
+      "grad_norm": 1.8784979581832886,
+      "learning_rate": 9.62843295638126e-06,
+      "loss": 0.07643356323242187,
+      "step": 300
+    },
+    {
+      "epoch": 0.12924071082390953,
+      "grad_norm": 3.160496234893799,
+      "learning_rate": 1.2859450726979e-05,
+      "loss": 0.07728703022003174,
+      "step": 400
+    },
+    {
+      "epoch": 0.16155088852988692,
+      "grad_norm": 1.793244481086731,
+      "learning_rate": 1.609046849757674e-05,
+      "loss": 0.0715451717376709,
+      "step": 500
+    },
+    {
+      "epoch": 0.1938610662358643,
+      "grad_norm": 0.49027326703071594,
+      "learning_rate": 1.9321486268174476e-05,
+      "loss": 0.07877041339874268,
+      "step": 600
+    },
+    {
+      "epoch": 0.22617124394184168,
+      "grad_norm": 0.728702962398529,
+      "learning_rate": 1.999007830695722e-05,
+      "loss": 0.07102310180664062,
+      "step": 700
+    },
+    {
+      "epoch": 0.25848142164781907,
+      "grad_norm": 2.55074405670166,
+      "learning_rate": 1.9949097313414066e-05,
+      "loss": 0.074349045753479,
+      "step": 800
+    },
+    {
+      "epoch": 0.29079159935379645,
+      "grad_norm": 3.9224605560302734,
+      "learning_rate": 1.9876486114300215e-05,
+      "loss": 0.07766849994659424,
+      "step": 900
+    },
+    {
+      "epoch": 0.32310177705977383,
+      "grad_norm": 0.9257252216339111,
+      "learning_rate": 1.9772475555398188e-05,
+      "loss": 0.0694255781173706,
+      "step": 1000
+    },
+    {
+      "epoch": 0.3554119547657512,
+      "grad_norm": 0.8081497550010681,
+      "learning_rate": 1.9637396307446846e-05,
+      "loss": 0.07494896411895752,
+      "step": 1100
+    },
+    {
+      "epoch": 0.3877221324717286,
+      "grad_norm": 2.14691424369812,
+      "learning_rate": 1.9471677814871786e-05,
+      "loss": 0.0675746250152588,
+      "step": 1200
+    },
+    {
+      "epoch": 0.420032310177706,
+      "grad_norm": 0.38400450348854065,
+      "learning_rate": 1.927584693049412e-05,
+      "loss": 0.07241044998168945,
+      "step": 1300
+    },
+    {
+      "epoch": 0.45234248788368336,
+      "grad_norm": 0.580016553401947,
+      "learning_rate": 1.9050526240558083e-05,
+      "loss": 0.07040606498718262,
+      "step": 1400
+    },
+    {
+      "epoch": 0.48465266558966075,
+      "grad_norm": 1.0501762628555298,
+      "learning_rate": 1.8796432085402662e-05,
+      "loss": 0.07063678741455078,
+      "step": 1500
+    },
+    {
+      "epoch": 0.5169628432956381,
+      "grad_norm": 0.9808917045593262,
+      "learning_rate": 1.8514372282069805e-05,
+      "loss": 0.067080078125,
+      "step": 1600
+    },
+    {
+      "epoch": 0.5492730210016155,
+      "grad_norm": 0.8777210116386414,
+      "learning_rate": 1.8205243556089643e-05,
+      "loss": 0.06770069122314454,
+      "step": 1700
+    },
+    {
+      "epoch": 0.5815831987075929,
+      "grad_norm": 1.6874562501907349,
+      "learning_rate": 1.7870028690607476e-05,
+      "loss": 0.07079707622528077,
+      "step": 1800
+    },
+    {
+      "epoch": 0.6138933764135702,
+      "grad_norm": 1.3245418071746826,
+      "learning_rate": 1.7509793401916104e-05,
+      "loss": 0.06404186248779296,
+      "step": 1900
+    },
+    {
+      "epoch": 0.6462035541195477,
+      "grad_norm": 0.3585558831691742,
+      "learning_rate": 1.7125682951326795e-05,
+      "loss": 0.06824737071990966,
+      "step": 2000
+    },
+    {
+      "epoch": 0.678513731825525,
+      "grad_norm": 0.8804681897163391,
+      "learning_rate": 1.671891850415046e-05,
+      "loss": 0.07004157543182372,
+      "step": 2100
+    },
+    {
+      "epoch": 0.7108239095315024,
+      "grad_norm": 0.6549601554870605,
+      "learning_rate": 1.629079324736454e-05,
+      "loss": 0.06939639568328858,
+      "step": 2200
+    },
+    {
+      "epoch": 0.7431340872374798,
+      "grad_norm": 1.4602007865905762,
+      "learning_rate": 1.584266827830838e-05,
+      "loss": 0.06469368457794189,
+      "step": 2300
+    },
+    {
+      "epoch": 0.7754442649434572,
+      "grad_norm": 1.0985392332077026,
+      "learning_rate": 1.537596827747772e-05,
+      "loss": 0.07550141334533692,
+      "step": 2400
+    },
+    {
+      "epoch": 0.8077544426494345,
+      "grad_norm": 0.9523833394050598,
+      "learning_rate": 1.4892176979175388e-05,
+      "loss": 0.06276164531707763,
+      "step": 2500
+    },
+    {
+      "epoch": 0.840064620355412,
+      "grad_norm": 0.4565122723579407,
+      "learning_rate": 1.4392832454417938e-05,
+      "loss": 0.0644590950012207,
+      "step": 2600
+    },
+    {
+      "epoch": 0.8723747980613893,
+      "grad_norm": 2.104994058609009,
+      "learning_rate": 1.387952222109479e-05,
+      "loss": 0.06694219589233398,
+      "step": 2700
+    },
+    {
+      "epoch": 0.9046849757673667,
+      "grad_norm": 1.4507120847702026,
+      "learning_rate": 1.3353878196925727e-05,
+      "loss": 0.059137086868286136,
+      "step": 2800
+    },
+    {
+      "epoch": 0.9369951534733441,
+      "grad_norm": 1.1051520109176636,
+      "learning_rate": 1.2817571511262256e-05,
+      "loss": 0.06713937282562256,
+      "step": 2900
+    },
+    {
+      "epoch": 0.9693053311793215,
+      "grad_norm": 1.7327321767807007,
+      "learning_rate": 1.2272307192227245e-05,
+      "loss": 0.0657884407043457,
+      "step": 3000
+    },
+    {
+      "epoch": 1.001615508885299,
+      "grad_norm": 1.4763927459716797,
+      "learning_rate": 1.1719818746083432e-05,
+      "loss": 0.06157140254974365,
+      "step": 3100
+    },
+    {
+      "epoch": 1.0339256865912763,
+      "grad_norm": 0.5653871297836304,
+      "learning_rate": 1.1161862646064167e-05,
+      "loss": 0.052196812629699704,
+      "step": 3200
+    },
+    {
+      "epoch": 1.0662358642972536,
+      "grad_norm": 0.6949484944343567,
+      "learning_rate": 1.0600212748187441e-05,
+      "loss": 0.05160783767700195,
+      "step": 3300
+    },
+    {
+      "epoch": 1.098546042003231,
+      "grad_norm": 0.5760153532028198,
+      "learning_rate": 1.0036654651806548e-05,
+      "loss": 0.049915013313293455,
+      "step": 3400
+    },
+    {
+      "epoch": 1.1308562197092085,
+      "grad_norm": 1.5963973999023438,
+      "learning_rate": 9.472980022826234e-06,
+      "loss": 0.0530696964263916,
+      "step": 3500
+    },
+    {
+      "epoch": 1.1631663974151858,
+      "grad_norm": 1.1081798076629639,
+      "learning_rate": 8.910980897632122e-06,
+      "loss": 0.051336941719055174,
+      "step": 3600
+    },
+    {
+      "epoch": 1.1954765751211631,
+      "grad_norm": 1.7282005548477173,
+      "learning_rate": 8.352443985842219e-06,
+      "loss": 0.052054371833801266,
+      "step": 3700
+    },
+    {
+      "epoch": 1.2277867528271407,
+      "grad_norm": 1.7319399118423462,
+      "learning_rate": 7.799144989993374e-06,
+      "loss": 0.05039342403411865,
+      "step": 3800
+    },
+    {
+      "epoch": 1.260096930533118,
+      "grad_norm": 0.6499872207641602,
+      "learning_rate": 7.252842960221437e-06,
+      "loss": 0.050861058235168455,
+      "step": 3900
+    },
+    {
+      "epoch": 1.2924071082390953,
+      "grad_norm": 0.6934958100318909,
+      "learning_rate": 6.715274701882817e-06,
+      "loss": 0.04509526252746582,
+      "step": 4000
+    },
+    {
+      "epoch": 1.3247172859450727,
+      "grad_norm": 2.537475824356079,
+      "learning_rate": 6.188149253896711e-06,
+      "loss": 0.04738297939300537,
+      "step": 4100
+    },
+    {
+      "epoch": 1.35702746365105,
+      "grad_norm": 1.5743188858032227,
+      "learning_rate": 5.67822712537558e-06,
+      "loss": 0.0544910192489624,
+      "step": 4200
+    },
+    {
+      "epoch": 1.3893376413570275,
+      "grad_norm": 0.7133609056472778,
+      "learning_rate": 5.176830762786425e-06,
+      "loss": 0.04516469955444336,
+      "step": 4300
+    },
+    {
+      "epoch": 1.4216478190630049,
+      "grad_norm": 0.8588969111442566,
+      "learning_rate": 4.6907682369936616e-06,
+      "loss": 0.05183727741241455,
+      "step": 4400
+    },
+    {
+      "epoch": 1.4539579967689822,
+      "grad_norm": 0.3707756996154785,
+      "learning_rate": 4.221584839708363e-06,
+      "loss": 0.05028769016265869,
+      "step": 4500
+    },
+    {
+      "epoch": 1.4862681744749597,
+      "grad_norm": 2.329963445663452,
+      "learning_rate": 3.770772200456203e-06,
+      "loss": 0.051742258071899416,
+      "step": 4600
+    },
+    {
+      "epoch": 1.518578352180937,
+      "grad_norm": 1.0984081029891968,
+      "learning_rate": 3.339763544383562e-06,
+      "loss": 0.05167407512664795,
+      "step": 4700
+    },
+    {
+      "epoch": 1.5508885298869144,
+      "grad_norm": 0.6611376404762268,
+      "learning_rate": 2.929929135743055e-06,
+      "loss": 0.04872979164123535,
+      "step": 4800
+    },
+    {
+      "epoch": 1.5831987075928917,
+      "grad_norm": 1.3234156370162964,
+      "learning_rate": 2.542571921544533e-06,
+      "loss": 0.051429886817932126,
+      "step": 4900
+    },
+    {
+      "epoch": 1.615508885298869,
+      "grad_norm": 1.6327112913131714,
+      "learning_rate": 2.1789233892213234e-06,
+      "loss": 0.05031768321990967,
+      "step": 5000
+    },
+    {
+      "epoch": 1.6478190630048464,
+      "grad_norm": 0.8545958995819092,
+      "learning_rate": 1.84013965148099e-06,
+      "loss": 0.04621196746826172,
+      "step": 5100
+    },
+    {
+      "epoch": 1.680129240710824,
+      "grad_norm": 0.8000152111053467,
+      "learning_rate": 1.5272977707877135e-06,
+      "loss": 0.050682687759399415,
+      "step": 5200
+    },
+    {
+      "epoch": 1.7124394184168013,
+      "grad_norm": 0.9961308240890503,
+      "learning_rate": 1.2413923351614643e-06,
+      "loss": 0.04989287853240967,
+      "step": 5300
+    },
+    {
+      "epoch": 1.7447495961227788,
+      "grad_norm": 0.6385215520858765,
+      "learning_rate": 9.833322961802383e-07,
+      "loss": 0.048794183731079105,
+      "step": 5400
+    },
+    {
+      "epoch": 1.7770597738287561,
+      "grad_norm": 1.6868358850479126,
+      "learning_rate": 7.539380792379569e-07,
+      "loss": 0.04847686290740967,
+      "step": 5500
+    },
+    {
+      "epoch": 1.8093699515347335,
+      "grad_norm": 0.4614435136318207,
+      "learning_rate": 5.539389752451485e-07,
+      "loss": 0.048504509925842286,
+      "step": 5600
+    },
+    {
+      "epoch": 1.8416801292407108,
+      "grad_norm": 1.719391107559204,
+      "learning_rate": 3.839708220646832e-07,
+      "loss": 0.046063599586486814,
+      "step": 5700
+    },
+    {
+      "epoch": 1.8739903069466881,
+      "grad_norm": 2.2700130939483643,
+      "learning_rate": 2.4457398305377857e-07,
+      "loss": 0.046228761672973635,
+      "step": 5800
+    },
+    {
+      "epoch": 1.9063004846526654,
+      "grad_norm": 1.16710364818573,
+      "learning_rate": 1.361916291388954e-07,
+      "loss": 0.04596792221069336,
+      "step": 5900
+    },
+    {
+      "epoch": 1.938610662358643,
+      "grad_norm": 0.6629289388656616,
+      "learning_rate": 5.916832988514754e-08,
+      "loss": 0.04853534698486328,
+      "step": 6000
+    },
+    {
+      "epoch": 1.9709208400646203,
+      "grad_norm": 0.6959134340286255,
+      "learning_rate": 1.3748958039517812e-08,
+      "loss": 0.04190609931945801,
+      "step": 6100
+    }
+  ],
+  "logging_steps": 100,
+  "max_steps": 6190,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 2,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 0.0,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-6190/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2181dd01650d66d3bf665d833ec71debd0d4333d3bb123add14eb6c07cff376f
+size 4856

config.json

@@ -0,0 +1,51 @@
+{
+  "_num_labels": 5,
+  "add_cross_attention": false,
+  "architectures": [
+    "BertModel"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": null,
+  "classifier_dropout": null,
+  "directionality": "bidi",
+  "dtype": "float32",
+  "eos_token_id": null,
+  "finetuning_task": "sentiment-analysis",
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "id2label": {
+    "0": "1 star",
+    "1": "2 stars",
+    "2": "3 stars",
+    "3": "4 stars",
+    "4": "5 stars"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "is_decoder": false,
+  "label2id": {
+    "1 star": 0,
+    "2 stars": 1,
+    "3 stars": 2,
+    "4 stars": 3,
+    "5 stars": 4
+  },
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "output_past": true,
+  "pad_token_id": 0,
+  "pooler_fc_size": 768,
+  "pooler_num_attention_heads": 12,
+  "pooler_num_fc_layers": 3,
+  "pooler_size_per_head": 128,
+  "pooler_type": "first_token_transform",
+  "tie_word_embeddings": true,
+  "transformers_version": "5.1.0",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 105879
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9725cc1b12322b0174e3cf6fead2ed7ee899deed3b3419ebe404932abf2dc4be
+size 669448016

model_config.txt

@@ -0,0 +1,5 @@
+model_type=regression
+output_range=0-1
+base_model=nlptown/bert-base-multilingual-uncased-sentiment
+class_weighted=True
+class_weights=0.621,0.827,0.883,1.226,4.312

modeling_calibrated.py

@@ -0,0 +1,184 @@
+"""
+Custom modeling file for calibrated sentiment prediction.
+Auto-generated - do not edit manually.
+"""
+
+import torch
+import torch.nn as nn
+from transformers import AutoModel, PreTrainedModel
+from transformers.modeling_outputs import SequenceClassifierOutput
+import json
+import os
+import numpy as np
+
+
+class CalibratedRegressionModel(PreTrainedModel):
+    """
+    Sentiment model with built-in calibration.
+    
+    Usage:
+        from transformers import AutoTokenizer
+        from modeling_calibrated import CalibratedRegressionModel
+        
+        model = CalibratedRegressionModel.from_pretrained("your-username/model-name")
+        tokenizer = AutoTokenizer.from_pretrained("your-username/model-name")
+        
+        # Single prediction
+        result = model.predict_sentiment("This is great!", tokenizer)
+        print(result)  # {'score': 0.85, 'category': 'Very Positive'}
+    """
+    
+    def __init__(self, config):
+        super().__init__(config)
+        
+        # Load base transformer
+        self.base_model = AutoModel.from_config(config)
+        
+        # Regression head
+        self.dropout = nn.Dropout(0.1)
+        self.regressor = nn.Linear(config.hidden_size, 1)
+        
+        # Load calibration config
+        self.calibrator = None
+        self._load_calibrator()
+    
+    def _load_calibrator(self):
+        """Load calibration configuration."""
+        calibrator_path = os.path.join(
+            os.path.dirname(__file__), 
+            "calibrator_config.json"
+        )
+        
+        if not os.path.exists(calibrator_path):
+            print("Warning: No calibrator found - using raw predictions")
+            return
+        
+        try:
+            with open(calibrator_path, 'r') as f:
+                config = json.load(f)
+            
+            self.calibrator = config
+            print(f"Loaded {config['method']} calibrator")
+            
+        except Exception as e:
+            print(f"Warning: Could not load calibrator: {e}")
+            self.calibrator = None
+    
+    def _calibrate_score(self, score):
+        """Apply calibration to a score."""
+        if self.calibrator is None:
+            return score
+        
+        method = self.calibrator['method']
+        
+        if method in ['isotonic', 'quantile_mapping']:
+            # Linear interpolation from mapping
+            mapping = self.calibrator['mapping']
+            x = np.array(mapping['input_scores'])
+            y = np.array(mapping['output_scores'])
+            
+            # Simple linear interpolation
+            calibrated = np.interp(score, x, y)
+            
+        elif method == 'piecewise':
+            # Apply correction from anchors
+            anchors = self.calibrator['anchors']
+            anchor_points = sorted([float(k) for k in anchors.keys()])
+            anchor_corrections = [anchors[str(p)] for p in anchor_points]
+            
+            correction = np.interp(score, anchor_points, anchor_corrections)
+            calibrated = score + correction
+        
+        else:
+            calibrated = score
+        
+        return float(np.clip(calibrated, 0.0, 1.0))
+    
+    def forward(self, input_ids, attention_mask=None, token_type_ids=None, labels=None):
+        """Forward pass with automatic calibration."""
+        
+        # Get base model outputs
+        outputs = self.base_model(
+            input_ids=input_ids,
+            attention_mask=attention_mask,
+            token_type_ids=token_type_ids
+        )
+        
+        pooled_output = outputs.pooler_output
+        pooled_output = self.dropout(pooled_output)
+        logits = self.regressor(pooled_output).squeeze(-1)
+        
+        # Clip to valid range
+        logits = torch.clamp(logits, 0.0, 1.0)
+        
+        # Apply calibration during inference (not training)
+        if not self.training and self.calibrator is not None:
+            # Calibrate each score in the batch
+            scores = logits.detach().cpu().numpy()
+            calibrated_scores = np.array([self._calibrate_score(s) for s in scores])
+            logits = torch.tensor(calibrated_scores, device=logits.device, dtype=logits.dtype)
+        
+        # Calculate loss if labels provided
+        loss = None
+        if labels is not None:
+            loss_fn = nn.MSELoss()
+            loss = loss_fn(logits, labels)
+        
+        return SequenceClassifierOutput(
+            loss=loss,
+            logits=logits,
+            hidden_states=outputs.hidden_states if hasattr(outputs, 'hidden_states') else None,
+            attentions=outputs.attentions if hasattr(outputs, 'attentions') else None,
+        )
+    
+    @staticmethod
+    def score_to_category(score):
+        """Convert continuous score to category label."""
+        if score <= 0.20:
+            return "Very Negative"
+        elif score <= 0.40:
+            return "Negative"
+        elif score <= 0.60:
+            return "Neutral"
+        elif score <= 0.80:
+            return "Positive"
+        else:
+            return "Very Positive"
+    
+    def predict_sentiment(self, text, tokenizer, device=None):
+        """
+        Predict sentiment for a single text (convenience method).
+        
+        Args:
+            text: Input text string
+            tokenizer: Loaded tokenizer
+            device: Device to use (auto-detected if None)
+        
+        Returns:
+            dict: {'score': float, 'category': str}
+        """
+        if device is None:
+            device = "cuda" if torch.cuda.is_available() else "cpu"
+        
+        self.eval()
+        self.to(device)
+        
+        # Tokenize
+        inputs = tokenizer(
+            text,
+            return_tensors="pt",
+            padding=True,
+            truncation=True,
+            max_length=512
+        )
+        inputs = {k: v.to(device) for k, v in inputs.items()}
+        
+        # Predict
+        with torch.no_grad():
+            outputs = self(**inputs)
+            score = outputs.logits.item()
+        
+        return {
+            'score': score,
+            'category': self.score_to_category(score)
+        }

regressor_head.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bec00dafb98407f2c5ee552c3243d065db8bf618c19b782aee35c555d3fa7abf
+size 4610

tokenizer_config.json

@@ -0,0 +1,15 @@
+{
+  "backend": "tokenizers",
+  "cls_token": "[CLS]",
+  "do_lower_case": true,
+  "is_local": false,
+  "mask_token": "[MASK]",
+  "max_len": 512,
+  "model_max_length": 512,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e9fb8678aa4cc1bafcf0fc80034214048963228af3f0c28998f22b805d360a6a
+size 4856