Initial upload - RoBERTa fine-tuned on r/Singapore

.gitattributes

@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+checkpoint-3095/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-6190/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,88 @@
+---
+language: en
+tags:
+- sentiment-analysis
+- singapore
+- singlish
+- regression
+license: mit
+---
+
+# Singapore Sentiment Analyzer - ROBERTA (Calibrated)
+
+Fine-tuned sentiment analysis model for Singapore social media, **with post-training calibration** for improved accuracy.
+
+## 🎯 Performance
+
+| Metric | Before Calibration | After Calibration | Improvement |
+|--------|-------------------|-------------------|-------------|
+| **Accuracy** | 52.6% | **64.0%** | **+11.4%** |
+| **MAE** | 0.126 | **0.104** | **-0.022** |
+| **RMSE** | 0.168 | **0.141** | **-0.027** |
+
+## 📊 Sentiment Scale
+
+| Score | Category |
+|-------|----------|
+| 0.00 - 0.20 | Very Negative |
+| 0.21 - 0.40 | Negative |
+| 0.41 - 0.60 | Neutral |
+| 0.61 - 0.80 | Positive |
+| 0.81 - 1.00 | Very Positive |
+
+## 🚀 Quick Start
+
+```python
+from transformers import AutoTokenizer
+from modeling_calibrated import CalibratedRegressionModel
+
+# Load model (calibration is automatic!)
+model_name = "your-username/roberta-singapore-sentiment"
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = CalibratedRegressionModel.from_pretrained(model_name)
+
+# Predict sentiment
+text = "This chicken rice is damn shiok sia!"
+result = model.predict_sentiment(text, tokenizer)
+
+print(f"Score: {result['score']:.3f}")      # 0.875
+print(f"Category: {result['category']}")   # "Very Positive"
+```
+
+## 💡 What is Calibration?
+
+After fine-tuning, we applied **isotonic regression calibration** on a validation set. This corrects systematic bias patterns where the model was:
+- Over-predicting on negative examples
+- Under-predicting on positive examples
+- Struggling with boundary cases (e.g., neutral vs negative)
+
+The calibration layer is built into the model - you get calibrated predictions automatically!
+
+## 📚 Training Details
+
+- **Base model**: `cardiffnlp/twitter-roberta-base-sentiment-latest`
+- **Training data**: 49,521 Singapore Reddit posts/comments
+- **Fine-tuning**: 5 epochs, MSE loss, learning rate 2e-5
+- **Calibration**: Isotonic regression on 500-sample validation set
+
+## 🌏 Singapore Context
+
+This model understands Singlish patterns and Singapore-specific terminology:
+- Particles: lah, lor, leh, sia
+- Slang: shiok, sian, jialat, paiseh
+- Local context: HDB, MRT, hawker, kopitiam
+
+## 📝 Citation
+
+```bibtex
+@misc{roberta-singapore-calibrated,
+  title = {Singapore Sentiment Analyzer - ROBERTA (Calibrated)},
+  year = {2026},
+  publisher = {HuggingFace},
+  url = {https://huggingface.co/your-username/roberta-singapore-sentiment}
+}
+```
+
+## 📄 License
+
+MIT License - Free for commercial and non-commercial use.

calibrator_config.json

@@ -0,0 +1,212 @@
+{
+  "method": "isotonic",
+  "version": "1.0",
+  "mapping": {
+    "input_scores": [
+      0.0,
+      0.01,
+      0.02,
+      0.03,
+      0.04,
+      0.05,
+      0.06,
+      0.07,
+      0.08,
+      0.09,
+      0.1,
+      0.11,
+      0.12,
+      0.13,
+      0.14,
+      0.15,
+      0.16,
+      0.17,
+      0.18,
+      0.19,
+      0.2,
+      0.21,
+      0.22,
+      0.23,
+      0.24,
+      0.25,
+      0.26,
+      0.27,
+      0.28,
+      0.29,
+      0.3,
+      0.31,
+      0.32,
+      0.33,
+      0.34,
+      0.35000000000000003,
+      0.36,
+      0.37,
+      0.38,
+      0.39,
+      0.4,
+      0.41000000000000003,
+      0.42,
+      0.43,
+      0.44,
+      0.45,
+      0.46,
+      0.47000000000000003,
+      0.48,
+      0.49,
+      0.5,
+      0.51,
+      0.52,
+      0.53,
+      0.54,
+      0.55,
+      0.56,
+      0.5700000000000001,
+      0.58,
+      0.59,
+      0.6,
+      0.61,
+      0.62,
+      0.63,
+      0.64,
+      0.65,
+      0.66,
+      0.67,
+      0.68,
+      0.6900000000000001,
+      0.7000000000000001,
+      0.71,
+      0.72,
+      0.73,
+      0.74,
+      0.75,
+      0.76,
+      0.77,
+      0.78,
+      0.79,
+      0.8,
+      0.81,
+      0.8200000000000001,
+      0.8300000000000001,
+      0.84,
+      0.85,
+      0.86,
+      0.87,
+      0.88,
+      0.89,
+      0.9,
+      0.91,
+      0.92,
+      0.93,
+      0.9400000000000001,
+      0.9500000000000001,
+      0.96,
+      0.97,
+      0.98,
+      0.99,
+      1.0
+    ],
+    "output_scores": [
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.27,
+      0.2992307692307692,
+      0.2992307692307692,
+      0.2992307692307692,
+      0.3272,
+      0.3272,
+      0.3272,
+      0.34397337082535834,
+      0.3448571428571429,
+      0.3448571428571429,
+      0.37571428571428567,
+      0.37571428571428567,
+      0.40338709677419354,
+      0.40338709677419354,
+      0.40338709677419354,
+      0.40713987827597964,
+      0.43027027027027026,
+      0.43256671918424794,
+      0.44,
+      0.44,
+      0.44,
+      0.44,
+      0.44,
+      0.45,
+      0.451875,
+      0.451875,
+      0.451875,
+      0.47468750000000004,
+      0.47468750000000004,
+      0.47468750000000004,
+      0.47468750000000004,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5066279069767443,
+      0.5311764705882354,
+      0.5311764705882354,
+      0.5311764705882354,
+      0.5311764705882354,
+      0.5311764705882354,
+      0.5311764705882354,
+      0.5311764705882354,
+      0.5327950005287025,
+      0.5691666666666667,
+      0.5691666666666667,
+      0.5691666666666667,
+      0.5691666666666667,
+      0.5691666666666667,
+      0.5691666666666667,
+      0.578,
+      0.6255555555555554,
+      0.6255555555555554,
+      0.6255555555555554,
+      0.6255555555555554,
+      0.6255555555555554,
+      0.6255555555555554,
+      0.7080074947341977,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0
+    ]
+  }
+}

checkpoint-3095/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2538f6728e4ce3b6913874b96bea3cbf01b35b69f36e2a0ff8afee61a43a6d5a
+size 1112201908

checkpoint-3095/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f679ee56b862ba9bd1a014dfc3a6c596475bbc4cf4843d4fd0e3761274bed760
+size 2224523514

checkpoint-3095/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec1d5b7b9bf8eb4b2f98128c10f9a0ee63e3904bb1961798817eb980b35e8d1e
+size 14244

checkpoint-3095/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:adc90cbad3fd05852b7e150f6fcb9bb1e3a5e38c2220ea5f0e80632e44f0a3c6
+size 988

checkpoint-3095/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:973efcdf28ee46e111fafd3e448424d1ca0aa9d4a70bfd873711cc91b30c6295
+size 1064

checkpoint-3095/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eaea213cb90c14e73a4c3a9d7d3a4080cbaf4cd4ff1d82152a5d17abdf21f483
+size 16781751

checkpoint-3095/tokenizer_config.json

@@ -0,0 +1,14 @@
+{
+  "add_prefix_space": true,
+  "backend": "tokenizers",
+  "bos_token": "<s>",
+  "cls_token": "<s>",
+  "eos_token": "</s>",
+  "is_local": false,
+  "mask_token": "<mask>",
+  "model_max_length": 512,
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "tokenizer_class": "XLMRobertaTokenizer",
+  "unk_token": "<unk>"
+}

checkpoint-3095/trainer_state.json

@@ -0,0 +1,244 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.0,
+  "eval_steps": 500,
+  "global_step": 3095,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03231017770597738,
+      "grad_norm": 9.861390113830566,
+      "learning_rate": 3.101777059773829e-06,
+      "loss": 0.5477748489379883,
+      "step": 100
+    },
+    {
+      "epoch": 0.06462035541195477,
+      "grad_norm": 2.616037368774414,
+      "learning_rate": 6.332794830371568e-06,
+      "loss": 0.12676631927490234,
+      "step": 200
+    },
+    {
+      "epoch": 0.09693053311793215,
+      "grad_norm": 4.2857279777526855,
+      "learning_rate": 9.563812600969306e-06,
+      "loss": 0.09911694526672363,
+      "step": 300
+    },
+    {
+      "epoch": 0.12924071082390953,
+      "grad_norm": 1.2939870357513428,
+      "learning_rate": 1.2794830371567044e-05,
+      "loss": 0.1049954891204834,
+      "step": 400
+    },
+    {
+      "epoch": 0.16155088852988692,
+      "grad_norm": 5.219731330871582,
+      "learning_rate": 1.6025848142164783e-05,
+      "loss": 0.08385737419128418,
+      "step": 500
+    },
+    {
+      "epoch": 0.1938610662358643,
+      "grad_norm": 2.850756883621216,
+      "learning_rate": 1.925686591276252e-05,
+      "loss": 0.09317334175109863,
+      "step": 600
+    },
+    {
+      "epoch": 0.22617124394184168,
+      "grad_norm": 1.8276008367538452,
+      "learning_rate": 1.9990574234185796e-05,
+      "loss": 0.07786022186279297,
+      "step": 700
+    },
+    {
+      "epoch": 0.25848142164781907,
+      "grad_norm": 2.793462038040161,
+      "learning_rate": 1.995022750965336e-05,
+      "loss": 0.08245490074157714,
+      "step": 800
+    },
+    {
+      "epoch": 0.29079159935379645,
+      "grad_norm": 6.711742877960205,
+      "learning_rate": 1.9878246986426318e-05,
+      "loss": 0.08018719673156738,
+      "step": 900
+    },
+    {
+      "epoch": 0.32310177705977383,
+      "grad_norm": 3.199460983276367,
+      "learning_rate": 1.9774861505240173e-05,
+      "loss": 0.0739774227142334,
+      "step": 1000
+    },
+    {
+      "epoch": 0.3554119547657512,
+      "grad_norm": 2.4899613857269287,
+      "learning_rate": 1.964039974958449e-05,
+      "loss": 0.08382820129394532,
+      "step": 1100
+    },
+    {
+      "epoch": 0.3877221324717286,
+      "grad_norm": 4.4406304359436035,
+      "learning_rate": 1.9475289200751162e-05,
+      "loss": 0.07487330436706544,
+      "step": 1200
+    },
+    {
+      "epoch": 0.420032310177706,
+      "grad_norm": 1.0857970714569092,
+      "learning_rate": 1.928005477878439e-05,
+      "loss": 0.07685728549957276,
+      "step": 1300
+    },
+    {
+      "epoch": 0.45234248788368336,
+      "grad_norm": 1.1819262504577637,
+      "learning_rate": 1.9055317173653e-05,
+      "loss": 0.07501106262207032,
+      "step": 1400
+    },
+    {
+      "epoch": 0.48465266558966075,
+      "grad_norm": 3.129441976547241,
+      "learning_rate": 1.880179087195068e-05,
+      "loss": 0.07474668979644776,
+      "step": 1500
+    },
+    {
+      "epoch": 0.5169628432956381,
+      "grad_norm": 2.9378674030303955,
+      "learning_rate": 1.8520281885397672e-05,
+      "loss": 0.07247552871704102,
+      "step": 1600
+    },
+    {
+      "epoch": 0.5492730210016155,
+      "grad_norm": 1.560481309890747,
+      "learning_rate": 1.821168518836544e-05,
+      "loss": 0.07358447074890137,
+      "step": 1700
+    },
+    {
+      "epoch": 0.5815831987075929,
+      "grad_norm": 4.726365089416504,
+      "learning_rate": 1.787698187257095e-05,
+      "loss": 0.07952657222747803,
+      "step": 1800
+    },
+    {
+      "epoch": 0.6138933764135702,
+      "grad_norm": 1.4165911674499512,
+      "learning_rate": 1.7517236027986427e-05,
+      "loss": 0.07016692161560059,
+      "step": 1900
+    },
+    {
+      "epoch": 0.6462035541195477,
+      "grad_norm": 0.4783337712287903,
+      "learning_rate": 1.7133591359880684e-05,
+      "loss": 0.07494973182678223,
+      "step": 2000
+    },
+    {
+      "epoch": 0.678513731825525,
+      "grad_norm": 2.530547618865967,
+      "learning_rate": 1.6727267552747313e-05,
+      "loss": 0.07734737873077392,
+      "step": 2100
+    },
+    {
+      "epoch": 0.7108239095315024,
+      "grad_norm": 1.0889544486999512,
+      "learning_rate": 1.6299556392679357e-05,
+      "loss": 0.0775426435470581,
+      "step": 2200
+    },
+    {
+      "epoch": 0.7431340872374798,
+      "grad_norm": 2.1081032752990723,
+      "learning_rate": 1.5851817660518402e-05,
+      "loss": 0.06733710289001466,
+      "step": 2300
+    },
+    {
+      "epoch": 0.7754442649434572,
+      "grad_norm": 1.5836951732635498,
+      "learning_rate": 1.5385474808834478e-05,
+      "loss": 0.08194868087768555,
+      "step": 2400
+    },
+    {
+      "epoch": 0.8077544426494345,
+      "grad_norm": 2.057037353515625,
+      "learning_rate": 1.4902010436480573e-05,
+      "loss": 0.06820503234863282,
+      "step": 2500
+    },
+    {
+      "epoch": 0.840064620355412,
+      "grad_norm": 0.6506631374359131,
+      "learning_rate": 1.4402961575109102e-05,
+      "loss": 0.07051002025604249,
+      "step": 2600
+    },
+    {
+      "epoch": 0.8723747980613893,
+      "grad_norm": 4.292245388031006,
+      "learning_rate": 1.388991480263541e-05,
+      "loss": 0.07151034355163574,
+      "step": 2700
+    },
+    {
+      "epoch": 0.9046849757673667,
+      "grad_norm": 1.9793055057525635,
+      "learning_rate": 1.336450119918359e-05,
+      "loss": 0.0655900478363037,
+      "step": 2800
+    },
+    {
+      "epoch": 0.9369951534733441,
+      "grad_norm": 2.530876398086548,
+      "learning_rate": 1.2828391161550802e-05,
+      "loss": 0.07584657192230225,
+      "step": 2900
+    },
+    {
+      "epoch": 0.9693053311793215,
+      "grad_norm": 2.5297999382019043,
+      "learning_rate": 1.2283289092675784e-05,
+      "loss": 0.07008735656738281,
+      "step": 3000
+    }
+  ],
+  "logging_steps": 100,
+  "max_steps": 6190,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 2,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 0.0,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-3095/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:85ca94fddce2114b27b9b9bdfc249806dcd2ebc421af3e27a32222368e1077c7
+size 4792

checkpoint-6190/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:87cd730ae4c38a947868a6481864ac60e3b38580246a584547a9baff198bfc90
+size 1112201908

checkpoint-6190/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7bce45e5c04298ae7ddd5934d82f3d57e3edf7b338e1d5bf76d2c5faa6cb66f
+size 2224523514

checkpoint-6190/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28ce47c620300bd9f2ffa8d5f2e1bae45452602cfdd4d5fc78dfcc639890e3ae
+size 14244

checkpoint-6190/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e28f05c7fe964d51cc0c14d3b235eda98be733ad1777b7507ff657cfadf5b07c
+size 988

checkpoint-6190/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8e5af96d214ce66ef00dfede4f395ac95de66fe120d30f632a424a2f80db894a
+size 1064

checkpoint-6190/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eaea213cb90c14e73a4c3a9d7d3a4080cbaf4cd4ff1d82152a5d17abdf21f483
+size 16781751

checkpoint-6190/tokenizer_config.json

@@ -0,0 +1,14 @@
+{
+  "add_prefix_space": true,
+  "backend": "tokenizers",
+  "bos_token": "<s>",
+  "cls_token": "<s>",
+  "eos_token": "</s>",
+  "is_local": false,
+  "mask_token": "<mask>",
+  "model_max_length": 512,
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "tokenizer_class": "XLMRobertaTokenizer",
+  "unk_token": "<unk>"
+}

checkpoint-6190/trainer_state.json

@@ -0,0 +1,461 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 2.0,
+  "eval_steps": 500,
+  "global_step": 6190,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03231017770597738,
+      "grad_norm": 9.861390113830566,
+      "learning_rate": 3.101777059773829e-06,
+      "loss": 0.5477748489379883,
+      "step": 100
+    },
+    {
+      "epoch": 0.06462035541195477,
+      "grad_norm": 2.616037368774414,
+      "learning_rate": 6.332794830371568e-06,
+      "loss": 0.12676631927490234,
+      "step": 200
+    },
+    {
+      "epoch": 0.09693053311793215,
+      "grad_norm": 4.2857279777526855,
+      "learning_rate": 9.563812600969306e-06,
+      "loss": 0.09911694526672363,
+      "step": 300
+    },
+    {
+      "epoch": 0.12924071082390953,
+      "grad_norm": 1.2939870357513428,
+      "learning_rate": 1.2794830371567044e-05,
+      "loss": 0.1049954891204834,
+      "step": 400
+    },
+    {
+      "epoch": 0.16155088852988692,
+      "grad_norm": 5.219731330871582,
+      "learning_rate": 1.6025848142164783e-05,
+      "loss": 0.08385737419128418,
+      "step": 500
+    },
+    {
+      "epoch": 0.1938610662358643,
+      "grad_norm": 2.850756883621216,
+      "learning_rate": 1.925686591276252e-05,
+      "loss": 0.09317334175109863,
+      "step": 600
+    },
+    {
+      "epoch": 0.22617124394184168,
+      "grad_norm": 1.8276008367538452,
+      "learning_rate": 1.9990574234185796e-05,
+      "loss": 0.07786022186279297,
+      "step": 700
+    },
+    {
+      "epoch": 0.25848142164781907,
+      "grad_norm": 2.793462038040161,
+      "learning_rate": 1.995022750965336e-05,
+      "loss": 0.08245490074157714,
+      "step": 800
+    },
+    {
+      "epoch": 0.29079159935379645,
+      "grad_norm": 6.711742877960205,
+      "learning_rate": 1.9878246986426318e-05,
+      "loss": 0.08018719673156738,
+      "step": 900
+    },
+    {
+      "epoch": 0.32310177705977383,
+      "grad_norm": 3.199460983276367,
+      "learning_rate": 1.9774861505240173e-05,
+      "loss": 0.0739774227142334,
+      "step": 1000
+    },
+    {
+      "epoch": 0.3554119547657512,
+      "grad_norm": 2.4899613857269287,
+      "learning_rate": 1.964039974958449e-05,
+      "loss": 0.08382820129394532,
+      "step": 1100
+    },
+    {
+      "epoch": 0.3877221324717286,
+      "grad_norm": 4.4406304359436035,
+      "learning_rate": 1.9475289200751162e-05,
+      "loss": 0.07487330436706544,
+      "step": 1200
+    },
+    {
+      "epoch": 0.420032310177706,
+      "grad_norm": 1.0857970714569092,
+      "learning_rate": 1.928005477878439e-05,
+      "loss": 0.07685728549957276,
+      "step": 1300
+    },
+    {
+      "epoch": 0.45234248788368336,
+      "grad_norm": 1.1819262504577637,
+      "learning_rate": 1.9055317173653e-05,
+      "loss": 0.07501106262207032,
+      "step": 1400
+    },
+    {
+      "epoch": 0.48465266558966075,
+      "grad_norm": 3.129441976547241,
+      "learning_rate": 1.880179087195068e-05,
+      "loss": 0.07474668979644776,
+      "step": 1500
+    },
+    {
+      "epoch": 0.5169628432956381,
+      "grad_norm": 2.9378674030303955,
+      "learning_rate": 1.8520281885397672e-05,
+      "loss": 0.07247552871704102,
+      "step": 1600
+    },
+    {
+      "epoch": 0.5492730210016155,
+      "grad_norm": 1.560481309890747,
+      "learning_rate": 1.821168518836544e-05,
+      "loss": 0.07358447074890137,
+      "step": 1700
+    },
+    {
+      "epoch": 0.5815831987075929,
+      "grad_norm": 4.726365089416504,
+      "learning_rate": 1.787698187257095e-05,
+      "loss": 0.07952657222747803,
+      "step": 1800
+    },
+    {
+      "epoch": 0.6138933764135702,
+      "grad_norm": 1.4165911674499512,
+      "learning_rate": 1.7517236027986427e-05,
+      "loss": 0.07016692161560059,
+      "step": 1900
+    },
+    {
+      "epoch": 0.6462035541195477,
+      "grad_norm": 0.4783337712287903,
+      "learning_rate": 1.7133591359880684e-05,
+      "loss": 0.07494973182678223,
+      "step": 2000
+    },
+    {
+      "epoch": 0.678513731825525,
+      "grad_norm": 2.530547618865967,
+      "learning_rate": 1.6727267552747313e-05,
+      "loss": 0.07734737873077392,
+      "step": 2100
+    },
+    {
+      "epoch": 0.7108239095315024,
+      "grad_norm": 1.0889544486999512,
+      "learning_rate": 1.6299556392679357e-05,
+      "loss": 0.0775426435470581,
+      "step": 2200
+    },
+    {
+      "epoch": 0.7431340872374798,
+      "grad_norm": 2.1081032752990723,
+      "learning_rate": 1.5851817660518402e-05,
+      "loss": 0.06733710289001466,
+      "step": 2300
+    },
+    {
+      "epoch": 0.7754442649434572,
+      "grad_norm": 1.5836951732635498,
+      "learning_rate": 1.5385474808834478e-05,
+      "loss": 0.08194868087768555,
+      "step": 2400
+    },
+    {
+      "epoch": 0.8077544426494345,
+      "grad_norm": 2.057037353515625,
+      "learning_rate": 1.4902010436480573e-05,
+      "loss": 0.06820503234863282,
+      "step": 2500
+    },
+    {
+      "epoch": 0.840064620355412,
+      "grad_norm": 0.6506631374359131,
+      "learning_rate": 1.4402961575109102e-05,
+      "loss": 0.07051002025604249,
+      "step": 2600
+    },
+    {
+      "epoch": 0.8723747980613893,
+      "grad_norm": 4.292245388031006,
+      "learning_rate": 1.388991480263541e-05,
+      "loss": 0.07151034355163574,
+      "step": 2700
+    },
+    {
+      "epoch": 0.9046849757673667,
+      "grad_norm": 1.9793055057525635,
+      "learning_rate": 1.336450119918359e-05,
+      "loss": 0.0655900478363037,
+      "step": 2800
+    },
+    {
+      "epoch": 0.9369951534733441,
+      "grad_norm": 2.530876398086548,
+      "learning_rate": 1.2828391161550802e-05,
+      "loss": 0.07584657192230225,
+      "step": 2900
+    },
+    {
+      "epoch": 0.9693053311793215,
+      "grad_norm": 2.5297999382019043,
+      "learning_rate": 1.2283289092675784e-05,
+      "loss": 0.07008735656738281,
+      "step": 3000
+    },
+    {
+      "epoch": 1.001615508885299,
+      "grad_norm": 1.7796375751495361,
+      "learning_rate": 1.1730927982994993e-05,
+      "loss": 0.06636083602905274,
+      "step": 3100
+    },
+    {
+      "epoch": 1.0339256865912763,
+      "grad_norm": 1.7367686033248901,
+      "learning_rate": 1.1173063900913238e-05,
+      "loss": 0.0592303991317749,
+      "step": 3200
+    },
+    {
+      "epoch": 1.0662358642972536,
+      "grad_norm": 4.276639461517334,
+      "learning_rate": 1.0611470409904767e-05,
+      "loss": 0.06370447158813476,
+      "step": 3300
+    },
+    {
+      "epoch": 1.098546042003231,
+      "grad_norm": 0.847137451171875,
+      "learning_rate": 1.004793292999394e-05,
+      "loss": 0.05840009212493896,
+      "step": 3400
+    },
+    {
+      "epoch": 1.1308562197092085,
+      "grad_norm": 0.6478699445724487,
+      "learning_rate": 9.484243061541569e-06,
+      "loss": 0.06211245059967041,
+      "step": 3500
+    },
+    {
+      "epoch": 1.1631663974151858,
+      "grad_norm": 1.4824755191802979,
+      "learning_rate": 8.922192889382645e-06,
+      "loss": 0.055956668853759765,
+      "step": 3600
+    },
+    {
+      "epoch": 1.1954765751211631,
+      "grad_norm": 2.773651599884033,
+      "learning_rate": 8.363569285423877e-06,
+      "loss": 0.06431435108184815,
+      "step": 3700
+    },
+    {
+      "epoch": 1.2277867528271407,
+      "grad_norm": 2.68066668510437,
+      "learning_rate": 7.810148227814154e-06,
+      "loss": 0.05840532779693604,
+      "step": 3800
+    },
+    {
+      "epoch": 1.260096930533118,
+      "grad_norm": 1.5976542234420776,
+      "learning_rate": 7.2691135581136115e-06,
+      "loss": 0.05926973342895508,
+      "step": 3900
+    },
+    {
+      "epoch": 1.2924071082390953,
+      "grad_norm": 1.544439673423767,
+      "learning_rate": 6.731258267944037e-06,
+      "loss": 0.05274605751037598,
+      "step": 4000
+    },
+    {
+      "epoch": 1.3247172859450727,
+      "grad_norm": 2.24636173248291,
+      "learning_rate": 6.203794973116895e-06,
+      "loss": 0.059646468162536624,
+      "step": 4100
+    },
+    {
+      "epoch": 1.35702746365105,
+      "grad_norm": 3.2433087825775146,
+      "learning_rate": 5.688400586815448e-06,
+      "loss": 0.06289317131042481,
+      "step": 4200
+    },
+    {
+      "epoch": 1.3893376413570275,
+      "grad_norm": 1.3600902557373047,
+      "learning_rate": 5.186713652706039e-06,
+      "loss": 0.052667765617370604,
+      "step": 4300
+    },
+    {
+      "epoch": 1.4216478190630049,
+      "grad_norm": 1.0024421215057373,
+      "learning_rate": 4.700329135674232e-06,
+      "loss": 0.06143908977508545,
+      "step": 4400
+    },
+    {
+      "epoch": 1.4539579967689822,
+      "grad_norm": 1.5457347631454468,
+      "learning_rate": 4.230793351106791e-06,
+      "loss": 0.05797869205474854,
+      "step": 4500
+    },
+    {
+      "epoch": 1.4862681744749597,
+      "grad_norm": 4.037192344665527,
+      "learning_rate": 3.779599048840291e-06,
+      "loss": 0.06049912929534912,
+      "step": 4600
+    },
+    {
+      "epoch": 1.518578352180937,
+      "grad_norm": 1.502553939819336,
+      "learning_rate": 3.348180667405534e-06,
+      "loss": 0.060120220184326174,
+      "step": 4700
+    },
+    {
+      "epoch": 1.5508885298869144,
+      "grad_norm": 1.232434868812561,
+      "learning_rate": 2.937909773655454e-06,
+      "loss": 0.05791036605834961,
+      "step": 4800
+    },
+    {
+      "epoch": 1.5831987075928917,
+      "grad_norm": 1.6803334951400757,
+      "learning_rate": 2.5500907022749176e-06,
+      "loss": 0.06459022045135498,
+      "step": 4900
+    },
+    {
+      "epoch": 1.615508885298869,
+      "grad_norm": 2.0008294582366943,
+      "learning_rate": 2.185956409035248e-06,
+      "loss": 0.05583086967468262,
+      "step": 5000
+    },
+    {
+      "epoch": 1.6478190630048464,
+      "grad_norm": 1.3095674514770508,
+      "learning_rate": 1.8466645509768467e-06,
+      "loss": 0.054550580978393555,
+      "step": 5100
+    },
+    {
+      "epoch": 1.680129240710824,
+      "grad_norm": 1.9832102060317993,
+      "learning_rate": 1.5332938059818138e-06,
+      "loss": 0.059768757820129394,
+      "step": 5200
+    },
+    {
+      "epoch": 1.7124394184168013,
+      "grad_norm": 1.8038883209228516,
+      "learning_rate": 1.2468404434373893e-06,
+      "loss": 0.0636633014678955,
+      "step": 5300
+    },
+    {
+      "epoch": 1.7447495961227788,
+      "grad_norm": 0.849116325378418,
+      "learning_rate": 9.882151568927734e-07,
+      "loss": 0.0593804407119751,
+      "step": 5400
+    },
+    {
+      "epoch": 1.7770597738287561,
+      "grad_norm": 7.403454780578613,
+      "learning_rate": 7.582401687789576e-07,
+      "loss": 0.055037131309509275,
+      "step": 5500
+    },
+    {
+      "epoch": 1.8093699515347335,
+      "grad_norm": 1.4914259910583496,
+      "learning_rate": 5.576466163962424e-07,
+      "loss": 0.0574748420715332,
+      "step": 5600
+    },
+    {
+      "epoch": 1.8416801292407108,
+      "grad_norm": 4.520964622497559,
+      "learning_rate": 3.870722274799332e-07,
+      "loss": 0.05434022903442383,
+      "step": 5700
+    },
+    {
+      "epoch": 1.8739903069466881,
+      "grad_norm": 4.723050117492676,
+      "learning_rate": 2.470592927340576e-07,
+      "loss": 0.0561255693435669,
+      "step": 5800
+    },
+    {
+      "epoch": 1.9063004846526654,
+      "grad_norm": 1.1265549659729004,
+      "learning_rate": 1.3805294177882567e-07,
+      "loss": 0.053927097320556644,
+      "step": 5900
+    },
+    {
+      "epoch": 1.938610662358643,
+      "grad_norm": 0.8897490501403809,
+      "learning_rate": 6.039972799296246e-08,
+      "loss": 0.05735964298248291,
+      "step": 6000
+    },
+    {
+      "epoch": 1.9709208400646203,
+      "grad_norm": 2.7680275440216064,
+      "learning_rate": 1.4346526749972056e-08,
+      "loss": 0.05199080467224121,
+      "step": 6100
+    }
+  ],
+  "logging_steps": 100,
+  "max_steps": 6190,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 2,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 0.0,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-6190/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:85ca94fddce2114b27b9b9bdfc249806dcd2ebc421af3e27a32222368e1077c7
+size 4792

config.json

@@ -0,0 +1,30 @@
+{
+  "add_cross_attention": false,
+  "architectures": [
+    "XLMRobertaModel"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": 0,
+  "classifier_dropout": null,
+  "dtype": "float32",
+  "eos_token_id": 2,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "is_decoder": false,
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 514,
+  "model_type": "xlm-roberta",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "output_past": true,
+  "pad_token_id": 1,
+  "position_embedding_type": "absolute",
+  "tie_word_embeddings": true,
+  "transformers_version": "5.1.0",
+  "type_vocab_size": 1,
+  "use_cache": true,
+  "vocab_size": 250002
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c52de2bbeecd89b72b0f6efa87d44ca44e235ef448b78509cf18a48c73eac4e4
+size 1112197064

model_config.txt

@@ -0,0 +1,5 @@
+model_type=regression
+output_range=0-1
+base_model=xlm-roberta-base
+class_weighted=True
+class_weights=0.621,0.827,0.883,1.226,4.312

modeling_calibrated.py

@@ -0,0 +1,184 @@
+"""
+Custom modeling file for calibrated sentiment prediction.
+Auto-generated - do not edit manually.
+"""
+
+import torch
+import torch.nn as nn
+from transformers import AutoModel, PreTrainedModel
+from transformers.modeling_outputs import SequenceClassifierOutput
+import json
+import os
+import numpy as np
+
+
+class CalibratedRegressionModel(PreTrainedModel):
+    """
+    Sentiment model with built-in calibration.
+    
+    Usage:
+        from transformers import AutoTokenizer
+        from modeling_calibrated import CalibratedRegressionModel
+        
+        model = CalibratedRegressionModel.from_pretrained("your-username/model-name")
+        tokenizer = AutoTokenizer.from_pretrained("your-username/model-name")
+        
+        # Single prediction
+        result = model.predict_sentiment("This is great!", tokenizer)
+        print(result)  # {'score': 0.85, 'category': 'Very Positive'}
+    """
+    
+    def __init__(self, config):
+        super().__init__(config)
+        
+        # Load base transformer
+        self.base_model = AutoModel.from_config(config)
+        
+        # Regression head
+        self.dropout = nn.Dropout(0.1)
+        self.regressor = nn.Linear(config.hidden_size, 1)
+        
+        # Load calibration config
+        self.calibrator = None
+        self._load_calibrator()
+    
+    def _load_calibrator(self):
+        """Load calibration configuration."""
+        calibrator_path = os.path.join(
+            os.path.dirname(__file__), 
+            "calibrator_config.json"
+        )
+        
+        if not os.path.exists(calibrator_path):
+            print("Warning: No calibrator found - using raw predictions")
+            return
+        
+        try:
+            with open(calibrator_path, 'r') as f:
+                config = json.load(f)
+            
+            self.calibrator = config
+            print(f"Loaded {config['method']} calibrator")
+            
+        except Exception as e:
+            print(f"Warning: Could not load calibrator: {e}")
+            self.calibrator = None
+    
+    def _calibrate_score(self, score):
+        """Apply calibration to a score."""
+        if self.calibrator is None:
+            return score
+        
+        method = self.calibrator['method']
+        
+        if method in ['isotonic', 'quantile_mapping']:
+            # Linear interpolation from mapping
+            mapping = self.calibrator['mapping']
+            x = np.array(mapping['input_scores'])
+            y = np.array(mapping['output_scores'])
+            
+            # Simple linear interpolation
+            calibrated = np.interp(score, x, y)
+            
+        elif method == 'piecewise':
+            # Apply correction from anchors
+            anchors = self.calibrator['anchors']
+            anchor_points = sorted([float(k) for k in anchors.keys()])
+            anchor_corrections = [anchors[str(p)] for p in anchor_points]
+            
+            correction = np.interp(score, anchor_points, anchor_corrections)
+            calibrated = score + correction
+        
+        else:
+            calibrated = score
+        
+        return float(np.clip(calibrated, 0.0, 1.0))
+    
+    def forward(self, input_ids, attention_mask=None, token_type_ids=None, labels=None):
+        """Forward pass with automatic calibration."""
+        
+        # Get base model outputs
+        outputs = self.base_model(
+            input_ids=input_ids,
+            attention_mask=attention_mask,
+            token_type_ids=token_type_ids
+        )
+        
+        pooled_output = outputs.pooler_output
+        pooled_output = self.dropout(pooled_output)
+        logits = self.regressor(pooled_output).squeeze(-1)
+        
+        # Clip to valid range
+        logits = torch.clamp(logits, 0.0, 1.0)
+        
+        # Apply calibration during inference (not training)
+        if not self.training and self.calibrator is not None:
+            # Calibrate each score in the batch
+            scores = logits.detach().cpu().numpy()
+            calibrated_scores = np.array([self._calibrate_score(s) for s in scores])
+            logits = torch.tensor(calibrated_scores, device=logits.device, dtype=logits.dtype)
+        
+        # Calculate loss if labels provided
+        loss = None
+        if labels is not None:
+            loss_fn = nn.MSELoss()
+            loss = loss_fn(logits, labels)
+        
+        return SequenceClassifierOutput(
+            loss=loss,
+            logits=logits,
+            hidden_states=outputs.hidden_states if hasattr(outputs, 'hidden_states') else None,
+            attentions=outputs.attentions if hasattr(outputs, 'attentions') else None,
+        )
+    
+    @staticmethod
+    def score_to_category(score):
+        """Convert continuous score to category label."""
+        if score <= 0.20:
+            return "Very Negative"
+        elif score <= 0.40:
+            return "Negative"
+        elif score <= 0.60:
+            return "Neutral"
+        elif score <= 0.80:
+            return "Positive"
+        else:
+            return "Very Positive"
+    
+    def predict_sentiment(self, text, tokenizer, device=None):
+        """
+        Predict sentiment for a single text (convenience method).
+        
+        Args:
+            text: Input text string
+            tokenizer: Loaded tokenizer
+            device: Device to use (auto-detected if None)
+        
+        Returns:
+            dict: {'score': float, 'category': str}
+        """
+        if device is None:
+            device = "cuda" if torch.cuda.is_available() else "cpu"
+        
+        self.eval()
+        self.to(device)
+        
+        # Tokenize
+        inputs = tokenizer(
+            text,
+            return_tensors="pt",
+            padding=True,
+            truncation=True,
+            max_length=512
+        )
+        inputs = {k: v.to(device) for k, v in inputs.items()}
+        
+        # Predict
+        with torch.no_grad():
+            outputs = self(**inputs)
+            score = outputs.logits.item()
+        
+        return {
+            'score': score,
+            'category': self.score_to_category(score)
+        }

regressor_head.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a1b74b41139df6fd69310879998ac9c14c73d69452680ada34b1c0abe031e61b
+size 4610

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eaea213cb90c14e73a4c3a9d7d3a4080cbaf4cd4ff1d82152a5d17abdf21f483
+size 16781751

tokenizer_config.json

@@ -0,0 +1,14 @@
+{
+  "add_prefix_space": true,
+  "backend": "tokenizers",
+  "bos_token": "<s>",
+  "cls_token": "<s>",
+  "eos_token": "</s>",
+  "is_local": false,
+  "mask_token": "<mask>",
+  "model_max_length": 512,
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "tokenizer_class": "XLMRobertaTokenizer",
+  "unk_token": "<unk>"
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce28074bafbbe140485a4cd0003003f05d85fe305e3bcbce5dfb5dc603f88645
+size 4792