Upload 19 files

README.md

@@ -1,3 +1,315 @@
----
-license: apache-2.0
----
+---
+license: apache-2.0
+base_model: Derify/ModChemBERT-MLM
+datasets:
+- Derify/augmented_canonical_druglike_QED_Pfizer_15M
+metrics:
+- roc_auc
+- rmse
+library_name: transformers
+tags:
+- modernbert
+- ModChemBERT
+- cheminformatics
+- chemical-language-model
+- molecular-property-prediction
+- mergekit
+- merge
+pipeline_tag: fill-mask
+model-index:
+- name: Derify/ModChemBERT-MLM
+  results:
+  - task:
+      type: text-classification
+      name: Classification (ROC AUC)
+    dataset:
+      name: BACE
+      type: BACE
+    metrics:
+    - type: roc_auc
+      value: 0.7924
+  - task:
+      type: text-classification
+      name: Classification (ROC AUC)
+    dataset:
+      name: BBBP
+      type: BBBP
+    metrics:
+    - type: roc_auc
+      value: 0.7282
+  - task:
+      type: text-classification
+      name: Classification (ROC AUC)
+    dataset:
+      name: CLINTOX
+      type: CLINTOX
+    metrics:
+    - type: roc_auc
+      value: 0.9725
+  - task:
+      type: text-classification
+      name: Classification (ROC AUC)
+    dataset:
+      name: HIV
+      type: HIV
+    metrics:
+    - type: roc_auc
+      value: 0.7770
+  - task:
+      type: text-classification
+      name: Classification (ROC AUC)
+    dataset:
+      name: SIDER
+      type: SIDER
+    metrics:
+    - type: roc_auc
+      value: 0.6542
+  - task:
+      type: text-classification
+      name: Classification (ROC AUC)
+    dataset:
+      name: TOX21
+      type: TOX21
+    metrics:
+    - type: roc_auc
+      value: 0.7646
+  - task:
+      type: regression
+      name: Regression (RMSE)
+    dataset:
+      name: BACE
+      type: BACE
+    metrics:
+    - type: rmse
+      value: 1.0304
+  - task:
+      type: regression
+      name: Regression (RMSE)
+    dataset:
+      name: CLEARANCE
+      type: CLEARANCE
+    metrics:
+    - type: rmse
+      value: 47.8418
+  - task:
+      type: regression
+      name: Regression (RMSE)
+    dataset:
+      name: ESOL
+      type: ESOL
+    metrics:
+    - type: rmse
+      value: 0.7669
+  - task:
+      type: regression
+      name: Regression (RMSE)
+    dataset:
+      name: FREESOLV
+      type: FREESOLV
+    metrics:
+    - type: rmse
+      value: 0.5293
+  - task:
+      type: regression
+      name: Regression (RMSE)
+    dataset:
+      name: LIPO
+      type: LIPO
+    metrics:
+    - type: rmse
+      value: 0.6708
+---
+
+# ModChemBERT: ModernBERT as a Chemical Language Model
+ModChemBERT is a ModernBERT-based chemical language model (CLM), trained on SMILES strings for masked language modeling (MLM) and downstream molecular property prediction (classification & regression).
+
+## Usage
+### Load Model
+```python
+from transformers import AutoModelForMaskedLM, AutoTokenizer
+
+model_id = "Derify/ModChemBERT-MLM-TAFT"
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+model = AutoModelForMaskedLM.from_pretrained(
+    model_id,
+    trust_remote_code=True,
+    dtype="float16",
+    device_map="auto",
+)
+```
+
+### Fill-Mask Pipeline
+```python
+from transformers import pipeline
+
+fill = pipeline("fill-mask", model=model, tokenizer=tokenizer)
+print(fill("c1ccccc1[MASK]"))
+```
+
+## Intended Use
+* Primary: Research and development for molecular property prediction, experimentation with pooling strategies, and as a foundational model for downstream applications.
+* Appropriate for: Binary / multi-class classification (e.g., toxicity, activity) and single-task or multi-task regression (e.g., solubility, clearance) after fine-tuning.
+* Not intended for generating novel molecules.
+
+## Limitations
+- Out-of-domain performance may degrade for: very long (>128 token) SMILES, inorganic / organometallic compounds, polymers, or charged / enumerated tautomers are not well represented in training.
+- No guarantee of synthesizability, safety, or biological efficacy.
+
+## Ethical Considerations & Responsible Use
+- Potential biases arise from training corpora skewed to drug-like space.
+- Do not deploy in clinical or regulatory settings without rigorous, domain-specific validation.
+
+## Architecture
+- Backbone: ModernBERT
+- Hidden size: 768
+- Intermediate size: 1152
+- Encoder Layers: 22
+- Attention heads: 12
+- Max sequence length: 256 tokens (MLM primarily trained with 128-token sequences)
+- Vocabulary: BPE tokenizer using [MolFormer's vocab](https://github.com/emapco/ModChemBERT/blob/main/modchembert/tokenizers/molformer/vocab.json) (2362 tokens)
+
+## Pooling (Classifier / Regressor Head)
+Kallergis et al. [1] demonstrated that the CLM embedding method prior to the prediction head can significantly impact downstream performance.
+
+Behrendt et al. [2] noted that the last few layers contain task-specific information and that pooling methods leveraging information from multiple layers can enhance model performance. Their results further demonstrated that the `max_seq_mha` pooling method was particularly effective in low-data regimes, which is often the case for molecular property prediction tasks.
+
+Multiple pooling strategies are supported by ModChemBERT to explore their impact on downstream performance:
+- `cls`: Last layer [CLS]
+- `mean`: Mean over last hidden layer
+- `max_cls`: Max over last k layers of [CLS]
+- `cls_mha`: MHA with [CLS] as query
+- `max_seq_mha`: MHA with max pooled sequence as KV and max pooled [CLS] as query
+- `sum_mean`: Sum over all layers then mean tokens
+- `sum_sum`: Sum over all layers then sum tokens
+- `mean_mean`: Mean over all layers then mean tokens
+- `mean_sum`: Mean over all layers then sum tokens
+- `max_seq_mean`: Max over last k layers then mean tokens
+
+## Training Pipeline
+<div align="center">
+  <img src="https://cdn-uploads.huggingface.co/production/uploads/656892962693fa22e18b5331/bxNbpgMkU8m60ypyEJoWQ.png" alt="ModChemBERT Training Pipeline" width="650"/>
+</div>
+
+### Rationale for MTR Stage
+Following Sultan et al. [3], multi-task regression (physicochemical properties) biases the latent space toward ADME-related representations prior to narrow TAFT specialization. Sultan et al. observed that MLM + DAPT (MTR) outperforms MLM-only, MTR-only, and MTR + DAPT (MTR).
+
+### Checkpoint Averaging Motivation
+Inspired by ModernBERT [4], JaColBERTv2.5 [5], and Llama 3.1 [6], where results show that model merging can enhance generalization or performance while mitigating overfitting to any single fine-tune or annealing checkpoint.
+
+## Datasets
+- Pretraining: [Derify/augmented_canonical_druglike_QED_Pfizer_15M](https://huggingface.co/datasets/Derify/augmented_canonical_druglike_QED_Pfizer_15M)
+- Domain Adaptive Pretraining (DAPT) & Task Adaptive Fine-tuning (TAFT): ADME + AstraZeneca datasets (10 tasks) with scaffold splits from DA4MT pipeline (see [domain-adaptation-molecular-transformers](https://github.com/emapco/ModChemBERT/tree/main/domain-adaptation-molecular-transformers))
+- Benchmarking: ChemBERTa-3 [7] tasks (BACE, BBBP, TOX21, HIV, SIDER, CLINTOX for classification; ESOL, FREESOLV, LIPO, BACE, CLEARANCE for regression)
+
+## Benchmarking
+Benchmarks were conducted with the ChemBERTa-3 framework using DeepChem scaffold splits. Each task was trained for 100 epochs with 3 random seeds.
+
+### Evaluation Methodology
+- Classification Metric: ROC AUC.
+- Regression Metric: RMSE.
+- Aggregation: Mean ± standard deviation of the triplicate results.
+- Input Constraints: SMILES truncated / filtered to ≤200 tokens, following the MolFormer paper's recommendation.
+
+### Results
+<details><summary>Click to expand</summary>
+
+#### Classification Datasets (ROC AUC - Higher is better)
+
+| Model                                                                        | BACE↑             | BBBP↑             | CLINTOX↑              | HIV↑                  | SIDER↑                | TOX21↑            | AVG†   |
+| ---------------------------------------------------------------------------- | ----------------- | ----------------- | --------------------- | --------------------- | --------------------- | ----------------- | ------ |
+| **Tasks**                                                                    | 1                 | 1                 | 2                     | 1                     | 27                    | 12                |        |
+| [ChemBERTa-100M-MLM](https://huggingface.co/DeepChem/ChemBERTa-100M-MLM)*    | 0.781 ± 0.019     | 0.700 ± 0.027     | 0.979 ± 0.022         | 0.740 ± 0.013         | 0.611 ± 0.002         | 0.718 ± 0.011     | 0.7548 |
+| [c3-MoLFormer-1.1B](https://huggingface.co/DeepChem/MoLFormer-c3-1.1B)*      | 0.819 ± 0.019     | 0.735 ± 0.019     | 0.839 ± 0.013         | 0.762 ± 0.005         | 0.618 ± 0.005         | 0.723 ± 0.012     | 0.7493 |
+| MoLFormer-LHPC*                                                              | **0.887 ± 0.004** | **0.908 ± 0.013** | 0.993 ± 0.004         | 0.750 ± 0.003         | 0.622 ± 0.007         | **0.791 ± 0.014** | 0.8252 |
+| -------------------------                                                    | ----------------- | ----------------- | -------------------   | -------------------   | -------------------   | ----------------- | ------ |
+| [MLM](https://huggingface.co/Derify/ModChemBERT-MLM)                         | 0.8065 ± 0.0103   | 0.7222 ± 0.0150   | 0.9709 ± 0.0227       | ***0.7800 ± 0.0133*** | 0.6419 ± 0.0113       | 0.7400 ± 0.0044   | 0.7769 |
+| [MLM + DAPT](https://huggingface.co/Derify/ModChemBERT-MLM-DAPT)             | 0.8224 ± 0.0156   | 0.7402 ± 0.0095   | 0.9820 ± 0.0138       | 0.7702 ± 0.0020       | 0.6303 ± 0.0039       | 0.7360 ± 0.0036   | 0.7802 |
+| [MLM + TAFT](https://huggingface.co/Derify/ModChemBERT-MLM-TAFT)             | 0.7924 ± 0.0155   | 0.7282 ± 0.0058   | 0.9725 ± 0.0213       | 0.7770 ± 0.0047       | 0.6542 ± 0.0128       | *0.7646 ± 0.0039* | 0.7815 |
+| [MLM + DAPT + TAFT](https://huggingface.co/Derify/ModChemBERT-MLM-DAPT-TAFT) | 0.8213 ± 0.0051   | 0.7356 ± 0.0094   | 0.9664 ± 0.0202       | 0.7750 ± 0.0048       | 0.6415 ± 0.0094       | 0.7263 ± 0.0036   | 0.7777 |
+| [MLM + DAPT + TAFT OPT](https://huggingface.co/Derify/ModChemBERT)           | *0.8346 ± 0.0045* | *0.7573 ± 0.0120* | ***0.9938 ± 0.0017*** | 0.7737 ± 0.0034       | ***0.6600 ± 0.0061*** | 0.7518 ± 0.0047   | 0.7952 |
+
+#### Regression Datasets (RMSE - Lower is better)
+
+| Model                                                                        | BACE↓                 | CLEARANCE↓             | ESOL↓                 | FREESOLV↓             | LIPO↓                 | AVG‡             |
+| ---------------------------------------------------------------------------- | --------------------- | ---------------------- | --------------------- | --------------------- | --------------------- | ---------------- |
+| **Tasks**                                                                    | 1                     | 1                      | 1                     | 1                     | 1                     |                  |
+| [ChemBERTa-100M-MLM](https://huggingface.co/DeepChem/ChemBERTa-100M-MLM)*    | 1.011 ± 0.038         | 51.582 ± 3.079         | 0.920 ± 0.011         | 0.536 ± 0.016         | 0.758 ± 0.013         | 0.8063 / 10.9614 |
+| [c3-MoLFormer-1.1B](https://huggingface.co/DeepChem/MoLFormer-c3-1.1B)*      | 1.094 ± 0.126         | 52.058 ± 2.767         | 0.829 ± 0.019         | 0.572 ± 0.023         | 0.728 ± 0.016         | 0.8058 / 11.0562 |
+| MoLFormer-LHPC*                                                              | 1.201 ± 0.100         | 45.74 ± 2.637          | 0.848 ± 0.031         | 0.683 ± 0.040         | 0.895 ± 0.080         | 0.9068 / 9.8734  |
+| -------------------------                                                    | -------------------   | --------------------   | -------------------   | -------------------   | -------------------   | ---------------- |
+| [MLM](https://huggingface.co/Derify/ModChemBERT-MLM)                         | 1.0893 ± 0.1319       | 49.0005 ± 1.2787       | 0.8456 ± 0.0406       | 0.5491 ± 0.0134       | 0.7147 ± 0.0062       | 0.7997 / 10.4398 |
+| [MLM + DAPT](https://huggingface.co/Derify/ModChemBERT-MLM-DAPT)             | 0.9931 ± 0.0258       | 45.4951 ± 0.7112       | 0.9319 ± 0.0153       | 0.6049 ± 0.0666       | 0.6874 ± 0.0040       | 0.8043 / 9.7425  |
+| [MLM + TAFT](https://huggingface.co/Derify/ModChemBERT-MLM-TAFT)             | 1.0304 ± 0.1146       | 47.8418 ± 0.4070       | ***0.7669 ± 0.0024*** | 0.5293 ± 0.0267       | 0.6708 ± 0.0074       | 0.7493 / 10.1678 |
+| [MLM + DAPT + TAFT](https://huggingface.co/Derify/ModChemBERT-MLM-DAPT-TAFT) | 0.9713 ± 0.0224       | ***42.8010 ± 3.3475*** | 0.8169 ± 0.0268       | 0.5445 ± 0.0257       | 0.6820 ± 0.0028       | 0.7537 / 9.1631  |
+| [MLM + DAPT + TAFT OPT](https://huggingface.co/Derify/ModChemBERT)           | ***0.9665 ± 0.0250*** | 44.0137 ± 1.1110       | 0.8158 ± 0.0115       | ***0.4979 ± 0.0158*** | ***0.6505 ± 0.0126*** | 0.7327 / 9.3889  |
+
+**Bold** indicates the best result in the column; *italic* indicates the best result among ModChemBERT checkpoints.<br/>
+\* Published results from the ChemBERTa-3 [7] paper for optimized chemical language models using DeepChem scaffold splits.<br/>
+† AVG column shows the mean score across all classification tasks.<br/>
+‡ AVG column shows the mean scores across all regression tasks without and with the clearance score.
+
+</details>
+
+## Optimized ModChemBERT Hyperparameters
+
+<details><summary>Click to expand</summary>
+
+### TAFT Datasets
+Optimal parameters (per dataset) for the `MLM + DAPT + TAFT OPT` merged model:
+
+| Dataset                | Learning Rate | Batch Size | Warmup Ratio | Classifier Pooling | Last k Layers |
+| ---------------------- | ------------- | ---------- | ------------ | ------------------ | ------------- |
+| adme_microsom_stab_h   | 3e-5          | 8          | 0.0          | max_seq_mean       | 5             |
+| adme_microsom_stab_r   | 3e-5          | 16         | 0.2          | max_cls            | 3             |
+| adme_permeability      | 3e-5          | 8          | 0.0          | max_cls            | 3             |
+| adme_ppb_h             | 1e-5          | 32         | 0.1          | max_seq_mean       | 5             |
+| adme_ppb_r             | 1e-5          | 32         | 0.0          | sum_mean           | N/A           |
+| adme_solubility        | 3e-5          | 32         | 0.0          | sum_mean           | N/A           |
+| astrazeneca_CL         | 3e-5          | 8          | 0.1          | max_seq_mha        | 3             |
+| astrazeneca_LogD74     | 1e-5          | 8          | 0.0          | max_seq_mean       | 5             |
+| astrazeneca_PPB        | 1e-5          | 32         | 0.0          | max_cls            | 3             |
+| astrazeneca_Solubility | 1e-5          | 32         | 0.0          | max_seq_mean       | 5             |
+
+### Benchmarking Datasets
+Optimal parameters (per dataset) for the `MLM + DAPT + TAFT OPT` merged model:
+
+| Dataset             | Batch Size | Classifier Pooling | Last k Layers | Pooling Attention Dropout | Classifier Dropout | Embedding Dropout |
+| ------------------- | ---------- | ------------------ | ------------- | ------------------------- | ------------------ | ----------------- |
+| bace_classification | 32         | max_seq_mha        | 3             | 0.0                       | 0.0                | 0.0               |
+| bbbp                | 64         | max_cls            | 3             | 0.1                       | 0.0                | 0.0               |
+| clintox             | 32         | max_seq_mha        | 5             | 0.1                       | 0.0                | 0.0               |
+| hiv                 | 32         | max_seq_mha        | 3             | 0.0                       | 0.0                | 0.0               |
+| sider               | 32         | mean               | N/A           | 0.1                       | 0.0                | 0.1               |
+| tox21               | 32         | max_seq_mha        | 5             | 0.1                       | 0.0                | 0.0               |
+| base_regression     | 32         | max_seq_mha        | 5             | 0.1                       | 0.0                | 0.0               |
+| clearance           | 32         | max_seq_mha        | 5             | 0.1                       | 0.0                | 0.0               |
+| esol                | 64         | sum_mean           | N/A           | 0.1                       | 0.0                | 0.1               |
+| freesolv            | 32         | max_seq_mha        | 5             | 0.1                       | 0.0                | 0.0               |
+| lipo                | 32         | max_seq_mha        | 3             | 0.1                       | 0.1                | 0.1               |
+
+</details>
+
+## Hardware
+Training and experiments were performed on 2 NVIDIA RTX 3090 GPUs.
+
+## Citation
+If you use ModChemBERT in your research, please cite the checkpoint and the following:
+```
+@software{cortes-2025-modchembert,
+  author = {Emmanuel Cortes},
+  title = {ModChemBERT: ModernBERT as a Chemical Language Model},
+  year = {2025},
+  publisher = {GitHub},
+  howpublished = {GitHub repository},
+  url = {https://github.com/emapco/ModChemBERT}
+}
+```
+
+## References
+1. Kallergis, Georgios, et al. "Domain adaptable language modeling of chemical compounds identifies potent pathoblockers for Pseudomonas aeruginosa." Communications Chemistry 8.1 (2025): 114.
+2. Behrendt, Maike, Stefan Sylvius Wagner, and Stefan Harmeling. "MaxPoolBERT: Enhancing BERT Classification via Layer-and Token-Wise Aggregation." arXiv preprint arXiv:2505.15696 (2025).
+3. Sultan, Afnan, et al. "Transformers for molecular property prediction: Domain adaptation efficiently improves performance." arXiv preprint arXiv:2503.03360 (2025).
+4. Warner, Benjamin, et al. "Smarter, better, faster, longer: A modern bidirectional encoder for fast, memory efficient, and long context finetuning and inference." arXiv preprint arXiv:2412.13663 (2024).
+5. Clavié, Benjamin. "JaColBERTv2.5: Optimising Multi-Vector Retrievers to Create State-of-the-Art Japanese Retrievers with Constrained Resources." Journal of Natural Language Processing 32.1 (2025): 176-218.
+6. Grattafiori, Aaron, et al. "The llama 3 herd of models." arXiv preprint arXiv:2407.21783 (2024).
+7. Singh, Riya, et al. "ChemBERTa-3: An Open Source Training Framework for Chemical Foundation Models." (2025).

config.json

@@ -0,0 +1,54 @@
+{
+  "architectures": [
+    "ModChemBertForMaskedLM",
+    "ModChemBertForSequenceClassification"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.1,
+  "auto_map": {
+    "AutoConfig": "configuration_modchembert.ModChemBertConfig",
+    "AutoModelForMaskedLM": "modeling_modchembert.ModChemBertForMaskedLM",
+    "AutoModelForSequenceClassification": "modeling_modchembert.ModChemBertForSequenceClassification"
+  },
+  "bos_token_id": 0,
+  "classifier_activation": "gelu",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "max_seq_mha",
+  "classifier_pooling_attention_dropout": 0.1,
+  "classifier_pooling_last_k": 3,
+  "classifier_pooling_num_attention_heads": 4,
+  "cls_token_id": 0,
+  "decoder_bias": true,
+  "deterministic_flash_attn": false,
+  "dtype": "float32",
+  "embedding_dropout": 0.1,
+  "eos_token_id": 1,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "hidden_activation": "gelu",
+  "hidden_size": 768,
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "layer_norm_eps": 1e-05,
+  "local_attention": 8,
+  "local_rope_theta": 10000.0,
+  "max_position_embeddings": 256,
+  "mlp_bias": false,
+  "mlp_dropout": 0.1,
+  "model_type": "modchembert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 22,
+  "num_labels": 1,
+  "pad_token_id": 2,
+  "position_embedding_type": "absolute",
+  "repad_logits_with_grad": false,
+  "sep_token_id": 1,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "transformers_version": "4.56.1",
+  "vocab_size": 2362
+}

configuration_modchembert.py

@@ -0,0 +1,84 @@
+# Copyright 2025 Emmanuel Cortes, All Rights Reserved.
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+from typing import Literal
+
+from transformers.models.modernbert.configuration_modernbert import ModernBertConfig
+
+
+class ModChemBertConfig(ModernBertConfig):
+    """
+    Configuration class for ModChemBert models.
+
+    This configuration class extends ModernBertConfig with additional parameters specific to
+    chemical molecule modeling and custom pooling strategies for classification/regression tasks.
+    It accepts all arguments and keyword arguments from ModernBertConfig.
+
+    Args:
+        classifier_pooling (str, optional): Pooling strategy for sequence classification.
+            Available options:
+            - "cls": Use CLS token representation
+            - "mean": Attention-weighted average pooling
+            - "sum_mean": Sum all hidden states across layers, then mean pool over sequence (ChemLM approach)
+            - "sum_sum": Sum all hidden states across layers, then sum pool over sequence
+            - "mean_mean": Mean all hidden states across layers, then mean pool over sequence
+            - "mean_sum": Mean all hidden states across layers, then sum pool over sequence
+            - "max_cls": Element-wise max pooling over last k hidden states, then take CLS token
+            - "cls_mha": Multi-head attention with CLS token as query and full sequence as keys/values
+            - "max_seq_mha": Max pooling over last k states + multi-head attention with CLS as query
+            - "max_seq_mean": Max pooling over last k hidden states, then mean pooling over sequence
+            Defaults to "sum_mean".
+        classifier_pooling_num_attention_heads (int, optional): Number of attention heads for multi-head attention
+            pooling strategies (cls_mha, max_seq_mha). Defaults to 4.
+        classifier_pooling_attention_dropout (float, optional): Dropout probability for multi-head attention
+            pooling strategies (cls_mha, max_seq_mha). Defaults to 0.0.
+        classifier_pooling_last_k (int, optional): Number of last hidden layers to use for max pooling
+            strategies (max_cls, max_seq_mha, max_seq_mean). Defaults to 8.
+        *args: Variable length argument list passed to ModernBertConfig.
+        **kwargs: Arbitrary keyword arguments passed to ModernBertConfig.
+
+    Note:
+        This class inherits all configuration parameters from ModernBertConfig including
+        hidden_size, num_hidden_layers, num_attention_heads, intermediate_size, etc.
+    """
+
+    model_type = "modchembert"
+
+    def __init__(
+        self,
+        *args,
+        classifier_pooling: Literal[
+            "cls",
+            "mean",
+            "sum_mean",
+            "sum_sum",
+            "mean_mean",
+            "mean_sum",
+            "max_cls",
+            "cls_mha",
+            "max_seq_mha",
+            "max_seq_mean",
+        ] = "max_seq_mha",
+        classifier_pooling_num_attention_heads: int = 4,
+        classifier_pooling_attention_dropout: float = 0.0,
+        classifier_pooling_last_k: int = 8,
+        **kwargs,
+    ):
+        # Pass classifier_pooling="cls" to circumvent ValueError in ModernBertConfig init
+        super().__init__(*args, classifier_pooling="cls", **kwargs)
+        # Override with custom value
+        self.classifier_pooling = classifier_pooling
+        self.classifier_pooling_num_attention_heads = classifier_pooling_num_attention_heads
+        self.classifier_pooling_attention_dropout = classifier_pooling_attention_dropout
+        self.classifier_pooling_last_k = classifier_pooling_last_k

logs_modchembert_classification_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_bace_classification_epochs100_batch_size32_20250923_153237.log

@@ -0,0 +1,357 @@
+2025-09-23 15:32:37,439 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Running benchmark for dataset: bace_classification
+2025-09-23 15:32:37,439 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - dataset: bace_classification, tasks: ['Class'], epochs: 100, learning rate: 3e-05
+2025-09-23 15:32:37,444 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset bace_classification at 2025-09-23_15-32-37
+2025-09-23 15:32:45,151 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.7599 | Val mean-roc_auc_score: 0.6470
+2025-09-23 15:32:45,152 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 38
+2025-09-23 15:32:45,685 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.6470
+2025-09-23 15:32:50,852 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.5132 | Val mean-roc_auc_score: 0.7121
+2025-09-23 15:32:51,045 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 76
+2025-09-23 15:32:51,578 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.7121
+2025-09-23 15:32:57,045 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.4397 | Val mean-roc_auc_score: 0.7233
+2025-09-23 15:32:57,224 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 114
+2025-09-23 15:32:57,824 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.7233
+2025-09-23 15:33:03,432 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.3355 | Val mean-roc_auc_score: 0.7555
+2025-09-23 15:33:03,623 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 152
+2025-09-23 15:33:04,166 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.7555
+2025-09-23 15:33:09,804 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.2796 | Val mean-roc_auc_score: 0.7464
+2025-09-23 15:33:15,500 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.2623 | Val mean-roc_auc_score: 0.7489
+2025-09-23 15:33:21,629 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.2081 | Val mean-roc_auc_score: 0.7254
+2025-09-23 15:33:27,511 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.2480 | Val mean-roc_auc_score: 0.7598
+2025-09-23 15:33:27,693 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 304
+2025-09-23 15:33:28,213 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 8 with val mean-roc_auc_score: 0.7598
+2025-09-23 15:33:34,104 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.1941 | Val mean-roc_auc_score: 0.7567
+2025-09-23 15:33:39,928 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.1439 | Val mean-roc_auc_score: 0.7603
+2025-09-23 15:33:40,112 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 380
+2025-09-23 15:33:40,631 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 10 with val mean-roc_auc_score: 0.7603
+2025-09-23 15:33:46,474 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.1970 | Val mean-roc_auc_score: 0.7313
+2025-09-23 15:33:52,494 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.1390 | Val mean-roc_auc_score: 0.7470
+2025-09-23 15:33:58,341 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.1012 | Val mean-roc_auc_score: 0.7528
+2025-09-23 15:34:04,234 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.1064 | Val mean-roc_auc_score: 0.7611
+2025-09-23 15:34:04,430 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 532
+2025-09-23 15:34:05,007 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 14 with val mean-roc_auc_score: 0.7611
+2025-09-23 15:34:10,847 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0752 | Val mean-roc_auc_score: 0.7524
+2025-09-23 15:34:16,609 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0908 | Val mean-roc_auc_score: 0.7476
+2025-09-23 15:34:22,192 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0695 | Val mean-roc_auc_score: 0.7555
+2025-09-23 15:34:27,993 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0736 | Val mean-roc_auc_score: 0.7466
+2025-09-23 15:34:33,306 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0593 | Val mean-roc_auc_score: 0.7513
+2025-09-23 15:34:39,124 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0409 | Val mean-roc_auc_score: 0.7385
+2025-09-23 15:34:44,965 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0454 | Val mean-roc_auc_score: 0.7350
+2025-09-23 15:34:51,033 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0690 | Val mean-roc_auc_score: 0.7448
+2025-09-23 15:34:56,801 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0584 | Val mean-roc_auc_score: 0.7795
+2025-09-23 15:34:56,952 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 874
+2025-09-23 15:34:57,494 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 23 with val mean-roc_auc_score: 0.7795
+2025-09-23 15:35:03,240 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0159 | Val mean-roc_auc_score: 0.7755
+2025-09-23 15:35:09,072 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0143 | Val mean-roc_auc_score: 0.7771
+2025-09-23 15:35:14,893 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0183 | Val mean-roc_auc_score: 0.7713
+2025-09-23 15:35:22,228 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0129 | Val mean-roc_auc_score: 0.7719
+2025-09-23 15:35:28,169 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0144 | Val mean-roc_auc_score: 0.7717
+2025-09-23 15:35:33,859 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0354 | Val mean-roc_auc_score: 0.7694
+2025-09-23 15:35:39,451 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0331 | Val mean-roc_auc_score: 0.7480
+2025-09-23 15:35:45,116 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0232 | Val mean-roc_auc_score: 0.7395
+2025-09-23 15:35:50,475 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0146 | Val mean-roc_auc_score: 0.7299
+2025-09-23 15:35:55,944 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0331 | Val mean-roc_auc_score: 0.7417
+2025-09-23 15:36:01,265 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0227 | Val mean-roc_auc_score: 0.7545
+2025-09-23 15:36:07,137 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0104 | Val mean-roc_auc_score: 0.7482
+2025-09-23 15:36:13,038 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0086 | Val mean-roc_auc_score: 0.7404
+2025-09-23 15:36:18,990 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0034 | Val mean-roc_auc_score: 0.7385
+2025-09-23 15:36:24,688 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0181 | Val mean-roc_auc_score: 0.7815
+2025-09-23 15:36:24,839 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 1444
+2025-09-23 15:36:25,378 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 38 with val mean-roc_auc_score: 0.7815
+2025-09-23 15:36:31,092 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.1143 | Val mean-roc_auc_score: 0.7536
+2025-09-23 15:36:36,860 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0186 | Val mean-roc_auc_score: 0.7611
+2025-09-23 15:36:42,689 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0197 | Val mean-roc_auc_score: 0.7538
+2025-09-23 15:36:48,923 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0111 | Val mean-roc_auc_score: 0.7571
+2025-09-23 15:36:54,849 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0146 | Val mean-roc_auc_score: 0.7467
+2025-09-23 15:37:00,609 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0133 | Val mean-roc_auc_score: 0.7565
+2025-09-23 15:37:06,465 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0248 | Val mean-roc_auc_score: 0.7439
+2025-09-23 15:37:12,313 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0151 | Val mean-roc_auc_score: 0.7355
+2025-09-23 15:37:18,132 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0099 | Val mean-roc_auc_score: 0.7631
+2025-09-23 15:37:23,368 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0127 | Val mean-roc_auc_score: 0.7590
+2025-09-23 15:37:28,719 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0085 | Val mean-roc_auc_score: 0.7612
+2025-09-23 15:37:34,691 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0119 | Val mean-roc_auc_score: 0.7559
+2025-09-23 15:37:40,507 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0273 | Val mean-roc_auc_score: 0.7596
+2025-09-23 15:37:46,552 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0229 | Val mean-roc_auc_score: 0.7613
+2025-09-23 15:37:53,657 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7642
+2025-09-23 15:37:59,535 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0037 | Val mean-roc_auc_score: 0.7620
+2025-09-23 15:38:05,327 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0034 | Val mean-roc_auc_score: 0.7579
+2025-09-23 15:38:11,183 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.7566
+2025-09-23 15:38:17,260 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.7584
+2025-09-23 15:38:23,163 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.7604
+2025-09-23 15:38:28,928 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.7599
+2025-09-23 15:38:34,608 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.7603
+2025-09-23 15:38:40,253 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.7609
+2025-09-23 15:38:46,148 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.7535
+2025-09-23 15:38:51,409 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.7584
+2025-09-23 15:38:56,644 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0107 | Val mean-roc_auc_score: 0.7604
+2025-09-23 15:39:02,208 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.7546
+2025-09-23 15:39:07,953 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.7564
+2025-09-23 15:39:14,163 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.7565
+2025-09-23 15:39:20,024 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0012 | Val mean-roc_auc_score: 0.7559
+2025-09-23 15:39:25,848 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.7592
+2025-09-23 15:39:31,693 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.7571
+2025-09-23 15:39:37,559 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.7561
+2025-09-23 15:39:43,703 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.7561
+2025-09-23 15:39:49,599 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.7552
+2025-09-23 15:39:55,443 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.7564
+2025-09-23 15:40:01,341 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.7557
+2025-09-23 15:40:07,152 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.7536
+2025-09-23 15:40:13,233 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0015 | Val mean-roc_auc_score: 0.7574
+2025-09-23 15:40:18,504 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.7597
+2025-09-23 15:40:25,053 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.7614
+2025-09-23 15:40:30,873 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0015 | Val mean-roc_auc_score: 0.7620
+2025-09-23 15:40:36,731 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.7618
+2025-09-23 15:40:42,785 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0093 | Val mean-roc_auc_score: 0.7665
+2025-09-23 15:40:48,660 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0096 | Val mean-roc_auc_score: 0.7574
+2025-09-23 15:40:54,752 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7624
+2025-09-23 15:41:00,680 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0100 | Val mean-roc_auc_score: 0.7622
+2025-09-23 15:41:06,558 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.7635
+2025-09-23 15:41:12,608 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0015 | Val mean-roc_auc_score: 0.7639
+2025-09-23 15:41:18,443 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.7662
+2025-09-23 15:41:24,290 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.7672
+2025-09-23 15:41:30,105 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.7673
+2025-09-23 15:41:35,766 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.7668
+2025-09-23 15:41:41,692 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0012 | Val mean-roc_auc_score: 0.7662
+2025-09-23 15:41:46,952 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.7660
+2025-09-23 15:41:52,102 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.7655
+2025-09-23 15:41:57,251 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0012 | Val mean-roc_auc_score: 0.7635
+2025-09-23 15:42:03,105 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.7648
+2025-09-23 15:42:09,140 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0011 | Val mean-roc_auc_score: 0.7646
+2025-09-23 15:42:14,816 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.7644
+2025-09-23 15:42:20,705 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.7642
+2025-09-23 15:42:26,620 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.7647
+2025-09-23 15:42:27,511 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.8057
+2025-09-23 15:42:27,826 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset bace_classification at 2025-09-23_15-42-27
+2025-09-23 15:42:33,199 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.6645 | Val mean-roc_auc_score: 0.7057
+2025-09-23 15:42:33,199 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 38
+2025-09-23 15:42:33,716 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.7057
+2025-09-23 15:42:39,523 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.4408 | Val mean-roc_auc_score: 0.7241
+2025-09-23 15:42:39,694 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 76
+2025-09-23 15:42:40,262 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.7241
+2025-09-23 15:42:46,107 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.3438 | Val mean-roc_auc_score: 0.7394
+2025-09-23 15:42:46,285 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 114
+2025-09-23 15:42:46,811 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.7394
+2025-09-23 15:42:52,674 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.3174 | Val mean-roc_auc_score: 0.7539
+2025-09-23 15:42:52,853 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 152
+2025-09-23 15:42:53,380 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.7539
+2025-09-23 15:42:59,242 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.2599 | Val mean-roc_auc_score: 0.7348
+2025-09-23 15:43:05,023 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.2366 | Val mean-roc_auc_score: 0.7308
+2025-09-23 15:43:11,000 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.2253 | Val mean-roc_auc_score: 0.7552
+2025-09-23 15:43:11,190 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 266
+2025-09-23 15:43:11,731 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 7 with val mean-roc_auc_score: 0.7552
+2025-09-23 15:43:17,491 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.1650 | Val mean-roc_auc_score: 0.7365
+2025-09-23 15:43:22,804 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.1941 | Val mean-roc_auc_score: 0.7526
+2025-09-23 15:43:28,603 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.1661 | Val mean-roc_auc_score: 0.7162
+2025-09-23 15:43:34,276 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.1684 | Val mean-roc_auc_score: 0.7259
+2025-09-23 15:43:40,165 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.1340 | Val mean-roc_auc_score: 0.7312
+2025-09-23 15:43:45,859 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.1192 | Val mean-roc_auc_score: 0.7440
+2025-09-23 15:43:51,737 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.1299 | Val mean-roc_auc_score: 0.7255
+2025-09-23 15:43:57,604 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0991 | Val mean-roc_auc_score: 0.7319
+2025-09-23 15:44:03,496 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.1006 | Val mean-roc_auc_score: 0.7245
+2025-09-23 15:44:09,545 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0662 | Val mean-roc_auc_score: 0.7197
+2025-09-23 15:44:15,462 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.1456 | Val mean-roc_auc_score: 0.7348
+2025-09-23 15:44:21,265 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0767 | Val mean-roc_auc_score: 0.7225
+2025-09-23 15:44:27,156 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0516 | Val mean-roc_auc_score: 0.7732
+2025-09-23 15:44:27,308 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 760
+2025-09-23 15:44:27,831 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 20 with val mean-roc_auc_score: 0.7732
+2025-09-23 15:44:33,700 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.1053 | Val mean-roc_auc_score: 0.7130
+2025-09-23 15:44:39,774 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0751 | Val mean-roc_auc_score: 0.7246
+2025-09-23 15:44:45,528 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0335 | Val mean-roc_auc_score: 0.7345
+2025-09-23 15:44:50,953 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0456 | Val mean-roc_auc_score: 0.7353
+2025-09-23 15:44:56,139 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0298 | Val mean-roc_auc_score: 0.7436
+2025-09-23 15:45:01,612 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0292 | Val mean-roc_auc_score: 0.7413
+2025-09-23 15:45:08,808 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0294 | Val mean-roc_auc_score: 0.7401
+2025-09-23 15:45:14,490 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0405 | Val mean-roc_auc_score: 0.7326
+2025-09-23 15:45:20,357 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0854 | Val mean-roc_auc_score: 0.7399
+2025-09-23 15:45:26,221 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0337 | Val mean-roc_auc_score: 0.7670
+2025-09-23 15:45:32,084 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.1308 | Val mean-roc_auc_score: 0.7358
+2025-09-23 15:45:38,232 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0566 | Val mean-roc_auc_score: 0.7727
+2025-09-23 15:45:44,039 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0290 | Val mean-roc_auc_score: 0.7657
+2025-09-23 15:45:49,840 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0197 | Val mean-roc_auc_score: 0.7591
+2025-09-23 15:45:55,671 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0149 | Val mean-roc_auc_score: 0.7691
+2025-09-23 15:46:01,504 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0395 | Val mean-roc_auc_score: 0.7357
+2025-09-23 15:46:07,627 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0360 | Val mean-roc_auc_score: 0.7226
+2025-09-23 15:46:13,315 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0237 | Val mean-roc_auc_score: 0.7303
+2025-09-23 15:46:19,218 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0163 | Val mean-roc_auc_score: 0.7413
+2025-09-23 15:46:24,362 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0136 | Val mean-roc_auc_score: 0.7428
+2025-09-23 15:46:30,140 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0091 | Val mean-roc_auc_score: 0.7354
+2025-09-23 15:46:36,158 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0125 | Val mean-roc_auc_score: 0.7733
+2025-09-23 15:46:36,308 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 1596
+2025-09-23 15:46:36,837 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 42 with val mean-roc_auc_score: 0.7733
+2025-09-23 15:46:42,617 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0708 | Val mean-roc_auc_score: 0.7700
+2025-09-23 15:46:48,407 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0260 | Val mean-roc_auc_score: 0.7719
+2025-09-23 15:46:54,047 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0418 | Val mean-roc_auc_score: 0.7683
+2025-09-23 15:46:59,772 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0150 | Val mean-roc_auc_score: 0.7621
+2025-09-23 15:47:05,729 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0144 | Val mean-roc_auc_score: 0.7583
+2025-09-23 15:47:11,529 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0064 | Val mean-roc_auc_score: 0.7568
+2025-09-23 15:47:17,414 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.7554
+2025-09-23 15:47:23,265 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.7562
+2025-09-23 15:47:29,167 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.7552
+2025-09-23 15:47:35,236 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0230 | Val mean-roc_auc_score: 0.7539
+2025-09-23 15:47:42,051 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0103 | Val mean-roc_auc_score: 0.7428
+2025-09-23 15:47:47,921 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0083 | Val mean-roc_auc_score: 0.7508
+2025-09-23 15:47:53,068 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.7513
+2025-09-23 15:47:58,556 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0042 | Val mean-roc_auc_score: 0.7516
+2025-09-23 15:48:04,713 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.7484
+2025-09-23 15:48:10,462 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0075 | Val mean-roc_auc_score: 0.7492
+2025-09-23 15:48:16,246 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0046 | Val mean-roc_auc_score: 0.7531
+2025-09-23 15:48:21,941 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0065 | Val mean-roc_auc_score: 0.7461
+2025-09-23 15:48:27,613 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.7490
+2025-09-23 15:48:33,517 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.7482
+2025-09-23 15:48:39,298 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0065 | Val mean-roc_auc_score: 0.7398
+2025-09-23 15:48:45,076 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0161 | Val mean-roc_auc_score: 0.7299
+2025-09-23 15:48:50,901 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0144 | Val mean-roc_auc_score: 0.7422
+2025-09-23 15:48:56,770 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.7450
+2025-09-23 15:49:03,228 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.7446
+2025-09-23 15:49:08,981 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.7453
+2025-09-23 15:49:14,934 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.7448
+2025-09-23 15:49:20,856 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.7452
+2025-09-23 15:49:26,162 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0017 | Val mean-roc_auc_score: 0.7448
+2025-09-23 15:49:32,266 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.7446
+2025-09-23 15:49:38,157 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0043 | Val mean-roc_auc_score: 0.7431
+2025-09-23 15:49:43,986 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0259 | Val mean-roc_auc_score: 0.7420
+2025-09-23 15:49:49,842 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0160 | Val mean-roc_auc_score: 0.7445
+2025-09-23 15:49:55,637 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7452
+2025-09-23 15:50:01,757 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.7465
+2025-09-23 15:50:07,598 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.7456
+2025-09-23 15:50:14,517 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0050 | Val mean-roc_auc_score: 0.7452
+2025-09-23 15:50:20,132 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.7436
+2025-09-23 15:50:25,820 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.7444
+2025-09-23 15:50:31,833 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.7436
+2025-09-23 15:50:37,482 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.7438
+2025-09-23 15:50:43,317 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.7436
+2025-09-23 15:50:49,267 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.7432
+2025-09-23 15:50:54,512 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.7440
+2025-09-23 15:51:00,236 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.7443
+2025-09-23 15:51:06,230 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.7440
+2025-09-23 15:51:12,141 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0011 | Val mean-roc_auc_score: 0.7446
+2025-09-23 15:51:18,063 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0042 | Val mean-roc_auc_score: 0.7427
+2025-09-23 15:51:23,956 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7412
+2025-09-23 15:51:30,287 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0085 | Val mean-roc_auc_score: 0.7522
+2025-09-23 15:51:36,222 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0083 | Val mean-roc_auc_score: 0.7479
+2025-09-23 15:51:42,004 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0083 | Val mean-roc_auc_score: 0.7494
+2025-09-23 15:51:47,763 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0266 | Val mean-roc_auc_score: 0.7507
+2025-09-23 15:51:53,458 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0096 | Val mean-roc_auc_score: 0.7504
+2025-09-23 15:51:59,421 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.7516
+2025-09-23 15:52:04,758 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.7510
+2025-09-23 15:52:10,625 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.7526
+2025-09-23 15:52:16,594 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.7515
+2025-09-23 15:52:17,466 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.7706
+2025-09-23 15:52:17,817 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset bace_classification at 2025-09-23_15-52-17
+2025-09-23 15:52:22,537 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.7368 | Val mean-roc_auc_score: 0.6879
+2025-09-23 15:52:22,537 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 38
+2025-09-23 15:52:23,070 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.6879
+2025-09-23 15:52:28,398 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.5033 | Val mean-roc_auc_score: 0.7126
+2025-09-23 15:52:28,570 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 76
+2025-09-23 15:52:29,088 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.7126
+2025-09-23 15:52:34,827 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.4174 | Val mean-roc_auc_score: 0.7462
+2025-09-23 15:52:35,001 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 114
+2025-09-23 15:52:35,518 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.7462
+2025-09-23 15:52:41,359 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.3289 | Val mean-roc_auc_score: 0.7367
+2025-09-23 15:52:47,115 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.2845 | Val mean-roc_auc_score: 0.7516
+2025-09-23 15:52:47,306 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 190
+2025-09-23 15:52:47,858 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 5 with val mean-roc_auc_score: 0.7516
+2025-09-23 15:52:53,820 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.2533 | Val mean-roc_auc_score: 0.7308
+2025-09-23 15:52:59,926 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.2220 | Val mean-roc_auc_score: 0.7065
+2025-09-23 15:53:05,758 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.2256 | Val mean-roc_auc_score: 0.7148
+2025-09-23 15:53:11,538 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.1719 | Val mean-roc_auc_score: 0.7478
+2025-09-23 15:53:17,239 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.1612 | Val mean-roc_auc_score: 0.7209
+2025-09-23 15:53:22,951 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.1701 | Val mean-roc_auc_score: 0.7282
+2025-09-23 15:53:28,786 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.1127 | Val mean-roc_auc_score: 0.7010
+2025-09-23 15:53:34,775 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.1201 | Val mean-roc_auc_score: 0.7374
+2025-09-23 15:53:40,703 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.1191 | Val mean-roc_auc_score: 0.7358
+2025-09-23 15:53:46,634 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0929 | Val mean-roc_auc_score: 0.7420
+2025-09-23 15:53:52,452 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0718 | Val mean-roc_auc_score: 0.7370
+2025-09-23 15:53:58,080 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0633 | Val mean-roc_auc_score: 0.7039
+2025-09-23 15:54:03,693 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0765 | Val mean-roc_auc_score: 0.7241
+2025-09-23 15:54:09,408 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0437 | Val mean-roc_auc_score: 0.7162
+2025-09-23 15:54:15,146 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0516 | Val mean-roc_auc_score: 0.7190
+2025-09-23 15:54:21,040 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0475 | Val mean-roc_auc_score: 0.7324
+2025-09-23 15:54:27,352 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0365 | Val mean-roc_auc_score: 0.7235
+2025-09-23 15:54:33,304 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0391 | Val mean-roc_auc_score: 0.7148
+2025-09-23 15:54:39,248 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0172 | Val mean-roc_auc_score: 0.7074
+2025-09-23 15:54:45,036 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0442 | Val mean-roc_auc_score: 0.7279
+2025-09-23 15:54:50,875 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0245 | Val mean-roc_auc_score: 0.7067
+2025-09-23 15:54:57,777 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0436 | Val mean-roc_auc_score: 0.7185
+2025-09-23 15:55:03,707 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0942 | Val mean-roc_auc_score: 0.7316
+2025-09-23 15:55:09,643 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0359 | Val mean-roc_auc_score: 0.7284
+2025-09-23 15:55:15,500 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0139 | Val mean-roc_auc_score: 0.7308
+2025-09-23 15:55:21,348 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0147 | Val mean-roc_auc_score: 0.7279
+2025-09-23 15:55:27,151 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0427 | Val mean-roc_auc_score: 0.7197
+2025-09-23 15:55:32,973 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0212 | Val mean-roc_auc_score: 0.7153
+2025-09-23 15:55:38,895 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0076 | Val mean-roc_auc_score: 0.7203
+2025-09-23 15:55:44,715 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0062 | Val mean-roc_auc_score: 0.7255
+2025-09-23 15:55:50,587 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0112 | Val mean-roc_auc_score: 0.7216
+2025-09-23 15:55:56,725 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7218
+2025-09-23 15:56:02,621 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.7234
+2025-09-23 15:56:08,510 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0267 | Val mean-roc_auc_score: 0.7429
+2025-09-23 15:56:14,214 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0535 | Val mean-roc_auc_score: 0.7463
+2025-09-23 15:56:19,884 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0333 | Val mean-roc_auc_score: 0.7542
+2025-09-23 15:56:20,300 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 1558
+2025-09-23 15:56:20,821 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 41 with val mean-roc_auc_score: 0.7542
+2025-09-23 15:56:26,230 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0164 | Val mean-roc_auc_score: 0.7442
+2025-09-23 15:56:31,892 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0129 | Val mean-roc_auc_score: 0.7401
+2025-09-23 15:56:37,971 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0103 | Val mean-roc_auc_score: 0.7389
+2025-09-23 15:56:43,840 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.7424
+2025-09-23 15:56:49,696 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0230 | Val mean-roc_auc_score: 0.7472
+2025-09-23 15:56:55,109 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0130 | Val mean-roc_auc_score: 0.7411
+2025-09-23 15:57:00,221 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0135 | Val mean-roc_auc_score: 0.7252
+2025-09-23 15:57:06,037 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0296 | Val mean-roc_auc_score: 0.7461
+2025-09-23 15:57:11,926 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0195 | Val mean-roc_auc_score: 0.7297
+2025-09-23 15:57:17,900 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0097 | Val mean-roc_auc_score: 0.7413
+2025-09-23 15:57:23,797 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7445
+2025-09-23 15:57:30,793 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7446
+2025-09-23 15:57:36,457 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0075 | Val mean-roc_auc_score: 0.7454
+2025-09-23 15:57:42,321 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.7462
+2025-09-23 15:57:48,133 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.7463
+2025-09-23 15:57:54,016 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.7510
+2025-09-23 15:57:59,914 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.7528
+2025-09-23 15:58:05,725 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.7509
+2025-09-23 15:58:11,576 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0012 | Val mean-roc_auc_score: 0.7507
+2025-09-23 15:58:17,429 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0039 | Val mean-roc_auc_score: 0.7522
+2025-09-23 15:58:23,482 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.7525
+2025-09-23 15:58:28,832 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.7528
+2025-09-23 15:58:34,693 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.7530
+2025-09-23 15:58:40,556 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.7522
+2025-09-23 15:58:46,468 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.7500
+2025-09-23 15:58:52,571 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0045 | Val mean-roc_auc_score: 0.7459
+2025-09-23 15:58:58,457 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.7482
+2025-09-23 15:59:04,291 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.7473
+2025-09-23 15:59:10,152 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.7476
+2025-09-23 15:59:16,103 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.7476
+2025-09-23 15:59:22,266 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.7443
+2025-09-23 15:59:28,088 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.7473
+2025-09-23 15:59:34,062 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.7454
+2025-09-23 15:59:39,793 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.7494
+2025-09-23 15:59:45,538 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.7435
+2025-09-23 15:59:51,503 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0043 | Val mean-roc_auc_score: 0.7513
+2025-09-23 15:59:56,679 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.7476
+2025-09-23 16:00:03,279 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.7492
+2025-09-23 16:00:08,996 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.7473
+2025-09-23 16:00:14,656 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.7498
+2025-09-23 16:00:20,664 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.7487
+2025-09-23 16:00:26,493 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.7480
+2025-09-23 16:00:32,302 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.7489
+2025-09-23 16:00:38,166 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.7418
+2025-09-23 16:00:44,045 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0158 | Val mean-roc_auc_score: 0.7440
+2025-09-23 16:00:50,120 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0167 | Val mean-roc_auc_score: 0.7570
+2025-09-23 16:00:50,263 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 3306
+2025-09-23 16:00:50,812 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 87 with val mean-roc_auc_score: 0.7570
+2025-09-23 16:00:56,722 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0043 | Val mean-roc_auc_score: 0.7583
+2025-09-23 16:00:56,901 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 3344
+2025-09-23 16:00:57,440 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 88 with val mean-roc_auc_score: 0.7583
+2025-09-23 16:01:03,255 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.7584
+2025-09-23 16:01:03,449 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Global step of best model: 3382
+2025-09-23 16:01:04,001 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Best model saved at epoch 89 with val mean-roc_auc_score: 0.7584
+2025-09-23 16:01:09,935 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.7575
+2025-09-23 16:01:15,934 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0038 | Val mean-roc_auc_score: 0.7561
+2025-09-23 16:01:22,312 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0112 | Val mean-roc_auc_score: 0.7584
+2025-09-23 16:01:27,932 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0152 | Val mean-roc_auc_score: 0.7482
+2025-09-23 16:01:33,813 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.7498
+2025-09-23 16:01:39,800 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.7516
+2025-09-23 16:01:45,608 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0080 | Val mean-roc_auc_score: 0.7534
+2025-09-23 16:01:51,665 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.7487
+2025-09-23 16:01:57,529 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0068 | Val mean-roc_auc_score: 0.7496
+2025-09-23 16:02:03,236 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.7509
+2025-09-23 16:02:08,901 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0011 | Val mean-roc_auc_score: 0.7508
+2025-09-23 16:02:09,776 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.8009
+2025-09-23 16:02:10,125 - logs_modchembert_bace_classification_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg mean-roc_auc_score: 0.7924, Std Dev: 0.0155

logs_modchembert_classification_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_bbbp_epochs100_batch_size32_20250923_160210.log

@@ -0,0 +1,337 @@
+2025-09-23 16:02:10,127 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Running benchmark for dataset: bbbp
+2025-09-23 16:02:10,127 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - dataset: bbbp, tasks: ['p_np'], epochs: 100, learning rate: 3e-05
+2025-09-23 16:02:10,131 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset bbbp at 2025-09-23_16-02-10
+2025-09-23 16:02:16,412 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.2993 | Val mean-roc_auc_score: 0.9929
+2025-09-23 16:02:16,412 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 52
+2025-09-23 16:02:16,953 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.9929
+2025-09-23 16:02:24,073 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.1001 | Val mean-roc_auc_score: 0.9902
+2025-09-23 16:02:31,156 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1280 | Val mean-roc_auc_score: 0.9922
+2025-09-23 16:02:38,245 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1035 | Val mean-roc_auc_score: 0.9941
+2025-09-23 16:02:38,381 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 208
+2025-09-23 16:02:38,908 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.9941
+2025-09-23 16:02:45,830 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0604 | Val mean-roc_auc_score: 0.9961
+2025-09-23 16:02:46,009 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 260
+2025-09-23 16:02:46,550 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 5 with val mean-roc_auc_score: 0.9961
+2025-09-23 16:02:53,516 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0592 | Val mean-roc_auc_score: 0.9781
+2025-09-23 16:03:00,095 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0430 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:03:07,062 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0278 | Val mean-roc_auc_score: 0.9801
+2025-09-23 16:03:13,867 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0383 | Val mean-roc_auc_score: 0.9887
+2025-09-23 16:03:20,737 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0091 | Val mean-roc_auc_score: 0.9856
+2025-09-23 16:03:27,425 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0118 | Val mean-roc_auc_score: 0.9864
+2025-09-23 16:03:34,514 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0081 | Val mean-roc_auc_score: 0.9870
+2025-09-23 16:03:41,235 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0092 | Val mean-roc_auc_score: 0.9834
+2025-09-23 16:03:47,661 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0046 | Val mean-roc_auc_score: 0.9879
+2025-09-23 16:03:54,715 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0113 | Val mean-roc_auc_score: 0.9811
+2025-09-23 16:04:01,694 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0173 | Val mean-roc_auc_score: 0.9879
+2025-09-23 16:04:08,944 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0613 | Val mean-roc_auc_score: 0.9921
+2025-09-23 16:04:15,886 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0153 | Val mean-roc_auc_score: 0.9935
+2025-09-23 16:04:22,801 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0080 | Val mean-roc_auc_score: 0.9913
+2025-09-23 16:04:29,989 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0050 | Val mean-roc_auc_score: 0.9900
+2025-09-23 16:04:37,118 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.9905
+2025-09-23 16:04:44,439 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.9899
+2025-09-23 16:04:51,564 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:04:58,581 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9877
+2025-09-23 16:05:05,558 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9884
+2025-09-23 16:05:12,479 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9889
+2025-09-23 16:05:19,304 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.9906
+2025-09-23 16:05:26,247 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.9922
+2025-09-23 16:05:33,007 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.9918
+2025-09-23 16:05:39,811 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.9921
+2025-09-23 16:05:46,739 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.9912
+2025-09-23 16:05:53,884 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.9915
+2025-09-23 16:06:00,023 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9914
+2025-09-23 16:06:06,944 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0015 | Val mean-roc_auc_score: 0.9906
+2025-09-23 16:06:13,864 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0147 | Val mean-roc_auc_score: 0.9935
+2025-09-23 16:06:20,774 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0141 | Val mean-roc_auc_score: 0.9889
+2025-09-23 16:06:28,139 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0039 | Val mean-roc_auc_score: 0.9883
+2025-09-23 16:06:35,161 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0054 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:06:42,962 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.9918
+2025-09-23 16:06:49,969 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0043 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:06:56,919 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.9883
+2025-09-23 16:07:04,249 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.9919
+2025-09-23 16:07:10,932 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:07:17,599 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:07:24,048 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0012 | Val mean-roc_auc_score: 0.9905
+2025-09-23 16:07:30,413 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9906
+2025-09-23 16:07:37,537 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.9916
+2025-09-23 16:07:44,612 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.9917
+2025-09-23 16:07:51,624 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9911
+2025-09-23 16:07:58,740 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9918
+2025-09-23 16:08:05,656 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9910
+2025-09-23 16:08:12,479 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9918
+2025-09-23 16:08:19,573 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9917
+2025-09-23 16:08:26,598 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.9919
+2025-09-23 16:08:33,639 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0011 | Val mean-roc_auc_score: 0.9912
+2025-09-23 16:08:40,685 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0002 | Val mean-roc_auc_score: 0.9912
+2025-09-23 16:08:47,693 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9912
+2025-09-23 16:08:55,508 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0003 | Val mean-roc_auc_score: 0.9911
+2025-09-23 16:09:02,131 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9911
+2025-09-23 16:09:09,244 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9911
+2025-09-23 16:09:16,183 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9911
+2025-09-23 16:09:23,609 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9912
+2025-09-23 16:09:30,550 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9911
+2025-09-23 16:09:37,111 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0002 | Val mean-roc_auc_score: 0.9910
+2025-09-23 16:09:43,970 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9911
+2025-09-23 16:09:50,771 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9910
+2025-09-23 16:09:57,792 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9915
+2025-09-23 16:10:04,659 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9905
+2025-09-23 16:10:11,612 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0157 | Val mean-roc_auc_score: 0.9895
+2025-09-23 16:10:18,447 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0150 | Val mean-roc_auc_score: 0.9919
+2025-09-23 16:10:24,747 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0111 | Val mean-roc_auc_score: 0.9910
+2025-09-23 16:10:31,575 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.9924
+2025-09-23 16:10:38,544 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9926
+2025-09-23 16:10:45,408 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:10:52,213 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:10:58,917 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.9925
+2025-09-23 16:11:06,798 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.9925
+2025-09-23 16:11:13,840 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.9925
+2025-09-23 16:11:20,913 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.9916
+2025-09-23 16:11:28,064 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.9924
+2025-09-23 16:11:35,265 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9919
+2025-09-23 16:11:42,696 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0012 | Val mean-roc_auc_score: 0.9921
+2025-09-23 16:11:49,588 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9921
+2025-09-23 16:11:55,578 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9921
+2025-09-23 16:12:02,388 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9921
+2025-09-23 16:12:09,371 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9921
+2025-09-23 16:12:16,730 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:12:23,723 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9921
+2025-09-23 16:12:30,534 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9923
+2025-09-23 16:12:37,342 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0037 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:12:44,233 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0167 | Val mean-roc_auc_score: 0.9924
+2025-09-23 16:12:51,552 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.9924
+2025-09-23 16:12:58,654 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:13:05,485 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.9926
+2025-09-23 16:13:12,134 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:13:18,834 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.9926
+2025-09-23 16:13:26,679 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:13:33,882 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.9926
+2025-09-23 16:13:40,844 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:13:47,948 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9926
+2025-09-23 16:13:48,861 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.7235
+2025-09-23 16:13:49,207 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset bbbp at 2025-09-23_16-13-49
+2025-09-23 16:13:55,677 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.2728 | Val mean-roc_auc_score: 0.9926
+2025-09-23 16:13:55,677 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 52
+2025-09-23 16:13:56,198 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.9926
+2025-09-23 16:14:02,554 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.1914 | Val mean-roc_auc_score: 0.9926
+2025-09-23 16:14:02,732 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 104
+2025-09-23 16:14:03,278 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.9926
+2025-09-23 16:14:10,143 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1178 | Val mean-roc_auc_score: 0.9895
+2025-09-23 16:14:17,180 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1138 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:14:17,330 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 208
+2025-09-23 16:14:17,866 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.9951
+2025-09-23 16:14:24,834 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0610 | Val mean-roc_auc_score: 0.9910
+2025-09-23 16:14:31,795 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0723 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:14:38,815 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0359 | Val mean-roc_auc_score: 0.9907
+2025-09-23 16:14:45,512 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0410 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:14:51,957 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0308 | Val mean-roc_auc_score: 0.9876
+2025-09-23 16:14:58,333 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0176 | Val mean-roc_auc_score: 0.9861
+2025-09-23 16:15:05,150 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0174 | Val mean-roc_auc_score: 0.9867
+2025-09-23 16:15:12,417 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0154 | Val mean-roc_auc_score: 0.9909
+2025-09-23 16:15:19,428 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0091 | Val mean-roc_auc_score: 0.9911
+2025-09-23 16:15:26,336 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.9924
+2025-09-23 16:15:33,221 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.9909
+2025-09-23 16:15:40,086 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0096 | Val mean-roc_auc_score: 0.9948
+2025-09-23 16:15:47,441 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.9912
+2025-09-23 16:15:54,514 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0068 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:15:54,665 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 936
+2025-09-23 16:15:55,241 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 18 with val mean-roc_auc_score: 0.9951
+2025-09-23 16:16:02,310 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0057 | Val mean-roc_auc_score: 0.9936
+2025-09-23 16:16:10,262 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0057 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:16:17,033 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.9943
+2025-09-23 16:16:23,677 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.9940
+2025-09-23 16:16:30,410 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9902
+2025-09-23 16:16:37,548 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9870
+2025-09-23 16:16:44,546 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0082 | Val mean-roc_auc_score: 0.9872
+2025-09-23 16:16:51,617 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0157 | Val mean-roc_auc_score: 0.9905
+2025-09-23 16:16:58,553 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.9881
+2025-09-23 16:17:05,609 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.9893
+2025-09-23 16:17:12,491 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:17:19,252 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.9917
+2025-09-23 16:17:26,035 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.9921
+2025-09-23 16:17:33,139 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0015 | Val mean-roc_auc_score: 0.9918
+2025-09-23 16:17:40,091 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:17:46,973 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0011 | Val mean-roc_auc_score: 0.9930
+2025-09-23 16:17:53,188 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9933
+2025-09-23 16:17:59,145 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.9937
+2025-09-23 16:18:06,368 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0641 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:18:13,541 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0332 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:18:21,932 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0272 | Val mean-roc_auc_score: 0.9911
+2025-09-23 16:18:29,069 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0123 | Val mean-roc_auc_score: 0.9928
+2025-09-23 16:18:36,251 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0045 | Val mean-roc_auc_score: 0.9928
+2025-09-23 16:18:43,574 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9929
+2025-09-23 16:18:50,603 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9928
+2025-09-23 16:18:57,658 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.9928
+2025-09-23 16:19:04,890 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.9928
+2025-09-23 16:19:12,134 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:19:18,752 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0011 | Val mean-roc_auc_score: 0.9928
+2025-09-23 16:19:24,842 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.9928
+2025-09-23 16:19:32,017 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0012 | Val mean-roc_auc_score: 0.9925
+2025-09-23 16:19:39,142 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:19:46,190 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9924
+2025-09-23 16:19:53,289 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9922
+2025-09-23 16:20:00,140 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.9909
+2025-09-23 16:20:06,970 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9916
+2025-09-23 16:20:13,939 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.9909
+2025-09-23 16:20:20,914 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.9914
+2025-09-23 16:20:28,186 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:20:36,322 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0003 | Val mean-roc_auc_score: 0.9913
+2025-09-23 16:20:42,941 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9912
+2025-09-23 16:20:49,229 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9913
+2025-09-23 16:20:55,131 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9916
+2025-09-23 16:21:02,488 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9915
+2025-09-23 16:21:09,541 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9916
+2025-09-23 16:21:16,693 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9905
+2025-09-23 16:21:23,438 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9916
+2025-09-23 16:21:30,151 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9906
+2025-09-23 16:21:37,362 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9905
+2025-09-23 16:21:44,362 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9906
+2025-09-23 16:21:51,446 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0003 | Val mean-roc_auc_score: 0.9906
+2025-09-23 16:21:58,428 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9905
+2025-09-23 16:22:05,337 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.9931
+2025-09-23 16:22:12,050 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.9867
+2025-09-23 16:22:18,985 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:22:25,015 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0011 | Val mean-roc_auc_score: 0.9922
+2025-09-23 16:22:31,816 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.9928
+2025-09-23 16:22:38,584 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9928
+2025-09-23 16:22:47,074 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9929
+2025-09-23 16:22:54,000 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9928
+2025-09-23 16:23:00,951 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9927
+2025-09-23 16:23:07,885 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.9926
+2025-09-23 16:23:15,111 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.9929
+2025-09-23 16:23:22,500 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0017 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:23:29,540 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0003 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:23:36,594 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9931
+2025-09-23 16:23:43,109 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9931
+2025-09-23 16:23:49,820 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9931
+2025-09-23 16:23:56,592 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9931
+2025-09-23 16:24:03,628 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9931
+2025-09-23 16:24:10,648 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:24:17,519 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9931
+2025-09-23 16:24:24,212 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:24:31,243 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:24:38,085 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:24:45,122 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:24:52,266 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9933
+2025-09-23 16:24:59,378 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:25:07,715 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9933
+2025-09-23 16:25:14,695 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:25:20,997 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:25:27,433 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9932
+2025-09-23 16:25:28,306 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.7249
+2025-09-23 16:25:28,673 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset bbbp at 2025-09-23_16-25-28
+2025-09-23 16:25:35,097 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.3101 | Val mean-roc_auc_score: 0.9935
+2025-09-23 16:25:35,097 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 52
+2025-09-23 16:25:35,675 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.9935
+2025-09-23 16:25:42,649 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.4551 | Val mean-roc_auc_score: 0.9925
+2025-09-23 16:25:49,758 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1238 | Val mean-roc_auc_score: 0.9919
+2025-09-23 16:25:56,920 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1113 | Val mean-roc_auc_score: 0.9930
+2025-09-23 16:26:04,068 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0622 | Val mean-roc_auc_score: 0.9907
+2025-09-23 16:26:10,845 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0892 | Val mean-roc_auc_score: 0.9938
+2025-09-23 16:26:11,297 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 312
+2025-09-23 16:26:11,842 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val mean-roc_auc_score: 0.9938
+2025-09-23 16:26:18,567 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0580 | Val mean-roc_auc_score: 0.9946
+2025-09-23 16:26:18,750 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 364
+2025-09-23 16:26:19,287 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 7 with val mean-roc_auc_score: 0.9946
+2025-09-23 16:26:26,007 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0298 | Val mean-roc_auc_score: 0.9939
+2025-09-23 16:26:32,905 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0183 | Val mean-roc_auc_score: 0.9937
+2025-09-23 16:26:39,761 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0181 | Val mean-roc_auc_score: 0.9914
+2025-09-23 16:26:46,708 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0221 | Val mean-roc_auc_score: 0.9926
+2025-09-23 16:26:53,277 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0226 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:27:00,352 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0159 | Val mean-roc_auc_score: 0.9942
+2025-09-23 16:27:07,422 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0130 | Val mean-roc_auc_score: 0.9948
+2025-09-23 16:27:07,574 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 728
+2025-09-23 16:27:08,130 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 14 with val mean-roc_auc_score: 0.9948
+2025-09-23 16:27:15,178 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0101 | Val mean-roc_auc_score: 0.9942
+2025-09-23 16:27:22,117 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.9947
+2025-09-23 16:27:29,424 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0054 | Val mean-roc_auc_score: 0.9941
+2025-09-23 16:27:36,410 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.9941
+2025-09-23 16:27:43,521 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.9938
+2025-09-23 16:27:51,857 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0039 | Val mean-roc_auc_score: 0.9937
+2025-09-23 16:27:58,740 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.9938
+2025-09-23 16:28:05,426 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.9938
+2025-09-23 16:28:12,119 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0066 | Val mean-roc_auc_score: 0.9952
+2025-09-23 16:28:12,261 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 1196
+2025-09-23 16:28:12,838 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 23 with val mean-roc_auc_score: 0.9952
+2025-09-23 16:28:19,232 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.9940
+2025-09-23 16:28:25,596 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0565 | Val mean-roc_auc_score: 0.9945
+2025-09-23 16:28:32,614 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0273 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:28:40,012 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:28:47,027 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0086 | Val mean-roc_auc_score: 0.9948
+2025-09-23 16:28:53,944 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0352 | Val mean-roc_auc_score: 0.9953
+2025-09-23 16:28:54,094 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 1508
+2025-09-23 16:28:54,650 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 29 with val mean-roc_auc_score: 0.9953
+2025-09-23 16:29:01,651 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0075 | Val mean-roc_auc_score: 0.9953
+2025-09-23 16:29:01,838 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Global step of best model: 1560
+2025-09-23 16:29:02,365 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Best model saved at epoch 30 with val mean-roc_auc_score: 0.9953
+2025-09-23 16:29:09,149 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.9947
+2025-09-23 16:29:16,233 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:29:22,955 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:29:29,670 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:29:36,734 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0017 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:29:43,904 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:29:50,408 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0104 | Val mean-roc_auc_score: 0.9948
+2025-09-23 16:29:57,086 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:30:05,222 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:30:12,258 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:30:19,203 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0015 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:30:26,404 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:30:33,355 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:30:40,516 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0012 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:30:47,602 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:30:54,658 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.9952
+2025-09-23 16:31:01,414 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:31:08,136 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:31:14,864 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:31:20,958 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.9948
+2025-09-23 16:31:27,484 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0015 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:31:34,513 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:31:41,190 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0012 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:31:48,285 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:31:55,363 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:32:02,462 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:32:09,825 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:32:18,033 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:32:24,802 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:32:31,703 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0003 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:32:38,983 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:32:46,222 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:32:52,494 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:32:59,240 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:33:05,882 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:33:12,700 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:33:20,047 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:33:27,028 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:33:34,018 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:33:41,029 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:33:47,977 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:33:54,648 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:34:01,650 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:34:08,693 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:34:15,731 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:34:21,746 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:34:30,535 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:34:37,740 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:34:44,854 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:34:51,646 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:34:58,495 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:35:05,554 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.9950
+2025-09-23 16:35:12,538 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.9949
+2025-09-23 16:35:19,424 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9951
+2025-09-23 16:35:26,331 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0002 | Val mean-roc_auc_score: 0.9944
+2025-09-23 16:35:33,277 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9942
+2025-09-23 16:35:40,566 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0010 | Val mean-roc_auc_score: 0.9936
+2025-09-23 16:35:47,827 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9938
+2025-09-23 16:35:54,102 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0011 | Val mean-roc_auc_score: 0.9936
+2025-09-23 16:36:01,187 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.9941
+2025-09-23 16:36:08,234 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0008 | Val mean-roc_auc_score: 0.9940
+2025-09-23 16:36:15,602 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9941
+2025-09-23 16:36:22,306 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9942
+2025-09-23 16:36:29,092 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9942
+2025-09-23 16:36:35,776 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9944
+2025-09-23 16:36:42,680 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.9940
+2025-09-23 16:36:50,687 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0007 | Val mean-roc_auc_score: 0.9944
+2025-09-23 16:36:57,739 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9944
+2025-09-23 16:37:04,808 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0003 | Val mean-roc_auc_score: 0.9944
+2025-09-23 16:37:11,823 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9945
+2025-09-23 16:37:12,716 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.7363
+2025-09-23 16:37:13,074 - logs_modchembert_bbbp_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg mean-roc_auc_score: 0.7282, Std Dev: 0.0058

logs_modchembert_classification_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_clintox_epochs100_batch_size32_20250923_163713.log

@@ -0,0 +1,373 @@
+2025-09-23 16:37:13,075 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Running benchmark for dataset: clintox
+2025-09-23 16:37:13,075 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - dataset: clintox, tasks: ['FDA_APPROVED', 'CT_TOX'], epochs: 100, learning rate: 3e-05
+2025-09-23 16:37:13,100 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset clintox at 2025-09-23_16-37-13
+2025-09-23 16:37:18,172 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.1326 | Val mean-roc_auc_score: 0.9127
+2025-09-23 16:37:18,172 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 37
+2025-09-23 16:37:18,725 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.9127
+2025-09-23 16:37:23,911 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.0410 | Val mean-roc_auc_score: 0.9767
+2025-09-23 16:37:24,105 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 74
+2025-09-23 16:37:24,641 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.9767
+2025-09-23 16:37:30,165 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.0202 | Val mean-roc_auc_score: 0.9775
+2025-09-23 16:37:30,351 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 111
+2025-09-23 16:37:30,883 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.9775
+2025-09-23 16:37:36,669 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.0279 | Val mean-roc_auc_score: 0.9741
+2025-09-23 16:37:42,391 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0266 | Val mean-roc_auc_score: 0.9816
+2025-09-23 16:37:42,548 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 185
+2025-09-23 16:37:43,138 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 5 with val mean-roc_auc_score: 0.9816
+2025-09-23 16:37:48,945 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0234 | Val mean-roc_auc_score: 0.9807
+2025-09-23 16:37:54,916 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0188 | Val mean-roc_auc_score: 0.9813
+2025-09-23 16:38:00,629 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0179 | Val mean-roc_auc_score: 0.9822
+2025-09-23 16:38:00,818 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 296
+2025-09-23 16:38:01,385 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 8 with val mean-roc_auc_score: 0.9822
+2025-09-23 16:38:06,952 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0165 | Val mean-roc_auc_score: 0.9816
+2025-09-23 16:38:12,442 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0141 | Val mean-roc_auc_score: 0.9828
+2025-09-23 16:38:12,636 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 370
+2025-09-23 16:38:13,211 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 10 with val mean-roc_auc_score: 0.9828
+2025-09-23 16:38:18,279 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0157 | Val mean-roc_auc_score: 0.9856
+2025-09-23 16:38:18,771 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 407
+2025-09-23 16:38:19,322 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 11 with val mean-roc_auc_score: 0.9856
+2025-09-23 16:38:24,917 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0129 | Val mean-roc_auc_score: 0.9866
+2025-09-23 16:38:25,104 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 444
+2025-09-23 16:38:25,692 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 12 with val mean-roc_auc_score: 0.9866
+2025-09-23 16:38:31,474 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0099 | Val mean-roc_auc_score: 0.9918
+2025-09-23 16:38:31,668 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 481
+2025-09-23 16:38:32,245 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 13 with val mean-roc_auc_score: 0.9918
+2025-09-23 16:38:37,872 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0184 | Val mean-roc_auc_score: 0.9874
+2025-09-23 16:38:43,541 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0109 | Val mean-roc_auc_score: 0.9883
+2025-09-23 16:38:48,598 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:38:54,722 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0131 | Val mean-roc_auc_score: 0.9845
+2025-09-23 16:39:00,513 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0197 | Val mean-roc_auc_score: 0.9857
+2025-09-23 16:39:06,291 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0006 | Val mean-roc_auc_score: 0.9868
+2025-09-23 16:39:12,089 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:39:17,646 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0068 | Val mean-roc_auc_score: 0.9877
+2025-09-23 16:39:23,498 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.9880
+2025-09-23 16:39:29,064 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.9874
+2025-09-23 16:39:34,724 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0125 | Val mean-roc_auc_score: 0.9857
+2025-09-23 16:39:40,324 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0472 | Val mean-roc_auc_score: 0.9867
+2025-09-23 16:39:46,178 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0332 | Val mean-roc_auc_score: 0.9845
+2025-09-23 16:39:53,509 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0139 | Val mean-roc_auc_score: 0.9839
+2025-09-23 16:39:59,165 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0123 | Val mean-roc_auc_score: 0.9867
+2025-09-23 16:40:04,827 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0111 | Val mean-roc_auc_score: 0.9890
+2025-09-23 16:40:10,521 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0131 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:40:15,752 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0137 | Val mean-roc_auc_score: 0.9862
+2025-09-23 16:40:21,279 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0087 | Val mean-roc_auc_score: 0.9874
+2025-09-23 16:40:26,960 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0074 | Val mean-roc_auc_score: 0.9874
+2025-09-23 16:40:32,321 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:40:38,000 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:40:43,715 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:40:49,543 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:40:55,020 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0043 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:41:00,544 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0038 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:41:06,179 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0034 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:41:11,635 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:41:17,624 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:41:23,360 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:41:29,124 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.9889
+2025-09-23 16:41:34,885 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.9905
+2025-09-23 16:41:40,588 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0003 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:41:46,011 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:41:51,075 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:41:56,816 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:42:02,548 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9889
+2025-09-23 16:42:08,288 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:42:14,376 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:42:20,009 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:42:25,631 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:42:32,533 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:42:37,618 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:42:43,559 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0001 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:42:49,019 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:42:54,692 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.9888
+2025-09-23 16:43:00,365 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:43:05,923 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0054 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:43:11,859 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:43:16,915 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:43:22,529 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:43:28,241 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:43:34,094 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:43:40,227 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:43:45,884 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:43:51,624 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:43:57,332 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:44:03,021 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:44:08,903 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:44:14,707 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0001 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:44:20,303 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9894
+2025-09-23 16:44:25,939 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:44:31,422 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:44:37,374 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:44:42,871 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:44:48,169 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:44:53,706 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:44:59,501 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:45:06,811 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:45:12,521 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:45:18,267 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0054 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:45:23,865 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:45:29,326 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:45:35,216 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:45:40,879 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9913
+2025-09-23 16:45:46,547 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:45:52,315 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9913
+2025-09-23 16:45:58,093 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:46:04,268 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0001 | Val mean-roc_auc_score: 0.9887
+2025-09-23 16:46:10,057 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9900
+2025-09-23 16:46:15,159 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.9913
+2025-09-23 16:46:20,469 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:46:26,122 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:46:32,099 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9905
+2025-09-23 16:46:37,768 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:46:43,311 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:46:48,815 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.9910
+2025-09-23 16:46:49,690 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.9945
+2025-09-23 16:46:50,084 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset clintox at 2025-09-23_16-46-50
+2025-09-23 16:46:55,086 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.1444 | Val mean-roc_auc_score: 0.9743
+2025-09-23 16:46:55,086 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 37
+2025-09-23 16:46:55,638 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.9743
+2025-09-23 16:47:00,956 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.0538 | Val mean-roc_auc_score: 0.9762
+2025-09-23 16:47:01,138 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 74
+2025-09-23 16:47:01,682 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.9762
+2025-09-23 16:47:07,529 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.0272 | Val mean-roc_auc_score: 0.9790
+2025-09-23 16:47:07,714 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 111
+2025-09-23 16:47:08,239 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.9790
+2025-09-23 16:47:13,877 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.0254 | Val mean-roc_auc_score: 0.9823
+2025-09-23 16:47:14,080 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 148
+2025-09-23 16:47:14,623 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.9823
+2025-09-23 16:47:20,325 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0245 | Val mean-roc_auc_score: 0.9811
+2025-09-23 16:47:26,037 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0170 | Val mean-roc_auc_score: 0.9839
+2025-09-23 16:47:26,510 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 222
+2025-09-23 16:47:27,042 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val mean-roc_auc_score: 0.9839
+2025-09-23 16:47:32,827 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0202 | Val mean-roc_auc_score: 0.9874
+2025-09-23 16:47:33,024 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 259
+2025-09-23 16:47:33,561 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 7 with val mean-roc_auc_score: 0.9874
+2025-09-23 16:47:39,300 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0151 | Val mean-roc_auc_score: 0.9840
+2025-09-23 16:47:44,310 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0210 | Val mean-roc_auc_score: 0.9863
+2025-09-23 16:47:49,877 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0140 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:47:50,056 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 370
+2025-09-23 16:47:50,591 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 10 with val mean-roc_auc_score: 0.9897
+2025-09-23 16:47:56,233 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0195 | Val mean-roc_auc_score: 0.9857
+2025-09-23 16:48:02,190 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0125 | Val mean-roc_auc_score: 0.9864
+2025-09-23 16:48:07,902 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0107 | Val mean-roc_auc_score: 0.9874
+2025-09-23 16:48:13,385 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0117 | Val mean-roc_auc_score: 0.9868
+2025-09-23 16:48:18,872 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0088 | Val mean-roc_auc_score: 0.9893
+2025-09-23 16:48:24,299 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.9887
+2025-09-23 16:48:30,120 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.9887
+2025-09-23 16:48:35,835 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.9895
+2025-09-23 16:48:41,571 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0112 | Val mean-roc_auc_score: 0.9868
+2025-09-23 16:48:47,310 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:48:53,015 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.9881
+2025-09-23 16:48:58,921 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0126 | Val mean-roc_auc_score: 0.9887
+2025-09-23 16:49:04,517 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0083 | Val mean-roc_auc_score: 0.9784
+2025-09-23 16:49:10,062 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0266 | Val mean-roc_auc_score: 0.9761
+2025-09-23 16:49:15,330 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0126 | Val mean-roc_auc_score: 0.9878
+2025-09-23 16:49:20,911 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0086 | Val mean-roc_auc_score: 0.9885
+2025-09-23 16:49:27,977 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0075 | Val mean-roc_auc_score: 0.9885
+2025-09-23 16:49:33,530 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.9885
+2025-09-23 16:49:39,101 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0045 | Val mean-roc_auc_score: 0.9885
+2025-09-23 16:49:44,836 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0050 | Val mean-roc_auc_score: 0.9890
+2025-09-23 16:49:50,415 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0042 | Val mean-roc_auc_score: 0.9885
+2025-09-23 16:49:56,368 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0042 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:50:02,041 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.9868
+2025-09-23 16:50:07,656 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0071 | Val mean-roc_auc_score: 0.9913
+2025-09-23 16:50:07,814 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 1258
+2025-09-23 16:50:08,377 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 34 with val mean-roc_auc_score: 0.9913
+2025-09-23 16:50:14,013 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0037 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:50:19,688 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0037 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:50:25,740 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0037 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:50:31,520 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0011 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:50:37,256 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:50:42,379 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0039 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:50:47,589 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:50:53,370 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:50:58,886 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:51:04,349 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:51:10,064 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:51:15,750 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0000 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:51:21,316 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9890
+2025-09-23 16:51:27,052 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0034 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:51:32,697 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.9908
+2025-09-23 16:51:38,387 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.9891
+2025-09-23 16:51:43,981 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.9896
+2025-09-23 16:51:49,964 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:51:55,649 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:52:01,435 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9885
+2025-09-23 16:52:08,394 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:52:13,678 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:52:19,725 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:52:25,422 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0017 | Val mean-roc_auc_score: 0.9897
+2025-09-23 16:52:31,123 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0017 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:52:36,848 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.9880
+2025-09-23 16:52:42,551 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.9848
+2025-09-23 16:52:48,060 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0086 | Val mean-roc_auc_score: 0.9925
+2025-09-23 16:52:48,206 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 2294
+2025-09-23 16:52:48,738 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 62 with val mean-roc_auc_score: 0.9925
+2025-09-23 16:52:54,414 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0115 | Val mean-roc_auc_score: 0.9931
+2025-09-23 16:52:54,625 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 2331
+2025-09-23 16:52:55,150 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 63 with val mean-roc_auc_score: 0.9931
+2025-09-23 16:53:00,973 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0076 | Val mean-roc_auc_score: 0.9931
+2025-09-23 16:53:06,675 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:53:12,399 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:53:18,445 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.9926
+2025-09-23 16:53:23,984 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:53:29,545 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:53:35,046 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:53:40,124 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:53:45,730 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:53:51,431 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0000 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:53:57,089 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:54:02,801 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:54:08,440 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:54:14,127 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:54:19,822 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:54:25,487 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:54:30,928 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:54:36,338 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:54:43,421 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:54:49,144 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:54:54,835 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:55:00,542 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:55:06,243 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:55:11,958 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:55:17,657 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:55:23,389 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:55:29,139 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0017 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:55:34,752 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:55:40,067 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0001 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:55:45,546 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.9920
+2025-09-23 16:55:51,092 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:55:56,785 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.9909
+2025-09-23 16:56:02,466 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.9909
+2025-09-23 16:56:08,428 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.9909
+2025-09-23 16:56:14,144 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0017 | Val mean-roc_auc_score: 0.9909
+2025-09-23 16:56:19,884 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:56:25,547 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.9909
+2025-09-23 16:56:26,395 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.9793
+2025-09-23 16:56:26,754 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset clintox at 2025-09-23_16-56-26
+2025-09-23 16:56:31,935 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.1503 | Val mean-roc_auc_score: 0.9637
+2025-09-23 16:56:31,935 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 37
+2025-09-23 16:56:32,452 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.9637
+2025-09-23 16:56:37,580 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.0427 | Val mean-roc_auc_score: 0.9758
+2025-09-23 16:56:37,748 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 74
+2025-09-23 16:56:38,271 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.9758
+2025-09-23 16:56:43,339 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.0182 | Val mean-roc_auc_score: 0.9805
+2025-09-23 16:56:43,523 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 111
+2025-09-23 16:56:44,076 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.9805
+2025-09-23 16:56:49,881 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.0338 | Val mean-roc_auc_score: 0.9861
+2025-09-23 16:56:50,106 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 148
+2025-09-23 16:56:50,638 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.9861
+2025-09-23 16:56:56,364 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0329 | Val mean-roc_auc_score: 0.9788
+2025-09-23 16:57:02,115 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0254 | Val mean-roc_auc_score: 0.9834
+2025-09-23 16:57:07,589 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0208 | Val mean-roc_auc_score: 0.9846
+2025-09-23 16:57:13,155 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0139 | Val mean-roc_auc_score: 0.9779
+2025-09-23 16:57:18,847 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0312 | Val mean-roc_auc_score: 0.9811
+2025-09-23 16:57:24,494 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0211 | Val mean-roc_auc_score: 0.9834
+2025-09-23 16:57:30,112 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.9863
+2025-09-23 16:57:30,558 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 407
+2025-09-23 16:57:31,111 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 11 with val mean-roc_auc_score: 0.9863
+2025-09-23 16:57:36,640 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0120 | Val mean-roc_auc_score: 0.9851
+2025-09-23 16:57:42,132 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0223 | Val mean-roc_auc_score: 0.9854
+2025-09-23 16:57:47,825 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0248 | Val mean-roc_auc_score: 0.9890
+2025-09-23 16:57:48,005 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 518
+2025-09-23 16:57:48,528 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 14 with val mean-roc_auc_score: 0.9890
+2025-09-23 16:57:54,182 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0133 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:57:54,365 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 555
+2025-09-23 16:57:54,899 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 15 with val mean-roc_auc_score: 0.9903
+2025-09-23 16:58:00,596 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0098 | Val mean-roc_auc_score: 0.9887
+2025-09-23 16:58:05,888 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.9899
+2025-09-23 16:58:11,129 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0150 | Val mean-roc_auc_score: 0.9886
+2025-09-23 16:58:16,792 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0334 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:58:22,416 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0080 | Val mean-roc_auc_score: 0.9892
+2025-09-23 16:58:28,024 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0071 | Val mean-roc_auc_score: 0.9914
+2025-09-23 16:58:28,497 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 777
+2025-09-23 16:58:29,044 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 21 with val mean-roc_auc_score: 0.9914
+2025-09-23 16:58:34,503 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.9914
+2025-09-23 16:58:34,686 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 814
+2025-09-23 16:58:35,228 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 22 with val mean-roc_auc_score: 0.9914
+2025-09-23 16:58:40,901 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.9936
+2025-09-23 16:58:41,097 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 851
+2025-09-23 16:58:41,696 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 23 with val mean-roc_auc_score: 0.9936
+2025-09-23 16:58:47,379 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0066 | Val mean-roc_auc_score: 0.9930
+2025-09-23 16:58:53,086 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.9914
+2025-09-23 16:58:58,675 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0045 | Val mean-roc_auc_score: 0.9887
+2025-09-23 16:59:05,908 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0182 | Val mean-roc_auc_score: 0.9881
+2025-09-23 16:59:11,587 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0117 | Val mean-roc_auc_score: 0.9903
+2025-09-23 16:59:17,006 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0184 | Val mean-roc_auc_score: 0.9925
+2025-09-23 16:59:22,552 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.9910
+2025-09-23 16:59:28,116 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.9921
+2025-09-23 16:59:33,553 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.9918
+2025-09-23 16:59:38,813 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.9915
+2025-09-23 16:59:44,318 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.9918
+2025-09-23 16:59:50,144 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0042 | Val mean-roc_auc_score: 0.9910
+2025-09-23 16:59:55,835 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.9931
+2025-09-23 17:00:01,577 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0039 | Val mean-roc_auc_score: 0.9918
+2025-09-23 17:00:07,268 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0001 | Val mean-roc_auc_score: 0.9925
+2025-09-23 17:00:12,904 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.9915
+2025-09-23 17:00:18,575 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.9918
+2025-09-23 17:00:24,052 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.9918
+2025-09-23 17:00:29,823 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0039 | Val mean-roc_auc_score: 0.9931
+2025-09-23 17:00:35,441 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.9925
+2025-09-23 17:00:40,981 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0037 | Val mean-roc_auc_score: 0.9928
+2025-09-23 17:00:46,601 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.9925
+2025-09-23 17:00:52,312 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0114 | Val mean-roc_auc_score: 0.9922
+2025-09-23 17:00:58,223 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.9931
+2025-09-23 17:01:03,242 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:01:03,397 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 1776
+2025-09-23 17:01:03,932 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 48 with val mean-roc_auc_score: 0.9937
+2025-09-23 17:01:09,588 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0012 | Val mean-roc_auc_score: 0.9931
+2025-09-23 17:01:15,199 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:01:20,780 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:01:26,121 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0038 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:01:26,282 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 1924
+2025-09-23 17:01:26,845 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 52 with val mean-roc_auc_score: 0.9943
+2025-09-23 17:01:32,471 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:01:38,123 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:01:45,129 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:01:50,688 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.9931
+2025-09-23 17:01:56,519 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:02:01,981 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:02:07,510 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:02:13,198 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:02:18,936 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9931
+2025-09-23 17:02:24,986 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:02:30,136 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9940
+2025-09-23 17:02:35,315 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:02:41,125 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0004 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:02:46,695 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:02:52,133 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:02:57,790 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0062 | Val mean-roc_auc_score: 0.9940
+2025-09-23 17:03:03,487 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.9937
+2025-09-23 17:03:09,153 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.9920
+2025-09-23 17:03:14,888 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.9920
+2025-09-23 17:03:20,915 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9920
+2025-09-23 17:03:26,656 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0000 | Val mean-roc_auc_score: 0.9920
+2025-09-23 17:03:32,326 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9920
+2025-09-23 17:03:38,037 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9920
+2025-09-23 17:03:43,592 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.9920
+2025-09-23 17:03:49,389 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.9920
+2025-09-23 17:03:54,995 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.9931
+2025-09-23 17:04:00,087 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:04:05,014 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:04:10,734 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:04:17,463 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:04:23,072 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9943
+2025-09-23 17:04:28,846 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:04:34,587 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:04:40,335 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:04:46,361 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:04:51,818 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:04:57,347 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:05:02,975 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0015 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:05:08,618 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0021 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:05:14,600 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0000 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:05:20,272 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:05:25,937 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:05:31,308 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:05:37,069 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9938
+2025-09-23 17:05:43,091 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9944
+2025-09-23 17:05:43,246 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Global step of best model: 3589
+2025-09-23 17:05:43,791 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Best model saved at epoch 97 with val mean-roc_auc_score: 0.9944
+2025-09-23 17:05:49,443 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.9944
+2025-09-23 17:05:55,126 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.9944
+2025-09-23 17:06:00,883 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.9944
+2025-09-23 17:06:01,737 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.9437
+2025-09-23 17:06:02,089 - logs_modchembert_clintox_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg mean-roc_auc_score: 0.9725, Std Dev: 0.0213

logs_modchembert_classification_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_hiv_epochs100_batch_size32_20250923_153257.log

@@ -0,0 +1,331 @@
+2025-09-23 15:32:57,085 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Running benchmark for dataset: hiv
+2025-09-23 15:32:57,085 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - dataset: hiv, tasks: ['HIV_active'], epochs: 100, learning rate: 3e-05
+2025-09-23 15:32:57,090 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset hiv at 2025-09-23_15-32-57
+2025-09-23 15:34:19,613 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.1204 | Val mean-roc_auc_score: 0.8254
+2025-09-23 15:34:19,613 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 1027
+2025-09-23 15:34:20,144 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.8254
+2025-09-23 15:35:46,004 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.0920 | Val mean-roc_auc_score: 0.8208
+2025-09-23 15:37:11,944 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1173 | Val mean-roc_auc_score: 0.8369
+2025-09-23 15:37:12,108 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 3081
+2025-09-23 15:37:12,659 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.8369
+2025-09-23 15:38:39,216 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.0732 | Val mean-roc_auc_score: 0.8483
+2025-09-23 15:38:39,363 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 4108
+2025-09-23 15:38:39,888 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.8483
+2025-09-23 15:40:07,310 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0516 | Val mean-roc_auc_score: 0.8387
+2025-09-23 15:41:34,106 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0484 | Val mean-roc_auc_score: 0.8457
+2025-09-23 15:43:01,785 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0463 | Val mean-roc_auc_score: 0.8315
+2025-09-23 15:44:28,844 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0156 | Val mean-roc_auc_score: 0.8134
+2025-09-23 15:45:55,737 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0382 | Val mean-roc_auc_score: 0.8129
+2025-09-23 15:47:22,995 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0286 | Val mean-roc_auc_score: 0.8159
+2025-09-23 15:48:51,155 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0117 | Val mean-roc_auc_score: 0.7577
+2025-09-23 15:50:17,552 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0172 | Val mean-roc_auc_score: 0.7877
+2025-09-23 15:51:44,991 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0300 | Val mean-roc_auc_score: 0.7850
+2025-09-23 15:53:11,728 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0187 | Val mean-roc_auc_score: 0.7388
+2025-09-23 15:54:39,305 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.7234
+2025-09-23 15:56:06,685 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0150 | Val mean-roc_auc_score: 0.7709
+2025-09-23 15:57:33,387 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0133 | Val mean-roc_auc_score: 0.7484
+2025-09-23 15:58:59,222 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0144 | Val mean-roc_auc_score: 0.7739
+2025-09-23 16:00:19,101 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0062 | Val mean-roc_auc_score: 0.7526
+2025-09-23 16:01:38,697 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0225 | Val mean-roc_auc_score: 0.7962
+2025-09-23 16:02:59,206 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.7711
+2025-09-23 16:04:20,055 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0112 | Val mean-roc_auc_score: 0.7627
+2025-09-23 16:05:39,488 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0139 | Val mean-roc_auc_score: 0.7700
+2025-09-23 16:07:00,674 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0108 | Val mean-roc_auc_score: 0.7510
+2025-09-23 16:08:20,943 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0084 | Val mean-roc_auc_score: 0.7572
+2025-09-23 16:09:41,664 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0099 | Val mean-roc_auc_score: 0.7557
+2025-09-23 16:11:01,636 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7617
+2025-09-23 16:12:22,003 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0093 | Val mean-roc_auc_score: 0.7723
+2025-09-23 16:13:42,531 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.7589
+2025-09-23 16:15:02,867 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0112 | Val mean-roc_auc_score: 0.7603
+2025-09-23 16:16:19,461 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0079 | Val mean-roc_auc_score: 0.7545
+2025-09-23 16:17:32,293 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0121 | Val mean-roc_auc_score: 0.7692
+2025-09-23 16:18:44,956 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0087 | Val mean-roc_auc_score: 0.7941
+2025-09-23 16:19:58,078 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0145 | Val mean-roc_auc_score: 0.7605
+2025-09-23 16:21:11,017 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0071 | Val mean-roc_auc_score: 0.7549
+2025-09-23 16:22:24,069 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.7740
+2025-09-23 16:23:39,024 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0076 | Val mean-roc_auc_score: 0.7600
+2025-09-23 16:24:51,958 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.7716
+2025-09-23 16:26:05,044 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0088 | Val mean-roc_auc_score: 0.7574
+2025-09-23 16:27:18,181 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7646
+2025-09-23 16:28:31,100 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7592
+2025-09-23 16:29:44,149 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7556
+2025-09-23 16:30:58,079 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.7565
+2025-09-23 16:32:11,795 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0036 | Val mean-roc_auc_score: 0.7547
+2025-09-23 16:33:24,871 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0046 | Val mean-roc_auc_score: 0.7580
+2025-09-23 16:34:34,899 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7559
+2025-09-23 16:35:44,407 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.7575
+2025-09-23 16:36:54,048 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0038 | Val mean-roc_auc_score: 0.7552
+2025-09-23 16:38:03,911 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.7487
+2025-09-23 16:39:12,629 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0054 | Val mean-roc_auc_score: 0.7475
+2025-09-23 16:40:22,714 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.7472
+2025-09-23 16:41:32,433 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.7583
+2025-09-23 16:42:41,844 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.7601
+2025-09-23 16:43:50,380 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0066 | Val mean-roc_auc_score: 0.7526
+2025-09-23 16:44:59,893 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7468
+2025-09-23 16:46:09,091 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7546
+2025-09-23 16:47:23,347 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0038 | Val mean-roc_auc_score: 0.7396
+2025-09-23 16:48:51,091 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0046 | Val mean-roc_auc_score: 0.7516
+2025-09-23 16:50:19,890 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.7510
+2025-09-23 16:51:48,730 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.7543
+2025-09-23 16:53:18,464 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0043 | Val mean-roc_auc_score: 0.7394
+2025-09-23 16:54:47,899 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.7509
+2025-09-23 16:56:16,978 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0001 | Val mean-roc_auc_score: 0.7474
+2025-09-23 16:57:45,893 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.7561
+2025-09-23 16:59:14,691 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0037 | Val mean-roc_auc_score: 0.7468
+2025-09-23 17:00:44,442 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0042 | Val mean-roc_auc_score: 0.7469
+2025-09-23 17:02:13,591 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7421
+2025-09-23 17:03:41,864 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0017 | Val mean-roc_auc_score: 0.7423
+2025-09-23 17:05:10,526 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.7504
+2025-09-23 17:06:38,758 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0031 | Val mean-roc_auc_score: 0.7481
+2025-09-23 17:08:07,514 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0084 | Val mean-roc_auc_score: 0.7432
+2025-09-23 17:09:37,298 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.7413
+2025-09-23 17:11:06,651 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.7566
+2025-09-23 17:12:36,313 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0033 | Val mean-roc_auc_score: 0.7547
+2025-09-23 17:14:05,895 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.7699
+2025-09-23 17:15:35,703 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0079 | Val mean-roc_auc_score: 0.7608
+2025-09-23 17:17:05,389 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.7509
+2025-09-23 17:18:33,800 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.7544
+2025-09-23 17:20:02,870 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0045 | Val mean-roc_auc_score: 0.7478
+2025-09-23 17:21:32,544 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.7533
+2025-09-23 17:23:01,616 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.7553
+2025-09-23 17:24:29,836 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.7694
+2025-09-23 17:25:58,687 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.7631
+2025-09-23 17:27:27,924 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.7546
+2025-09-23 17:28:56,019 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7514
+2025-09-23 17:30:25,061 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.7488
+2025-09-23 17:31:55,210 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.7501
+2025-09-23 17:33:24,426 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.7607
+2025-09-23 17:34:53,423 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.7540
+2025-09-23 17:36:22,022 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.7520
+2025-09-23 17:37:51,816 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.7472
+2025-09-23 17:39:21,252 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0038 | Val mean-roc_auc_score: 0.7637
+2025-09-23 17:40:50,045 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.7576
+2025-09-23 17:42:02,532 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.7476
+2025-09-23 17:43:02,921 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0046 | Val mean-roc_auc_score: 0.7812
+2025-09-23 17:44:03,844 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0099 | Val mean-roc_auc_score: 0.7716
+2025-09-23 17:45:05,041 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0050 | Val mean-roc_auc_score: 0.7693
+2025-09-23 17:46:05,500 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.7666
+2025-09-23 17:47:06,610 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0037 | Val mean-roc_auc_score: 0.7629
+2025-09-23 17:48:07,479 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.7577
+2025-09-23 17:48:11,176 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.7837
+2025-09-23 17:48:11,645 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset hiv at 2025-09-23_17-48-11
+2025-09-23 17:49:08,509 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.1169 | Val mean-roc_auc_score: 0.8152
+2025-09-23 17:49:08,509 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 1027
+2025-09-23 17:49:09,021 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.8152
+2025-09-23 17:50:10,026 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.1001 | Val mean-roc_auc_score: 0.8315
+2025-09-23 17:50:10,163 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 2054
+2025-09-23 17:50:10,695 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.8315
+2025-09-23 17:51:11,338 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.0590 | Val mean-roc_auc_score: 0.8272
+2025-09-23 17:52:12,005 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1245 | Val mean-roc_auc_score: 0.8339
+2025-09-23 17:52:12,155 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 4108
+2025-09-23 17:52:12,690 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.8339
+2025-09-23 17:53:13,789 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0790 | Val mean-roc_auc_score: 0.8173
+2025-09-23 17:54:14,273 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0441 | Val mean-roc_auc_score: 0.8433
+2025-09-23 17:54:14,871 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 6162
+2025-09-23 17:54:15,409 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val mean-roc_auc_score: 0.8433
+2025-09-23 17:55:15,938 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0562 | Val mean-roc_auc_score: 0.8204
+2025-09-23 17:56:16,165 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0234 | Val mean-roc_auc_score: 0.7905
+2025-09-23 17:57:16,712 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0334 | Val mean-roc_auc_score: 0.8001
+2025-09-23 17:58:17,279 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0344 | Val mean-roc_auc_score: 0.8020
+2025-09-23 17:59:18,531 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0126 | Val mean-roc_auc_score: 0.7389
+2025-09-23 18:00:19,536 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0203 | Val mean-roc_auc_score: 0.8060
+2025-09-23 18:01:19,881 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0152 | Val mean-roc_auc_score: 0.7259
+2025-09-23 18:02:21,078 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0169 | Val mean-roc_auc_score: 0.7829
+2025-09-23 18:03:21,346 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0039 | Val mean-roc_auc_score: 0.8041
+2025-09-23 18:04:22,955 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0151 | Val mean-roc_auc_score: 0.7620
+2025-09-23 18:05:24,531 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0177 | Val mean-roc_auc_score: 0.7868
+2025-09-23 18:06:25,117 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0161 | Val mean-roc_auc_score: 0.7834
+2025-09-23 18:07:26,354 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7541
+2025-09-23 18:08:27,032 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.7164
+2025-09-23 18:09:28,219 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0133 | Val mean-roc_auc_score: 0.7754
+2025-09-23 18:10:29,425 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7299
+2025-09-23 18:11:30,126 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0141 | Val mean-roc_auc_score: 0.7370
+2025-09-23 18:12:31,008 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0125 | Val mean-roc_auc_score: 0.7276
+2025-09-23 18:13:31,611 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7128
+2025-09-23 18:14:32,740 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0083 | Val mean-roc_auc_score: 0.7102
+2025-09-23 18:15:33,742 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0079 | Val mean-roc_auc_score: 0.7094
+2025-09-23 18:16:34,159 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0179 | Val mean-roc_auc_score: 0.7395
+2025-09-23 18:17:35,042 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0092 | Val mean-roc_auc_score: 0.7702
+2025-09-23 18:18:35,847 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0152 | Val mean-roc_auc_score: 0.7094
+2025-09-23 18:19:37,221 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0134 | Val mean-roc_auc_score: 0.7011
+2025-09-23 18:20:38,121 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0071 | Val mean-roc_auc_score: 0.7313
+2025-09-23 18:21:38,550 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0077 | Val mean-roc_auc_score: 0.7133
+2025-09-23 18:22:39,433 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0094 | Val mean-roc_auc_score: 0.6993
+2025-09-23 18:23:40,199 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0137 | Val mean-roc_auc_score: 0.7236
+2025-09-23 18:24:41,196 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.7025
+2025-09-23 18:25:43,385 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.6775
+2025-09-23 18:26:44,514 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.7229
+2025-09-23 18:27:45,684 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0062 | Val mean-roc_auc_score: 0.7203
+2025-09-23 18:28:46,010 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0075 | Val mean-roc_auc_score: 0.6948
+2025-09-23 18:29:47,232 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0011 | Val mean-roc_auc_score: 0.7252
+2025-09-23 18:30:48,780 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0045 | Val mean-roc_auc_score: 0.7146
+2025-09-23 18:31:49,611 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0089 | Val mean-roc_auc_score: 0.7187
+2025-09-23 18:32:51,012 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0093 | Val mean-roc_auc_score: 0.7256
+2025-09-23 18:33:51,967 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.7098
+2025-09-23 18:34:53,202 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0067 | Val mean-roc_auc_score: 0.7162
+2025-09-23 18:35:54,168 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.7068
+2025-09-23 18:36:54,832 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7074
+2025-09-23 18:37:56,389 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0092 | Val mean-roc_auc_score: 0.7250
+2025-09-23 18:38:57,069 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0128 | Val mean-roc_auc_score: 0.7370
+2025-09-23 18:39:58,059 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7390
+2025-09-23 18:40:59,252 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0038 | Val mean-roc_auc_score: 0.7291
+2025-09-23 18:41:59,825 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.7242
+2025-09-23 18:43:01,212 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7056
+2025-09-23 18:44:01,927 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0077 | Val mean-roc_auc_score: 0.6897
+2025-09-23 18:45:03,037 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0019 | Val mean-roc_auc_score: 0.7191
+2025-09-23 18:46:04,519 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0097 | Val mean-roc_auc_score: 0.6933
+2025-09-23 18:47:05,315 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7272
+2025-09-23 18:48:06,539 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0076 | Val mean-roc_auc_score: 0.7175
+2025-09-23 18:49:07,192 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0099 | Val mean-roc_auc_score: 0.7150
+2025-09-23 18:50:08,202 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.7210
+2025-09-23 18:51:09,716 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.7388
+2025-09-23 18:52:10,590 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0002 | Val mean-roc_auc_score: 0.7251
+2025-09-23 18:53:11,954 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.7205
+2025-09-23 18:54:12,855 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0026 | Val mean-roc_auc_score: 0.7195
+2025-09-23 18:55:15,013 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.7149
+2025-09-23 18:56:16,307 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.7152
+2025-09-23 18:57:16,796 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7020
+2025-09-23 18:58:18,088 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7183
+2025-09-23 18:59:18,424 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0039 | Val mean-roc_auc_score: 0.7015
+2025-09-23 19:00:19,536 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.6950
+2025-09-23 19:01:20,990 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0042 | Val mean-roc_auc_score: 0.7118
+2025-09-23 19:02:21,355 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0045 | Val mean-roc_auc_score: 0.6883
+2025-09-23 19:03:22,468 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.7360
+2025-09-23 19:04:24,045 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0102 | Val mean-roc_auc_score: 0.7152
+2025-09-23 19:05:25,225 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.6928
+2025-09-23 19:06:26,410 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.6990
+2025-09-23 19:07:27,086 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.7093
+2025-09-23 19:08:26,398 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7139
+2025-09-23 19:09:25,397 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0102 | Val mean-roc_auc_score: 0.7414
+2025-09-23 19:10:24,810 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7085
+2025-09-23 19:11:24,294 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.7153
+2025-09-23 19:12:22,936 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.7044
+2025-09-23 19:13:22,067 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.7290
+2025-09-23 19:14:20,903 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7357
+2025-09-23 19:15:20,617 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.7252
+2025-09-23 19:16:19,791 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0038 | Val mean-roc_auc_score: 0.7222
+2025-09-23 19:17:18,801 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0043 | Val mean-roc_auc_score: 0.7084
+2025-09-23 19:18:18,029 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0001 | Val mean-roc_auc_score: 0.7137
+2025-09-23 19:19:17,247 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.7113
+2025-09-23 19:20:16,728 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0023 | Val mean-roc_auc_score: 0.7061
+2025-09-23 19:21:16,009 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.6913
+2025-09-23 19:22:14,869 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.7150
+2025-09-23 19:23:14,192 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7181
+2025-09-23 19:24:13,134 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0074 | Val mean-roc_auc_score: 0.7182
+2025-09-23 19:25:12,704 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0045 | Val mean-roc_auc_score: 0.7044
+2025-09-23 19:26:11,849 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0088 | Val mean-roc_auc_score: 0.7202
+2025-09-23 19:27:10,675 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.7237
+2025-09-23 19:28:10,332 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0042 | Val mean-roc_auc_score: 0.7127
+2025-09-23 19:29:09,229 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.7289
+2025-09-23 19:29:12,417 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.7736
+2025-09-23 19:29:13,065 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset hiv at 2025-09-23_19-29-13
+2025-09-23 19:30:08,859 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.1019 | Val mean-roc_auc_score: 0.7988
+2025-09-23 19:30:08,860 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 1027
+2025-09-23 19:30:09,374 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.7988
+2025-09-23 19:31:08,578 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.0972 | Val mean-roc_auc_score: 0.8244
+2025-09-23 19:31:08,716 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 2054
+2025-09-23 19:31:09,237 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.8244
+2025-09-23 19:32:08,195 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1173 | Val mean-roc_auc_score: 0.8269
+2025-09-23 19:32:08,336 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 3081
+2025-09-23 19:32:08,857 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.8269
+2025-09-23 19:33:07,539 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.0354 | Val mean-roc_auc_score: 0.8350
+2025-09-23 19:33:07,680 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Global step of best model: 4108
+2025-09-23 19:33:08,201 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.8350
+2025-09-23 19:34:07,608 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0585 | Val mean-roc_auc_score: 0.8290
+2025-09-23 19:35:06,621 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0557 | Val mean-roc_auc_score: 0.8254
+2025-09-23 19:36:06,172 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0363 | Val mean-roc_auc_score: 0.8126
+2025-09-23 19:37:04,976 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0371 | Val mean-roc_auc_score: 0.8049
+2025-09-23 19:38:04,234 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0276 | Val mean-roc_auc_score: 0.8242
+2025-09-23 19:39:03,135 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0229 | Val mean-roc_auc_score: 0.8090
+2025-09-23 19:40:02,616 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0274 | Val mean-roc_auc_score: 0.7805
+2025-09-23 19:41:02,345 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0116 | Val mean-roc_auc_score: 0.7489
+2025-09-23 19:42:01,106 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0222 | Val mean-roc_auc_score: 0.7778
+2025-09-23 19:43:00,600 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0127 | Val mean-roc_auc_score: 0.7222
+2025-09-23 19:43:59,653 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0090 | Val mean-roc_auc_score: 0.7647
+2025-09-23 19:44:59,081 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0160 | Val mean-roc_auc_score: 0.7850
+2025-09-23 19:45:58,443 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0180 | Val mean-roc_auc_score: 0.7703
+2025-09-23 19:46:57,353 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0095 | Val mean-roc_auc_score: 0.7379
+2025-09-23 19:47:56,918 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.7277
+2025-09-23 19:48:56,033 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0120 | Val mean-roc_auc_score: 0.7273
+2025-09-23 19:49:55,532 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0075 | Val mean-roc_auc_score: 0.7433
+2025-09-23 19:50:54,860 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0082 | Val mean-roc_auc_score: 0.7345
+2025-09-23 19:51:53,917 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0142 | Val mean-roc_auc_score: 0.7613
+2025-09-23 19:52:53,402 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0065 | Val mean-roc_auc_score: 0.7450
+2025-09-23 19:53:52,503 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0134 | Val mean-roc_auc_score: 0.7792
+2025-09-23 19:54:52,110 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7080
+2025-09-23 19:55:51,660 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0072 | Val mean-roc_auc_score: 0.7414
+2025-09-23 19:56:50,512 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7499
+2025-09-23 19:57:49,775 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0075 | Val mean-roc_auc_score: 0.7515
+2025-09-23 19:58:48,722 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.7394
+2025-09-23 19:59:47,946 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7169
+2025-09-23 20:00:47,486 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7095
+2025-09-23 20:01:46,840 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0084 | Val mean-roc_auc_score: 0.7325
+2025-09-23 20:02:46,533 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7367
+2025-09-23 20:03:45,599 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0067 | Val mean-roc_auc_score: 0.7050
+2025-09-23 20:04:45,131 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.7210
+2025-09-23 20:05:45,627 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.7084
+2025-09-23 20:06:44,768 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7134
+2025-09-23 20:07:44,396 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7098
+2025-09-23 20:08:43,348 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.6826
+2025-09-23 20:09:42,947 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0016 | Val mean-roc_auc_score: 0.7208
+2025-09-23 20:10:42,630 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0067 | Val mean-roc_auc_score: 0.7261
+2025-09-23 20:11:41,568 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0030 | Val mean-roc_auc_score: 0.7062
+2025-09-23 20:12:41,067 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0085 | Val mean-roc_auc_score: 0.7272
+2025-09-23 20:13:39,867 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0014 | Val mean-roc_auc_score: 0.7086
+2025-09-23 20:14:39,573 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0109 | Val mean-roc_auc_score: 0.7192
+2025-09-23 20:15:39,119 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0078 | Val mean-roc_auc_score: 0.7375
+2025-09-23 20:16:37,966 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.7323
+2025-09-23 20:17:37,649 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.7341
+2025-09-23 20:18:36,585 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7280
+2025-09-23 20:19:36,163 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.7224
+2025-09-23 20:20:35,689 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0013 | Val mean-roc_auc_score: 0.7529
+2025-09-23 20:21:34,699 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7411
+2025-09-23 20:22:34,578 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.7238
+2025-09-23 20:23:33,554 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.7136
+2025-09-23 20:24:33,066 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0025 | Val mean-roc_auc_score: 0.6897
+2025-09-23 20:25:32,388 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0027 | Val mean-roc_auc_score: 0.7002
+2025-09-23 20:26:31,191 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.7196
+2025-09-23 20:27:30,751 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0074 | Val mean-roc_auc_score: 0.7478
+2025-09-23 20:28:29,628 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0100 | Val mean-roc_auc_score: 0.7394
+2025-09-23 20:29:29,186 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7191
+2025-09-23 20:30:28,827 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0034 | Val mean-roc_auc_score: 0.7189
+2025-09-23 20:31:27,723 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0005 | Val mean-roc_auc_score: 0.7146
+2025-09-23 20:32:27,389 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0093 | Val mean-roc_auc_score: 0.7103
+2025-09-23 20:33:26,142 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0078 | Val mean-roc_auc_score: 0.7261
+2025-09-23 20:34:25,730 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.7115
+2025-09-23 20:35:25,307 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0076 | Val mean-roc_auc_score: 0.7173
+2025-09-23 20:36:24,177 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7132
+2025-09-23 20:37:23,796 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7063
+2025-09-23 20:38:22,267 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0046 | Val mean-roc_auc_score: 0.6928
+2025-09-23 20:39:19,887 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.7194
+2025-09-23 20:40:17,262 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0020 | Val mean-roc_auc_score: 0.7022
+2025-09-23 20:41:13,554 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7108
+2025-09-23 20:42:10,432 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7174
+2025-09-23 20:43:07,475 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0116 | Val mean-roc_auc_score: 0.7123
+2025-09-23 20:44:04,226 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0032 | Val mean-roc_auc_score: 0.7098
+2025-09-23 20:45:00,792 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0022 | Val mean-roc_auc_score: 0.7000
+2025-09-23 20:45:56,860 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0142 | Val mean-roc_auc_score: 0.7147
+2025-09-23 20:46:53,649 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0018 | Val mean-roc_auc_score: 0.7172
+2025-09-23 20:47:49,737 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.7130
+2025-09-23 20:48:46,485 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7181
+2025-09-23 20:49:43,309 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0086 | Val mean-roc_auc_score: 0.7092
+2025-09-23 20:50:39,283 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0034 | Val mean-roc_auc_score: 0.7016
+2025-09-23 20:51:36,108 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.7167
+2025-09-23 20:52:32,109 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0046 | Val mean-roc_auc_score: 0.7079
+2025-09-23 20:53:28,802 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0090 | Val mean-roc_auc_score: 0.7081
+2025-09-23 20:54:25,532 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.7325
+2025-09-23 20:55:21,433 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0029 | Val mean-roc_auc_score: 0.7087
+2025-09-23 20:56:18,326 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0077 | Val mean-roc_auc_score: 0.7128
+2025-09-23 20:57:14,337 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.7070
+2025-09-23 20:58:11,046 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0046 | Val mean-roc_auc_score: 0.7064
+2025-09-23 20:59:07,841 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7093
+2025-09-23 21:00:03,838 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0009 | Val mean-roc_auc_score: 0.7151
+2025-09-23 21:01:00,612 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0028 | Val mean-roc_auc_score: 0.7155
+2025-09-23 21:01:56,548 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0043 | Val mean-roc_auc_score: 0.7335
+2025-09-23 21:02:53,377 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.7400
+2025-09-23 21:03:50,186 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0024 | Val mean-roc_auc_score: 0.7243
+2025-09-23 21:04:46,377 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0040 | Val mean-roc_auc_score: 0.7309
+2025-09-23 21:05:43,105 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0054 | Val mean-roc_auc_score: 0.7152
+2025-09-23 21:06:39,201 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7565
+2025-09-23 21:06:42,287 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.7738
+2025-09-23 21:06:43,090 - logs_modchembert_hiv_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg mean-roc_auc_score: 0.7770, Std Dev: 0.0047

logs_modchembert_classification_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_sider_epochs100_batch_size32_20250923_170602.log

@@ -0,0 +1,355 @@
+2025-09-23 17:06:02,090 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Running benchmark for dataset: sider
+2025-09-23 17:06:02,091 - logs_modchembert_sider_epochs100_batch_size32 - INFO - dataset: sider, tasks: ['Hepatobiliary disorders', 'Metabolism and nutrition disorders', 'Product issues', 'Eye disorders', 'Investigations', 'Musculoskeletal and connective tissue disorders', 'Gastrointestinal disorders', 'Social circumstances', 'Immune system disorders', 'Reproductive system and breast disorders', 'Neoplasms benign, malignant and unspecified (incl cysts and polyps)', 'General disorders and administration site conditions', 'Endocrine disorders', 'Surgical and medical procedures', 'Vascular disorders', 'Blood and lymphatic system disorders', 'Skin and subcutaneous tissue disorders', 'Congenital, familial and genetic disorders', 'Infections and infestations', 'Respiratory, thoracic and mediastinal disorders', 'Psychiatric disorders', 'Renal and urinary disorders', 'Pregnancy, puerperium and perinatal conditions', 'Ear and labyrinth disorders', 'Cardiac disorders', 'Nervous system disorders', 'Injury, poisoning and procedural complications'], epochs: 100, learning rate: 3e-05
+2025-09-23 17:06:02,104 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset sider at 2025-09-23_17-06-02
+2025-09-23 17:06:07,163 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.5286 | Val mean-roc_auc_score: 0.5518
+2025-09-23 17:06:07,163 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 35
+2025-09-23 17:06:07,687 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.5518
+2025-09-23 17:06:13,174 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.5071 | Val mean-roc_auc_score: 0.5893
+2025-09-23 17:06:13,349 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 70
+2025-09-23 17:06:13,886 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.5893
+2025-09-23 17:06:19,231 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.4906 | Val mean-roc_auc_score: 0.5857
+2025-09-23 17:06:24,534 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.4750 | Val mean-roc_auc_score: 0.6008
+2025-09-23 17:06:24,714 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 140
+2025-09-23 17:06:25,236 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.6008
+2025-09-23 17:06:30,403 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.4571 | Val mean-roc_auc_score: 0.6049
+2025-09-23 17:06:30,583 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 175
+2025-09-23 17:06:31,104 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 5 with val mean-roc_auc_score: 0.6049
+2025-09-23 17:06:36,469 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.4156 | Val mean-roc_auc_score: 0.6089
+2025-09-23 17:06:36,989 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 210
+2025-09-23 17:06:37,568 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val mean-roc_auc_score: 0.6089
+2025-09-23 17:06:42,937 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.3875 | Val mean-roc_auc_score: 0.6101
+2025-09-23 17:06:43,122 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 245
+2025-09-23 17:06:43,661 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 7 with val mean-roc_auc_score: 0.6101
+2025-09-23 17:06:49,054 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.3571 | Val mean-roc_auc_score: 0.6182
+2025-09-23 17:06:49,252 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 280
+2025-09-23 17:06:49,835 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 8 with val mean-roc_auc_score: 0.6182
+2025-09-23 17:06:54,700 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.3417 | Val mean-roc_auc_score: 0.6189
+2025-09-23 17:06:54,898 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 315
+2025-09-23 17:06:55,468 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 9 with val mean-roc_auc_score: 0.6189
+2025-09-23 17:07:00,441 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.3089 | Val mean-roc_auc_score: 0.6268
+2025-09-23 17:07:00,629 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 350
+2025-09-23 17:07:01,211 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 10 with val mean-roc_auc_score: 0.6268
+2025-09-23 17:07:06,906 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.2911 | Val mean-roc_auc_score: 0.6187
+2025-09-23 17:07:12,592 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.2687 | Val mean-roc_auc_score: 0.6189
+2025-09-23 17:07:17,953 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.2500 | Val mean-roc_auc_score: 0.6071
+2025-09-23 17:07:23,414 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.2411 | Val mean-roc_auc_score: 0.6066
+2025-09-23 17:07:28,879 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.2263 | Val mean-roc_auc_score: 0.6128
+2025-09-23 17:07:34,358 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.2062 | Val mean-roc_auc_score: 0.6020
+2025-09-23 17:07:40,187 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.1902 | Val mean-roc_auc_score: 0.5981
+2025-09-23 17:07:45,436 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.1802 | Val mean-roc_auc_score: 0.6105
+2025-09-23 17:07:50,740 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.1661 | Val mean-roc_auc_score: 0.6068
+2025-09-23 17:07:55,957 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.1545 | Val mean-roc_auc_score: 0.6048
+2025-09-23 17:08:01,217 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.1536 | Val mean-roc_auc_score: 0.6045
+2025-09-23 17:08:07,007 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.1393 | Val mean-roc_auc_score: 0.6091
+2025-09-23 17:08:12,485 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.1492 | Val mean-roc_auc_score: 0.6033
+2025-09-23 17:08:17,930 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.1286 | Val mean-roc_auc_score: 0.6081
+2025-09-23 17:08:22,791 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.1205 | Val mean-roc_auc_score: 0.6006
+2025-09-23 17:08:27,640 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.1141 | Val mean-roc_auc_score: 0.6016
+2025-09-23 17:08:33,199 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.1125 | Val mean-roc_auc_score: 0.5960
+2025-09-23 17:08:38,411 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.1076 | Val mean-roc_auc_score: 0.6001
+2025-09-23 17:08:44,918 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.1073 | Val mean-roc_auc_score: 0.5938
+2025-09-23 17:08:50,310 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0978 | Val mean-roc_auc_score: 0.6004
+2025-09-23 17:08:55,792 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0929 | Val mean-roc_auc_score: 0.6067
+2025-09-23 17:09:01,514 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0934 | Val mean-roc_auc_score: 0.6013
+2025-09-23 17:09:07,047 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0888 | Val mean-roc_auc_score: 0.6039
+2025-09-23 17:09:12,555 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0835 | Val mean-roc_auc_score: 0.6021
+2025-09-23 17:09:17,912 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0831 | Val mean-roc_auc_score: 0.6067
+2025-09-23 17:09:23,357 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0777 | Val mean-roc_auc_score: 0.6021
+2025-09-23 17:09:29,028 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0772 | Val mean-roc_auc_score: 0.6011
+2025-09-23 17:09:34,436 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0740 | Val mean-roc_auc_score: 0.6051
+2025-09-23 17:09:39,820 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0710 | Val mean-roc_auc_score: 0.6032
+2025-09-23 17:09:45,215 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0696 | Val mean-roc_auc_score: 0.6027
+2025-09-23 17:09:50,102 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0692 | Val mean-roc_auc_score: 0.6026
+2025-09-23 17:09:55,364 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0683 | Val mean-roc_auc_score: 0.6040
+2025-09-23 17:10:00,277 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0734 | Val mean-roc_auc_score: 0.6020
+2025-09-23 17:10:05,696 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0647 | Val mean-roc_auc_score: 0.5992
+2025-09-23 17:10:11,111 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0625 | Val mean-roc_auc_score: 0.6043
+2025-09-23 17:10:16,541 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0578 | Val mean-roc_auc_score: 0.6046
+2025-09-23 17:10:22,070 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0607 | Val mean-roc_auc_score: 0.5993
+2025-09-23 17:10:27,283 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0598 | Val mean-roc_auc_score: 0.6011
+2025-09-23 17:10:32,546 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0612 | Val mean-roc_auc_score: 0.6010
+2025-09-23 17:10:37,806 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0565 | Val mean-roc_auc_score: 0.5995
+2025-09-23 17:10:43,222 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0565 | Val mean-roc_auc_score: 0.5989
+2025-09-23 17:10:48,891 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0594 | Val mean-roc_auc_score: 0.6012
+2025-09-23 17:10:54,313 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0547 | Val mean-roc_auc_score: 0.6004
+2025-09-23 17:10:59,724 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0540 | Val mean-roc_auc_score: 0.6015
+2025-09-23 17:11:05,202 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0528 | Val mean-roc_auc_score: 0.5976
+2025-09-23 17:11:10,800 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0513 | Val mean-roc_auc_score: 0.5978
+2025-09-23 17:11:16,570 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0516 | Val mean-roc_auc_score: 0.5991
+2025-09-23 17:11:22,683 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0516 | Val mean-roc_auc_score: 0.6009
+2025-09-23 17:11:27,516 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0498 | Val mean-roc_auc_score: 0.5967
+2025-09-23 17:11:32,828 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0480 | Val mean-roc_auc_score: 0.5974
+2025-09-23 17:11:38,123 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0478 | Val mean-roc_auc_score: 0.6003
+2025-09-23 17:11:43,713 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0469 | Val mean-roc_auc_score: 0.5995
+2025-09-23 17:11:49,187 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0488 | Val mean-roc_auc_score: 0.5986
+2025-09-23 17:11:54,593 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0467 | Val mean-roc_auc_score: 0.5978
+2025-09-23 17:12:00,053 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0460 | Val mean-roc_auc_score: 0.5980
+2025-09-23 17:12:05,453 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0465 | Val mean-roc_auc_score: 0.5969
+2025-09-23 17:12:11,267 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0449 | Val mean-roc_auc_score: 0.5954
+2025-09-23 17:12:16,769 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0453 | Val mean-roc_auc_score: 0.5949
+2025-09-23 17:12:22,167 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0464 | Val mean-roc_auc_score: 0.5950
+2025-09-23 17:12:27,623 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0449 | Val mean-roc_auc_score: 0.5949
+2025-09-23 17:12:33,107 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0433 | Val mean-roc_auc_score: 0.5972
+2025-09-23 17:12:38,886 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0428 | Val mean-roc_auc_score: 0.5973
+2025-09-23 17:12:44,364 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0420 | Val mean-roc_auc_score: 0.5982
+2025-09-23 17:12:49,148 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0417 | Val mean-roc_auc_score: 0.5984
+2025-09-23 17:12:54,117 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0419 | Val mean-roc_auc_score: 0.5947
+2025-09-23 17:12:59,331 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0415 | Val mean-roc_auc_score: 0.5997
+2025-09-23 17:13:04,931 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0406 | Val mean-roc_auc_score: 0.5980
+2025-09-23 17:13:10,198 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0406 | Val mean-roc_auc_score: 0.5975
+2025-09-23 17:13:15,621 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0402 | Val mean-roc_auc_score: 0.5969
+2025-09-23 17:13:21,051 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0395 | Val mean-roc_auc_score: 0.5970
+2025-09-23 17:13:26,409 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0404 | Val mean-roc_auc_score: 0.5973
+2025-09-23 17:13:32,213 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0395 | Val mean-roc_auc_score: 0.5994
+2025-09-23 17:13:37,709 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0432 | Val mean-roc_auc_score: 0.5983
+2025-09-23 17:13:43,209 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0391 | Val mean-roc_auc_score: 0.5991
+2025-09-23 17:13:48,637 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0391 | Val mean-roc_auc_score: 0.5992
+2025-09-23 17:13:55,366 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0391 | Val mean-roc_auc_score: 0.6005
+2025-09-23 17:14:01,128 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0379 | Val mean-roc_auc_score: 0.5988
+2025-09-23 17:14:06,627 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0371 | Val mean-roc_auc_score: 0.5982
+2025-09-23 17:14:11,505 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0391 | Val mean-roc_auc_score: 0.5963
+2025-09-23 17:14:16,452 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0379 | Val mean-roc_auc_score: 0.5977
+2025-09-23 17:14:21,777 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0377 | Val mean-roc_auc_score: 0.5978
+2025-09-23 17:14:27,574 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0389 | Val mean-roc_auc_score: 0.5982
+2025-09-23 17:14:33,034 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0366 | Val mean-roc_auc_score: 0.5947
+2025-09-23 17:14:38,489 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0357 | Val mean-roc_auc_score: 0.5962
+2025-09-23 17:14:43,946 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0355 | Val mean-roc_auc_score: 0.5973
+2025-09-23 17:14:49,336 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0355 | Val mean-roc_auc_score: 0.5987
+2025-09-23 17:14:55,069 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0357 | Val mean-roc_auc_score: 0.5967
+2025-09-23 17:15:00,432 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0354 | Val mean-roc_auc_score: 0.5967
+2025-09-23 17:15:05,637 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0350 | Val mean-roc_auc_score: 0.5960
+2025-09-23 17:15:10,897 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0350 | Val mean-roc_auc_score: 0.5994
+2025-09-23 17:15:11,739 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.6532
+2025-09-23 17:15:12,096 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset sider at 2025-09-23_17-15-12
+2025-09-23 17:15:16,945 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.5357 | Val mean-roc_auc_score: 0.5486
+2025-09-23 17:15:16,945 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 35
+2025-09-23 17:15:17,469 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.5486
+2025-09-23 17:15:22,889 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.5000 | Val mean-roc_auc_score: 0.5611
+2025-09-23 17:15:23,066 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 70
+2025-09-23 17:15:23,600 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.5611
+2025-09-23 17:15:29,088 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.4813 | Val mean-roc_auc_score: 0.5886
+2025-09-23 17:15:29,269 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 105
+2025-09-23 17:15:29,804 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.5886
+2025-09-23 17:15:35,369 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.4750 | Val mean-roc_auc_score: 0.6082
+2025-09-23 17:15:35,582 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 140
+2025-09-23 17:15:36,127 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.6082
+2025-09-23 17:15:41,644 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.4518 | Val mean-roc_auc_score: 0.6042
+2025-09-23 17:15:46,746 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.4156 | Val mean-roc_auc_score: 0.6075
+2025-09-23 17:15:52,904 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.3911 | Val mean-roc_auc_score: 0.6218
+2025-09-23 17:15:53,050 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 245
+2025-09-23 17:15:53,603 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 7 with val mean-roc_auc_score: 0.6218
+2025-09-23 17:15:58,935 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.3661 | Val mean-roc_auc_score: 0.6377
+2025-09-23 17:15:59,124 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 280
+2025-09-23 17:15:59,670 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 8 with val mean-roc_auc_score: 0.6377
+2025-09-23 17:16:05,064 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.3417 | Val mean-roc_auc_score: 0.6193
+2025-09-23 17:16:10,544 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.3125 | Val mean-roc_auc_score: 0.6188
+2025-09-23 17:16:16,054 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.2946 | Val mean-roc_auc_score: 0.6294
+2025-09-23 17:16:21,998 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.2781 | Val mean-roc_auc_score: 0.6084
+2025-09-23 17:16:27,422 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.2571 | Val mean-roc_auc_score: 0.5993
+2025-09-23 17:16:32,718 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.2464 | Val mean-roc_auc_score: 0.6213
+2025-09-23 17:16:37,929 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.2275 | Val mean-roc_auc_score: 0.6036
+2025-09-23 17:16:43,145 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.2107 | Val mean-roc_auc_score: 0.6138
+2025-09-23 17:16:48,761 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.1964 | Val mean-roc_auc_score: 0.6161
+2025-09-23 17:16:54,166 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.1844 | Val mean-roc_auc_score: 0.6186
+2025-09-23 17:16:59,585 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.1723 | Val mean-roc_auc_score: 0.6215
+2025-09-23 17:17:04,455 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.1607 | Val mean-roc_auc_score: 0.6216
+2025-09-23 17:17:09,680 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.1545 | Val mean-roc_auc_score: 0.6280
+2025-09-23 17:17:14,831 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.1473 | Val mean-roc_auc_score: 0.6266
+2025-09-23 17:17:20,323 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.1375 | Val mean-roc_auc_score: 0.6247
+2025-09-23 17:17:25,510 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.1295 | Val mean-roc_auc_score: 0.6240
+2025-09-23 17:17:31,052 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.1205 | Val mean-roc_auc_score: 0.6206
+2025-09-23 17:17:36,421 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.1203 | Val mean-roc_auc_score: 0.6252
+2025-09-23 17:17:42,111 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.1138 | Val mean-roc_auc_score: 0.6180
+2025-09-23 17:17:47,631 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.1071 | Val mean-roc_auc_score: 0.6223
+2025-09-23 17:17:54,258 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.1062 | Val mean-roc_auc_score: 0.6171
+2025-09-23 17:17:59,467 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0996 | Val mean-roc_auc_score: 0.6173
+2025-09-23 17:18:04,677 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0964 | Val mean-roc_auc_score: 0.6158
+2025-09-23 17:18:10,258 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0918 | Val mean-roc_auc_score: 0.6208
+2025-09-23 17:18:15,558 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0875 | Val mean-roc_auc_score: 0.6154
+2025-09-23 17:18:21,015 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0839 | Val mean-roc_auc_score: 0.6200
+2025-09-23 17:18:26,410 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0844 | Val mean-roc_auc_score: 0.6130
+2025-09-23 17:18:31,774 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0817 | Val mean-roc_auc_score: 0.6135
+2025-09-23 17:18:37,648 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0781 | Val mean-roc_auc_score: 0.6130
+2025-09-23 17:18:42,575 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0771 | Val mean-roc_auc_score: 0.6120
+2025-09-23 17:18:48,069 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0737 | Val mean-roc_auc_score: 0.6207
+2025-09-23 17:18:53,480 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0719 | Val mean-roc_auc_score: 0.6152
+2025-09-23 17:18:58,882 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0701 | Val mean-roc_auc_score: 0.6131
+2025-09-23 17:19:04,576 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0683 | Val mean-roc_auc_score: 0.6160
+2025-09-23 17:19:09,933 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0625 | Val mean-roc_auc_score: 0.6146
+2025-09-23 17:19:15,429 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0638 | Val mean-roc_auc_score: 0.6143
+2025-09-23 17:19:20,882 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0647 | Val mean-roc_auc_score: 0.6188
+2025-09-23 17:19:26,264 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0621 | Val mean-roc_auc_score: 0.6165
+2025-09-23 17:19:31,856 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0621 | Val mean-roc_auc_score: 0.6161
+2025-09-23 17:19:37,075 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0598 | Val mean-roc_auc_score: 0.6161
+2025-09-23 17:19:42,431 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0589 | Val mean-roc_auc_score: 0.6131
+2025-09-23 17:19:47,980 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0585 | Val mean-roc_auc_score: 0.6148
+2025-09-23 17:19:53,499 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0580 | Val mean-roc_auc_score: 0.6146
+2025-09-23 17:19:59,290 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0574 | Val mean-roc_auc_score: 0.6126
+2025-09-23 17:20:04,705 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0554 | Val mean-roc_auc_score: 0.6135
+2025-09-23 17:20:09,543 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0549 | Val mean-roc_auc_score: 0.6154
+2025-09-23 17:20:14,795 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0537 | Val mean-roc_auc_score: 0.6123
+2025-09-23 17:20:20,370 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0536 | Val mean-roc_auc_score: 0.6113
+2025-09-23 17:20:26,285 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0518 | Val mean-roc_auc_score: 0.6135
+2025-09-23 17:20:32,976 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0518 | Val mean-roc_auc_score: 0.6165
+2025-09-23 17:20:38,390 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0502 | Val mean-roc_auc_score: 0.6145
+2025-09-23 17:20:43,875 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0504 | Val mean-roc_auc_score: 0.6133
+2025-09-23 17:20:49,235 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0491 | Val mean-roc_auc_score: 0.6146
+2025-09-23 17:20:55,018 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0489 | Val mean-roc_auc_score: 0.6174
+2025-09-23 17:21:00,401 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0471 | Val mean-roc_auc_score: 0.6160
+2025-09-23 17:21:05,832 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0475 | Val mean-roc_auc_score: 0.6183
+2025-09-23 17:21:11,237 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0473 | Val mean-roc_auc_score: 0.6167
+2025-09-23 17:21:16,493 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0471 | Val mean-roc_auc_score: 0.6128
+2025-09-23 17:21:21,641 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0464 | Val mean-roc_auc_score: 0.6132
+2025-09-23 17:21:26,948 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0471 | Val mean-roc_auc_score: 0.6137
+2025-09-23 17:21:32,225 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0448 | Val mean-roc_auc_score: 0.6165
+2025-09-23 17:21:37,137 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0449 | Val mean-roc_auc_score: 0.6138
+2025-09-23 17:21:42,511 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0437 | Val mean-roc_auc_score: 0.6159
+2025-09-23 17:21:48,056 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0439 | Val mean-roc_auc_score: 0.6141
+2025-09-23 17:21:53,418 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0444 | Val mean-roc_auc_score: 0.6189
+2025-09-23 17:21:58,812 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0440 | Val mean-roc_auc_score: 0.6126
+2025-09-23 17:22:04,279 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0431 | Val mean-roc_auc_score: 0.6151
+2025-09-23 17:22:09,824 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0431 | Val mean-roc_auc_score: 0.6123
+2025-09-23 17:22:15,675 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0422 | Val mean-roc_auc_score: 0.6166
+2025-09-23 17:22:21,203 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0424 | Val mean-roc_auc_score: 0.6155
+2025-09-23 17:22:26,629 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0413 | Val mean-roc_auc_score: 0.6153
+2025-09-23 17:22:32,010 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0408 | Val mean-roc_auc_score: 0.6128
+2025-09-23 17:22:37,515 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0404 | Val mean-roc_auc_score: 0.6152
+2025-09-23 17:22:43,219 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0404 | Val mean-roc_auc_score: 0.6152
+2025-09-23 17:22:48,088 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0385 | Val mean-roc_auc_score: 0.6136
+2025-09-23 17:22:53,401 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0397 | Val mean-roc_auc_score: 0.6140
+2025-09-23 17:22:58,712 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0393 | Val mean-roc_auc_score: 0.6124
+2025-09-23 17:23:04,936 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0387 | Val mean-roc_auc_score: 0.6116
+2025-09-23 17:23:10,612 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0397 | Val mean-roc_auc_score: 0.6116
+2025-09-23 17:23:15,999 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0393 | Val mean-roc_auc_score: 0.6132
+2025-09-23 17:23:21,399 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0383 | Val mean-roc_auc_score: 0.6121
+2025-09-23 17:23:26,823 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0379 | Val mean-roc_auc_score: 0.6120
+2025-09-23 17:23:32,280 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0384 | Val mean-roc_auc_score: 0.6121
+2025-09-23 17:23:37,966 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0355 | Val mean-roc_auc_score: 0.6125
+2025-09-23 17:23:43,485 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0377 | Val mean-roc_auc_score: 0.6156
+2025-09-23 17:23:48,893 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0375 | Val mean-roc_auc_score: 0.6131
+2025-09-23 17:23:54,311 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0377 | Val mean-roc_auc_score: 0.6132
+2025-09-23 17:23:59,814 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0379 | Val mean-roc_auc_score: 0.6121
+2025-09-23 17:24:05,636 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0368 | Val mean-roc_auc_score: 0.6145
+2025-09-23 17:24:11,005 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0357 | Val mean-roc_auc_score: 0.6118
+2025-09-23 17:24:16,221 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0366 | Val mean-roc_auc_score: 0.6100
+2025-09-23 17:24:21,446 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0364 | Val mean-roc_auc_score: 0.6127
+2025-09-23 17:24:22,292 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.6391
+2025-09-23 17:24:22,654 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset sider at 2025-09-23_17-24-22
+2025-09-23 17:24:27,418 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.5321 | Val mean-roc_auc_score: 0.5332
+2025-09-23 17:24:27,426 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 35
+2025-09-23 17:24:27,980 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.5332
+2025-09-23 17:24:33,124 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.5071 | Val mean-roc_auc_score: 0.5585
+2025-09-23 17:24:33,301 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 70
+2025-09-23 17:24:33,837 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.5585
+2025-09-23 17:24:39,415 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.4906 | Val mean-roc_auc_score: 0.5797
+2025-09-23 17:24:39,594 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 105
+2025-09-23 17:24:40,131 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.5797
+2025-09-23 17:24:45,539 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.4750 | Val mean-roc_auc_score: 0.6014
+2025-09-23 17:24:45,723 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 140
+2025-09-23 17:24:46,257 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.6014
+2025-09-23 17:24:51,609 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.4500 | Val mean-roc_auc_score: 0.5968
+2025-09-23 17:24:57,013 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.4062 | Val mean-roc_auc_score: 0.6113
+2025-09-23 17:24:57,521 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 210
+2025-09-23 17:24:58,051 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val mean-roc_auc_score: 0.6113
+2025-09-23 17:25:03,322 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.3786 | Val mean-roc_auc_score: 0.6089
+2025-09-23 17:25:08,523 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.3607 | Val mean-roc_auc_score: 0.6114
+2025-09-23 17:25:08,712 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 280
+2025-09-23 17:25:09,245 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 8 with val mean-roc_auc_score: 0.6114
+2025-09-23 17:25:14,489 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.3354 | Val mean-roc_auc_score: 0.6209
+2025-09-23 17:25:14,680 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 315
+2025-09-23 17:25:15,219 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 9 with val mean-roc_auc_score: 0.6209
+2025-09-23 17:25:20,690 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.3143 | Val mean-roc_auc_score: 0.6226
+2025-09-23 17:25:20,872 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Global step of best model: 350
+2025-09-23 17:25:21,395 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Best model saved at epoch 10 with val mean-roc_auc_score: 0.6226
+2025-09-23 17:25:26,763 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.3000 | Val mean-roc_auc_score: 0.6121
+2025-09-23 17:25:32,552 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.2797 | Val mean-roc_auc_score: 0.6147
+2025-09-23 17:25:37,440 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.2589 | Val mean-roc_auc_score: 0.6093
+2025-09-23 17:25:42,876 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.2446 | Val mean-roc_auc_score: 0.6143
+2025-09-23 17:25:48,254 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.2313 | Val mean-roc_auc_score: 0.6032
+2025-09-23 17:25:53,722 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.2143 | Val mean-roc_auc_score: 0.6052
+2025-09-23 17:25:58,870 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.2018 | Val mean-roc_auc_score: 0.6119
+2025-09-23 17:26:03,753 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.1885 | Val mean-roc_auc_score: 0.6110
+2025-09-23 17:26:09,156 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.1777 | Val mean-roc_auc_score: 0.6066
+2025-09-23 17:26:14,575 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.1688 | Val mean-roc_auc_score: 0.6028
+2025-09-23 17:26:19,927 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.1580 | Val mean-roc_auc_score: 0.6047
+2025-09-23 17:26:25,567 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.1545 | Val mean-roc_auc_score: 0.6061
+2025-09-23 17:26:30,895 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.1430 | Val mean-roc_auc_score: 0.6077
+2025-09-23 17:26:36,170 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.1357 | Val mean-roc_auc_score: 0.6136
+2025-09-23 17:26:41,404 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.1268 | Val mean-roc_auc_score: 0.6158
+2025-09-23 17:26:46,906 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.1305 | Val mean-roc_auc_score: 0.6082
+2025-09-23 17:26:52,736 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.1187 | Val mean-roc_auc_score: 0.6110
+2025-09-23 17:26:58,294 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.1143 | Val mean-roc_auc_score: 0.6071
+2025-09-23 17:27:04,701 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.1073 | Val mean-roc_auc_score: 0.6093
+2025-09-23 17:27:10,175 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.1040 | Val mean-roc_auc_score: 0.6118
+2025-09-23 17:27:15,995 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.1013 | Val mean-roc_auc_score: 0.6160
+2025-09-23 17:27:21,745 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0969 | Val mean-roc_auc_score: 0.6108
+2025-09-23 17:27:26,442 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0929 | Val mean-roc_auc_score: 0.6098
+2025-09-23 17:27:31,601 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0897 | Val mean-roc_auc_score: 0.6172
+2025-09-23 17:27:37,123 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0862 | Val mean-roc_auc_score: 0.6117
+2025-09-23 17:27:42,613 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0835 | Val mean-roc_auc_score: 0.6129
+2025-09-23 17:27:48,414 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0821 | Val mean-roc_auc_score: 0.6061
+2025-09-23 17:27:53,689 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0797 | Val mean-roc_auc_score: 0.6160
+2025-09-23 17:27:58,914 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0754 | Val mean-roc_auc_score: 0.6119
+2025-09-23 17:28:04,178 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0746 | Val mean-roc_auc_score: 0.6125
+2025-09-23 17:28:09,331 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0741 | Val mean-roc_auc_score: 0.6136
+2025-09-23 17:28:15,028 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0728 | Val mean-roc_auc_score: 0.6158
+2025-09-23 17:28:20,448 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0633 | Val mean-roc_auc_score: 0.6134
+2025-09-23 17:28:25,846 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0674 | Val mean-roc_auc_score: 0.6182
+2025-09-23 17:28:31,184 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0665 | Val mean-roc_auc_score: 0.6153
+2025-09-23 17:28:36,749 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0633 | Val mean-roc_auc_score: 0.6152
+2025-09-23 17:28:42,464 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0647 | Val mean-roc_auc_score: 0.6154
+2025-09-23 17:28:47,931 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0616 | Val mean-roc_auc_score: 0.6154
+2025-09-23 17:28:52,870 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0641 | Val mean-roc_auc_score: 0.6130
+2025-09-23 17:28:57,791 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0616 | Val mean-roc_auc_score: 0.6148
+2025-09-23 17:29:03,081 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0594 | Val mean-roc_auc_score: 0.6125
+2025-09-23 17:29:08,926 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0617 | Val mean-roc_auc_score: 0.6176
+2025-09-23 17:29:14,450 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0569 | Val mean-roc_auc_score: 0.6135
+2025-09-23 17:29:19,979 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0560 | Val mean-roc_auc_score: 0.6149
+2025-09-23 17:29:25,450 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0550 | Val mean-roc_auc_score: 0.6174
+2025-09-23 17:29:30,983 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0554 | Val mean-roc_auc_score: 0.6153
+2025-09-23 17:29:36,780 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0545 | Val mean-roc_auc_score: 0.6140
+2025-09-23 17:29:43,415 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0542 | Val mean-roc_auc_score: 0.6128
+2025-09-23 17:29:48,812 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0527 | Val mean-roc_auc_score: 0.6142
+2025-09-23 17:29:53,752 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0513 | Val mean-roc_auc_score: 0.6175
+2025-09-23 17:29:59,123 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0507 | Val mean-roc_auc_score: 0.6138
+2025-09-23 17:30:04,725 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0507 | Val mean-roc_auc_score: 0.6129
+2025-09-23 17:30:09,934 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0504 | Val mean-roc_auc_score: 0.6140
+2025-09-23 17:30:15,211 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0491 | Val mean-roc_auc_score: 0.6138
+2025-09-23 17:30:19,894 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0489 | Val mean-roc_auc_score: 0.6134
+2025-09-23 17:30:24,902 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0494 | Val mean-roc_auc_score: 0.6158
+2025-09-23 17:30:30,807 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0478 | Val mean-roc_auc_score: 0.6158
+2025-09-23 17:30:36,260 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0467 | Val mean-roc_auc_score: 0.6162
+2025-09-23 17:30:41,750 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0479 | Val mean-roc_auc_score: 0.6160
+2025-09-23 17:30:47,166 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0462 | Val mean-roc_auc_score: 0.6154
+2025-09-23 17:30:52,539 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0458 | Val mean-roc_auc_score: 0.6133
+2025-09-23 17:30:58,344 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0480 | Val mean-roc_auc_score: 0.6160
+2025-09-23 17:31:03,800 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0446 | Val mean-roc_auc_score: 0.6136
+2025-09-23 17:31:09,386 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0442 | Val mean-roc_auc_score: 0.6136
+2025-09-23 17:31:14,864 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0444 | Val mean-roc_auc_score: 0.6157
+2025-09-23 17:31:19,940 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0433 | Val mean-roc_auc_score: 0.6177
+2025-09-23 17:31:25,711 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0435 | Val mean-roc_auc_score: 0.6164
+2025-09-23 17:31:30,965 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0432 | Val mean-roc_auc_score: 0.6157
+2025-09-23 17:31:36,222 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0426 | Val mean-roc_auc_score: 0.6152
+2025-09-23 17:31:41,592 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0417 | Val mean-roc_auc_score: 0.6146
+2025-09-23 17:31:46,467 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0431 | Val mean-roc_auc_score: 0.6170
+2025-09-23 17:31:51,713 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0415 | Val mean-roc_auc_score: 0.6150
+2025-09-23 17:31:57,022 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0461 | Val mean-roc_auc_score: 0.6149
+2025-09-23 17:32:02,257 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0420 | Val mean-roc_auc_score: 0.6153
+2025-09-23 17:32:07,541 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0415 | Val mean-roc_auc_score: 0.6158
+2025-09-23 17:32:14,162 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0402 | Val mean-roc_auc_score: 0.6161
+2025-09-23 17:32:19,967 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0400 | Val mean-roc_auc_score: 0.6147
+2025-09-23 17:32:25,401 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0404 | Val mean-roc_auc_score: 0.6152
+2025-09-23 17:32:30,824 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0391 | Val mean-roc_auc_score: 0.6152
+2025-09-23 17:32:36,312 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0395 | Val mean-roc_auc_score: 0.6138
+2025-09-23 17:32:41,808 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0388 | Val mean-roc_auc_score: 0.6138
+2025-09-23 17:32:47,615 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0393 | Val mean-roc_auc_score: 0.6130
+2025-09-23 17:32:53,135 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0393 | Val mean-roc_auc_score: 0.6152
+2025-09-23 17:32:58,504 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0379 | Val mean-roc_auc_score: 0.6146
+2025-09-23 17:33:03,838 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0386 | Val mean-roc_auc_score: 0.6133
+2025-09-23 17:33:09,250 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0384 | Val mean-roc_auc_score: 0.6131
+2025-09-23 17:33:14,451 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0375 | Val mean-roc_auc_score: 0.6139
+2025-09-23 17:33:19,130 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0375 | Val mean-roc_auc_score: 0.6157
+2025-09-23 17:33:24,585 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0368 | Val mean-roc_auc_score: 0.6142
+2025-09-23 17:33:30,178 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0379 | Val mean-roc_auc_score: 0.6144
+2025-09-23 17:33:31,026 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.6704
+2025-09-23 17:33:31,420 - logs_modchembert_sider_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg mean-roc_auc_score: 0.6542, Std Dev: 0.0128

logs_modchembert_classification_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_tox21_epochs100_batch_size32_20250923_173331.log

@@ -0,0 +1,329 @@
+2025-09-23 17:33:31,421 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Running benchmark for dataset: tox21
+2025-09-23 17:33:31,421 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - dataset: tox21, tasks: ['NR-AR', 'NR-AR-LBD', 'NR-AhR', 'NR-Aromatase', 'NR-ER', 'NR-ER-LBD', 'NR-PPAR-gamma', 'SR-ARE', 'SR-ATAD5', 'SR-HSE', 'SR-MMP', 'SR-p53'], epochs: 100, learning rate: 3e-05
+2025-09-23 17:33:31,434 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset tox21 at 2025-09-23_17-33-31
+2025-09-23 17:33:49,274 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.1732 | Val mean-roc_auc_score: 0.7399
+2025-09-23 17:33:49,274 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Global step of best model: 196
+2025-09-23 17:33:49,817 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.7399
+2025-09-23 17:34:08,656 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.1617 | Val mean-roc_auc_score: 0.7591
+2025-09-23 17:34:08,831 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Global step of best model: 392
+2025-09-23 17:34:09,357 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.7591
+2025-09-23 17:34:28,061 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1435 | Val mean-roc_auc_score: 0.7756
+2025-09-23 17:34:28,238 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Global step of best model: 588
+2025-09-23 17:34:28,808 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.7756
+2025-09-23 17:34:46,151 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1376 | Val mean-roc_auc_score: 0.7742
+2025-09-23 17:35:04,403 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.1297 | Val mean-roc_auc_score: 0.7677
+2025-09-23 17:35:24,388 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.1168 | Val mean-roc_auc_score: 0.7702
+2025-09-23 17:35:43,450 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.1042 | Val mean-roc_auc_score: 0.7673
+2025-09-23 17:36:02,744 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0919 | Val mean-roc_auc_score: 0.7590
+2025-09-23 17:36:20,575 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0830 | Val mean-roc_auc_score: 0.7518
+2025-09-23 17:36:39,536 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0708 | Val mean-roc_auc_score: 0.7424
+2025-09-23 17:36:59,351 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0617 | Val mean-roc_auc_score: 0.7377
+2025-09-23 17:37:18,505 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0508 | Val mean-roc_auc_score: 0.7406
+2025-09-23 17:37:37,738 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0449 | Val mean-roc_auc_score: 0.7371
+2025-09-23 17:37:55,810 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0426 | Val mean-roc_auc_score: 0.7341
+2025-09-23 17:38:14,583 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0383 | Val mean-roc_auc_score: 0.7319
+2025-09-23 17:38:33,975 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0315 | Val mean-roc_auc_score: 0.7300
+2025-09-23 17:38:53,414 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0342 | Val mean-roc_auc_score: 0.7300
+2025-09-23 17:39:11,797 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0289 | Val mean-roc_auc_score: 0.7295
+2025-09-23 17:39:30,697 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0257 | Val mean-roc_auc_score: 0.7291
+2025-09-23 17:39:49,962 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0234 | Val mean-roc_auc_score: 0.7324
+2025-09-23 17:40:09,476 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0245 | Val mean-roc_auc_score: 0.7342
+2025-09-23 17:40:28,571 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0186 | Val mean-roc_auc_score: 0.7326
+2025-09-23 17:40:46,010 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0166 | Val mean-roc_auc_score: 0.7353
+2025-09-23 17:41:04,301 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0222 | Val mean-roc_auc_score: 0.7287
+2025-09-23 17:41:23,175 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0155 | Val mean-roc_auc_score: 0.7321
+2025-09-23 17:41:43,245 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0158 | Val mean-roc_auc_score: 0.7291
+2025-09-23 17:42:02,563 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0145 | Val mean-roc_auc_score: 0.7293
+2025-09-23 17:42:20,433 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0129 | Val mean-roc_auc_score: 0.7288
+2025-09-23 17:42:39,583 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0146 | Val mean-roc_auc_score: 0.7305
+2025-09-23 17:42:57,914 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0121 | Val mean-roc_auc_score: 0.7284
+2025-09-23 17:43:17,482 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0116 | Val mean-roc_auc_score: 0.7260
+2025-09-23 17:43:35,436 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0125 | Val mean-roc_auc_score: 0.7259
+2025-09-23 17:43:54,426 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0102 | Val mean-roc_auc_score: 0.7254
+2025-09-23 17:44:13,441 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0121 | Val mean-roc_auc_score: 0.7281
+2025-09-23 17:44:32,250 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0096 | Val mean-roc_auc_score: 0.7258
+2025-09-23 17:44:51,847 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0099 | Val mean-roc_auc_score: 0.7285
+2025-09-23 17:45:09,494 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0102 | Val mean-roc_auc_score: 0.7281
+2025-09-23 17:45:28,291 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0096 | Val mean-roc_auc_score: 0.7288
+2025-09-23 17:45:46,101 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0102 | Val mean-roc_auc_score: 0.7291
+2025-09-23 17:46:05,226 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0092 | Val mean-roc_auc_score: 0.7282
+2025-09-23 17:46:25,057 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0092 | Val mean-roc_auc_score: 0.7278
+2025-09-23 17:46:43,455 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0088 | Val mean-roc_auc_score: 0.7268
+2025-09-23 17:47:02,018 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0096 | Val mean-roc_auc_score: 0.7259
+2025-09-23 17:47:20,369 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0085 | Val mean-roc_auc_score: 0.7251
+2025-09-23 17:47:39,327 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7275
+2025-09-23 17:47:58,972 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0094 | Val mean-roc_auc_score: 0.7294
+2025-09-23 17:48:17,315 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0064 | Val mean-roc_auc_score: 0.7273
+2025-09-23 17:48:35,694 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0082 | Val mean-roc_auc_score: 0.7256
+2025-09-23 17:48:54,651 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0095 | Val mean-roc_auc_score: 0.7276
+2025-09-23 17:49:13,636 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0084 | Val mean-roc_auc_score: 0.7276
+2025-09-23 17:49:31,401 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0088 | Val mean-roc_auc_score: 0.7272
+2025-09-23 17:49:52,219 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.7260
+2025-09-23 17:50:09,993 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0071 | Val mean-roc_auc_score: 0.7264
+2025-09-23 17:50:28,936 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0084 | Val mean-roc_auc_score: 0.7254
+2025-09-23 17:50:47,589 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0078 | Val mean-roc_auc_score: 0.7279
+2025-09-23 17:51:04,557 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0080 | Val mean-roc_auc_score: 0.7239
+2025-09-23 17:51:24,268 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0072 | Val mean-roc_auc_score: 0.7250
+2025-09-23 17:51:43,286 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.7261
+2025-09-23 17:52:02,417 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0081 | Val mean-roc_auc_score: 0.7227
+2025-09-23 17:52:20,604 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.7257
+2025-09-23 17:52:38,288 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0068 | Val mean-roc_auc_score: 0.7261
+2025-09-23 17:52:58,498 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.7266
+2025-09-23 17:53:17,499 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7252
+2025-09-23 17:53:36,444 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7248
+2025-09-23 17:53:53,924 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0067 | Val mean-roc_auc_score: 0.7227
+2025-09-23 17:54:12,894 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.7234
+2025-09-23 17:54:32,758 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7244
+2025-09-23 17:54:51,410 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.7246
+2025-09-23 17:55:10,308 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.7231
+2025-09-23 17:55:27,397 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.7230
+2025-09-23 17:55:45,523 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0064 | Val mean-roc_auc_score: 0.7231
+2025-09-23 17:56:06,189 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7245
+2025-09-23 17:56:24,946 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7248
+2025-09-23 17:56:43,793 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7246
+2025-09-23 17:57:01,812 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0066 | Val mean-roc_auc_score: 0.7246
+2025-09-23 17:57:20,604 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0062 | Val mean-roc_auc_score: 0.7221
+2025-09-23 17:57:40,827 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7231
+2025-09-23 17:57:59,322 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.7240
+2025-09-23 17:58:16,786 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7219
+2025-09-23 17:58:34,957 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.7232
+2025-09-23 17:58:53,727 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7240
+2025-09-23 17:59:13,551 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0054 | Val mean-roc_auc_score: 0.7249
+2025-09-23 17:59:32,603 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.7250
+2025-09-23 17:59:50,176 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7245
+2025-09-23 18:00:08,491 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7248
+2025-09-23 18:00:27,722 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7254
+2025-09-23 18:00:48,192 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.7253
+2025-09-23 18:01:06,085 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.7270
+2025-09-23 18:01:23,374 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0062 | Val mean-roc_auc_score: 0.7250
+2025-09-23 18:01:41,953 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.7252
+2025-09-23 18:02:00,821 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0045 | Val mean-roc_auc_score: 0.7249
+2025-09-23 18:02:21,421 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0054 | Val mean-roc_auc_score: 0.7245
+2025-09-23 18:02:39,172 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7243
+2025-09-23 18:02:57,502 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7259
+2025-09-23 18:03:15,619 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0043 | Val mean-roc_auc_score: 0.7260
+2025-09-23 18:03:34,412 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.7245
+2025-09-23 18:03:55,044 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7242
+2025-09-23 18:04:12,064 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0043 | Val mean-roc_auc_score: 0.7249
+2025-09-23 18:04:30,362 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7246
+2025-09-23 18:04:49,180 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7245
+2025-09-23 18:04:50,726 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.7636
+2025-09-23 18:04:51,155 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset tox21 at 2025-09-23_18-04-51
+2025-09-23 18:05:08,649 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.1745 | Val mean-roc_auc_score: 0.7520
+2025-09-23 18:05:08,649 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Global step of best model: 196
+2025-09-23 18:05:09,176 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.7520
+2025-09-23 18:05:27,941 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.1583 | Val mean-roc_auc_score: 0.7595
+2025-09-23 18:05:28,109 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Global step of best model: 392
+2025-09-23 18:05:28,633 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.7595
+2025-09-23 18:05:46,375 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1449 | Val mean-roc_auc_score: 0.7720
+2025-09-23 18:05:46,548 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Global step of best model: 588
+2025-09-23 18:05:47,077 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.7720
+2025-09-23 18:06:05,622 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1310 | Val mean-roc_auc_score: 0.7539
+2025-09-23 18:06:24,225 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.1266 | Val mean-roc_auc_score: 0.7647
+2025-09-23 18:06:44,308 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.1176 | Val mean-roc_auc_score: 0.7575
+2025-09-23 18:07:02,227 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.1011 | Val mean-roc_auc_score: 0.7458
+2025-09-23 18:07:21,228 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0873 | Val mean-roc_auc_score: 0.7509
+2025-09-23 18:07:39,881 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0771 | Val mean-roc_auc_score: 0.7495
+2025-09-23 18:07:59,102 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0648 | Val mean-roc_auc_score: 0.7486
+2025-09-23 18:08:18,694 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0622 | Val mean-roc_auc_score: 0.7457
+2025-09-23 18:08:36,225 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0508 | Val mean-roc_auc_score: 0.7368
+2025-09-23 18:08:54,890 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0449 | Val mean-roc_auc_score: 0.7290
+2025-09-23 18:09:13,086 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0421 | Val mean-roc_auc_score: 0.7355
+2025-09-23 18:09:31,792 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0359 | Val mean-roc_auc_score: 0.7323
+2025-09-23 18:09:51,253 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0321 | Val mean-roc_auc_score: 0.7277
+2025-09-23 18:10:09,484 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0275 | Val mean-roc_auc_score: 0.7304
+2025-09-23 18:10:27,859 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0264 | Val mean-roc_auc_score: 0.7241
+2025-09-23 18:10:46,512 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0254 | Val mean-roc_auc_score: 0.7251
+2025-09-23 18:11:05,654 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0228 | Val mean-roc_auc_score: 0.7215
+2025-09-23 18:11:24,445 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0210 | Val mean-roc_auc_score: 0.7310
+2025-09-23 18:11:43,944 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0201 | Val mean-roc_auc_score: 0.7266
+2025-09-23 18:12:02,660 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0171 | Val mean-roc_auc_score: 0.7241
+2025-09-23 18:12:20,899 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0151 | Val mean-roc_auc_score: 0.7259
+2025-09-23 18:12:39,585 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0158 | Val mean-roc_auc_score: 0.7263
+2025-09-23 18:12:58,391 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0147 | Val mean-roc_auc_score: 0.7230
+2025-09-23 18:13:17,116 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0144 | Val mean-roc_auc_score: 0.7246
+2025-09-23 18:13:36,230 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0138 | Val mean-roc_auc_score: 0.7230
+2025-09-23 18:13:54,986 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0126 | Val mean-roc_auc_score: 0.7204
+2025-09-23 18:14:13,469 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0117 | Val mean-roc_auc_score: 0.7197
+2025-09-23 18:14:32,259 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0125 | Val mean-roc_auc_score: 0.7215
+2025-09-23 18:14:51,629 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0109 | Val mean-roc_auc_score: 0.7214
+2025-09-23 18:15:10,608 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0109 | Val mean-roc_auc_score: 0.7216
+2025-09-23 18:15:29,062 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0117 | Val mean-roc_auc_score: 0.7176
+2025-09-23 18:15:46,538 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0105 | Val mean-roc_auc_score: 0.7168
+2025-09-23 18:16:06,538 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0100 | Val mean-roc_auc_score: 0.7186
+2025-09-23 18:16:25,699 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0102 | Val mean-roc_auc_score: 0.7225
+2025-09-23 18:16:44,564 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0107 | Val mean-roc_auc_score: 0.7200
+2025-09-23 18:17:02,581 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0105 | Val mean-roc_auc_score: 0.7187
+2025-09-23 18:17:19,434 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0092 | Val mean-roc_auc_score: 0.7194
+2025-09-23 18:17:39,478 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0102 | Val mean-roc_auc_score: 0.7207
+2025-09-23 18:17:58,075 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0099 | Val mean-roc_auc_score: 0.7158
+2025-09-23 18:18:17,033 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0093 | Val mean-roc_auc_score: 0.7180
+2025-09-23 18:18:35,575 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0092 | Val mean-roc_auc_score: 0.7209
+2025-09-23 18:18:52,896 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0115 | Val mean-roc_auc_score: 0.7194
+2025-09-23 18:19:12,569 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0075 | Val mean-roc_auc_score: 0.7177
+2025-09-23 18:19:31,960 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0074 | Val mean-roc_auc_score: 0.7184
+2025-09-23 18:19:50,511 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7192
+2025-09-23 18:20:08,839 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.7186
+2025-09-23 18:20:27,224 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.7189
+2025-09-23 18:20:45,961 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.7187
+2025-09-23 18:21:05,782 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0078 | Val mean-roc_auc_score: 0.7191
+2025-09-23 18:21:24,157 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0071 | Val mean-roc_auc_score: 0.7185
+2025-09-23 18:21:41,696 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0084 | Val mean-roc_auc_score: 0.7180
+2025-09-23 18:22:00,666 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7206
+2025-09-23 18:22:19,416 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.7198
+2025-09-23 18:22:39,789 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0066 | Val mean-roc_auc_score: 0.7190
+2025-09-23 18:22:57,978 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.7202
+2025-09-23 18:23:15,061 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0067 | Val mean-roc_auc_score: 0.7201
+2025-09-23 18:23:33,251 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.7205
+2025-09-23 18:23:52,230 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.7183
+2025-09-23 18:24:12,564 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0066 | Val mean-roc_auc_score: 0.7199
+2025-09-23 18:24:30,983 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.7195
+2025-09-23 18:24:49,350 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7189
+2025-09-23 18:25:08,266 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.7189
+2025-09-23 18:25:26,551 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0067 | Val mean-roc_auc_score: 0.7183
+2025-09-23 18:25:46,988 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7189
+2025-09-23 18:26:04,714 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7181
+2025-09-23 18:26:23,572 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0064 | Val mean-roc_auc_score: 0.7181
+2025-09-23 18:26:42,780 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7175
+2025-09-23 18:27:01,295 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7193
+2025-09-23 18:27:21,276 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0066 | Val mean-roc_auc_score: 0.7181
+2025-09-23 18:27:38,906 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.7178
+2025-09-23 18:27:57,580 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.7177
+2025-09-23 18:28:15,962 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7166
+2025-09-23 18:28:34,335 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0054 | Val mean-roc_auc_score: 0.7174
+2025-09-23 18:28:54,206 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7175
+2025-09-23 18:29:13,121 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7180
+2025-09-23 18:29:31,947 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7174
+2025-09-23 18:29:50,278 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7169
+2025-09-23 18:30:08,753 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7182
+2025-09-23 18:30:27,894 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7176
+2025-09-23 18:30:46,318 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.7175
+2025-09-23 18:31:04,566 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0056 | Val mean-roc_auc_score: 0.7174
+2025-09-23 18:31:23,142 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7172
+2025-09-23 18:31:42,386 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7171
+2025-09-23 18:32:01,584 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.7190
+2025-09-23 18:32:20,595 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7168
+2025-09-23 18:32:38,679 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.7170
+2025-09-23 18:32:57,067 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7188
+2025-09-23 18:33:15,614 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7151
+2025-09-23 18:33:35,968 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7185
+2025-09-23 18:33:55,012 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0041 | Val mean-roc_auc_score: 0.7179
+2025-09-23 18:34:13,472 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0044 | Val mean-roc_auc_score: 0.7168
+2025-09-23 18:34:31,821 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.7173
+2025-09-23 18:34:48,901 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0042 | Val mean-roc_auc_score: 0.7170
+2025-09-23 18:35:08,668 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0038 | Val mean-roc_auc_score: 0.7168
+2025-09-23 18:35:27,429 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7183
+2025-09-23 18:35:46,285 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0054 | Val mean-roc_auc_score: 0.7167
+2025-09-23 18:36:05,274 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0047 | Val mean-roc_auc_score: 0.7159
+2025-09-23 18:36:06,786 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.7604
+2025-09-23 18:36:07,249 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset tox21 at 2025-09-23_18-36-07
+2025-09-23 18:36:23,311 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.1771 | Val mean-roc_auc_score: 0.7512
+2025-09-23 18:36:23,311 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Global step of best model: 196
+2025-09-23 18:36:23,878 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val mean-roc_auc_score: 0.7512
+2025-09-23 18:36:42,783 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.1576 | Val mean-roc_auc_score: 0.7611
+2025-09-23 18:36:42,960 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Global step of best model: 392
+2025-09-23 18:36:43,499 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val mean-roc_auc_score: 0.7611
+2025-09-23 18:37:02,046 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1477 | Val mean-roc_auc_score: 0.7746
+2025-09-23 18:37:02,241 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Global step of best model: 588
+2025-09-23 18:37:02,777 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val mean-roc_auc_score: 0.7746
+2025-09-23 18:37:21,776 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1295 | Val mean-roc_auc_score: 0.7847
+2025-09-23 18:37:21,921 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Global step of best model: 784
+2025-09-23 18:37:22,444 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val mean-roc_auc_score: 0.7847
+2025-09-23 18:37:40,039 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.1250 | Val mean-roc_auc_score: 0.7801
+2025-09-23 18:37:59,233 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.1086 | Val mean-roc_auc_score: 0.7778
+2025-09-23 18:38:18,367 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0998 | Val mean-roc_auc_score: 0.7567
+2025-09-23 18:38:37,112 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0924 | Val mean-roc_auc_score: 0.7563
+2025-09-23 18:38:55,965 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0757 | Val mean-roc_auc_score: 0.7505
+2025-09-23 18:39:12,972 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0664 | Val mean-roc_auc_score: 0.7460
+2025-09-23 18:39:32,424 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0552 | Val mean-roc_auc_score: 0.7444
+2025-09-23 18:39:51,384 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0481 | Val mean-roc_auc_score: 0.7498
+2025-09-23 18:40:10,527 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0439 | Val mean-roc_auc_score: 0.7386
+2025-09-23 18:40:29,276 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0392 | Val mean-roc_auc_score: 0.7396
+2025-09-23 18:40:46,951 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0373 | Val mean-roc_auc_score: 0.7339
+2025-09-23 18:41:06,502 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0286 | Val mean-roc_auc_score: 0.7411
+2025-09-23 18:41:25,381 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0289 | Val mean-roc_auc_score: 0.7367
+2025-09-23 18:41:44,144 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0264 | Val mean-roc_auc_score: 0.7317
+2025-09-23 18:42:02,377 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0244 | Val mean-roc_auc_score: 0.7377
+2025-09-23 18:42:21,055 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0233 | Val mean-roc_auc_score: 0.7336
+2025-09-23 18:42:40,665 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0240 | Val mean-roc_auc_score: 0.7400
+2025-09-23 18:43:00,240 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0203 | Val mean-roc_auc_score: 0.7368
+2025-09-23 18:43:18,661 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0159 | Val mean-roc_auc_score: 0.7362
+2025-09-23 18:43:35,978 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0192 | Val mean-roc_auc_score: 0.7358
+2025-09-23 18:43:54,592 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0155 | Val mean-roc_auc_score: 0.7347
+2025-09-23 18:44:14,299 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0142 | Val mean-roc_auc_score: 0.7374
+2025-09-23 18:44:34,023 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0138 | Val mean-roc_auc_score: 0.7361
+2025-09-23 18:44:52,145 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0131 | Val mean-roc_auc_score: 0.7385
+2025-09-23 18:45:08,680 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0131 | Val mean-roc_auc_score: 0.7388
+2025-09-23 18:45:27,546 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0135 | Val mean-roc_auc_score: 0.7351
+2025-09-23 18:45:47,566 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0135 | Val mean-roc_auc_score: 0.7311
+2025-09-23 18:46:06,924 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0133 | Val mean-roc_auc_score: 0.7366
+2025-09-23 18:46:24,239 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0110 | Val mean-roc_auc_score: 0.7360
+2025-09-23 18:46:42,412 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0109 | Val mean-roc_auc_score: 0.7359
+2025-09-23 18:47:00,676 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0104 | Val mean-roc_auc_score: 0.7348
+2025-09-23 18:47:20,696 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0096 | Val mean-roc_auc_score: 0.7328
+2025-09-23 18:47:40,147 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0099 | Val mean-roc_auc_score: 0.7316
+2025-09-23 18:47:56,970 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0107 | Val mean-roc_auc_score: 0.7330
+2025-09-23 18:48:15,123 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0091 | Val mean-roc_auc_score: 0.7333
+2025-09-23 18:48:33,797 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0081 | Val mean-roc_auc_score: 0.7335
+2025-09-23 18:48:54,183 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0101 | Val mean-roc_auc_score: 0.7336
+2025-09-23 18:49:13,175 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0103 | Val mean-roc_auc_score: 0.7325
+2025-09-23 18:49:30,873 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0090 | Val mean-roc_auc_score: 0.7323
+2025-09-23 18:49:49,778 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0090 | Val mean-roc_auc_score: 0.7335
+2025-09-23 18:50:08,137 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0084 | Val mean-roc_auc_score: 0.7355
+2025-09-23 18:50:28,306 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0077 | Val mean-roc_auc_score: 0.7325
+2025-09-23 18:50:46,880 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0071 | Val mean-roc_auc_score: 0.7320
+2025-09-23 18:51:04,753 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0093 | Val mean-roc_auc_score: 0.7329
+2025-09-23 18:51:23,550 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0066 | Val mean-roc_auc_score: 0.7327
+2025-09-23 18:51:41,812 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0073 | Val mean-roc_auc_score: 0.7290
+2025-09-23 18:52:00,300 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0074 | Val mean-roc_auc_score: 0.7346
+2025-09-23 18:52:19,858 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0081 | Val mean-roc_auc_score: 0.7343
+2025-09-23 18:52:38,498 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0075 | Val mean-roc_auc_score: 0.7335
+2025-09-23 18:52:57,683 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0067 | Val mean-roc_auc_score: 0.7336
+2025-09-23 18:53:16,024 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7330
+2025-09-23 18:53:34,294 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.7346
+2025-09-23 18:53:53,370 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7338
+2025-09-23 18:54:12,198 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7347
+2025-09-23 18:54:31,226 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0067 | Val mean-roc_auc_score: 0.7348
+2025-09-23 18:54:50,302 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0068 | Val mean-roc_auc_score: 0.7346
+2025-09-23 18:55:08,088 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0065 | Val mean-roc_auc_score: 0.7351
+2025-09-23 18:55:27,599 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0064 | Val mean-roc_auc_score: 0.7357
+2025-09-23 18:55:45,975 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7346
+2025-09-23 18:56:04,721 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0070 | Val mean-roc_auc_score: 0.7333
+2025-09-23 18:56:23,264 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0064 | Val mean-roc_auc_score: 0.7321
+2025-09-23 18:56:41,452 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7331
+2025-09-23 18:57:02,278 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7336
+2025-09-23 18:57:20,516 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.7327
+2025-09-23 18:57:39,571 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7346
+2025-09-23 18:57:57,919 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7325
+2025-09-23 18:58:15,674 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7311
+2025-09-23 18:58:36,416 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0063 | Val mean-roc_auc_score: 0.7312
+2025-09-23 18:58:55,518 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0068 | Val mean-roc_auc_score: 0.7332
+2025-09-23 18:59:13,810 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0065 | Val mean-roc_auc_score: 0.7345
+2025-09-23 18:59:31,905 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0059 | Val mean-roc_auc_score: 0.7352
+2025-09-23 18:59:48,937 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7341
+2025-09-23 19:00:09,265 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7364
+2025-09-23 19:00:28,137 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7356
+2025-09-23 19:00:46,606 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7361
+2025-09-23 19:01:04,823 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7342
+2025-09-23 19:01:23,100 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0057 | Val mean-roc_auc_score: 0.7362
+2025-09-23 19:01:44,054 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7341
+2025-09-23 19:02:02,210 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0051 | Val mean-roc_auc_score: 0.7343
+2025-09-23 19:02:21,204 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7340
+2025-09-23 19:02:38,914 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0060 | Val mean-roc_auc_score: 0.7314
+2025-09-23 19:02:57,701 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0053 | Val mean-roc_auc_score: 0.7340
+2025-09-23 19:03:18,543 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0057 | Val mean-roc_auc_score: 0.7341
+2025-09-23 19:03:36,948 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0061 | Val mean-roc_auc_score: 0.7345
+2025-09-23 19:03:55,031 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0055 | Val mean-roc_auc_score: 0.7352
+2025-09-23 19:04:11,858 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0048 | Val mean-roc_auc_score: 0.7351
+2025-09-23 19:04:30,112 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0046 | Val mean-roc_auc_score: 0.7341
+2025-09-23 19:04:50,608 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0042 | Val mean-roc_auc_score: 0.7349
+2025-09-23 19:05:09,141 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0045 | Val mean-roc_auc_score: 0.7339
+2025-09-23 19:05:27,468 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.7324
+2025-09-23 19:05:45,882 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0052 | Val mean-roc_auc_score: 0.7347
+2025-09-23 19:06:04,908 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0058 | Val mean-roc_auc_score: 0.7336
+2025-09-23 19:06:24,522 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0069 | Val mean-roc_auc_score: 0.7315
+2025-09-23 19:06:43,316 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0035 | Val mean-roc_auc_score: 0.7334
+2025-09-23 19:07:00,711 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0057 | Val mean-roc_auc_score: 0.7339
+2025-09-23 19:07:19,539 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0049 | Val mean-roc_auc_score: 0.7328
+2025-09-23 19:07:21,101 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Test mean-roc_auc_score: 0.7697
+2025-09-23 19:07:21,601 - logs_modchembert_tox21_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg mean-roc_auc_score: 0.7646, Std Dev: 0.0039

logs_modchembert_regression_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_bace_regression_epochs100_batch_size32_20250923_153243.log

@@ -0,0 +1,327 @@
+2025-09-23 15:32:43,020 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Running benchmark for dataset: bace_regression
+2025-09-23 15:32:43,020 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - dataset: bace_regression, tasks: ['pIC50'], epochs: 100, learning rate: 3e-05, transform: True
+2025-09-23 15:32:43,025 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset bace_regression at 2025-09-23_15-32-43
+2025-09-23 15:32:48,494 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.7632 | Val rms_score: 0.5624
+2025-09-23 15:32:48,494 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Global step of best model: 38
+2025-09-23 15:32:49,035 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 0.5624
+2025-09-23 15:32:52,586 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.3947 | Val rms_score: 0.6616
+2025-09-23 15:32:56,081 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.3058 | Val rms_score: 0.7009
+2025-09-23 15:32:59,792 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.2368 | Val rms_score: 0.7269
+2025-09-23 15:33:04,929 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.2220 | Val rms_score: 0.6853
+2025-09-23 15:33:09,844 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.1931 | Val rms_score: 0.7314
+2025-09-23 15:33:14,991 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.1719 | Val rms_score: 0.6990
+2025-09-23 15:33:20,066 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.1533 | Val rms_score: 0.5772
+2025-09-23 15:33:24,946 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.1316 | Val rms_score: 0.6658
+2025-09-23 15:33:29,656 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.1299 | Val rms_score: 0.7158
+2025-09-23 15:33:34,476 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.1372 | Val rms_score: 0.5717
+2025-09-23 15:33:39,691 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.1143 | Val rms_score: 0.7283
+2025-09-23 15:33:44,782 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0975 | Val rms_score: 0.7408
+2025-09-23 15:33:49,795 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.1030 | Val rms_score: 0.7165
+2025-09-23 15:33:54,854 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0921 | Val rms_score: 0.6376
+2025-09-23 15:34:00,066 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0737 | Val rms_score: 0.7195
+2025-09-23 15:34:05,511 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0843 | Val rms_score: 0.6892
+2025-09-23 15:34:10,806 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0785 | Val rms_score: 0.7086
+2025-09-23 15:34:15,451 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0771 | Val rms_score: 0.6359
+2025-09-23 15:34:19,920 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0699 | Val rms_score: 0.6803
+2025-09-23 15:34:24,789 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0678 | Val rms_score: 0.5871
+2025-09-23 15:34:30,136 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0647 | Val rms_score: 0.6301
+2025-09-23 15:34:35,216 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0658 | Val rms_score: 0.7528
+2025-09-23 15:34:40,251 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0671 | Val rms_score: 0.6838
+2025-09-23 15:34:45,375 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0604 | Val rms_score: 0.6878
+2025-09-23 15:34:50,520 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0576 | Val rms_score: 0.6815
+2025-09-23 15:34:56,792 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0550 | Val rms_score: 0.7233
+2025-09-23 15:35:01,875 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0539 | Val rms_score: 0.6768
+2025-09-23 15:35:07,045 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0454 | Val rms_score: 0.7266
+2025-09-23 15:35:12,192 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0535 | Val rms_score: 0.6604
+2025-09-23 15:35:17,378 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0485 | Val rms_score: 0.6930
+2025-09-23 15:35:22,700 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0417 | Val rms_score: 0.6955
+2025-09-23 15:35:27,733 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0440 | Val rms_score: 0.6438
+2025-09-23 15:35:32,770 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0430 | Val rms_score: 0.6804
+2025-09-23 15:35:37,449 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0383 | Val rms_score: 0.6678
+2025-09-23 15:35:42,200 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0356 | Val rms_score: 0.6577
+2025-09-23 15:35:47,066 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0360 | Val rms_score: 0.6738
+2025-09-23 15:35:52,290 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0339 | Val rms_score: 0.6651
+2025-09-23 15:35:57,432 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0399 | Val rms_score: 0.6800
+2025-09-23 15:36:02,539 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0365 | Val rms_score: 0.6859
+2025-09-23 15:36:07,657 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0343 | Val rms_score: 0.6738
+2025-09-23 15:36:12,956 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0358 | Val rms_score: 0.6908
+2025-09-23 15:36:18,050 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0342 | Val rms_score: 0.6802
+2025-09-23 15:36:23,119 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0312 | Val rms_score: 0.6927
+2025-09-23 15:36:28,224 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0404 | Val rms_score: 0.6842
+2025-09-23 15:36:33,247 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0327 | Val rms_score: 0.6683
+2025-09-23 15:36:38,482 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0304 | Val rms_score: 0.6857
+2025-09-23 15:36:43,590 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0285 | Val rms_score: 0.6669
+2025-09-23 15:36:48,668 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0294 | Val rms_score: 0.6803
+2025-09-23 15:36:53,838 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0329 | Val rms_score: 0.7074
+2025-09-23 15:36:59,058 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0312 | Val rms_score: 0.6897
+2025-09-23 15:37:04,056 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0302 | Val rms_score: 0.6886
+2025-09-23 15:37:09,875 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0312 | Val rms_score: 0.6550
+2025-09-23 15:37:14,099 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0273 | Val rms_score: 0.6783
+2025-09-23 15:37:19,309 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0288 | Val rms_score: 0.6834
+2025-09-23 15:37:24,532 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0283 | Val rms_score: 0.6736
+2025-09-23 15:37:30,009 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0240 | Val rms_score: 0.6733
+2025-09-23 15:37:35,307 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0247 | Val rms_score: 0.6650
+2025-09-23 15:37:40,645 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0251 | Val rms_score: 0.6875
+2025-09-23 15:37:45,965 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0232 | Val rms_score: 0.6929
+2025-09-23 15:37:51,267 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0235 | Val rms_score: 0.6898
+2025-09-23 15:37:56,858 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0219 | Val rms_score: 0.6766
+2025-09-23 15:38:02,177 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0212 | Val rms_score: 0.6698
+2025-09-23 15:38:07,477 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0238 | Val rms_score: 0.6865
+2025-09-23 15:38:12,701 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0212 | Val rms_score: 0.6712
+2025-09-23 15:38:17,989 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0255 | Val rms_score: 0.7072
+2025-09-23 15:38:23,298 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0182 | Val rms_score: 0.7080
+2025-09-23 15:38:27,933 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0194 | Val rms_score: 0.6749
+2025-09-23 15:38:33,107 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0173 | Val rms_score: 0.6834
+2025-09-23 15:38:37,608 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0193 | Val rms_score: 0.6941
+2025-09-23 15:38:42,011 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0228 | Val rms_score: 0.6768
+2025-09-23 15:38:47,610 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0178 | Val rms_score: 0.6620
+2025-09-23 15:38:52,908 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0183 | Val rms_score: 0.6831
+2025-09-23 15:38:58,179 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0169 | Val rms_score: 0.6882
+2025-09-23 15:39:03,464 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0172 | Val rms_score: 0.6658
+2025-09-23 15:39:08,652 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0164 | Val rms_score: 0.6934
+2025-09-23 15:39:13,996 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0154 | Val rms_score: 0.6906
+2025-09-23 15:39:19,156 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0177 | Val rms_score: 0.6820
+2025-09-23 15:39:25,388 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0167 | Val rms_score: 0.6765
+2025-09-23 15:39:30,689 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0167 | Val rms_score: 0.7093
+2025-09-23 15:39:36,051 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0162 | Val rms_score: 0.6856
+2025-09-23 15:39:41,575 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0184 | Val rms_score: 0.6814
+2025-09-23 15:39:46,704 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0161 | Val rms_score: 0.7072
+2025-09-23 15:39:51,862 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0154 | Val rms_score: 0.7001
+2025-09-23 15:39:57,016 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0149 | Val rms_score: 0.6772
+2025-09-23 15:40:02,205 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0149 | Val rms_score: 0.7069
+2025-09-23 15:40:06,944 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0158 | Val rms_score: 0.6876
+2025-09-23 15:40:11,917 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0150 | Val rms_score: 0.6641
+2025-09-23 15:40:17,147 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0148 | Val rms_score: 0.6687
+2025-09-23 15:40:22,414 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0133 | Val rms_score: 0.6735
+2025-09-23 15:40:27,627 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0148 | Val rms_score: 0.6736
+2025-09-23 15:40:33,071 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0143 | Val rms_score: 0.6757
+2025-09-23 15:40:38,455 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0136 | Val rms_score: 0.6999
+2025-09-23 15:40:43,790 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0139 | Val rms_score: 0.6507
+2025-09-23 15:40:49,158 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0147 | Val rms_score: 0.7008
+2025-09-23 15:40:54,484 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0143 | Val rms_score: 0.6737
+2025-09-23 15:41:00,029 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0154 | Val rms_score: 0.7119
+2025-09-23 15:41:05,354 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0136 | Val rms_score: 0.6760
+2025-09-23 15:41:10,604 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0125 | Val rms_score: 0.6896
+2025-09-23 15:41:15,687 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0142 | Val rms_score: 0.7089
+2025-09-23 15:41:16,195 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Test rms_score: 1.1898
+2025-09-23 15:41:16,518 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset bace_regression at 2025-09-23_15-41-16
+2025-09-23 15:41:20,980 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.6974 | Val rms_score: 0.9186
+2025-09-23 15:41:20,980 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Global step of best model: 38
+2025-09-23 15:41:21,498 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 0.9186
+2025-09-23 15:41:26,676 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.3964 | Val rms_score: 0.7411
+2025-09-23 15:41:26,846 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Global step of best model: 76
+2025-09-23 15:41:27,364 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 0.7411
+2025-09-23 15:41:31,966 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.2489 | Val rms_score: 0.6450
+2025-09-23 15:41:32,144 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Global step of best model: 114
+2025-09-23 15:41:32,661 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val rms_score: 0.6450
+2025-09-23 15:41:37,292 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.2434 | Val rms_score: 0.8176
+2025-09-23 15:41:42,578 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.2122 | Val rms_score: 0.6907
+2025-09-23 15:41:47,890 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.1908 | Val rms_score: 0.6564
+2025-09-23 15:41:53,369 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.1711 | Val rms_score: 0.6508
+2025-09-23 15:41:58,708 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.1426 | Val rms_score: 0.7617
+2025-09-23 15:42:04,097 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.1365 | Val rms_score: 0.6979
+2025-09-23 15:42:09,437 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.1332 | Val rms_score: 0.6527
+2025-09-23 15:42:14,748 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.1354 | Val rms_score: 0.6267
+2025-09-23 15:42:15,139 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Global step of best model: 418
+2025-09-23 15:42:15,657 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Best model saved at epoch 11 with val rms_score: 0.6267
+2025-09-23 15:42:20,934 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.1192 | Val rms_score: 0.7037
+2025-09-23 15:42:26,272 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.1086 | Val rms_score: 0.7363
+2025-09-23 15:42:31,513 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.1094 | Val rms_score: 0.6679
+2025-09-23 15:42:36,848 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0863 | Val rms_score: 0.6946
+2025-09-23 15:42:41,893 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.1328 | Val rms_score: 0.7521
+2025-09-23 15:42:47,200 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0859 | Val rms_score: 0.7342
+2025-09-23 15:42:52,385 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0818 | Val rms_score: 0.7761
+2025-09-23 15:42:57,469 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0923 | Val rms_score: 0.7018
+2025-09-23 15:43:02,141 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0740 | Val rms_score: 0.6657
+2025-09-23 15:43:07,357 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0711 | Val rms_score: 0.6469
+2025-09-23 15:43:12,874 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0690 | Val rms_score: 0.6512
+2025-09-23 15:43:18,108 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0637 | Val rms_score: 0.7320
+2025-09-23 15:43:23,367 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0726 | Val rms_score: 0.7052
+2025-09-23 15:43:28,559 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0596 | Val rms_score: 0.6870
+2025-09-23 15:43:33,721 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0572 | Val rms_score: 0.6872
+2025-09-23 15:43:40,122 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0574 | Val rms_score: 0.6982
+2025-09-23 15:43:45,332 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0547 | Val rms_score: 0.7532
+2025-09-23 15:43:50,601 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0608 | Val rms_score: 0.6930
+2025-09-23 15:43:55,851 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0530 | Val rms_score: 0.7312
+2025-09-23 15:44:01,169 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0629 | Val rms_score: 0.7510
+2025-09-23 15:44:06,665 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0530 | Val rms_score: 0.6868
+2025-09-23 15:44:11,797 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0471 | Val rms_score: 0.7292
+2025-09-23 15:44:17,027 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0440 | Val rms_score: 0.7075
+2025-09-23 15:44:22,310 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0471 | Val rms_score: 0.7303
+2025-09-23 15:44:26,818 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0430 | Val rms_score: 0.7473
+2025-09-23 15:44:31,833 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0472 | Val rms_score: 0.6988
+2025-09-23 15:44:36,932 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0428 | Val rms_score: 0.6654
+2025-09-23 15:44:42,131 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0419 | Val rms_score: 0.6527
+2025-09-23 15:44:47,266 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0373 | Val rms_score: 0.7055
+2025-09-23 15:44:52,567 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0380 | Val rms_score: 0.7422
+2025-09-23 15:44:58,109 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0397 | Val rms_score: 0.6912
+2025-09-23 15:45:03,339 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0363 | Val rms_score: 0.7056
+2025-09-23 15:45:08,629 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0341 | Val rms_score: 0.6903
+2025-09-23 15:45:13,925 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0336 | Val rms_score: 0.7452
+2025-09-23 15:45:19,169 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0337 | Val rms_score: 0.7156
+2025-09-23 15:45:24,650 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0325 | Val rms_score: 0.6792
+2025-09-23 15:45:29,865 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0301 | Val rms_score: 0.7047
+2025-09-23 15:45:34,450 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0315 | Val rms_score: 0.6809
+2025-09-23 15:45:39,552 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0302 | Val rms_score: 0.7062
+2025-09-23 15:45:44,604 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0284 | Val rms_score: 0.7306
+2025-09-23 15:45:49,898 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0298 | Val rms_score: 0.7384
+2025-09-23 15:45:55,358 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0336 | Val rms_score: 0.7346
+2025-09-23 15:46:00,168 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0286 | Val rms_score: 0.7196
+2025-09-23 15:46:05,286 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0259 | Val rms_score: 0.7441
+2025-09-23 15:46:10,554 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0285 | Val rms_score: 0.7334
+2025-09-23 15:46:16,043 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0259 | Val rms_score: 0.7017
+2025-09-23 15:46:21,259 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0378 | Val rms_score: 0.7236
+2025-09-23 15:46:26,459 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0247 | Val rms_score: 0.6944
+2025-09-23 15:46:31,646 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0269 | Val rms_score: 0.7314
+2025-09-23 15:46:36,952 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0229 | Val rms_score: 0.7089
+2025-09-23 15:46:42,389 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0218 | Val rms_score: 0.7093
+2025-09-23 15:46:47,523 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0254 | Val rms_score: 0.7227
+2025-09-23 15:46:52,764 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0251 | Val rms_score: 0.7468
+2025-09-23 15:46:57,882 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0223 | Val rms_score: 0.7313
+2025-09-23 15:47:02,920 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0275 | Val rms_score: 0.7066
+2025-09-23 15:47:08,250 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0240 | Val rms_score: 0.6740
+2025-09-23 15:47:13,305 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0237 | Val rms_score: 0.7361
+2025-09-23 15:47:18,325 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0281 | Val rms_score: 0.7128
+2025-09-23 15:47:22,973 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0265 | Val rms_score: 0.6856
+2025-09-23 15:47:27,841 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0236 | Val rms_score: 0.7115
+2025-09-23 15:47:33,156 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0216 | Val rms_score: 0.7244
+2025-09-23 15:47:38,169 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0248 | Val rms_score: 0.7479
+2025-09-23 15:47:43,217 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0199 | Val rms_score: 0.7119
+2025-09-23 15:47:48,377 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0184 | Val rms_score: 0.6887
+2025-09-23 15:47:53,606 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0215 | Val rms_score: 0.7163
+2025-09-23 15:47:59,072 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0195 | Val rms_score: 0.7179
+2025-09-23 15:48:04,373 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0193 | Val rms_score: 0.7196
+2025-09-23 15:48:10,529 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0286 | Val rms_score: 0.7270
+2025-09-23 15:48:15,758 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0173 | Val rms_score: 0.7112
+2025-09-23 15:48:20,904 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0179 | Val rms_score: 0.6911
+2025-09-23 15:48:26,427 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0210 | Val rms_score: 0.6950
+2025-09-23 15:48:31,634 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0188 | Val rms_score: 0.6803
+2025-09-23 15:48:36,946 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0193 | Val rms_score: 0.6832
+2025-09-23 15:48:42,175 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0198 | Val rms_score: 0.7017
+2025-09-23 15:48:47,225 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0174 | Val rms_score: 0.7098
+2025-09-23 15:48:52,265 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0113 | Val rms_score: 0.7193
+2025-09-23 15:48:57,300 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0173 | Val rms_score: 0.7061
+2025-09-23 15:49:02,455 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0159 | Val rms_score: 0.7302
+2025-09-23 15:49:07,541 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0183 | Val rms_score: 0.7146
+2025-09-23 15:49:12,782 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0174 | Val rms_score: 0.6915
+2025-09-23 15:49:18,253 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0182 | Val rms_score: 0.6979
+2025-09-23 15:49:23,527 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0152 | Val rms_score: 0.6995
+2025-09-23 15:49:28,922 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0172 | Val rms_score: 0.6947
+2025-09-23 15:49:34,283 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0193 | Val rms_score: 0.7109
+2025-09-23 15:49:39,488 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0171 | Val rms_score: 0.7071
+2025-09-23 15:49:45,279 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0176 | Val rms_score: 0.6884
+2025-09-23 15:49:50,001 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0166 | Val rms_score: 0.6828
+2025-09-23 15:49:55,276 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0143 | Val rms_score: 0.6850
+2025-09-23 15:50:00,488 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0146 | Val rms_score: 0.6954
+2025-09-23 15:50:01,037 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Test rms_score: 0.9253
+2025-09-23 15:50:01,366 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset bace_regression at 2025-09-23_15-50-01
+2025-09-23 15:50:06,289 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.7237 | Val rms_score: 0.7429
+2025-09-23 15:50:06,289 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Global step of best model: 38
+2025-09-23 15:50:06,833 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 0.7429
+2025-09-23 15:50:12,039 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.4161 | Val rms_score: 0.7291
+2025-09-23 15:50:12,205 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Global step of best model: 76
+2025-09-23 15:50:12,763 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 0.7291
+2025-09-23 15:50:17,224 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.3214 | Val rms_score: 0.6446
+2025-09-23 15:50:17,394 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Global step of best model: 114
+2025-09-23 15:50:17,915 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val rms_score: 0.6446
+2025-09-23 15:50:23,144 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.2615 | Val rms_score: 0.5852
+2025-09-23 15:50:23,321 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Global step of best model: 152
+2025-09-23 15:50:23,860 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val rms_score: 0.5852
+2025-09-23 15:50:29,121 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.2220 | Val rms_score: 0.5952
+2025-09-23 15:50:34,394 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.2065 | Val rms_score: 0.7065
+2025-09-23 15:50:39,910 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.1743 | Val rms_score: 0.6663
+2025-09-23 15:50:45,283 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.1973 | Val rms_score: 0.7485
+2025-09-23 15:50:50,592 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.1398 | Val rms_score: 0.6783
+2025-09-23 15:50:55,935 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.1357 | Val rms_score: 0.7064
+2025-09-23 15:51:01,252 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.1311 | Val rms_score: 0.6680
+2025-09-23 15:51:06,783 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.1127 | Val rms_score: 0.7236
+2025-09-23 15:51:12,034 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.1077 | Val rms_score: 0.7618
+2025-09-23 15:51:17,072 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0996 | Val rms_score: 0.8921
+2025-09-23 15:51:22,282 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0958 | Val rms_score: 0.8292
+2025-09-23 15:51:27,361 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.1162 | Val rms_score: 0.7961
+2025-09-23 15:51:32,717 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0839 | Val rms_score: 0.8269
+2025-09-23 15:51:37,806 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0872 | Val rms_score: 0.6972
+2025-09-23 15:51:42,285 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0778 | Val rms_score: 0.6379
+2025-09-23 15:51:46,806 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0744 | Val rms_score: 0.6533
+2025-09-23 15:51:51,947 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0810 | Val rms_score: 0.6750
+2025-09-23 15:51:57,526 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0642 | Val rms_score: 0.6953
+2025-09-23 15:52:02,748 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0609 | Val rms_score: 0.6645
+2025-09-23 15:52:08,024 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0684 | Val rms_score: 0.6795
+2025-09-23 15:52:13,096 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0580 | Val rms_score: 0.6118
+2025-09-23 15:52:18,277 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0563 | Val rms_score: 0.6816
+2025-09-23 15:52:24,681 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0526 | Val rms_score: 0.6569
+2025-09-23 15:52:29,963 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0567 | Val rms_score: 0.6775
+2025-09-23 15:52:35,265 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0918 | Val rms_score: 0.6962
+2025-09-23 15:52:39,896 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0504 | Val rms_score: 0.6827
+2025-09-23 15:52:45,213 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0491 | Val rms_score: 0.6858
+2025-09-23 15:52:50,660 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0479 | Val rms_score: 0.6581
+2025-09-23 15:52:55,864 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0405 | Val rms_score: 0.7189
+2025-09-23 15:53:01,087 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0413 | Val rms_score: 0.6745
+2025-09-23 15:53:06,369 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0477 | Val rms_score: 0.6543
+2025-09-23 15:53:10,813 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0442 | Val rms_score: 0.7129
+2025-09-23 15:53:15,958 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0384 | Val rms_score: 0.6600
+2025-09-23 15:53:21,168 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0356 | Val rms_score: 0.7416
+2025-09-23 15:53:26,393 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0403 | Val rms_score: 0.7362
+2025-09-23 15:53:31,700 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0445 | Val rms_score: 0.6655
+2025-09-23 15:53:36,970 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0380 | Val rms_score: 0.6503
+2025-09-23 15:53:42,270 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0329 | Val rms_score: 0.6601
+2025-09-23 15:53:47,436 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0345 | Val rms_score: 0.6642
+2025-09-23 15:53:52,571 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0337 | Val rms_score: 0.7007
+2025-09-23 15:53:57,751 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0311 | Val rms_score: 0.7240
+2025-09-23 15:54:02,557 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0302 | Val rms_score: 0.6679
+2025-09-23 15:54:08,080 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0300 | Val rms_score: 0.7008
+2025-09-23 15:54:13,332 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0301 | Val rms_score: 0.6711
+2025-09-23 15:54:18,603 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0306 | Val rms_score: 0.6848
+2025-09-23 15:54:23,874 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0323 | Val rms_score: 0.7223
+2025-09-23 15:54:29,159 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0312 | Val rms_score: 0.7383
+2025-09-23 15:54:34,754 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0304 | Val rms_score: 0.6889
+2025-09-23 15:54:40,410 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0326 | Val rms_score: 0.7064
+2025-09-23 15:54:45,464 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0267 | Val rms_score: 0.6729
+2025-09-23 15:54:50,419 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0249 | Val rms_score: 0.6919
+2025-09-23 15:54:55,505 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0234 | Val rms_score: 0.7171
+2025-09-23 15:55:00,876 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0230 | Val rms_score: 0.6926
+2025-09-23 15:55:06,201 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0276 | Val rms_score: 0.7124
+2025-09-23 15:55:11,436 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0237 | Val rms_score: 0.7131
+2025-09-23 15:55:16,721 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0223 | Val rms_score: 0.7059
+2025-09-23 15:55:22,073 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0217 | Val rms_score: 0.7109
+2025-09-23 15:55:27,615 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0232 | Val rms_score: 0.7012
+2025-09-23 15:55:32,985 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0213 | Val rms_score: 0.7031
+2025-09-23 15:55:38,243 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0201 | Val rms_score: 0.6933
+2025-09-23 15:55:43,551 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0209 | Val rms_score: 0.7095
+2025-09-23 15:55:48,711 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0209 | Val rms_score: 0.7111
+2025-09-23 15:55:54,185 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0193 | Val rms_score: 0.7025
+2025-09-23 15:55:59,514 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0195 | Val rms_score: 0.7054
+2025-09-23 15:56:04,147 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0194 | Val rms_score: 0.7237
+2025-09-23 15:56:08,688 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0190 | Val rms_score: 0.6903
+2025-09-23 15:56:13,849 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0197 | Val rms_score: 0.6883
+2025-09-23 15:56:19,281 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0196 | Val rms_score: 0.7258
+2025-09-23 15:56:24,359 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0208 | Val rms_score: 0.7213
+2025-09-23 15:56:29,527 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0192 | Val rms_score: 0.6997
+2025-09-23 15:56:34,880 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0179 | Val rms_score: 0.6894
+2025-09-23 15:56:40,146 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0184 | Val rms_score: 0.7082
+2025-09-23 15:56:45,692 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0192 | Val rms_score: 0.6606
+2025-09-23 15:56:51,017 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0180 | Val rms_score: 0.7032
+2025-09-23 15:56:56,735 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0242 | Val rms_score: 0.7063
+2025-09-23 15:57:02,129 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0161 | Val rms_score: 0.6937
+2025-09-23 15:57:07,468 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0169 | Val rms_score: 0.6816
+2025-09-23 15:57:12,958 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0136 | Val rms_score: 0.7086
+2025-09-23 15:57:18,214 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0152 | Val rms_score: 0.6986
+2025-09-23 15:57:23,385 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0149 | Val rms_score: 0.7184
+2025-09-23 15:57:28,646 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0165 | Val rms_score: 0.7147
+2025-09-23 15:57:33,183 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0188 | Val rms_score: 0.6983
+2025-09-23 15:57:38,583 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0175 | Val rms_score: 0.6672
+2025-09-23 15:57:43,856 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0168 | Val rms_score: 0.6641
+2025-09-23 15:57:49,091 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0168 | Val rms_score: 0.6984
+2025-09-23 15:57:54,420 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0178 | Val rms_score: 0.7044
+2025-09-23 15:57:59,646 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0155 | Val rms_score: 0.6834
+2025-09-23 15:58:05,143 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0150 | Val rms_score: 0.6961
+2025-09-23 15:58:10,465 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0155 | Val rms_score: 0.6910
+2025-09-23 15:58:15,707 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0147 | Val rms_score: 0.6974
+2025-09-23 15:58:20,381 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0133 | Val rms_score: 0.7059
+2025-09-23 15:58:25,664 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0127 | Val rms_score: 0.6874
+2025-09-23 15:58:31,149 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0143 | Val rms_score: 0.7105
+2025-09-23 15:58:36,373 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0142 | Val rms_score: 0.7352
+2025-09-23 15:58:41,517 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0142 | Val rms_score: 0.7204
+2025-09-23 15:58:46,634 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0131 | Val rms_score: 0.6847
+2025-09-23 15:58:47,102 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Test rms_score: 0.9761
+2025-09-23 15:58:47,433 - logs_modchembert_bace_regression_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg rms_score: 1.0304, Std Dev: 0.1146

logs_modchembert_regression_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_clearance_epochs100_batch_size32_20250923_155847.log

@@ -0,0 +1,343 @@
+2025-09-23 15:58:47,434 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Running benchmark for dataset: clearance
+2025-09-23 15:58:47,434 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - dataset: clearance, tasks: ['target'], epochs: 100, learning rate: 3e-05, transform: True
+2025-09-23 15:58:47,440 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset clearance at 2025-09-23_15-58-47
+2025-09-23 15:58:50,522 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 2.9048 | Val rms_score: 64.4146
+2025-09-23 15:58:50,522 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 21
+2025-09-23 15:58:51,078 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 64.4146
+2025-09-23 15:58:54,382 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 1.5476 | Val rms_score: 60.7774
+2025-09-23 15:58:54,553 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 42
+2025-09-23 15:58:55,123 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 60.7774
+2025-09-23 15:58:58,041 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 1.3036 | Val rms_score: 56.2072
+2025-09-23 15:58:58,224 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 63
+2025-09-23 15:58:58,763 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val rms_score: 56.2072
+2025-09-23 15:59:01,756 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.9524 | Val rms_score: 57.7758
+2025-09-23 15:59:04,881 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.5563 | Val rms_score: 56.6243
+2025-09-23 15:59:08,111 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.5685 | Val rms_score: 56.3067
+2025-09-23 15:59:11,532 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.4256 | Val rms_score: 52.7751
+2025-09-23 15:59:11,732 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 147
+2025-09-23 15:59:12,269 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 7 with val rms_score: 52.7751
+2025-09-23 15:59:15,443 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.2917 | Val rms_score: 53.8809
+2025-09-23 15:59:18,676 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.2545 | Val rms_score: 53.3727
+2025-09-23 15:59:22,142 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.1773 | Val rms_score: 54.1458
+2025-09-23 15:59:25,563 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.1749 | Val rms_score: 55.0962
+2025-09-23 15:59:29,246 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.1607 | Val rms_score: 54.6244
+2025-09-23 15:59:32,677 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.1317 | Val rms_score: 54.9578
+2025-09-23 15:59:36,067 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.1339 | Val rms_score: 53.2909
+2025-09-23 15:59:38,972 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.1172 | Val rms_score: 54.5441
+2025-09-23 15:59:42,400 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.1220 | Val rms_score: 54.4550
+2025-09-23 15:59:46,035 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.1362 | Val rms_score: 53.6734
+2025-09-23 15:59:49,388 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.1302 | Val rms_score: 53.4385
+2025-09-23 15:59:52,731 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.1064 | Val rms_score: 53.7716
+2025-09-23 15:59:56,128 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0863 | Val rms_score: 53.3175
+2025-09-23 15:59:59,536 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0785 | Val rms_score: 53.5502
+2025-09-23 16:00:03,152 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0792 | Val rms_score: 53.5879
+2025-09-23 16:00:06,515 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0744 | Val rms_score: 53.7084
+2025-09-23 16:00:09,897 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0986 | Val rms_score: 52.4849
+2025-09-23 16:00:10,055 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 504
+2025-09-23 16:00:10,606 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 24 with val rms_score: 52.4849
+2025-09-23 16:00:13,998 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0755 | Val rms_score: 53.4247
+2025-09-23 16:00:16,740 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0722 | Val rms_score: 52.7315
+2025-09-23 16:00:20,046 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0673 | Val rms_score: 53.2687
+2025-09-23 16:00:23,372 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0770 | Val rms_score: 53.1594
+2025-09-23 16:00:26,724 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0621 | Val rms_score: 54.4709
+2025-09-23 16:00:30,087 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0751 | Val rms_score: 52.0724
+2025-09-23 16:00:30,285 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 630
+2025-09-23 16:00:30,867 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 30 with val rms_score: 52.0724
+2025-09-23 16:00:34,301 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0640 | Val rms_score: 53.6212
+2025-09-23 16:00:37,994 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0658 | Val rms_score: 53.1400
+2025-09-23 16:00:41,372 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0655 | Val rms_score: 52.3414
+2025-09-23 16:00:44,770 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0578 | Val rms_score: 52.8821
+2025-09-23 16:00:48,137 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0562 | Val rms_score: 52.6956
+2025-09-23 16:00:51,598 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0543 | Val rms_score: 53.1207
+2025-09-23 16:00:55,202 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0480 | Val rms_score: 52.6687
+2025-09-23 16:00:58,197 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0525 | Val rms_score: 53.0538
+2025-09-23 16:01:01,576 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0409 | Val rms_score: 52.5507
+2025-09-23 16:01:04,951 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0424 | Val rms_score: 53.1289
+2025-09-23 16:01:08,307 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0502 | Val rms_score: 52.2980
+2025-09-23 16:01:11,897 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0454 | Val rms_score: 51.2038
+2025-09-23 16:01:12,041 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 882
+2025-09-23 16:01:12,581 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 42 with val rms_score: 51.2038
+2025-09-23 16:01:15,972 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0365 | Val rms_score: 52.3488
+2025-09-23 16:01:19,229 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0450 | Val rms_score: 52.7973
+2025-09-23 16:01:22,516 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0452 | Val rms_score: 52.5988
+2025-09-23 16:01:25,704 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0484 | Val rms_score: 51.7505
+2025-09-23 16:01:29,244 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0465 | Val rms_score: 52.4046
+2025-09-23 16:01:33,438 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0391 | Val rms_score: 52.3794
+2025-09-23 16:01:36,268 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0445 | Val rms_score: 52.2507
+2025-09-23 16:01:39,268 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0415 | Val rms_score: 53.2267
+2025-09-23 16:01:42,602 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0443 | Val rms_score: 51.8783
+2025-09-23 16:01:46,168 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0387 | Val rms_score: 51.9046
+2025-09-23 16:01:49,373 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0403 | Val rms_score: 52.3628
+2025-09-23 16:01:52,749 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0383 | Val rms_score: 52.2623
+2025-09-23 16:01:56,163 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0471 | Val rms_score: 53.2199
+2025-09-23 16:01:59,482 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0366 | Val rms_score: 52.4045
+2025-09-23 16:02:03,080 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0450 | Val rms_score: 51.6118
+2025-09-23 16:02:06,479 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0388 | Val rms_score: 52.0146
+2025-09-23 16:02:09,820 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0339 | Val rms_score: 52.1151
+2025-09-23 16:02:13,230 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0335 | Val rms_score: 51.5018
+2025-09-23 16:02:16,373 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0357 | Val rms_score: 51.3810
+2025-09-23 16:02:20,052 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0287 | Val rms_score: 51.5677
+2025-09-23 16:02:23,295 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0322 | Val rms_score: 52.0980
+2025-09-23 16:02:26,547 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0385 | Val rms_score: 51.0717
+2025-09-23 16:02:26,693 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 1344
+2025-09-23 16:02:27,236 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 64 with val rms_score: 51.0717
+2025-09-23 16:02:30,507 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0339 | Val rms_score: 51.5128
+2025-09-23 16:02:33,751 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0320 | Val rms_score: 52.5312
+2025-09-23 16:02:37,318 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0310 | Val rms_score: 51.9217
+2025-09-23 16:02:40,722 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0296 | Val rms_score: 52.1772
+2025-09-23 16:02:44,084 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0286 | Val rms_score: 51.8858
+2025-09-23 16:02:47,439 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0307 | Val rms_score: 51.9655
+2025-09-23 16:02:50,740 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0266 | Val rms_score: 52.3772
+2025-09-23 16:02:54,299 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0288 | Val rms_score: 52.5480
+2025-09-23 16:02:57,188 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0337 | Val rms_score: 51.4142
+2025-09-23 16:03:00,183 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0402 | Val rms_score: 52.0467
+2025-09-23 16:03:03,529 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0329 | Val rms_score: 51.6782
+2025-09-23 16:03:06,940 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0326 | Val rms_score: 52.6323
+2025-09-23 16:03:10,452 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0306 | Val rms_score: 52.2625
+2025-09-23 16:03:13,783 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0268 | Val rms_score: 52.0978
+2025-09-23 16:03:17,099 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0268 | Val rms_score: 51.6988
+2025-09-23 16:03:20,513 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0249 | Val rms_score: 51.3871
+2025-09-23 16:03:23,925 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0322 | Val rms_score: 51.7331
+2025-09-23 16:03:27,531 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0253 | Val rms_score: 51.2242
+2025-09-23 16:03:30,943 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0246 | Val rms_score: 52.0744
+2025-09-23 16:03:33,794 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0224 | Val rms_score: 52.2049
+2025-09-23 16:03:37,101 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0224 | Val rms_score: 51.5314
+2025-09-23 16:03:40,439 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0207 | Val rms_score: 51.1434
+2025-09-23 16:03:44,170 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0257 | Val rms_score: 52.4424
+2025-09-23 16:03:47,560 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0262 | Val rms_score: 51.5833
+2025-09-23 16:03:50,892 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0249 | Val rms_score: 51.1982
+2025-09-23 16:03:54,309 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0246 | Val rms_score: 51.3339
+2025-09-23 16:03:57,665 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0197 | Val rms_score: 51.8717
+2025-09-23 16:04:01,140 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0206 | Val rms_score: 51.4453
+2025-09-23 16:04:04,327 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0218 | Val rms_score: 50.8917
+2025-09-23 16:04:04,472 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 1953
+2025-09-23 16:04:05,017 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 93 with val rms_score: 50.8917
+2025-09-23 16:04:08,246 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0259 | Val rms_score: 52.5053
+2025-09-23 16:04:11,383 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0213 | Val rms_score: 51.4773
+2025-09-23 16:04:15,590 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0219 | Val rms_score: 52.1857
+2025-09-23 16:04:18,997 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0194 | Val rms_score: 51.6751
+2025-09-23 16:04:22,019 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0220 | Val rms_score: 51.8457
+2025-09-23 16:04:25,459 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0229 | Val rms_score: 51.8682
+2025-09-23 16:04:28,808 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0213 | Val rms_score: 51.3125
+2025-09-23 16:04:29,303 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Test rms_score: 47.3413
+2025-09-23 16:04:29,625 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset clearance at 2025-09-23_16-04-29
+2025-09-23 16:04:32,806 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 2.8810 | Val rms_score: 64.1828
+2025-09-23 16:04:32,806 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 21
+2025-09-23 16:04:33,347 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 64.1828
+2025-09-23 16:04:36,736 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 1.5357 | Val rms_score: 61.6657
+2025-09-23 16:04:36,907 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 42
+2025-09-23 16:04:37,441 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 61.6657
+2025-09-23 16:04:40,784 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 1.3155 | Val rms_score: 51.6429
+2025-09-23 16:04:40,959 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 63
+2025-09-23 16:04:41,478 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val rms_score: 51.6429
+2025-09-23 16:04:44,803 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 1.0238 | Val rms_score: 55.3201
+2025-09-23 16:04:48,171 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.7688 | Val rms_score: 49.8112
+2025-09-23 16:04:48,350 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 105
+2025-09-23 16:04:48,877 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 5 with val rms_score: 49.8112
+2025-09-23 16:04:51,720 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.5536 | Val rms_score: 53.9356
+2025-09-23 16:04:55,343 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.3646 | Val rms_score: 53.4953
+2025-09-23 16:04:58,736 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.2723 | Val rms_score: 52.8911
+2025-09-23 16:05:02,151 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.2083 | Val rms_score: 52.3115
+2025-09-23 16:05:05,516 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.2062 | Val rms_score: 53.7355
+2025-09-23 16:05:08,829 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.1644 | Val rms_score: 54.6787
+2025-09-23 16:05:12,444 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.1585 | Val rms_score: 54.0003
+2025-09-23 16:05:15,797 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.1406 | Val rms_score: 54.7218
+2025-09-23 16:05:19,090 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.1310 | Val rms_score: 54.3926
+2025-09-23 16:05:22,299 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.1125 | Val rms_score: 53.1509
+2025-09-23 16:05:25,481 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.1086 | Val rms_score: 53.6322
+2025-09-23 16:05:28,988 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0997 | Val rms_score: 54.2865
+2025-09-23 16:05:32,241 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0908 | Val rms_score: 52.0481
+2025-09-23 16:05:35,456 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0863 | Val rms_score: 53.5262
+2025-09-23 16:05:38,443 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0828 | Val rms_score: 53.1050
+2025-09-23 16:05:41,391 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0748 | Val rms_score: 52.7918
+2025-09-23 16:05:44,924 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0729 | Val rms_score: 52.0584
+2025-09-23 16:05:48,372 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0647 | Val rms_score: 53.1887
+2025-09-23 16:05:51,747 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.1079 | Val rms_score: 52.3895
+2025-09-23 16:05:55,166 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0733 | Val rms_score: 51.9434
+2025-09-23 16:05:58,513 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0647 | Val rms_score: 52.9971
+2025-09-23 16:06:02,019 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0636 | Val rms_score: 52.1252
+2025-09-23 16:06:05,218 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0792 | Val rms_score: 52.0694
+2025-09-23 16:06:08,448 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0738 | Val rms_score: 53.5043
+2025-09-23 16:06:11,543 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0859 | Val rms_score: 53.7143
+2025-09-23 16:06:14,737 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0755 | Val rms_score: 52.6572
+2025-09-23 16:06:18,190 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0551 | Val rms_score: 52.9711
+2025-09-23 16:06:21,439 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0547 | Val rms_score: 53.7424
+2025-09-23 16:06:24,891 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0572 | Val rms_score: 52.6225
+2025-09-23 16:06:28,266 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0528 | Val rms_score: 51.8708
+2025-09-23 16:06:31,516 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0599 | Val rms_score: 51.8018
+2025-09-23 16:06:35,150 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0456 | Val rms_score: 52.0364
+2025-09-23 16:06:38,479 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0480 | Val rms_score: 52.7463
+2025-09-23 16:06:41,840 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0452 | Val rms_score: 53.0674
+2025-09-23 16:06:45,160 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0432 | Val rms_score: 52.3117
+2025-09-23 16:06:48,572 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0452 | Val rms_score: 52.1652
+2025-09-23 16:06:52,319 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0459 | Val rms_score: 52.9385
+2025-09-23 16:06:55,700 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0550 | Val rms_score: 52.6301
+2025-09-23 16:06:58,477 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0441 | Val rms_score: 52.5454
+2025-09-23 16:07:01,406 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0420 | Val rms_score: 51.9439
+2025-09-23 16:07:04,759 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0448 | Val rms_score: 53.6195
+2025-09-23 16:07:08,376 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0428 | Val rms_score: 51.9563
+2025-09-23 16:07:12,671 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0417 | Val rms_score: 52.0420
+2025-09-23 16:07:16,065 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0426 | Val rms_score: 52.9924
+2025-09-23 16:07:19,462 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0350 | Val rms_score: 52.2841
+2025-09-23 16:07:22,828 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0450 | Val rms_score: 51.6702
+2025-09-23 16:07:26,466 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0376 | Val rms_score: 51.9973
+2025-09-23 16:07:29,343 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0383 | Val rms_score: 52.4745
+2025-09-23 16:07:32,687 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0378 | Val rms_score: 51.4141
+2025-09-23 16:07:36,020 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0355 | Val rms_score: 53.1024
+2025-09-23 16:07:39,421 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0339 | Val rms_score: 51.7457
+2025-09-23 16:07:43,026 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0363 | Val rms_score: 52.3038
+2025-09-23 16:07:46,404 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0310 | Val rms_score: 52.2082
+2025-09-23 16:07:49,744 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0368 | Val rms_score: 51.2399
+2025-09-23 16:07:53,080 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0407 | Val rms_score: 51.9361
+2025-09-23 16:07:56,412 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0348 | Val rms_score: 52.3489
+2025-09-23 16:07:59,957 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0261 | Val rms_score: 51.7292
+2025-09-23 16:08:03,199 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0335 | Val rms_score: 52.5782
+2025-09-23 16:08:06,483 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0299 | Val rms_score: 51.9017
+2025-09-23 16:08:09,719 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0327 | Val rms_score: 52.8559
+2025-09-23 16:08:12,956 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0335 | Val rms_score: 52.5423
+2025-09-23 16:08:16,596 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0346 | Val rms_score: 52.7408
+2025-09-23 16:08:19,513 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0314 | Val rms_score: 52.1002
+2025-09-23 16:08:22,428 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0305 | Val rms_score: 51.8033
+2025-09-23 16:08:25,796 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0320 | Val rms_score: 51.6772
+2025-09-23 16:08:29,118 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0355 | Val rms_score: 52.7855
+2025-09-23 16:08:32,563 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0277 | Val rms_score: 51.5858
+2025-09-23 16:08:35,912 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0264 | Val rms_score: 52.1851
+2025-09-23 16:08:39,156 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0264 | Val rms_score: 51.7117
+2025-09-23 16:08:42,512 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0268 | Val rms_score: 51.7072
+2025-09-23 16:08:45,834 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0277 | Val rms_score: 52.9206
+2025-09-23 16:08:49,507 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0262 | Val rms_score: 52.2689
+2025-09-23 16:08:52,884 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0242 | Val rms_score: 51.9277
+2025-09-23 16:08:56,310 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0246 | Val rms_score: 52.1394
+2025-09-23 16:08:59,632 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0257 | Val rms_score: 52.1480
+2025-09-23 16:09:02,981 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0177 | Val rms_score: 52.0657
+2025-09-23 16:09:06,541 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0228 | Val rms_score: 51.6482
+2025-09-23 16:09:09,791 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0236 | Val rms_score: 51.9890
+2025-09-23 16:09:13,001 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0240 | Val rms_score: 52.5238
+2025-09-23 16:09:16,236 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0234 | Val rms_score: 53.5937
+2025-09-23 16:09:19,496 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0241 | Val rms_score: 51.8436
+2025-09-23 16:09:23,147 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0219 | Val rms_score: 52.2614
+2025-09-23 16:09:26,526 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0221 | Val rms_score: 51.7228
+2025-09-23 16:09:29,896 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0275 | Val rms_score: 52.5084
+2025-09-23 16:09:33,301 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0255 | Val rms_score: 52.1294
+2025-09-23 16:09:36,629 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0225 | Val rms_score: 52.1346
+2025-09-23 16:09:39,708 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0253 | Val rms_score: 51.5442
+2025-09-23 16:09:42,665 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0230 | Val rms_score: 52.9107
+2025-09-23 16:09:46,072 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0228 | Val rms_score: 51.8405
+2025-09-23 16:09:49,475 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0262 | Val rms_score: 52.3715
+2025-09-23 16:09:53,821 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0245 | Val rms_score: 52.4280
+2025-09-23 16:09:57,456 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0217 | Val rms_score: 52.4344
+2025-09-23 16:10:00,865 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0231 | Val rms_score: 51.9628
+2025-09-23 16:10:04,166 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0247 | Val rms_score: 52.3798
+2025-09-23 16:10:07,132 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0221 | Val rms_score: 52.6243
+2025-09-23 16:10:07,605 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Test rms_score: 47.8457
+2025-09-23 16:10:07,913 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset clearance at 2025-09-23_16-10-07
+2025-09-23 16:10:10,979 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 2.8333 | Val rms_score: 61.7199
+2025-09-23 16:10:10,979 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 21
+2025-09-23 16:10:11,517 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 61.7199
+2025-09-23 16:10:14,812 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 1.5595 | Val rms_score: 56.5517
+2025-09-23 16:10:14,987 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 42
+2025-09-23 16:10:15,532 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 56.5517
+2025-09-23 16:10:18,902 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 1.2917 | Val rms_score: 55.7577
+2025-09-23 16:10:19,085 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 63
+2025-09-23 16:10:19,615 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val rms_score: 55.7577
+2025-09-23 16:10:22,960 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.9940 | Val rms_score: 49.4852
+2025-09-23 16:10:23,140 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Global step of best model: 84
+2025-09-23 16:10:23,681 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val rms_score: 49.4852
+2025-09-23 16:10:27,013 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.8688 | Val rms_score: 57.8875
+2025-09-23 16:10:30,339 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.5774 | Val rms_score: 53.3043
+2025-09-23 16:10:34,030 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.4286 | Val rms_score: 51.4965
+2025-09-23 16:10:37,336 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.3423 | Val rms_score: 55.1529
+2025-09-23 16:10:40,601 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.2604 | Val rms_score: 54.9146
+2025-09-23 16:10:43,882 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.2437 | Val rms_score: 54.8047
+2025-09-23 16:10:47,074 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.1801 | Val rms_score: 56.2482
+2025-09-23 16:10:50,562 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.1726 | Val rms_score: 56.1988
+2025-09-23 16:10:53,893 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.1399 | Val rms_score: 56.6824
+2025-09-23 16:10:57,129 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.1176 | Val rms_score: 54.9101
+2025-09-23 16:11:00,104 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.1089 | Val rms_score: 55.0056
+2025-09-23 16:11:03,026 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0982 | Val rms_score: 55.9964
+2025-09-23 16:11:06,690 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0919 | Val rms_score: 55.5890
+2025-09-23 16:11:10,074 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0997 | Val rms_score: 56.1309
+2025-09-23 16:11:13,430 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0863 | Val rms_score: 55.2265
+2025-09-23 16:11:16,885 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0891 | Val rms_score: 55.2649
+2025-09-23 16:11:20,307 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0789 | Val rms_score: 57.0729
+2025-09-23 16:11:23,397 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0703 | Val rms_score: 54.5726
+2025-09-23 16:11:26,612 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0681 | Val rms_score: 56.2811
+2025-09-23 16:11:29,842 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0952 | Val rms_score: 55.9929
+2025-09-23 16:11:33,135 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0655 | Val rms_score: 55.1508
+2025-09-23 16:11:36,382 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0636 | Val rms_score: 54.9086
+2025-09-23 16:11:39,872 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0677 | Val rms_score: 54.4931
+2025-09-23 16:11:43,282 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0644 | Val rms_score: 56.3476
+2025-09-23 16:11:46,660 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0807 | Val rms_score: 54.9040
+2025-09-23 16:11:49,970 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0688 | Val rms_score: 54.6308
+2025-09-23 16:11:53,235 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0565 | Val rms_score: 54.4854
+2025-09-23 16:11:56,865 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0521 | Val rms_score: 54.8628
+2025-09-23 16:12:00,254 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0625 | Val rms_score: 53.2328
+2025-09-23 16:12:03,604 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0600 | Val rms_score: 53.9883
+2025-09-23 16:12:06,967 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0621 | Val rms_score: 53.6648
+2025-09-23 16:12:10,407 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0565 | Val rms_score: 54.0352
+2025-09-23 16:12:14,073 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0543 | Val rms_score: 53.7250
+2025-09-23 16:12:17,504 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0487 | Val rms_score: 54.4356
+2025-09-23 16:12:20,420 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0440 | Val rms_score: 54.8511
+2025-09-23 16:12:23,368 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0435 | Val rms_score: 54.0993
+2025-09-23 16:12:26,716 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0433 | Val rms_score: 55.2133
+2025-09-23 16:12:30,373 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0452 | Val rms_score: 53.6537
+2025-09-23 16:12:33,648 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0267 | Val rms_score: 55.3331
+2025-09-23 16:12:37,054 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0419 | Val rms_score: 53.9443
+2025-09-23 16:12:40,403 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0450 | Val rms_score: 55.0959
+2025-09-23 16:12:43,123 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0495 | Val rms_score: 54.3647
+2025-09-23 16:12:46,649 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0467 | Val rms_score: 54.2524
+2025-09-23 16:12:50,841 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0415 | Val rms_score: 54.5548
+2025-09-23 16:12:54,080 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0445 | Val rms_score: 53.7829
+2025-09-23 16:12:57,375 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0374 | Val rms_score: 55.2459
+2025-09-23 16:13:00,627 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0394 | Val rms_score: 54.7028
+2025-09-23 16:13:04,347 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0407 | Val rms_score: 53.4607
+2025-09-23 16:13:07,634 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0421 | Val rms_score: 53.8731
+2025-09-23 16:13:10,966 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0366 | Val rms_score: 54.2852
+2025-09-23 16:13:14,376 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0357 | Val rms_score: 54.1573
+2025-09-23 16:13:17,665 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0376 | Val rms_score: 54.3116
+2025-09-23 16:13:21,340 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0363 | Val rms_score: 53.4057
+2025-09-23 16:13:24,688 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0373 | Val rms_score: 53.2463
+2025-09-23 16:13:27,996 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0335 | Val rms_score: 53.9092
+2025-09-23 16:13:31,356 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0309 | Val rms_score: 53.6502
+2025-09-23 16:13:34,707 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0346 | Val rms_score: 53.7358
+2025-09-23 16:13:38,250 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0261 | Val rms_score: 53.9274
+2025-09-23 16:13:41,250 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0290 | Val rms_score: 53.6667
+2025-09-23 16:13:44,164 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0357 | Val rms_score: 53.8288
+2025-09-23 16:13:47,582 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0292 | Val rms_score: 54.1736
+2025-09-23 16:13:50,953 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0329 | Val rms_score: 53.5181
+2025-09-23 16:13:54,484 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0332 | Val rms_score: 54.2348
+2025-09-23 16:13:57,829 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0264 | Val rms_score: 53.3717
+2025-09-23 16:14:00,640 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0286 | Val rms_score: 54.4662
+2025-09-23 16:14:04,002 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0299 | Val rms_score: 54.6656
+2025-09-23 16:14:07,362 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0270 | Val rms_score: 53.6906
+2025-09-23 16:14:11,066 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0308 | Val rms_score: 54.1202
+2025-09-23 16:14:14,389 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0259 | Val rms_score: 53.9152
+2025-09-23 16:14:17,781 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0260 | Val rms_score: 53.9365
+2025-09-23 16:14:21,141 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0283 | Val rms_score: 53.8003
+2025-09-23 16:14:24,555 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0259 | Val rms_score: 53.5949
+2025-09-23 16:14:28,162 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0269 | Val rms_score: 53.8700
+2025-09-23 16:14:31,522 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0309 | Val rms_score: 54.2039
+2025-09-23 16:14:34,852 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0255 | Val rms_score: 54.8122
+2025-09-23 16:14:38,207 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0233 | Val rms_score: 54.0177
+2025-09-23 16:14:41,543 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0212 | Val rms_score: 53.8244
+2025-09-23 16:14:45,162 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0246 | Val rms_score: 53.2493
+2025-09-23 16:14:48,412 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0238 | Val rms_score: 53.1124
+2025-09-23 16:14:51,647 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0225 | Val rms_score: 53.0574
+2025-09-23 16:14:54,837 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0260 | Val rms_score: 54.3885
+2025-09-23 16:14:58,174 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0252 | Val rms_score: 53.1988
+2025-09-23 16:15:01,377 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0272 | Val rms_score: 53.4111
+2025-09-23 16:15:04,296 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0246 | Val rms_score: 53.1587
+2025-09-23 16:15:07,612 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0247 | Val rms_score: 53.5860
+2025-09-23 16:15:10,994 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0188 | Val rms_score: 53.5242
+2025-09-23 16:15:14,235 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0202 | Val rms_score: 53.9253
+2025-09-23 16:15:17,925 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0255 | Val rms_score: 53.0505
+2025-09-23 16:15:21,088 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0216 | Val rms_score: 53.0964
+2025-09-23 16:15:24,430 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0226 | Val rms_score: 53.4543
+2025-09-23 16:15:27,762 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0220 | Val rms_score: 53.6302
+2025-09-23 16:15:32,046 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0199 | Val rms_score: 53.2150
+2025-09-23 16:15:35,690 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0192 | Val rms_score: 53.4553
+2025-09-23 16:15:38,993 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0198 | Val rms_score: 53.0611
+2025-09-23 16:15:42,322 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0188 | Val rms_score: 54.2889
+2025-09-23 16:15:45,519 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0202 | Val rms_score: 52.6335
+2025-09-23 16:15:45,917 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Test rms_score: 48.3383
+2025-09-23 16:15:46,244 - logs_modchembert_clearance_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg rms_score: 47.8418, Std Dev: 0.4070

logs_modchembert_regression_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_delaney_epochs100_batch_size32_20250923_161546.log

@@ -0,0 +1,349 @@
+2025-09-23 16:15:46,245 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Running benchmark for dataset: delaney
+2025-09-23 16:15:46,245 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - dataset: delaney, tasks: ['measured_log_solubility_in_mols_per_litre'], epochs: 100, learning rate: 3e-05, transform: True
+2025-09-23 16:15:46,256 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset delaney at 2025-09-23_16-15-46
+2025-09-23 16:15:49,467 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.2532 | Val rms_score: 1.0595
+2025-09-23 16:15:49,467 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 29
+2025-09-23 16:15:49,994 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 1.0595
+2025-09-23 16:15:53,377 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.1088 | Val rms_score: 0.9917
+2025-09-23 16:15:53,548 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 58
+2025-09-23 16:15:54,127 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 0.9917
+2025-09-23 16:15:57,535 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.0760 | Val rms_score: 1.0079
+2025-09-23 16:16:01,071 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.0605 | Val rms_score: 0.9093
+2025-09-23 16:16:01,245 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 116
+2025-09-23 16:16:01,773 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val rms_score: 0.9093
+2025-09-23 16:16:05,314 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0488 | Val rms_score: 0.9311
+2025-09-23 16:16:08,799 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0501 | Val rms_score: 0.9452
+2025-09-23 16:16:12,625 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0394 | Val rms_score: 0.9710
+2025-09-23 16:16:16,117 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0366 | Val rms_score: 0.9289
+2025-09-23 16:16:19,316 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0338 | Val rms_score: 0.9424
+2025-09-23 16:16:22,630 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0277 | Val rms_score: 0.9215
+2025-09-23 16:16:26,076 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0230 | Val rms_score: 0.9344
+2025-09-23 16:16:29,924 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0240 | Val rms_score: 0.9015
+2025-09-23 16:16:30,126 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 348
+2025-09-23 16:16:30,668 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 12 with val rms_score: 0.9015
+2025-09-23 16:16:33,791 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0249 | Val rms_score: 0.9404
+2025-09-23 16:16:37,300 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0181 | Val rms_score: 0.8927
+2025-09-23 16:16:37,506 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 406
+2025-09-23 16:16:38,078 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 14 with val rms_score: 0.8927
+2025-09-23 16:16:41,534 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0197 | Val rms_score: 0.9033
+2025-09-23 16:16:45,085 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0179 | Val rms_score: 0.8869
+2025-09-23 16:16:45,540 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 464
+2025-09-23 16:16:46,080 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 16 with val rms_score: 0.8869
+2025-09-23 16:16:49,561 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0157 | Val rms_score: 0.9576
+2025-09-23 16:16:53,199 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0162 | Val rms_score: 0.9403
+2025-09-23 16:16:56,741 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0154 | Val rms_score: 0.9107
+2025-09-23 16:17:00,261 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0167 | Val rms_score: 0.9372
+2025-09-23 16:17:03,761 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0135 | Val rms_score: 0.8995
+2025-09-23 16:17:07,622 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0133 | Val rms_score: 0.9455
+2025-09-23 16:17:11,176 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0131 | Val rms_score: 0.9300
+2025-09-23 16:17:14,593 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0163 | Val rms_score: 0.9167
+2025-09-23 16:17:17,988 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0170 | Val rms_score: 0.8995
+2025-09-23 16:17:21,400 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0151 | Val rms_score: 0.8814
+2025-09-23 16:17:21,815 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 754
+2025-09-23 16:17:22,362 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 26 with val rms_score: 0.8814
+2025-09-23 16:17:25,756 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0112 | Val rms_score: 0.8842
+2025-09-23 16:17:29,079 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0111 | Val rms_score: 0.8785
+2025-09-23 16:17:29,273 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 812
+2025-09-23 16:17:29,823 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 28 with val rms_score: 0.8785
+2025-09-23 16:17:33,046 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0111 | Val rms_score: 0.9217
+2025-09-23 16:17:36,481 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0123 | Val rms_score: 0.9012
+2025-09-23 16:17:39,792 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0098 | Val rms_score: 0.8997
+2025-09-23 16:17:43,123 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0103 | Val rms_score: 0.9153
+2025-09-23 16:17:46,561 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0106 | Val rms_score: 0.9164
+2025-09-23 16:17:50,007 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0135 | Val rms_score: 0.8998
+2025-09-23 16:17:54,553 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0086 | Val rms_score: 0.9056
+2025-09-23 16:17:58,107 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0088 | Val rms_score: 0.9209
+2025-09-23 16:18:02,054 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0090 | Val rms_score: 0.9135
+2025-09-23 16:18:05,595 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0103 | Val rms_score: 0.9080
+2025-09-23 16:18:09,142 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0102 | Val rms_score: 0.8904
+2025-09-23 16:18:12,683 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0118 | Val rms_score: 0.9341
+2025-09-23 16:18:16,248 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0093 | Val rms_score: 0.8920
+2025-09-23 16:18:20,095 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0066 | Val rms_score: 0.9142
+2025-09-23 16:18:23,656 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0080 | Val rms_score: 0.9040
+2025-09-23 16:18:27,146 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0071 | Val rms_score: 0.8906
+2025-09-23 16:18:30,713 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0060 | Val rms_score: 0.9007
+2025-09-23 16:18:34,326 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0065 | Val rms_score: 0.9232
+2025-09-23 16:18:38,144 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0070 | Val rms_score: 0.9031
+2025-09-23 16:18:41,634 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0068 | Val rms_score: 0.9233
+2025-09-23 16:18:44,840 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0072 | Val rms_score: 0.8960
+2025-09-23 16:18:48,260 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0059 | Val rms_score: 0.9120
+2025-09-23 16:18:51,594 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0065 | Val rms_score: 0.9102
+2025-09-23 16:18:55,071 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0076 | Val rms_score: 0.9142
+2025-09-23 16:18:58,552 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0067 | Val rms_score: 0.9331
+2025-09-23 16:19:01,991 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0060 | Val rms_score: 0.9216
+2025-09-23 16:19:05,462 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0062 | Val rms_score: 0.9100
+2025-09-23 16:19:09,000 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0063 | Val rms_score: 0.9076
+2025-09-23 16:19:12,821 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0067 | Val rms_score: 0.9118
+2025-09-23 16:19:16,369 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0071 | Val rms_score: 0.9189
+2025-09-23 16:19:19,995 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0072 | Val rms_score: 0.8984
+2025-09-23 16:19:23,427 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0065 | Val rms_score: 0.9465
+2025-09-23 16:19:26,923 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0065 | Val rms_score: 0.9021
+2025-09-23 16:19:30,737 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0064 | Val rms_score: 0.9052
+2025-09-23 16:19:34,235 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0063 | Val rms_score: 0.9129
+2025-09-23 16:19:37,812 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0061 | Val rms_score: 0.9316
+2025-09-23 16:19:41,411 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0062 | Val rms_score: 0.9237
+2025-09-23 16:19:44,937 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0082 | Val rms_score: 0.8822
+2025-09-23 16:19:48,845 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0067 | Val rms_score: 0.9417
+2025-09-23 16:19:52,452 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0057 | Val rms_score: 0.9204
+2025-09-23 16:19:56,622 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0032 | Val rms_score: 0.9129
+2025-09-23 16:19:59,785 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0050 | Val rms_score: 0.9154
+2025-09-23 16:20:03,299 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0048 | Val rms_score: 0.9252
+2025-09-23 16:20:06,728 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0047 | Val rms_score: 0.9271
+2025-09-23 16:20:10,187 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0055 | Val rms_score: 0.9369
+2025-09-23 16:20:13,761 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0057 | Val rms_score: 0.9141
+2025-09-23 16:20:17,320 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0054 | Val rms_score: 0.9140
+2025-09-23 16:20:20,774 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0038 | Val rms_score: 0.9193
+2025-09-23 16:20:24,469 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0052 | Val rms_score: 0.9146
+2025-09-23 16:20:27,887 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0046 | Val rms_score: 0.9219
+2025-09-23 16:20:31,265 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0049 | Val rms_score: 0.9168
+2025-09-23 16:20:34,699 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0048 | Val rms_score: 0.9192
+2025-09-23 16:20:38,187 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0049 | Val rms_score: 0.9207
+2025-09-23 16:20:41,984 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0046 | Val rms_score: 0.9178
+2025-09-23 16:20:45,493 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0047 | Val rms_score: 0.9178
+2025-09-23 16:20:49,143 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0048 | Val rms_score: 0.9264
+2025-09-23 16:20:52,643 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0043 | Val rms_score: 0.9241
+2025-09-23 16:20:56,174 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0047 | Val rms_score: 0.9117
+2025-09-23 16:20:59,974 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0047 | Val rms_score: 0.9187
+2025-09-23 16:21:03,533 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0044 | Val rms_score: 0.8958
+2025-09-23 16:21:07,134 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0047 | Val rms_score: 0.9062
+2025-09-23 16:21:10,229 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0049 | Val rms_score: 0.9249
+2025-09-23 16:21:13,521 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0049 | Val rms_score: 0.9067
+2025-09-23 16:21:17,039 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0044 | Val rms_score: 0.9276
+2025-09-23 16:21:20,606 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0042 | Val rms_score: 0.9204
+2025-09-23 16:21:24,063 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0043 | Val rms_score: 0.9195
+2025-09-23 16:21:27,641 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0046 | Val rms_score: 0.9180
+2025-09-23 16:21:31,198 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0050 | Val rms_score: 0.9224
+2025-09-23 16:21:35,018 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0045 | Val rms_score: 0.9083
+2025-09-23 16:21:38,540 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0043 | Val rms_score: 0.9300
+2025-09-23 16:21:42,032 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0038 | Val rms_score: 0.9289
+2025-09-23 16:21:45,602 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0038 | Val rms_score: 0.9279
+2025-09-23 16:21:46,049 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Test rms_score: 0.7681
+2025-09-23 16:21:46,350 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset delaney at 2025-09-23_16-21-46
+2025-09-23 16:21:49,632 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.2759 | Val rms_score: 1.0618
+2025-09-23 16:21:49,632 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 29
+2025-09-23 16:21:50,194 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 1.0618
+2025-09-23 16:21:53,531 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.0964 | Val rms_score: 0.9919
+2025-09-23 16:21:53,700 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 58
+2025-09-23 16:21:54,252 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 0.9919
+2025-09-23 16:21:57,587 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.0824 | Val rms_score: 0.9620
+2025-09-23 16:21:57,765 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 87
+2025-09-23 16:21:58,297 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val rms_score: 0.9620
+2025-09-23 16:22:01,672 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.0718 | Val rms_score: 1.0094
+2025-09-23 16:22:05,138 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0566 | Val rms_score: 0.9508
+2025-09-23 16:22:05,318 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 145
+2025-09-23 16:22:05,866 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 5 with val rms_score: 0.9508
+2025-09-23 16:22:09,375 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0445 | Val rms_score: 0.8799
+2025-09-23 16:22:09,856 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 174
+2025-09-23 16:22:10,378 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val rms_score: 0.8799
+2025-09-23 16:22:13,875 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0492 | Val rms_score: 0.9140
+2025-09-23 16:22:17,398 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0407 | Val rms_score: 0.9117
+2025-09-23 16:22:20,891 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0330 | Val rms_score: 0.8867
+2025-09-23 16:22:24,025 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0290 | Val rms_score: 0.9152
+2025-09-23 16:22:27,212 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0286 | Val rms_score: 0.8915
+2025-09-23 16:22:31,047 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0269 | Val rms_score: 0.9190
+2025-09-23 16:22:34,532 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0267 | Val rms_score: 0.9315
+2025-09-23 16:22:38,028 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0190 | Val rms_score: 0.9368
+2025-09-23 16:22:41,580 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0203 | Val rms_score: 0.9127
+2025-09-23 16:22:45,098 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0197 | Val rms_score: 0.8896
+2025-09-23 16:22:48,967 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0214 | Val rms_score: 0.9217
+2025-09-23 16:22:52,461 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0198 | Val rms_score: 0.8936
+2025-09-23 16:22:55,998 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0182 | Val rms_score: 0.9184
+2025-09-23 16:22:59,518 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0151 | Val rms_score: 0.9274
+2025-09-23 16:23:02,893 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0124 | Val rms_score: 0.9456
+2025-09-23 16:23:06,614 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0136 | Val rms_score: 0.9319
+2025-09-23 16:23:10,068 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0145 | Val rms_score: 0.9224
+2025-09-23 16:23:13,500 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0127 | Val rms_score: 0.9331
+2025-09-23 16:23:16,904 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0111 | Val rms_score: 0.9615
+2025-09-23 16:23:20,449 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0187 | Val rms_score: 0.9467
+2025-09-23 16:23:24,235 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0144 | Val rms_score: 0.9343
+2025-09-23 16:23:27,871 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0133 | Val rms_score: 0.9131
+2025-09-23 16:23:31,484 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0110 | Val rms_score: 0.9446
+2025-09-23 16:23:34,909 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0101 | Val rms_score: 0.9385
+2025-09-23 16:23:38,046 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0108 | Val rms_score: 0.9403
+2025-09-23 16:23:41,585 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0119 | Val rms_score: 0.9260
+2025-09-23 16:23:44,979 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0106 | Val rms_score: 0.9347
+2025-09-23 16:23:48,381 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0106 | Val rms_score: 0.9170
+2025-09-23 16:23:52,759 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0117 | Val rms_score: 0.9408
+2025-09-23 16:23:56,184 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0111 | Val rms_score: 0.9186
+2025-09-23 16:24:00,032 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0094 | Val rms_score: 0.9303
+2025-09-23 16:24:03,691 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0087 | Val rms_score: 0.9296
+2025-09-23 16:24:07,208 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0088 | Val rms_score: 0.9688
+2025-09-23 16:24:10,828 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0106 | Val rms_score: 0.9434
+2025-09-23 16:24:14,368 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0099 | Val rms_score: 0.9745
+2025-09-23 16:24:18,135 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0107 | Val rms_score: 0.9210
+2025-09-23 16:24:21,700 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0086 | Val rms_score: 0.9398
+2025-09-23 16:24:25,209 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0083 | Val rms_score: 0.9290
+2025-09-23 16:24:28,612 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0059 | Val rms_score: 0.9387
+2025-09-23 16:24:32,232 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0078 | Val rms_score: 0.9419
+2025-09-23 16:24:36,069 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0083 | Val rms_score: 0.9377
+2025-09-23 16:24:39,664 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0084 | Val rms_score: 0.9362
+2025-09-23 16:24:43,176 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0080 | Val rms_score: 0.9444
+2025-09-23 16:24:46,493 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0073 | Val rms_score: 0.9496
+2025-09-23 16:24:49,639 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0072 | Val rms_score: 0.9417
+2025-09-23 16:24:53,107 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0075 | Val rms_score: 0.9594
+2025-09-23 16:24:56,542 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0071 | Val rms_score: 0.9548
+2025-09-23 16:25:00,023 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0067 | Val rms_score: 0.9324
+2025-09-23 16:25:03,572 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0066 | Val rms_score: 0.9415
+2025-09-23 16:25:07,060 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0070 | Val rms_score: 0.9358
+2025-09-23 16:25:10,858 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0080 | Val rms_score: 0.9972
+2025-09-23 16:25:14,376 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0068 | Val rms_score: 0.9395
+2025-09-23 16:25:17,938 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0056 | Val rms_score: 0.9666
+2025-09-23 16:25:21,665 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0061 | Val rms_score: 0.9792
+2025-09-23 16:25:25,197 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0061 | Val rms_score: 0.9614
+2025-09-23 16:25:29,066 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0066 | Val rms_score: 0.9687
+2025-09-23 16:25:32,581 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0061 | Val rms_score: 0.9532
+2025-09-23 16:25:36,185 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0054 | Val rms_score: 0.9606
+2025-09-23 16:25:39,686 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0057 | Val rms_score: 0.9470
+2025-09-23 16:25:43,256 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0064 | Val rms_score: 0.9510
+2025-09-23 16:25:46,959 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0059 | Val rms_score: 0.9634
+2025-09-23 16:25:50,326 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0052 | Val rms_score: 0.9453
+2025-09-23 16:25:54,663 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0032 | Val rms_score: 0.9671
+2025-09-23 16:25:57,948 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0057 | Val rms_score: 0.9636
+2025-09-23 16:26:01,351 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0053 | Val rms_score: 0.9387
+2025-09-23 16:26:04,838 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0052 | Val rms_score: 0.9597
+2025-09-23 16:26:08,241 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0051 | Val rms_score: 0.9544
+2025-09-23 16:26:11,734 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0050 | Val rms_score: 0.9574
+2025-09-23 16:26:15,251 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0053 | Val rms_score: 0.9123
+2025-09-23 16:26:18,726 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0054 | Val rms_score: 0.9544
+2025-09-23 16:26:22,556 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0052 | Val rms_score: 0.9548
+2025-09-23 16:26:26,120 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0051 | Val rms_score: 0.9401
+2025-09-23 16:26:29,626 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0053 | Val rms_score: 0.9416
+2025-09-23 16:26:33,195 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0058 | Val rms_score: 0.9609
+2025-09-23 16:26:36,765 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0055 | Val rms_score: 0.9310
+2025-09-23 16:26:40,607 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0059 | Val rms_score: 0.9339
+2025-09-23 16:26:44,062 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0042 | Val rms_score: 0.9285
+2025-09-23 16:26:47,423 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0048 | Val rms_score: 0.9491
+2025-09-23 16:26:50,797 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0049 | Val rms_score: 0.9375
+2025-09-23 16:26:54,225 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0046 | Val rms_score: 0.9492
+2025-09-23 16:26:57,923 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0042 | Val rms_score: 0.9359
+2025-09-23 16:27:01,513 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0048 | Val rms_score: 0.9494
+2025-09-23 16:27:05,022 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0043 | Val rms_score: 0.9481
+2025-09-23 16:27:08,551 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0048 | Val rms_score: 0.9486
+2025-09-23 16:27:12,095 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0048 | Val rms_score: 0.9508
+2025-09-23 16:27:15,621 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0044 | Val rms_score: 0.9402
+2025-09-23 16:27:18,741 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0044 | Val rms_score: 0.9338
+2025-09-23 16:27:22,243 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0043 | Val rms_score: 0.9609
+2025-09-23 16:27:25,792 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0044 | Val rms_score: 0.9486
+2025-09-23 16:27:29,123 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0045 | Val rms_score: 0.9360
+2025-09-23 16:27:32,992 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0052 | Val rms_score: 0.9592
+2025-09-23 16:27:36,541 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0044 | Val rms_score: 0.9433
+2025-09-23 16:27:40,009 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0042 | Val rms_score: 0.9441
+2025-09-23 16:27:43,557 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0044 | Val rms_score: 0.9530
+2025-09-23 16:27:43,998 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Test rms_score: 0.7691
+2025-09-23 16:27:44,299 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset delaney at 2025-09-23_16-27-44
+2025-09-23 16:27:47,521 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.2640 | Val rms_score: 1.1129
+2025-09-23 16:27:47,521 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 29
+2025-09-23 16:27:48,055 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 1.1129
+2025-09-23 16:27:51,610 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.1029 | Val rms_score: 0.9465
+2025-09-23 16:27:51,782 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 58
+2025-09-23 16:27:52,359 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 0.9465
+2025-09-23 16:27:55,887 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.0754 | Val rms_score: 0.9950
+2025-09-23 16:27:59,422 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.0625 | Val rms_score: 1.0158
+2025-09-23 16:28:02,990 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0520 | Val rms_score: 0.9715
+2025-09-23 16:28:06,535 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0447 | Val rms_score: 0.9159
+2025-09-23 16:28:07,012 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 174
+2025-09-23 16:28:07,577 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val rms_score: 0.9159
+2025-09-23 16:28:11,108 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0459 | Val rms_score: 0.9148
+2025-09-23 16:28:11,294 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 203
+2025-09-23 16:28:11,835 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 7 with val rms_score: 0.9148
+2025-09-23 16:28:15,239 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0412 | Val rms_score: 0.9233
+2025-09-23 16:28:18,672 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0292 | Val rms_score: 0.9217
+2025-09-23 16:28:21,643 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0268 | Val rms_score: 0.9164
+2025-09-23 16:28:25,028 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0300 | Val rms_score: 0.9301
+2025-09-23 16:28:28,641 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0252 | Val rms_score: 0.8913
+2025-09-23 16:28:28,806 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 348
+2025-09-23 16:28:29,362 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 12 with val rms_score: 0.8913
+2025-09-23 16:28:32,447 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0256 | Val rms_score: 0.9262
+2025-09-23 16:28:35,937 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0238 | Val rms_score: 0.9142
+2025-09-23 16:28:39,532 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0205 | Val rms_score: 0.8876
+2025-09-23 16:28:39,720 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 435
+2025-09-23 16:28:40,265 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 15 with val rms_score: 0.8876
+2025-09-23 16:28:43,846 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0179 | Val rms_score: 0.8729
+2025-09-23 16:28:44,317 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Global step of best model: 464
+2025-09-23 16:28:44,860 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Best model saved at epoch 16 with val rms_score: 0.8729
+2025-09-23 16:28:48,488 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0164 | Val rms_score: 0.8906
+2025-09-23 16:28:51,925 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0173 | Val rms_score: 0.9094
+2025-09-23 16:28:55,432 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0178 | Val rms_score: 0.8917
+2025-09-23 16:28:58,950 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0143 | Val rms_score: 0.8988
+2025-09-23 16:29:02,524 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0130 | Val rms_score: 0.8896
+2025-09-23 16:29:06,383 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0150 | Val rms_score: 0.8927
+2025-09-23 16:29:09,912 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0171 | Val rms_score: 0.9523
+2025-09-23 16:29:13,529 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0176 | Val rms_score: 0.9970
+2025-09-23 16:29:17,116 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0142 | Val rms_score: 0.9356
+2025-09-23 16:29:20,627 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0124 | Val rms_score: 0.9339
+2025-09-23 16:29:24,403 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0136 | Val rms_score: 0.9255
+2025-09-23 16:29:27,825 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0095 | Val rms_score: 0.9649
+2025-09-23 16:29:31,219 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0117 | Val rms_score: 0.9234
+2025-09-23 16:29:34,643 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0114 | Val rms_score: 0.9560
+2025-09-23 16:29:38,085 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0092 | Val rms_score: 0.9189
+2025-09-23 16:29:41,517 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0172 | Val rms_score: 0.9400
+2025-09-23 16:29:44,601 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0128 | Val rms_score: 0.9091
+2025-09-23 16:29:48,150 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0097 | Val rms_score: 0.9403
+2025-09-23 16:29:52,650 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0090 | Val rms_score: 0.9186
+2025-09-23 16:29:56,226 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0084 | Val rms_score: 0.9617
+2025-09-23 16:30:00,073 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0083 | Val rms_score: 0.9325
+2025-09-23 16:30:03,503 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0099 | Val rms_score: 0.9550
+2025-09-23 16:30:07,021 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0075 | Val rms_score: 0.9528
+2025-09-23 16:30:10,579 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0080 | Val rms_score: 0.9534
+2025-09-23 16:30:14,155 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0071 | Val rms_score: 0.9442
+2025-09-23 16:30:17,994 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0076 | Val rms_score: 0.9590
+2025-09-23 16:30:21,566 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0077 | Val rms_score: 0.9411
+2025-09-23 16:30:25,122 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0076 | Val rms_score: 0.9558
+2025-09-23 16:30:28,765 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0084 | Val rms_score: 0.9416
+2025-09-23 16:30:32,373 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0075 | Val rms_score: 0.9677
+2025-09-23 16:30:36,269 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0069 | Val rms_score: 0.9653
+2025-09-23 16:30:39,786 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0070 | Val rms_score: 0.9481
+2025-09-23 16:30:43,240 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0066 | Val rms_score: 0.9354
+2025-09-23 16:30:46,671 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0083 | Val rms_score: 0.9708
+2025-09-23 16:30:50,108 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0078 | Val rms_score: 0.9602
+2025-09-23 16:30:53,777 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0061 | Val rms_score: 0.9592
+2025-09-23 16:30:57,012 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0063 | Val rms_score: 0.9282
+2025-09-23 16:31:00,341 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0064 | Val rms_score: 0.9415
+2025-09-23 16:31:03,944 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0068 | Val rms_score: 0.9566
+2025-09-23 16:31:07,494 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0074 | Val rms_score: 0.9369
+2025-09-23 16:31:11,302 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0073 | Val rms_score: 0.9449
+2025-09-23 16:31:14,967 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0072 | Val rms_score: 0.9722
+2025-09-23 16:31:18,617 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0082 | Val rms_score: 0.9555
+2025-09-23 16:31:22,106 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0064 | Val rms_score: 0.9614
+2025-09-23 16:31:25,736 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0062 | Val rms_score: 0.9568
+2025-09-23 16:31:29,578 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0054 | Val rms_score: 0.9408
+2025-09-23 16:31:33,061 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0059 | Val rms_score: 0.9525
+2025-09-23 16:31:36,522 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0054 | Val rms_score: 0.9713
+2025-09-23 16:31:40,017 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0052 | Val rms_score: 0.9559
+2025-09-23 16:31:43,442 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0059 | Val rms_score: 0.9451
+2025-09-23 16:31:47,120 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0048 | Val rms_score: 0.9537
+2025-09-23 16:31:50,539 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0058 | Val rms_score: 0.9470
+2025-09-23 16:31:54,988 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0031 | Val rms_score: 0.9591
+2025-09-23 16:31:58,413 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0054 | Val rms_score: 0.9875
+2025-09-23 16:32:01,960 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0060 | Val rms_score: 0.9846
+2025-09-23 16:32:05,754 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0061 | Val rms_score: 0.9571
+2025-09-23 16:32:08,939 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0059 | Val rms_score: 0.9718
+2025-09-23 16:32:12,055 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0055 | Val rms_score: 0.9597
+2025-09-23 16:32:15,674 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0048 | Val rms_score: 0.9547
+2025-09-23 16:32:19,179 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0053 | Val rms_score: 0.9654
+2025-09-23 16:32:23,014 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0046 | Val rms_score: 0.9783
+2025-09-23 16:32:26,574 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0045 | Val rms_score: 0.9747
+2025-09-23 16:32:30,134 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0055 | Val rms_score: 0.9671
+2025-09-23 16:32:33,503 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0047 | Val rms_score: 0.9771
+2025-09-23 16:32:36,931 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0050 | Val rms_score: 0.9493
+2025-09-23 16:32:40,636 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0046 | Val rms_score: 0.9601
+2025-09-23 16:32:44,055 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0040 | Val rms_score: 0.9675
+2025-09-23 16:32:47,510 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0044 | Val rms_score: 0.9828
+2025-09-23 16:32:50,985 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0045 | Val rms_score: 0.9727
+2025-09-23 16:32:54,598 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0045 | Val rms_score: 0.9792
+2025-09-23 16:32:58,500 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0047 | Val rms_score: 0.9847
+2025-09-23 16:33:02,155 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0045 | Val rms_score: 0.9659
+2025-09-23 16:33:05,699 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0045 | Val rms_score: 0.9782
+2025-09-23 16:33:08,892 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0046 | Val rms_score: 0.9635
+2025-09-23 16:33:12,454 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0048 | Val rms_score: 0.9520
+2025-09-23 16:33:16,261 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0045 | Val rms_score: 0.9836
+2025-09-23 16:33:19,778 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0044 | Val rms_score: 0.9501
+2025-09-23 16:33:22,782 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0044 | Val rms_score: 0.9713
+2025-09-23 16:33:25,983 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0039 | Val rms_score: 0.9552
+2025-09-23 16:33:29,537 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0041 | Val rms_score: 0.9647
+2025-09-23 16:33:33,367 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0047 | Val rms_score: 0.9757
+2025-09-23 16:33:36,766 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0043 | Val rms_score: 0.9705
+2025-09-23 16:33:40,464 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0039 | Val rms_score: 0.9538
+2025-09-23 16:33:43,962 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0038 | Val rms_score: 0.9745
+2025-09-23 16:33:44,451 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Test rms_score: 0.7636
+2025-09-23 16:33:44,765 - logs_modchembert_delaney_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg rms_score: 0.7669, Std Dev: 0.0024

logs_modchembert_regression_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_freesolv_epochs100_batch_size32_20250923_163344.log

@@ -0,0 +1,367 @@
+2025-09-23 16:33:44,766 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Running benchmark for dataset: freesolv
+2025-09-23 16:33:44,767 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - dataset: freesolv, tasks: ['y'], epochs: 100, learning rate: 3e-05, transform: True
+2025-09-23 16:33:44,786 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset freesolv at 2025-09-23_16-33-44
+2025-09-23 16:33:47,146 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.5331 | Val rms_score: 1.0297
+2025-09-23 16:33:47,146 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 17
+2025-09-23 16:33:47,726 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 1.0297
+2025-09-23 16:33:50,223 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.2537 | Val rms_score: 1.1179
+2025-09-23 16:33:52,732 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1884 | Val rms_score: 0.9443
+2025-09-23 16:33:52,907 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 51
+2025-09-23 16:33:53,453 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val rms_score: 0.9443
+2025-09-23 16:33:56,008 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1581 | Val rms_score: 0.8542
+2025-09-23 16:33:56,190 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 68
+2025-09-23 16:33:56,747 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val rms_score: 0.8542
+2025-09-23 16:33:59,308 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.1379 | Val rms_score: 0.8880
+2025-09-23 16:34:01,771 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0288 | Val rms_score: 0.7912
+2025-09-23 16:34:02,334 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 102
+2025-09-23 16:34:02,902 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val rms_score: 0.7912
+2025-09-23 16:34:05,302 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0703 | Val rms_score: 0.7949
+2025-09-23 16:34:07,816 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0616 | Val rms_score: 0.7294
+2025-09-23 16:34:08,000 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 136
+2025-09-23 16:34:08,573 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 8 with val rms_score: 0.7294
+2025-09-23 16:34:11,028 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0551 | Val rms_score: 0.7646
+2025-09-23 16:34:13,535 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0496 | Val rms_score: 0.7237
+2025-09-23 16:34:13,742 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 170
+2025-09-23 16:34:14,296 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 10 with val rms_score: 0.7237
+2025-09-23 16:34:16,594 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0616 | Val rms_score: 0.5909
+2025-09-23 16:34:17,083 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 187
+2025-09-23 16:34:17,639 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 11 with val rms_score: 0.5909
+2025-09-23 16:34:20,197 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.4121 | Val rms_score: 1.1368
+2025-09-23 16:34:22,714 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.1838 | Val rms_score: 1.0212
+2025-09-23 16:34:25,255 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.1085 | Val rms_score: 0.9405
+2025-09-23 16:34:27,875 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0846 | Val rms_score: 0.9135
+2025-09-23 16:34:30,444 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0671 | Val rms_score: 0.8700
+2025-09-23 16:34:33,076 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0554 | Val rms_score: 0.8197
+2025-09-23 16:34:35,482 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0265 | Val rms_score: 0.7514
+2025-09-23 16:34:37,976 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0453 | Val rms_score: 0.7831
+2025-09-23 16:34:40,448 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0375 | Val rms_score: 0.7463
+2025-09-23 16:34:42,844 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0377 | Val rms_score: 0.7322
+2025-09-23 16:34:45,617 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0322 | Val rms_score: 0.7362
+2025-09-23 16:34:48,045 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0284 | Val rms_score: 0.7028
+2025-09-23 16:34:50,548 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0287 | Val rms_score: 0.7351
+2025-09-23 16:34:53,040 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0262 | Val rms_score: 0.7048
+2025-09-23 16:34:55,560 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0294 | Val rms_score: 0.7558
+2025-09-23 16:34:58,381 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0308 | Val rms_score: 0.7432
+2025-09-23 16:35:00,931 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0331 | Val rms_score: 0.8672
+2025-09-23 16:35:03,486 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0478 | Val rms_score: 0.7091
+2025-09-23 16:35:06,058 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0202 | Val rms_score: 0.7078
+2025-09-23 16:35:08,544 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0206 | Val rms_score: 0.7213
+2025-09-23 16:35:11,411 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0250 | Val rms_score: 0.6831
+2025-09-23 16:35:13,976 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0178 | Val rms_score: 0.7171
+2025-09-23 16:35:16,562 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0169 | Val rms_score: 0.6897
+2025-09-23 16:35:19,191 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0141 | Val rms_score: 0.6886
+2025-09-23 16:35:21,790 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0172 | Val rms_score: 0.7528
+2025-09-23 16:35:24,429 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0292 | Val rms_score: 0.7092
+2025-09-23 16:35:27,025 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0216 | Val rms_score: 0.7163
+2025-09-23 16:35:29,575 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0147 | Val rms_score: 0.6871
+2025-09-23 16:35:32,059 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0135 | Val rms_score: 0.7001
+2025-09-23 16:35:34,592 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0133 | Val rms_score: 0.6771
+2025-09-23 16:35:37,415 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0136 | Val rms_score: 0.6989
+2025-09-23 16:35:40,039 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0142 | Val rms_score: 0.7200
+2025-09-23 16:35:42,239 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0184 | Val rms_score: 0.6859
+2025-09-23 16:35:44,530 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0142 | Val rms_score: 0.7051
+2025-09-23 16:35:47,013 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0114 | Val rms_score: 0.6933
+2025-09-23 16:35:49,897 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0109 | Val rms_score: 0.6929
+2025-09-23 16:35:52,455 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0106 | Val rms_score: 0.7075
+2025-09-23 16:35:54,950 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0109 | Val rms_score: 0.6972
+2025-09-23 16:35:57,444 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0096 | Val rms_score: 0.6937
+2025-09-23 16:36:00,001 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0095 | Val rms_score: 0.6969
+2025-09-23 16:36:02,799 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0109 | Val rms_score: 0.7026
+2025-09-23 16:36:05,330 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0017 | Val rms_score: 0.7022
+2025-09-23 16:36:07,822 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0080 | Val rms_score: 0.7090
+2025-09-23 16:36:10,313 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0092 | Val rms_score: 0.7101
+2025-09-23 16:36:12,763 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0098 | Val rms_score: 0.7225
+2025-09-23 16:36:15,619 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0109 | Val rms_score: 0.6845
+2025-09-23 16:36:18,164 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0101 | Val rms_score: 0.6998
+2025-09-23 16:36:21,719 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0068 | Val rms_score: 0.6976
+2025-09-23 16:36:24,274 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0086 | Val rms_score: 0.7093
+2025-09-23 16:36:26,836 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0102 | Val rms_score: 0.6987
+2025-09-23 16:36:29,723 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0083 | Val rms_score: 0.7049
+2025-09-23 16:36:31,942 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0075 | Val rms_score: 0.7030
+2025-09-23 16:36:34,525 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0074 | Val rms_score: 0.7031
+2025-09-23 16:36:37,068 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0064 | Val rms_score: 0.7006
+2025-09-23 16:36:39,624 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0066 | Val rms_score: 0.7039
+2025-09-23 16:36:42,460 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0067 | Val rms_score: 0.7051
+2025-09-23 16:36:44,976 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0060 | Val rms_score: 0.7132
+2025-09-23 16:36:47,577 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0057 | Val rms_score: 0.7068
+2025-09-23 16:36:50,169 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0064 | Val rms_score: 0.7149
+2025-09-23 16:36:52,396 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0098 | Val rms_score: 0.6899
+2025-09-23 16:36:54,968 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0064 | Val rms_score: 0.7286
+2025-09-23 16:36:57,602 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0075 | Val rms_score: 0.7135
+2025-09-23 16:36:59,974 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0066 | Val rms_score: 0.7124
+2025-09-23 16:37:02,554 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0064 | Val rms_score: 0.7225
+2025-09-23 16:37:05,161 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0076 | Val rms_score: 0.7156
+2025-09-23 16:37:08,033 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0068 | Val rms_score: 0.7111
+2025-09-23 16:37:10,625 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0064 | Val rms_score: 0.7169
+2025-09-23 16:37:13,101 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0065 | Val rms_score: 0.7100
+2025-09-23 16:37:15,559 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0053 | Val rms_score: 0.7147
+2025-09-23 16:37:17,997 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0057 | Val rms_score: 0.7093
+2025-09-23 16:37:20,821 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0055 | Val rms_score: 0.7125
+2025-09-23 16:37:23,385 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0054 | Val rms_score: 0.7169
+2025-09-23 16:37:25,887 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0051 | Val rms_score: 0.7173
+2025-09-23 16:37:28,440 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0060 | Val rms_score: 0.6837
+2025-09-23 16:37:30,998 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0075 | Val rms_score: 0.7281
+2025-09-23 16:37:33,853 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0065 | Val rms_score: 0.7127
+2025-09-23 16:37:36,424 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0068 | Val rms_score: 0.7288
+2025-09-23 16:37:38,982 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0171 | Val rms_score: 0.8272
+2025-09-23 16:37:41,432 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0420 | Val rms_score: 0.8557
+2025-09-23 16:37:44,035 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0386 | Val rms_score: 0.7458
+2025-09-23 16:37:46,876 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0156 | Val rms_score: 0.6890
+2025-09-23 16:37:49,399 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0124 | Val rms_score: 0.7461
+2025-09-23 16:37:51,937 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0229 | Val rms_score: 0.6774
+2025-09-23 16:37:54,499 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0130 | Val rms_score: 0.6914
+2025-09-23 16:37:57,113 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0105 | Val rms_score: 0.6999
+2025-09-23 16:37:59,949 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0121 | Val rms_score: 0.6837
+2025-09-23 16:38:02,174 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0109 | Val rms_score: 0.6712
+2025-09-23 16:38:04,587 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0094 | Val rms_score: 0.7292
+2025-09-23 16:38:07,051 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0069 | Val rms_score: 0.6941
+2025-09-23 16:38:07,480 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Test rms_score: 0.5608
+2025-09-23 16:38:07,790 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset freesolv at 2025-09-23_16-38-07
+2025-09-23 16:38:10,005 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.4926 | Val rms_score: 1.0036
+2025-09-23 16:38:10,005 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 17
+2025-09-23 16:38:10,529 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 1.0036
+2025-09-23 16:38:13,101 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.2215 | Val rms_score: 1.0470
+2025-09-23 16:38:15,629 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1425 | Val rms_score: 0.8988
+2025-09-23 16:38:15,799 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 51
+2025-09-23 16:38:16,336 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val rms_score: 0.8988
+2025-09-23 16:38:18,867 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1075 | Val rms_score: 0.8497
+2025-09-23 16:38:19,059 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 68
+2025-09-23 16:38:19,613 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val rms_score: 0.8497
+2025-09-23 16:38:22,178 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.0947 | Val rms_score: 0.8595
+2025-09-23 16:38:24,725 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0498 | Val rms_score: 1.0429
+2025-09-23 16:38:27,563 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.1195 | Val rms_score: 0.9290
+2025-09-23 16:38:30,076 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0699 | Val rms_score: 0.8619
+2025-09-23 16:38:32,586 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0545 | Val rms_score: 0.7865
+2025-09-23 16:38:32,768 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 153
+2025-09-23 16:38:33,323 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 9 with val rms_score: 0.7865
+2025-09-23 16:38:35,863 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0443 | Val rms_score: 0.8073
+2025-09-23 16:38:38,518 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0411 | Val rms_score: 0.7576
+2025-09-23 16:38:39,024 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 187
+2025-09-23 16:38:39,570 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 11 with val rms_score: 0.7576
+2025-09-23 16:38:42,175 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0322 | Val rms_score: 0.7660
+2025-09-23 16:38:44,724 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0368 | Val rms_score: 0.7095
+2025-09-23 16:38:44,909 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 221
+2025-09-23 16:38:45,474 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 13 with val rms_score: 0.7095
+2025-09-23 16:38:47,612 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0349 | Val rms_score: 0.7964
+2025-09-23 16:38:50,181 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0772 | Val rms_score: 0.7793
+2025-09-23 16:38:52,835 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0928 | Val rms_score: 0.8270
+2025-09-23 16:38:55,677 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0501 | Val rms_score: 0.7441
+2025-09-23 16:38:58,203 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0306 | Val rms_score: 0.7248
+2025-09-23 16:39:00,803 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0299 | Val rms_score: 0.7388
+2025-09-23 16:39:03,362 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0281 | Val rms_score: 0.7268
+2025-09-23 16:39:05,972 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0255 | Val rms_score: 0.7053
+2025-09-23 16:39:06,399 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 357
+2025-09-23 16:39:06,939 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 21 with val rms_score: 0.7053
+2025-09-23 16:39:09,420 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0290 | Val rms_score: 0.7644
+2025-09-23 16:39:11,722 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0455 | Val rms_score: 0.6656
+2025-09-23 16:39:11,920 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 391
+2025-09-23 16:39:12,467 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 23 with val rms_score: 0.6656
+2025-09-23 16:39:14,839 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0234 | Val rms_score: 0.6991
+2025-09-23 16:39:17,379 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0260 | Val rms_score: 0.7783
+2025-09-23 16:39:19,961 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0892 | Val rms_score: 0.8554
+2025-09-23 16:39:22,762 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.1287 | Val rms_score: 0.8236
+2025-09-23 16:39:25,301 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0602 | Val rms_score: 0.7665
+2025-09-23 16:39:27,795 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0315 | Val rms_score: 0.7142
+2025-09-23 16:39:30,394 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0186 | Val rms_score: 0.6998
+2025-09-23 16:39:32,951 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0179 | Val rms_score: 0.6821
+2025-09-23 16:39:35,809 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0159 | Val rms_score: 0.6820
+2025-09-23 16:39:38,417 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0151 | Val rms_score: 0.6736
+2025-09-23 16:39:40,973 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0200 | Val rms_score: 0.6532
+2025-09-23 16:39:41,156 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 578
+2025-09-23 16:39:41,733 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 34 with val rms_score: 0.6532
+2025-09-23 16:39:44,262 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0239 | Val rms_score: 0.7194
+2025-09-23 16:39:46,811 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0260 | Val rms_score: 0.6250
+2025-09-23 16:39:47,279 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 612
+2025-09-23 16:39:47,819 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 36 with val rms_score: 0.6250
+2025-09-23 16:39:50,297 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0680 | Val rms_score: 0.8003
+2025-09-23 16:39:52,804 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0427 | Val rms_score: 0.7936
+2025-09-23 16:39:55,185 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0208 | Val rms_score: 0.7144
+2025-09-23 16:39:57,617 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0144 | Val rms_score: 0.7282
+2025-09-23 16:40:00,112 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0114 | Val rms_score: 0.7194
+2025-09-23 16:40:02,883 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0107 | Val rms_score: 0.7164
+2025-09-23 16:40:05,484 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0126 | Val rms_score: 0.7259
+2025-09-23 16:40:07,999 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0137 | Val rms_score: 0.7259
+2025-09-23 16:40:10,520 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0110 | Val rms_score: 0.7219
+2025-09-23 16:40:13,125 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0090 | Val rms_score: 0.7230
+2025-09-23 16:40:16,095 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0101 | Val rms_score: 0.7149
+2025-09-23 16:40:18,597 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0090 | Val rms_score: 0.7199
+2025-09-23 16:40:20,911 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0086 | Val rms_score: 0.7232
+2025-09-23 16:40:23,233 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0110 | Val rms_score: 0.7320
+2025-09-23 16:40:25,753 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0129 | Val rms_score: 0.7122
+2025-09-23 16:40:28,629 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0182 | Val rms_score: 0.6851
+2025-09-23 16:40:31,130 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0359 | Val rms_score: 0.7598
+2025-09-23 16:40:33,667 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0247 | Val rms_score: 0.7497
+2025-09-23 16:40:36,217 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0178 | Val rms_score: 0.7211
+2025-09-23 16:40:38,736 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0185 | Val rms_score: 0.7140
+2025-09-23 16:40:41,605 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0207 | Val rms_score: 0.7235
+2025-09-23 16:40:44,295 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0213 | Val rms_score: 0.7579
+2025-09-23 16:40:47,833 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0360 | Val rms_score: 0.6994
+2025-09-23 16:40:50,465 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0162 | Val rms_score: 0.7262
+2025-09-23 16:40:53,047 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0139 | Val rms_score: 0.7195
+2025-09-23 16:40:55,975 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0132 | Val rms_score: 0.7118
+2025-09-23 16:40:58,435 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0119 | Val rms_score: 0.7140
+2025-09-23 16:41:01,023 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0119 | Val rms_score: 0.7244
+2025-09-23 16:41:03,493 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0069 | Val rms_score: 0.7159
+2025-09-23 16:41:06,069 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0117 | Val rms_score: 0.7106
+2025-09-23 16:41:08,874 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0147 | Val rms_score: 0.7380
+2025-09-23 16:41:11,408 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0114 | Val rms_score: 0.7138
+2025-09-23 16:41:13,949 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0101 | Val rms_score: 0.7114
+2025-09-23 16:41:16,437 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0104 | Val rms_score: 0.7385
+2025-09-23 16:41:18,930 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0073 | Val rms_score: 0.7190
+2025-09-23 16:41:21,769 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0097 | Val rms_score: 0.7247
+2025-09-23 16:41:24,308 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0090 | Val rms_score: 0.7262
+2025-09-23 16:41:26,786 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0089 | Val rms_score: 0.7350
+2025-09-23 16:41:29,243 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0095 | Val rms_score: 0.7176
+2025-09-23 16:41:31,487 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0083 | Val rms_score: 0.7205
+2025-09-23 16:41:34,155 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0087 | Val rms_score: 0.7161
+2025-09-23 16:41:36,789 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0080 | Val rms_score: 0.7108
+2025-09-23 16:41:39,273 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0088 | Val rms_score: 0.7021
+2025-09-23 16:41:41,939 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0074 | Val rms_score: 0.7150
+2025-09-23 16:41:44,479 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0076 | Val rms_score: 0.7028
+2025-09-23 16:41:47,431 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0079 | Val rms_score: 0.7060
+2025-09-23 16:41:49,945 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0062 | Val rms_score: 0.7174
+2025-09-23 16:41:52,431 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0070 | Val rms_score: 0.7113
+2025-09-23 16:41:54,944 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0069 | Val rms_score: 0.7089
+2025-09-23 16:41:57,473 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0075 | Val rms_score: 0.7134
+2025-09-23 16:42:00,184 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0098 | Val rms_score: 0.7097
+2025-09-23 16:42:02,705 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0092 | Val rms_score: 0.7219
+2025-09-23 16:42:05,209 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0091 | Val rms_score: 0.7120
+2025-09-23 16:42:07,844 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0065 | Val rms_score: 0.7189
+2025-09-23 16:42:10,349 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0067 | Val rms_score: 0.7159
+2025-09-23 16:42:13,223 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0080 | Val rms_score: 0.7133
+2025-09-23 16:42:15,758 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0071 | Val rms_score: 0.7170
+2025-09-23 16:42:18,310 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0065 | Val rms_score: 0.7094
+2025-09-23 16:42:20,948 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0071 | Val rms_score: 0.7111
+2025-09-23 16:42:23,474 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0061 | Val rms_score: 0.7097
+2025-09-23 16:42:26,272 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0063 | Val rms_score: 0.7150
+2025-09-23 16:42:28,822 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0064 | Val rms_score: 0.7124
+2025-09-23 16:42:31,371 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0061 | Val rms_score: 0.7124
+2025-09-23 16:42:33,939 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0063 | Val rms_score: 0.7114
+2025-09-23 16:42:34,403 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Test rms_score: 0.4955
+2025-09-23 16:42:34,716 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset freesolv at 2025-09-23_16-42-34
+2025-09-23 16:42:37,067 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.6287 | Val rms_score: 0.9630
+2025-09-23 16:42:37,067 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 17
+2025-09-23 16:42:37,612 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 0.9630
+2025-09-23 16:42:39,832 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.3180 | Val rms_score: 1.1704
+2025-09-23 16:42:42,099 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.1893 | Val rms_score: 1.0321
+2025-09-23 16:42:44,574 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1388 | Val rms_score: 0.9330
+2025-09-23 16:42:44,770 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 68
+2025-09-23 16:42:45,328 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val rms_score: 0.9330
+2025-09-23 16:42:47,725 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.1135 | Val rms_score: 0.9161
+2025-09-23 16:42:47,911 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 85
+2025-09-23 16:42:48,471 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 5 with val rms_score: 0.9161
+2025-09-23 16:42:50,978 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.0962 | Val rms_score: 0.8425
+2025-09-23 16:42:51,437 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 102
+2025-09-23 16:42:51,965 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val rms_score: 0.8425
+2025-09-23 16:42:54,506 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.1039 | Val rms_score: 0.9967
+2025-09-23 16:42:57,172 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.1397 | Val rms_score: 0.8364
+2025-09-23 16:42:57,354 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 136
+2025-09-23 16:42:57,907 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 8 with val rms_score: 0.8364
+2025-09-23 16:43:00,449 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0878 | Val rms_score: 0.8180
+2025-09-23 16:43:00,639 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 153
+2025-09-23 16:43:01,195 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 9 with val rms_score: 0.8180
+2025-09-23 16:43:03,746 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0956 | Val rms_score: 0.9201
+2025-09-23 16:43:06,304 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0901 | Val rms_score: 0.7999
+2025-09-23 16:43:06,780 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 187
+2025-09-23 16:43:07,336 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 11 with val rms_score: 0.7999
+2025-09-23 16:43:09,891 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0300 | Val rms_score: 0.7670
+2025-09-23 16:43:10,089 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 204
+2025-09-23 16:43:10,656 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 12 with val rms_score: 0.7670
+2025-09-23 16:43:13,206 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0551 | Val rms_score: 0.7642
+2025-09-23 16:43:13,442 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 221
+2025-09-23 16:43:14,044 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 13 with val rms_score: 0.7642
+2025-09-23 16:43:16,608 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0772 | Val rms_score: 0.7470
+2025-09-23 16:43:16,810 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 238
+2025-09-23 16:43:17,352 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 14 with val rms_score: 0.7470
+2025-09-23 16:43:19,603 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0584 | Val rms_score: 0.7532
+2025-09-23 16:43:22,166 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0581 | Val rms_score: 0.7122
+2025-09-23 16:43:22,651 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 272
+2025-09-23 16:43:23,187 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 16 with val rms_score: 0.7122
+2025-09-23 16:43:25,742 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0418 | Val rms_score: 0.7673
+2025-09-23 16:43:28,344 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0518 | Val rms_score: 0.7259
+2025-09-23 16:43:30,952 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0460 | Val rms_score: 0.7566
+2025-09-23 16:43:33,513 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0425 | Val rms_score: 0.7181
+2025-09-23 16:43:35,962 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0322 | Val rms_score: 0.6856
+2025-09-23 16:43:36,393 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Global step of best model: 357
+2025-09-23 16:43:36,954 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Best model saved at epoch 21 with val rms_score: 0.6856
+2025-09-23 16:43:39,433 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0280 | Val rms_score: 0.7254
+2025-09-23 16:43:41,891 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0255 | Val rms_score: 0.7166
+2025-09-23 16:43:44,316 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0243 | Val rms_score: 0.7080
+2025-09-23 16:43:46,764 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0210 | Val rms_score: 0.7008
+2025-09-23 16:43:49,163 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0172 | Val rms_score: 0.7108
+2025-09-23 16:43:51,792 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0178 | Val rms_score: 0.7064
+2025-09-23 16:43:54,376 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0188 | Val rms_score: 0.6878
+2025-09-23 16:43:56,913 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0160 | Val rms_score: 0.7168
+2025-09-23 16:43:59,454 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0146 | Val rms_score: 0.7025
+2025-09-23 16:44:02,082 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0151 | Val rms_score: 0.7015
+2025-09-23 16:44:05,008 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0194 | Val rms_score: 0.7248
+2025-09-23 16:44:07,606 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0255 | Val rms_score: 0.7338
+2025-09-23 16:44:10,198 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0190 | Val rms_score: 0.7376
+2025-09-23 16:44:12,736 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0180 | Val rms_score: 0.7402
+2025-09-23 16:44:15,276 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0143 | Val rms_score: 0.7170
+2025-09-23 16:44:18,150 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0125 | Val rms_score: 0.7182
+2025-09-23 16:44:20,728 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0126 | Val rms_score: 0.6987
+2025-09-23 16:44:23,280 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0117 | Val rms_score: 0.7133
+2025-09-23 16:44:25,827 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0126 | Val rms_score: 0.7252
+2025-09-23 16:44:28,320 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0133 | Val rms_score: 0.7046
+2025-09-23 16:44:31,162 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0129 | Val rms_score: 0.7233
+2025-09-23 16:44:33,620 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0126 | Val rms_score: 0.7321
+2025-09-23 16:44:36,148 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0106 | Val rms_score: 0.7272
+2025-09-23 16:44:38,639 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0097 | Val rms_score: 0.7205
+2025-09-23 16:44:41,085 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0107 | Val rms_score: 0.7015
+2025-09-23 16:44:43,942 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0104 | Val rms_score: 0.7326
+2025-09-23 16:44:46,430 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0085 | Val rms_score: 0.7227
+2025-09-23 16:44:48,987 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0082 | Val rms_score: 0.7342
+2025-09-23 16:44:51,510 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0092 | Val rms_score: 0.7230
+2025-09-23 16:44:54,003 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0106 | Val rms_score: 0.7154
+2025-09-23 16:44:56,719 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0111 | Val rms_score: 0.7231
+2025-09-23 16:44:59,051 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0043 | Val rms_score: 0.7155
+2025-09-23 16:45:01,401 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0078 | Val rms_score: 0.7253
+2025-09-23 16:45:03,918 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0080 | Val rms_score: 0.7255
+2025-09-23 16:45:06,467 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0082 | Val rms_score: 0.7262
+2025-09-23 16:45:09,374 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0085 | Val rms_score: 0.7276
+2025-09-23 16:45:11,975 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0086 | Val rms_score: 0.7190
+2025-09-23 16:45:15,423 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0061 | Val rms_score: 0.7245
+2025-09-23 16:45:17,948 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0076 | Val rms_score: 0.7255
+2025-09-23 16:45:20,452 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0075 | Val rms_score: 0.7252
+2025-09-23 16:45:23,253 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0073 | Val rms_score: 0.7260
+2025-09-23 16:45:25,752 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0069 | Val rms_score: 0.7259
+2025-09-23 16:45:28,210 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0076 | Val rms_score: 0.7148
+2025-09-23 16:45:30,732 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0119 | Val rms_score: 0.7123
+2025-09-23 16:45:33,185 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0110 | Val rms_score: 0.7284
+2025-09-23 16:45:36,095 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0086 | Val rms_score: 0.7208
+2025-09-23 16:45:38,636 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0114 | Val rms_score: 0.7768
+2025-09-23 16:45:41,291 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0226 | Val rms_score: 0.7364
+2025-09-23 16:45:43,796 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0239 | Val rms_score: 0.6931
+2025-09-23 16:45:46,355 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0099 | Val rms_score: 0.7137
+2025-09-23 16:45:49,190 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0081 | Val rms_score: 0.7195
+2025-09-23 16:45:51,762 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0093 | Val rms_score: 0.7026
+2025-09-23 16:45:54,309 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0249 | Val rms_score: 0.7572
+2025-09-23 16:45:56,846 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0252 | Val rms_score: 0.7416
+2025-09-23 16:45:59,401 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0340 | Val rms_score: 0.7479
+2025-09-23 16:46:02,277 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0451 | Val rms_score: 0.7613
+2025-09-23 16:46:04,777 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0126 | Val rms_score: 0.7614
+2025-09-23 16:46:07,028 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0106 | Val rms_score: 0.7435
+2025-09-23 16:46:09,383 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0101 | Val rms_score: 0.7514
+2025-09-23 16:46:11,797 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0069 | Val rms_score: 0.7301
+2025-09-23 16:46:14,655 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0065 | Val rms_score: 0.7624
+2025-09-23 16:46:17,236 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0059 | Val rms_score: 0.7502
+2025-09-23 16:46:19,793 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0062 | Val rms_score: 0.7414
+2025-09-23 16:46:22,361 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0071 | Val rms_score: 0.7252
+2025-09-23 16:46:24,883 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0099 | Val rms_score: 0.7519
+2025-09-23 16:46:27,797 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0088 | Val rms_score: 0.7669
+2025-09-23 16:46:30,352 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0074 | Val rms_score: 0.7362
+2025-09-23 16:46:32,926 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0053 | Val rms_score: 0.7495
+2025-09-23 16:46:35,456 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0059 | Val rms_score: 0.7439
+2025-09-23 16:46:37,961 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0060 | Val rms_score: 0.7334
+2025-09-23 16:46:40,789 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0057 | Val rms_score: 0.7346
+2025-09-23 16:46:43,165 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0065 | Val rms_score: 0.7572
+2025-09-23 16:46:45,606 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0059 | Val rms_score: 0.7531
+2025-09-23 16:46:48,136 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0070 | Val rms_score: 0.7548
+2025-09-23 16:46:50,672 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0118 | Val rms_score: 0.7314
+2025-09-23 16:46:53,481 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0082 | Val rms_score: 0.7699
+2025-09-23 16:46:56,013 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0079 | Val rms_score: 0.7603
+2025-09-23 16:46:58,466 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0061 | Val rms_score: 0.7453
+2025-09-23 16:47:01,173 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0062 | Val rms_score: 0.7545
+2025-09-23 16:47:01,608 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Test rms_score: 0.5316
+2025-09-23 16:47:01,930 - logs_modchembert_freesolv_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg rms_score: 0.5293, Std Dev: 0.0267

logs_modchembert_regression_ModChemBERT-MLM-TAFT/modchembert_deepchem_splits_run_lipo_epochs100_batch_size32_20250923_164701.log

@@ -0,0 +1,349 @@
+2025-09-23 16:47:01,931 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Running benchmark for dataset: lipo
+2025-09-23 16:47:01,931 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - dataset: lipo, tasks: ['exp'], epochs: 100, learning rate: 3e-05, transform: True
+2025-09-23 16:47:01,957 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Starting triplicate run 1 for dataset lipo at 2025-09-23_16-47-01
+2025-09-23 16:47:12,610 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.3453 | Val rms_score: 0.8830
+2025-09-23 16:47:12,610 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 105
+2025-09-23 16:47:13,151 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 0.8830
+2025-09-23 16:47:23,127 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.2516 | Val rms_score: 0.7136
+2025-09-23 16:47:23,303 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 210
+2025-09-23 16:47:23,840 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 0.7136
+2025-09-23 16:47:34,755 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.2156 | Val rms_score: 0.6932
+2025-09-23 16:47:34,933 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 315
+2025-09-23 16:47:35,452 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val rms_score: 0.6932
+2025-09-23 16:47:46,485 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1609 | Val rms_score: 0.6754
+2025-09-23 16:47:46,679 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 420
+2025-09-23 16:47:47,219 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val rms_score: 0.6754
+2025-09-23 16:47:58,306 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.1437 | Val rms_score: 0.6788
+2025-09-23 16:48:08,659 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.1141 | Val rms_score: 0.6607
+2025-09-23 16:48:09,179 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 630
+2025-09-23 16:48:09,746 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val rms_score: 0.6607
+2025-09-23 16:48:20,288 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.0969 | Val rms_score: 0.6684
+2025-09-23 16:48:30,968 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0930 | Val rms_score: 0.6690
+2025-09-23 16:48:41,886 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0760 | Val rms_score: 0.6655
+2025-09-23 16:48:52,551 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0681 | Val rms_score: 0.6687
+2025-09-23 16:49:03,421 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0676 | Val rms_score: 0.6722
+2025-09-23 16:49:14,769 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0565 | Val rms_score: 0.6761
+2025-09-23 16:49:25,217 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0526 | Val rms_score: 0.6774
+2025-09-23 16:49:35,404 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0464 | Val rms_score: 0.6694
+2025-09-23 16:49:46,538 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0406 | Val rms_score: 0.6762
+2025-09-23 16:49:57,639 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0426 | Val rms_score: 0.6623
+2025-09-23 16:50:08,818 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0379 | Val rms_score: 0.6664
+2025-09-23 16:50:18,827 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0385 | Val rms_score: 0.6807
+2025-09-23 16:50:29,540 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0345 | Val rms_score: 0.6616
+2025-09-23 16:50:41,586 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0359 | Val rms_score: 0.6753
+2025-09-23 16:50:52,713 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0312 | Val rms_score: 0.6581
+2025-09-23 16:50:53,167 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 2205
+2025-09-23 16:50:53,706 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 21 with val rms_score: 0.6581
+2025-09-23 16:51:04,610 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0367 | Val rms_score: 0.6579
+2025-09-23 16:51:04,800 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 2310
+2025-09-23 16:51:05,332 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 22 with val rms_score: 0.6579
+2025-09-23 16:51:15,783 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0297 | Val rms_score: 0.6654
+2025-09-23 16:51:26,386 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0285 | Val rms_score: 0.6618
+2025-09-23 16:51:37,362 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0297 | Val rms_score: 0.6719
+2025-09-23 16:51:47,551 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0258 | Val rms_score: 0.6610
+2025-09-23 16:51:58,550 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0247 | Val rms_score: 0.6599
+2025-09-23 16:52:09,376 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0242 | Val rms_score: 0.6721
+2025-09-23 16:52:21,308 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0248 | Val rms_score: 0.6591
+2025-09-23 16:52:32,223 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0262 | Val rms_score: 0.6710
+2025-09-23 16:52:42,757 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0247 | Val rms_score: 0.6660
+2025-09-23 16:52:53,489 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0234 | Val rms_score: 0.6679
+2025-09-23 16:53:04,630 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0230 | Val rms_score: 0.6739
+2025-09-23 16:53:15,488 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0233 | Val rms_score: 0.6679
+2025-09-23 16:53:25,255 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0210 | Val rms_score: 0.6687
+2025-09-23 16:53:36,148 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0229 | Val rms_score: 0.6801
+2025-09-23 16:53:47,573 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0232 | Val rms_score: 0.6639
+2025-09-23 16:53:58,248 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0207 | Val rms_score: 0.6770
+2025-09-23 16:54:10,277 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0207 | Val rms_score: 0.6648
+2025-09-23 16:54:21,370 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0209 | Val rms_score: 0.6646
+2025-09-23 16:54:32,013 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0229 | Val rms_score: 0.6742
+2025-09-23 16:54:42,679 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0215 | Val rms_score: 0.6749
+2025-09-23 16:54:52,201 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0215 | Val rms_score: 0.6635
+2025-09-23 16:55:03,072 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0190 | Val rms_score: 0.6674
+2025-09-23 16:55:14,075 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0166 | Val rms_score: 0.6664
+2025-09-23 16:55:24,619 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0184 | Val rms_score: 0.6730
+2025-09-23 16:55:35,926 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0183 | Val rms_score: 0.6713
+2025-09-23 16:55:47,369 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0182 | Val rms_score: 0.6652
+2025-09-23 16:55:58,201 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0182 | Val rms_score: 0.6615
+2025-09-23 16:56:09,188 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0192 | Val rms_score: 0.6736
+2025-09-23 16:56:18,646 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0172 | Val rms_score: 0.6678
+2025-09-23 16:56:29,324 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0177 | Val rms_score: 0.6681
+2025-09-23 16:56:39,879 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0171 | Val rms_score: 0.6685
+2025-09-23 16:56:50,313 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0171 | Val rms_score: 0.6664
+2025-09-23 16:57:01,348 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0164 | Val rms_score: 0.6638
+2025-09-23 16:57:12,579 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0162 | Val rms_score: 0.6643
+2025-09-23 16:57:23,956 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0183 | Val rms_score: 0.6613
+2025-09-23 16:57:35,777 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0167 | Val rms_score: 0.6638
+2025-09-23 16:57:45,565 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0166 | Val rms_score: 0.6675
+2025-09-23 16:57:56,306 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0156 | Val rms_score: 0.6603
+2025-09-23 16:58:07,359 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0130 | Val rms_score: 0.6661
+2025-09-23 16:58:18,036 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0114 | Val rms_score: 0.6682
+2025-09-23 16:58:28,958 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0168 | Val rms_score: 0.6709
+2025-09-23 16:58:40,014 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0151 | Val rms_score: 0.6669
+2025-09-23 16:58:51,213 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0144 | Val rms_score: 0.6635
+2025-09-23 16:59:01,766 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0147 | Val rms_score: 0.6658
+2025-09-23 16:59:12,951 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0140 | Val rms_score: 0.6628
+2025-09-23 16:59:22,907 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0149 | Val rms_score: 0.6627
+2025-09-23 16:59:33,176 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0149 | Val rms_score: 0.6579
+2025-09-23 16:59:43,439 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0154 | Val rms_score: 0.6623
+2025-09-23 16:59:54,404 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0141 | Val rms_score: 0.6666
+2025-09-23 17:00:05,717 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0140 | Val rms_score: 0.6629
+2025-09-23 17:00:16,762 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0141 | Val rms_score: 0.6586
+2025-09-23 17:00:27,868 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0143 | Val rms_score: 0.6641
+2025-09-23 17:00:38,989 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0143 | Val rms_score: 0.6644
+2025-09-23 17:00:48,028 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0147 | Val rms_score: 0.6638
+2025-09-23 17:00:59,841 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0140 | Val rms_score: 0.6644
+2025-09-23 17:01:09,934 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0128 | Val rms_score: 0.6630
+2025-09-23 17:01:20,816 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0141 | Val rms_score: 0.6661
+2025-09-23 17:01:31,711 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0134 | Val rms_score: 0.6615
+2025-09-23 17:01:42,666 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0155 | Val rms_score: 0.6636
+2025-09-23 17:01:54,122 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0143 | Val rms_score: 0.6699
+2025-09-23 17:02:05,241 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0132 | Val rms_score: 0.6676
+2025-09-23 17:02:14,896 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0160 | Val rms_score: 0.6694
+2025-09-23 17:02:25,815 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0128 | Val rms_score: 0.6659
+2025-09-23 17:02:37,289 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0128 | Val rms_score: 0.6619
+2025-09-23 17:02:48,685 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0134 | Val rms_score: 0.6618
+2025-09-23 17:02:59,643 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0125 | Val rms_score: 0.6603
+2025-09-23 17:03:10,110 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0140 | Val rms_score: 0.6642
+2025-09-23 17:03:20,804 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0130 | Val rms_score: 0.6695
+2025-09-23 17:03:31,912 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0128 | Val rms_score: 0.6637
+2025-09-23 17:03:42,184 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0135 | Val rms_score: 0.6636
+2025-09-23 17:03:52,409 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0132 | Val rms_score: 0.6616
+2025-09-23 17:04:02,566 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0132 | Val rms_score: 0.6669
+2025-09-23 17:04:13,577 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0124 | Val rms_score: 0.6601
+2025-09-23 17:04:25,587 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0123 | Val rms_score: 0.6651
+2025-09-23 17:04:36,782 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0131 | Val rms_score: 0.6666
+2025-09-23 17:04:47,724 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0120 | Val rms_score: 0.6641
+2025-09-23 17:04:58,933 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0130 | Val rms_score: 0.6663
+2025-09-23 17:05:09,309 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0126 | Val rms_score: 0.6640
+2025-09-23 17:05:10,007 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Test rms_score: 0.6810
+2025-09-23 17:05:10,376 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Starting triplicate run 2 for dataset lipo at 2025-09-23_17-05-10
+2025-09-23 17:05:20,621 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.3828 | Val rms_score: 0.7847
+2025-09-23 17:05:20,622 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 105
+2025-09-23 17:05:21,150 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 0.7847
+2025-09-23 17:05:31,265 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.2672 | Val rms_score: 0.7279
+2025-09-23 17:05:31,446 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 210
+2025-09-23 17:05:31,972 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 0.7279
+2025-09-23 17:05:42,958 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.2167 | Val rms_score: 0.7805
+2025-09-23 17:05:53,920 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1492 | Val rms_score: 0.6888
+2025-09-23 17:05:54,102 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 420
+2025-09-23 17:05:54,630 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val rms_score: 0.6888
+2025-09-23 17:06:05,514 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.1219 | Val rms_score: 0.6935
+2025-09-23 17:06:16,426 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.1240 | Val rms_score: 0.6831
+2025-09-23 17:06:16,934 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 630
+2025-09-23 17:06:17,468 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val rms_score: 0.6831
+2025-09-23 17:06:28,513 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.1085 | Val rms_score: 0.6853
+2025-09-23 17:06:38,548 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0902 | Val rms_score: 0.6666
+2025-09-23 17:06:38,740 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 840
+2025-09-23 17:06:39,309 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 8 with val rms_score: 0.6666
+2025-09-23 17:06:49,578 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0764 | Val rms_score: 0.6573
+2025-09-23 17:06:49,761 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 945
+2025-09-23 17:06:50,305 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 9 with val rms_score: 0.6573
+2025-09-23 17:07:01,768 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0678 | Val rms_score: 0.6832
+2025-09-23 17:07:12,970 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0619 | Val rms_score: 0.6945
+2025-09-23 17:07:24,311 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0568 | Val rms_score: 0.6795
+2025-09-23 17:07:35,081 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0531 | Val rms_score: 0.6841
+2025-09-23 17:07:45,965 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0473 | Val rms_score: 0.6785
+2025-09-23 17:07:56,919 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0483 | Val rms_score: 0.6856
+2025-09-23 17:08:06,932 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0461 | Val rms_score: 0.7072
+2025-09-23 17:08:17,469 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0430 | Val rms_score: 0.6901
+2025-09-23 17:08:28,555 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0378 | Val rms_score: 0.6754
+2025-09-23 17:08:39,467 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0377 | Val rms_score: 0.6725
+2025-09-23 17:08:51,289 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0361 | Val rms_score: 0.6814
+2025-09-23 17:09:02,422 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0301 | Val rms_score: 0.6848
+2025-09-23 17:09:13,813 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0355 | Val rms_score: 0.6882
+2025-09-23 17:09:24,220 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0332 | Val rms_score: 0.6754
+2025-09-23 17:09:34,361 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0322 | Val rms_score: 0.6832
+2025-09-23 17:09:44,559 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0300 | Val rms_score: 0.6696
+2025-09-23 17:09:55,708 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0322 | Val rms_score: 0.6731
+2025-09-23 17:10:06,706 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0306 | Val rms_score: 0.6685
+2025-09-23 17:10:17,185 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0268 | Val rms_score: 0.6828
+2025-09-23 17:10:28,890 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0250 | Val rms_score: 0.6798
+2025-09-23 17:10:39,898 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0239 | Val rms_score: 0.6873
+2025-09-23 17:10:50,798 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0230 | Val rms_score: 0.6732
+2025-09-23 17:11:01,891 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0268 | Val rms_score: 0.6705
+2025-09-23 17:11:11,482 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0245 | Val rms_score: 0.6811
+2025-09-23 17:11:22,341 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0234 | Val rms_score: 0.6788
+2025-09-23 17:11:33,374 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0225 | Val rms_score: 0.6779
+2025-09-23 17:11:44,486 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0227 | Val rms_score: 0.6739
+2025-09-23 17:11:55,981 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0216 | Val rms_score: 0.6846
+2025-09-23 17:12:06,962 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0210 | Val rms_score: 0.6702
+2025-09-23 17:12:18,417 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0207 | Val rms_score: 0.6705
+2025-09-23 17:12:28,827 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0213 | Val rms_score: 0.6797
+2025-09-23 17:12:38,062 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0187 | Val rms_score: 0.6721
+2025-09-23 17:12:48,877 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0174 | Val rms_score: 0.6705
+2025-09-23 17:12:59,327 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0207 | Val rms_score: 0.6756
+2025-09-23 17:13:10,374 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0206 | Val rms_score: 0.6752
+2025-09-23 17:13:21,458 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0206 | Val rms_score: 0.6740
+2025-09-23 17:13:32,600 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0184 | Val rms_score: 0.6745
+2025-09-23 17:13:43,925 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0175 | Val rms_score: 0.6750
+2025-09-23 17:13:55,701 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0190 | Val rms_score: 0.6711
+2025-09-23 17:14:05,039 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0202 | Val rms_score: 0.6736
+2025-09-23 17:14:15,532 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0187 | Val rms_score: 0.6701
+2025-09-23 17:14:26,290 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0178 | Val rms_score: 0.6688
+2025-09-23 17:14:37,785 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0177 | Val rms_score: 0.6720
+2025-09-23 17:14:48,926 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0186 | Val rms_score: 0.6661
+2025-09-23 17:15:00,021 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0167 | Val rms_score: 0.6727
+2025-09-23 17:15:10,938 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0169 | Val rms_score: 0.6724
+2025-09-23 17:15:21,290 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0169 | Val rms_score: 0.6711
+2025-09-23 17:15:31,529 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0176 | Val rms_score: 0.6745
+2025-09-23 17:15:42,091 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0180 | Val rms_score: 0.6690
+2025-09-23 17:15:52,472 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0162 | Val rms_score: 0.6700
+2025-09-23 17:16:03,217 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0151 | Val rms_score: 0.6734
+2025-09-23 17:16:14,399 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0210 | Val rms_score: 0.6681
+2025-09-23 17:16:25,685 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0177 | Val rms_score: 0.6727
+2025-09-23 17:16:36,724 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0171 | Val rms_score: 0.6690
+2025-09-23 17:16:47,694 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0160 | Val rms_score: 0.6739
+2025-09-23 17:16:58,068 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0170 | Val rms_score: 0.6782
+2025-09-23 17:17:07,262 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0167 | Val rms_score: 0.6715
+2025-09-23 17:17:18,978 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0151 | Val rms_score: 0.6719
+2025-09-23 17:17:29,642 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0157 | Val rms_score: 0.6739
+2025-09-23 17:17:40,708 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0161 | Val rms_score: 0.6724
+2025-09-23 17:17:51,703 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0152 | Val rms_score: 0.6697
+2025-09-23 17:18:02,836 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0151 | Val rms_score: 0.6693
+2025-09-23 17:18:14,236 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0151 | Val rms_score: 0.6732
+2025-09-23 17:18:24,483 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0146 | Val rms_score: 0.6709
+2025-09-23 17:18:34,292 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0140 | Val rms_score: 0.6700
+2025-09-23 17:18:44,652 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0144 | Val rms_score: 0.6685
+2025-09-23 17:18:55,085 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0144 | Val rms_score: 0.6641
+2025-09-23 17:19:07,505 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0145 | Val rms_score: 0.6708
+2025-09-23 17:19:18,597 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0140 | Val rms_score: 0.6682
+2025-09-23 17:19:29,478 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0141 | Val rms_score: 0.6664
+2025-09-23 17:19:40,444 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0146 | Val rms_score: 0.6731
+2025-09-23 17:19:50,961 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0134 | Val rms_score: 0.6718
+2025-09-23 17:20:01,379 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0146 | Val rms_score: 0.6687
+2025-09-23 17:20:11,774 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0158 | Val rms_score: 0.6694
+2025-09-23 17:20:22,729 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0144 | Val rms_score: 0.6733
+2025-09-23 17:20:33,296 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0152 | Val rms_score: 0.6689
+2025-09-23 17:20:44,706 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0140 | Val rms_score: 0.6673
+2025-09-23 17:20:56,020 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0137 | Val rms_score: 0.6674
+2025-09-23 17:21:07,144 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0138 | Val rms_score: 0.6749
+2025-09-23 17:21:17,718 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0140 | Val rms_score: 0.6703
+2025-09-23 17:21:28,932 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0131 | Val rms_score: 0.6657
+2025-09-23 17:21:38,980 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0132 | Val rms_score: 0.6668
+2025-09-23 17:21:50,063 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0123 | Val rms_score: 0.6763
+2025-09-23 17:22:00,823 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0135 | Val rms_score: 0.6709
+2025-09-23 17:22:11,254 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0133 | Val rms_score: 0.6748
+2025-09-23 17:22:21,989 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0127 | Val rms_score: 0.6722
+2025-09-23 17:22:33,864 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0133 | Val rms_score: 0.6740
+2025-09-23 17:22:44,936 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0124 | Val rms_score: 0.6731
+2025-09-23 17:22:56,068 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0126 | Val rms_score: 0.6688
+2025-09-23 17:23:05,283 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0125 | Val rms_score: 0.6641
+2025-09-23 17:23:16,310 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0127 | Val rms_score: 0.6762
+2025-09-23 17:23:17,119 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Test rms_score: 0.6673
+2025-09-23 17:23:17,496 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Starting triplicate run 3 for dataset lipo at 2025-09-23_17-23-17
+2025-09-23 17:23:28,334 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 1/100 | Train Loss: 0.3969 | Val rms_score: 0.7874
+2025-09-23 17:23:28,334 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 105
+2025-09-23 17:23:28,865 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 1 with val rms_score: 0.7874
+2025-09-23 17:23:39,816 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 2/100 | Train Loss: 0.3250 | Val rms_score: 0.7317
+2025-09-23 17:23:39,987 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 210
+2025-09-23 17:23:40,526 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 2 with val rms_score: 0.7317
+2025-09-23 17:23:51,149 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 3/100 | Train Loss: 0.2229 | Val rms_score: 0.6903
+2025-09-23 17:23:51,331 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 315
+2025-09-23 17:23:51,863 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 3 with val rms_score: 0.6903
+2025-09-23 17:24:02,283 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 4/100 | Train Loss: 0.1578 | Val rms_score: 0.6852
+2025-09-23 17:24:02,492 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 420
+2025-09-23 17:24:03,028 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 4 with val rms_score: 0.6852
+2025-09-23 17:24:13,532 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 5/100 | Train Loss: 0.1381 | Val rms_score: 0.7189
+2025-09-23 17:24:24,662 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 6/100 | Train Loss: 0.1276 | Val rms_score: 0.6701
+2025-09-23 17:24:25,170 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 630
+2025-09-23 17:24:25,705 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 6 with val rms_score: 0.6701
+2025-09-23 17:24:35,634 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 7/100 | Train Loss: 0.1196 | Val rms_score: 0.7227
+2025-09-23 17:24:46,687 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 8/100 | Train Loss: 0.0816 | Val rms_score: 0.6632
+2025-09-23 17:24:46,836 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 840
+2025-09-23 17:24:47,413 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 8 with val rms_score: 0.6632
+2025-09-23 17:24:58,635 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 9/100 | Train Loss: 0.0743 | Val rms_score: 0.6677
+2025-09-23 17:25:10,695 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 10/100 | Train Loss: 0.0694 | Val rms_score: 0.6647
+2025-09-23 17:25:21,245 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 11/100 | Train Loss: 0.0631 | Val rms_score: 0.6721
+2025-09-23 17:25:32,100 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 12/100 | Train Loss: 0.0633 | Val rms_score: 0.6880
+2025-09-23 17:25:42,456 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 13/100 | Train Loss: 0.0534 | Val rms_score: 0.6741
+2025-09-23 17:25:53,262 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 14/100 | Train Loss: 0.0525 | Val rms_score: 0.6716
+2025-09-23 17:26:02,591 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 15/100 | Train Loss: 0.0462 | Val rms_score: 0.6665
+2025-09-23 17:26:13,306 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 16/100 | Train Loss: 0.0437 | Val rms_score: 0.6710
+2025-09-23 17:26:24,655 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 17/100 | Train Loss: 0.0414 | Val rms_score: 0.6699
+2025-09-23 17:26:35,690 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 18/100 | Train Loss: 0.0391 | Val rms_score: 0.6808
+2025-09-23 17:26:46,510 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 19/100 | Train Loss: 0.0363 | Val rms_score: 0.6816
+2025-09-23 17:26:57,943 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 20/100 | Train Loss: 0.0345 | Val rms_score: 0.6725
+2025-09-23 17:27:08,396 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 21/100 | Train Loss: 0.0314 | Val rms_score: 0.6815
+2025-09-23 17:27:19,857 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 22/100 | Train Loss: 0.0355 | Val rms_score: 0.6729
+2025-09-23 17:27:29,409 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 23/100 | Train Loss: 0.0315 | Val rms_score: 0.6737
+2025-09-23 17:27:39,913 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 24/100 | Train Loss: 0.0352 | Val rms_score: 0.6725
+2025-09-23 17:27:50,424 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 25/100 | Train Loss: 0.0267 | Val rms_score: 0.6719
+2025-09-23 17:28:01,638 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 26/100 | Train Loss: 0.0305 | Val rms_score: 0.6716
+2025-09-23 17:28:13,063 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 27/100 | Train Loss: 0.0281 | Val rms_score: 0.6584
+2025-09-23 17:28:13,214 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Global step of best model: 2835
+2025-09-23 17:28:13,762 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Best model saved at epoch 27 with val rms_score: 0.6584
+2025-09-23 17:28:24,659 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 28/100 | Train Loss: 0.0275 | Val rms_score: 0.6724
+2025-09-23 17:28:35,931 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 29/100 | Train Loss: 0.0266 | Val rms_score: 0.6685
+2025-09-23 17:28:46,927 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 30/100 | Train Loss: 0.0272 | Val rms_score: 0.6651
+2025-09-23 17:28:56,804 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 31/100 | Train Loss: 0.0256 | Val rms_score: 0.6797
+2025-09-23 17:29:08,133 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 32/100 | Train Loss: 0.0255 | Val rms_score: 0.6714
+2025-09-23 17:29:19,016 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 33/100 | Train Loss: 0.0243 | Val rms_score: 0.6692
+2025-09-23 17:29:29,994 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 34/100 | Train Loss: 0.0235 | Val rms_score: 0.6630
+2025-09-23 17:29:40,939 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 35/100 | Train Loss: 0.0226 | Val rms_score: 0.6666
+2025-09-23 17:29:51,372 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 36/100 | Train Loss: 0.0221 | Val rms_score: 0.6729
+2025-09-23 17:30:01,872 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 37/100 | Train Loss: 0.0222 | Val rms_score: 0.6625
+2025-09-23 17:30:12,957 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 38/100 | Train Loss: 0.0216 | Val rms_score: 0.6680
+2025-09-23 17:30:23,993 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 39/100 | Train Loss: 0.0212 | Val rms_score: 0.6629
+2025-09-23 17:30:34,338 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 40/100 | Train Loss: 0.0203 | Val rms_score: 0.6683
+2025-09-23 17:30:45,546 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 41/100 | Train Loss: 0.0239 | Val rms_score: 0.6652
+2025-09-23 17:30:56,394 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 42/100 | Train Loss: 0.0241 | Val rms_score: 0.6684
+2025-09-23 17:31:06,888 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 43/100 | Train Loss: 0.0195 | Val rms_score: 0.6628
+2025-09-23 17:31:17,860 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 44/100 | Train Loss: 0.0186 | Val rms_score: 0.6690
+2025-09-23 17:31:28,346 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 45/100 | Train Loss: 0.0205 | Val rms_score: 0.6623
+2025-09-23 17:31:39,222 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 46/100 | Train Loss: 0.0186 | Val rms_score: 0.6689
+2025-09-23 17:31:50,326 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 47/100 | Train Loss: 0.0198 | Val rms_score: 0.6628
+2025-09-23 17:32:01,229 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 48/100 | Train Loss: 0.0191 | Val rms_score: 0.6756
+2025-09-23 17:32:12,159 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 49/100 | Train Loss: 0.0177 | Val rms_score: 0.6660
+2025-09-23 17:32:23,055 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 50/100 | Train Loss: 0.0187 | Val rms_score: 0.6722
+2025-09-23 17:32:33,921 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 51/100 | Train Loss: 0.0182 | Val rms_score: 0.6688
+2025-09-23 17:32:45,367 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 52/100 | Train Loss: 0.0190 | Val rms_score: 0.6672
+2025-09-23 17:32:55,989 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 53/100 | Train Loss: 0.0179 | Val rms_score: 0.6683
+2025-09-23 17:33:06,668 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 54/100 | Train Loss: 0.0181 | Val rms_score: 0.6623
+2025-09-23 17:33:17,225 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 55/100 | Train Loss: 0.0180 | Val rms_score: 0.6725
+2025-09-23 17:33:26,383 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 56/100 | Train Loss: 0.0181 | Val rms_score: 0.6737
+2025-09-23 17:33:37,138 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 57/100 | Train Loss: 0.0169 | Val rms_score: 0.6758
+2025-09-23 17:33:48,666 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 58/100 | Train Loss: 0.0169 | Val rms_score: 0.6689
+2025-09-23 17:33:59,596 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 59/100 | Train Loss: 0.0169 | Val rms_score: 0.6693
+2025-09-23 17:34:10,653 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 60/100 | Train Loss: 0.0166 | Val rms_score: 0.6709
+2025-09-23 17:34:21,169 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 61/100 | Train Loss: 0.0152 | Val rms_score: 0.6716
+2025-09-23 17:34:32,646 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 62/100 | Train Loss: 0.0174 | Val rms_score: 0.6654
+2025-09-23 17:34:43,780 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 63/100 | Train Loss: 0.0148 | Val rms_score: 0.6683
+2025-09-23 17:34:53,684 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 64/100 | Train Loss: 0.0167 | Val rms_score: 0.6686
+2025-09-23 17:35:04,869 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 65/100 | Train Loss: 0.0163 | Val rms_score: 0.6692
+2025-09-23 17:35:15,892 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 66/100 | Train Loss: 0.0155 | Val rms_score: 0.6712
+2025-09-23 17:35:27,680 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 67/100 | Train Loss: 0.0151 | Val rms_score: 0.6723
+2025-09-23 17:35:38,499 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 68/100 | Train Loss: 0.0146 | Val rms_score: 0.6656
+2025-09-23 17:35:49,019 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 69/100 | Train Loss: 0.0157 | Val rms_score: 0.6666
+2025-09-23 17:36:00,066 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 70/100 | Train Loss: 0.0155 | Val rms_score: 0.6666
+2025-09-23 17:36:10,964 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 71/100 | Train Loss: 0.0160 | Val rms_score: 0.6685
+2025-09-23 17:36:21,308 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 72/100 | Train Loss: 0.0156 | Val rms_score: 0.6668
+2025-09-23 17:36:32,125 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 73/100 | Train Loss: 0.0159 | Val rms_score: 0.6736
+2025-09-23 17:36:42,930 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 74/100 | Train Loss: 0.0145 | Val rms_score: 0.6687
+2025-09-23 17:36:53,395 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 75/100 | Train Loss: 0.0154 | Val rms_score: 0.6644
+2025-09-23 17:37:03,893 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 76/100 | Train Loss: 0.0148 | Val rms_score: 0.6677
+2025-09-23 17:37:15,678 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 77/100 | Train Loss: 0.0146 | Val rms_score: 0.6678
+2025-09-23 17:37:26,847 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 78/100 | Train Loss: 0.0141 | Val rms_score: 0.6632
+2025-09-23 17:37:37,737 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 79/100 | Train Loss: 0.0134 | Val rms_score: 0.6684
+2025-09-23 17:37:48,329 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 80/100 | Train Loss: 0.0141 | Val rms_score: 0.6690
+2025-09-23 17:37:58,216 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 81/100 | Train Loss: 0.0133 | Val rms_score: 0.6703
+2025-09-23 17:38:09,720 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 82/100 | Train Loss: 0.0140 | Val rms_score: 0.6669
+2025-09-23 17:38:20,812 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 83/100 | Train Loss: 0.0144 | Val rms_score: 0.6682
+2025-09-23 17:38:31,785 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 84/100 | Train Loss: 0.0154 | Val rms_score: 0.6668
+2025-09-23 17:38:41,826 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 85/100 | Train Loss: 0.0142 | Val rms_score: 0.6706
+2025-09-23 17:38:53,283 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 86/100 | Train Loss: 0.0161 | Val rms_score: 0.6702
+2025-09-23 17:39:04,554 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 87/100 | Train Loss: 0.0131 | Val rms_score: 0.6677
+2025-09-23 17:39:15,652 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 88/100 | Train Loss: 0.0139 | Val rms_score: 0.6687
+2025-09-23 17:39:24,888 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 89/100 | Train Loss: 0.0135 | Val rms_score: 0.6668
+2025-09-23 17:39:35,795 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 90/100 | Train Loss: 0.0145 | Val rms_score: 0.6670
+2025-09-23 17:39:46,754 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 91/100 | Train Loss: 0.0138 | Val rms_score: 0.6654
+2025-09-23 17:39:58,274 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 92/100 | Train Loss: 0.0145 | Val rms_score: 0.6697
+2025-09-23 17:40:08,767 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 93/100 | Train Loss: 0.0136 | Val rms_score: 0.6698
+2025-09-23 17:40:19,795 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 94/100 | Train Loss: 0.0135 | Val rms_score: 0.6672
+2025-09-23 17:40:30,611 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 95/100 | Train Loss: 0.0123 | Val rms_score: 0.6689
+2025-09-23 17:40:41,996 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 96/100 | Train Loss: 0.0128 | Val rms_score: 0.6696
+2025-09-23 17:40:51,724 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 97/100 | Train Loss: 0.0124 | Val rms_score: 0.6660
+2025-09-23 17:41:02,555 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 98/100 | Train Loss: 0.0133 | Val rms_score: 0.6732
+2025-09-23 17:41:13,693 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 99/100 | Train Loss: 0.0132 | Val rms_score: 0.6655
+2025-09-23 17:41:24,594 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Epoch 100/100 | Train Loss: 0.0133 | Val rms_score: 0.6676
+2025-09-23 17:41:25,421 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Test rms_score: 0.6640
+2025-09-23 17:41:25,802 - logs_modchembert_lipo_epochs100_batch_size32 - INFO - Final Triplicate Test Results — Avg rms_score: 0.6708, Std Dev: 0.0074

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8656f01d9edb002cf882df1e554a0a10e57065c97d4c08a1abfe34bad98da87f
+size 460409308

modeling_modchembert.py

@@ -0,0 +1,554 @@
+# Copyright 2025 Emmanuel Cortes, All Rights Reserved.
+#
+# Copyright 2024 Answer.AI, LightOn, and contributors, and the HuggingFace Inc. team. All rights reserved.
+#
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# This file is adapted from the transformers library.
+# Modifications include:
+# - Additional classifier_pooling options for ModChemBertForSequenceClassification
+#   - sum_mean, sum_sum, mean_sum, mean_mean: from ChemLM (utilizes all hidden states)
+#   - max_cls, cls_mha, max_seq_mha: from MaxPoolBERT (utilizes last k hidden states)
+#   - max_seq_mean: a merge between sum_mean and max_cls (utilizes last k hidden states)
+# - Addition of ModChemBertPoolingAttention for cls_mha and max_seq_mha pooling options
+
+import copy
+import math
+import typing
+from contextlib import nullcontext
+
+import torch
+import torch.nn as nn
+from torch.nn import BCEWithLogitsLoss, CrossEntropyLoss, MSELoss
+from transformers.modeling_attn_mask_utils import _prepare_4d_attention_mask
+from transformers.modeling_outputs import MaskedLMOutput, SequenceClassifierOutput
+from transformers.models.modernbert.modeling_modernbert import (
+    MODERNBERT_ATTENTION_FUNCTION,
+    ModernBertModel,
+    ModernBertPredictionHead,
+    ModernBertPreTrainedModel,
+    ModernBertRotaryEmbedding,
+    _pad_modernbert_output,
+    _unpad_modernbert_input,
+)
+from transformers.utils import logging
+
+from .configuration_modchembert import ModChemBertConfig
+
+logger = logging.get_logger(__name__)
+
+
+class InitWeightsMixin:
+    def _init_weights(self, module: nn.Module):
+        super()._init_weights(module)  # type: ignore
+
+        cutoff_factor = self.config.initializer_cutoff_factor  # type: ignore
+        if cutoff_factor is None:
+            cutoff_factor = 3
+
+        def init_weight(module: nn.Module, std: float):
+            if isinstance(module, nn.Linear):
+                nn.init.trunc_normal_(
+                    module.weight,
+                    mean=0.0,
+                    std=std,
+                    a=-cutoff_factor * std,
+                    b=cutoff_factor * std,
+                )
+                if module.bias is not None:
+                    nn.init.zeros_(module.bias)
+
+        stds = {
+            "in": self.config.initializer_range,  # type: ignore
+            "out": self.config.initializer_range / math.sqrt(2.0 * self.config.num_hidden_layers),  # type: ignore
+            "final_out": self.config.hidden_size**-0.5,  # type: ignore
+        }
+
+        if isinstance(module, ModChemBertForMaskedLM):
+            init_weight(module.decoder, stds["out"])
+        elif isinstance(module, ModChemBertForSequenceClassification):
+            init_weight(module.classifier, stds["final_out"])
+        elif isinstance(module, ModChemBertPoolingAttention):
+            init_weight(module.Wq, stds["in"])
+            init_weight(module.Wk, stds["in"])
+            init_weight(module.Wv, stds["in"])
+            init_weight(module.Wo, stds["out"])
+
+
+class ModChemBertPoolingAttention(nn.Module):
+    """Performs multi-headed self attention on a batch of sequences."""
+
+    def __init__(self, config: ModChemBertConfig):
+        super().__init__()
+        self.config = copy.deepcopy(config)
+        # Override num_attention_heads to use classifier_pooling_num_attention_heads
+        self.config.num_attention_heads = config.classifier_pooling_num_attention_heads
+        # Override attention_dropout to use classifier_pooling_attention_dropout
+        self.config.attention_dropout = config.classifier_pooling_attention_dropout
+
+        if config.hidden_size % config.num_attention_heads != 0:
+            raise ValueError(
+                f"The hidden size ({config.hidden_size}) is not a multiple of the number of attention heads "
+                f"({config.num_attention_heads})"
+            )
+
+        self.attention_dropout = config.attention_dropout
+        self.num_heads = config.num_attention_heads
+        self.head_dim = config.hidden_size // config.num_attention_heads
+        self.all_head_size = self.head_dim * self.num_heads
+        self.Wq = nn.Linear(config.hidden_size, self.all_head_size, bias=config.attention_bias)
+        self.Wk = nn.Linear(config.hidden_size, self.all_head_size, bias=config.attention_bias)
+        self.Wv = nn.Linear(config.hidden_size, self.all_head_size, bias=config.attention_bias)
+
+        # Use global attention
+        self.local_attention = (-1, -1)
+        rope_theta = config.global_rope_theta
+        # sdpa path from original ModernBert implementation
+        config_copy = copy.deepcopy(config)
+        config_copy.rope_theta = rope_theta
+        self.rotary_emb = ModernBertRotaryEmbedding(config=config_copy)
+
+        self.Wo = nn.Linear(config.hidden_size, config.hidden_size, bias=config.attention_bias)
+        self.out_drop = nn.Dropout(config.attention_dropout) if config.attention_dropout > 0.0 else nn.Identity()
+        self.pruned_heads = set()
+
+    def forward(
+        self,
+        q: torch.Tensor,
+        kv: torch.Tensor,
+        attention_mask: torch.Tensor | None = None,
+        **kwargs,
+    ) -> torch.Tensor:
+        bs, seq_len = kv.shape[:2]
+        q_proj: torch.Tensor = self.Wq(q)
+        k_proj: torch.Tensor = self.Wk(kv)
+        v_proj: torch.Tensor = self.Wv(kv)
+        qkv = torch.stack(
+            (
+                q_proj.reshape(bs, seq_len, self.num_heads, self.head_dim),
+                k_proj.reshape(bs, seq_len, self.num_heads, self.head_dim),
+                v_proj.reshape(bs, seq_len, self.num_heads, self.head_dim),
+            ),
+            dim=2,
+        )  # (bs, seq_len, 3, num_heads, head_dim)
+
+        device = kv.device
+        if attention_mask is None:
+            attention_mask = torch.ones((bs, seq_len), device=device, dtype=torch.bool)
+        position_ids = torch.arange(seq_len, device=device).unsqueeze(0).long()
+
+        attn_outputs = MODERNBERT_ATTENTION_FUNCTION["sdpa"](
+            self,
+            qkv=qkv,
+            attention_mask=_prepare_4d_attention_mask(attention_mask, kv.dtype),
+            sliding_window_mask=None,  # not needed when using global attention
+            position_ids=position_ids,
+            local_attention=self.local_attention,
+            bs=bs,
+            dim=self.all_head_size,
+            **kwargs,
+        )
+        hidden_states = attn_outputs[0]
+        hidden_states = self.out_drop(self.Wo(hidden_states))
+
+        return hidden_states
+
+
+class ModChemBertForMaskedLM(InitWeightsMixin, ModernBertPreTrainedModel):
+    config_class = ModChemBertConfig
+    _tied_weights_keys = ["decoder.weight"]
+
+    def __init__(self, config: ModChemBertConfig):
+        super().__init__(config)
+        self.config = config
+        self.model = ModernBertModel(config)
+        self.head = ModernBertPredictionHead(config)
+        self.decoder = nn.Linear(config.hidden_size, config.vocab_size, bias=config.decoder_bias)
+
+        self.sparse_prediction = self.config.sparse_prediction
+        self.sparse_pred_ignore_index = self.config.sparse_pred_ignore_index
+
+        # Initialize weights and apply final processing
+        self.post_init()
+
+    def get_output_embeddings(self):
+        return self.decoder
+
+    def set_output_embeddings(self, new_embeddings: nn.Linear):
+        self.decoder = new_embeddings
+
+    @torch.compile(dynamic=True)
+    def compiled_head(self, output: torch.Tensor) -> torch.Tensor:
+        return self.decoder(self.head(output))
+
+    def forward(
+        self,
+        input_ids: torch.LongTensor | None = None,
+        attention_mask: torch.Tensor | None = None,
+        sliding_window_mask: torch.Tensor | None = None,
+        position_ids: torch.Tensor | None = None,
+        inputs_embeds: torch.Tensor | None = None,
+        labels: torch.Tensor | None = None,
+        indices: torch.Tensor | None = None,
+        cu_seqlens: torch.Tensor | None = None,
+        max_seqlen: int | None = None,
+        batch_size: int | None = None,
+        seq_len: int | None = None,
+        output_attentions: bool | None = None,
+        output_hidden_states: bool | None = None,
+        return_dict: bool | None = None,
+        **kwargs,
+    ) -> tuple[torch.Tensor] | tuple[torch.Tensor, typing.Any] | MaskedLMOutput:
+        r"""
+        sliding_window_mask (`torch.Tensor` of shape `(batch_size, sequence_length)`, *optional*):
+            Mask to avoid performing attention on padding or far-away tokens. In ModernBert, only every few layers
+            perform global attention, while the rest perform local attention. This mask is used to avoid attending to
+            far-away tokens in the local attention layers when not using Flash Attention.
+        indices (`torch.Tensor` of shape `(total_unpadded_tokens,)`, *optional*):
+            Indices of the non-padding tokens in the input sequence. Used for unpadding the output.
+        cu_seqlens (`torch.Tensor` of shape `(batch + 1,)`, *optional*):
+            Cumulative sequence lengths of the input sequences. Used to index the unpadded tensors.
+        max_seqlen (`int`, *optional*):
+            Maximum sequence length in the batch excluding padding tokens. Used to unpad input_ids & pad output tensors.
+        batch_size (`int`, *optional*):
+            Batch size of the input sequences. Used to pad the output tensors.
+        seq_len (`int`, *optional*):
+            Sequence length of the input sequences including padding tokens. Used to pad the output tensors.
+        """
+        return_dict = return_dict if return_dict is not None else self.config.use_return_dict
+        self._maybe_set_compile()
+
+        if self.config._attn_implementation == "flash_attention_2":  # noqa: SIM102
+            if indices is None and cu_seqlens is None and max_seqlen is None:
+                if batch_size is None and seq_len is None:
+                    if inputs_embeds is not None:
+                        batch_size, seq_len = inputs_embeds.shape[:2]
+                    else:
+                        batch_size, seq_len = input_ids.shape[:2]  # type: ignore
+                device = input_ids.device if input_ids is not None else inputs_embeds.device  # type: ignore
+
+                if attention_mask is None:
+                    attention_mask = torch.ones((batch_size, seq_len), device=device, dtype=torch.bool)  # type: ignore
+
+                if inputs_embeds is None:
+                    with torch.no_grad():
+                        input_ids, indices, cu_seqlens, max_seqlen, position_ids, labels = _unpad_modernbert_input(
+                            inputs=input_ids,  # type: ignore
+                            attention_mask=attention_mask,  # type: ignore
+                            position_ids=position_ids,
+                            labels=labels,
+                        )
+                else:
+                    inputs_embeds, indices, cu_seqlens, max_seqlen, position_ids, labels = _unpad_modernbert_input(
+                        inputs=inputs_embeds,
+                        attention_mask=attention_mask,  # type: ignore
+                        position_ids=position_ids,
+                        labels=labels,
+                    )
+
+        outputs = self.model(
+            input_ids=input_ids,
+            attention_mask=attention_mask,
+            sliding_window_mask=sliding_window_mask,
+            position_ids=position_ids,
+            inputs_embeds=inputs_embeds,
+            indices=indices,
+            cu_seqlens=cu_seqlens,
+            max_seqlen=max_seqlen,
+            batch_size=batch_size,
+            seq_len=seq_len,
+            output_attentions=output_attentions,
+            output_hidden_states=output_hidden_states,
+            return_dict=return_dict,
+        )
+        last_hidden_state = outputs[0]
+
+        if self.sparse_prediction and labels is not None:
+            # flatten labels and output first
+            labels = labels.view(-1)
+            last_hidden_state = last_hidden_state.view(labels.shape[0], -1)
+
+            # then filter out the non-masked tokens
+            mask_tokens = labels != self.sparse_pred_ignore_index
+            last_hidden_state = last_hidden_state[mask_tokens]
+            labels = labels[mask_tokens]
+
+        logits = (
+            self.compiled_head(last_hidden_state)
+            if self.config.reference_compile
+            else self.decoder(self.head(last_hidden_state))
+        )
+
+        loss = None
+        if labels is not None:
+            loss = self.loss_function(logits, labels, vocab_size=self.config.vocab_size, **kwargs)
+
+        if self.config._attn_implementation == "flash_attention_2":
+            with nullcontext() if self.config.repad_logits_with_grad or labels is None else torch.no_grad():
+                logits = _pad_modernbert_output(inputs=logits, indices=indices, batch=batch_size, seqlen=seq_len)  # type: ignore
+
+        if not return_dict:
+            output = (logits,)
+            return ((loss,) + output) if loss is not None else output
+
+        return MaskedLMOutput(
+            loss=loss,
+            logits=typing.cast(torch.FloatTensor, logits),
+            hidden_states=outputs.hidden_states,
+            attentions=outputs.attentions,
+        )
+
+
+class ModChemBertForSequenceClassification(InitWeightsMixin, ModernBertPreTrainedModel):
+    config_class = ModChemBertConfig
+
+    def __init__(self, config: ModChemBertConfig):
+        super().__init__(config)
+        self.num_labels = config.num_labels
+        self.config = config
+
+        self.model = ModernBertModel(config)
+        if self.config.classifier_pooling in {"cls_mha", "max_seq_mha"}:
+            self.pooling_attn = ModChemBertPoolingAttention(config=self.config)
+        else:
+            self.pooling_attn = None
+        self.head = ModernBertPredictionHead(config)
+        self.drop = torch.nn.Dropout(config.classifier_dropout)
+        self.classifier = nn.Linear(config.hidden_size, config.num_labels)
+
+        # Initialize weights and apply final processing
+        self.post_init()
+
+    def forward(
+        self,
+        input_ids: torch.LongTensor | None = None,
+        attention_mask: torch.Tensor | None = None,
+        sliding_window_mask: torch.Tensor | None = None,
+        position_ids: torch.Tensor | None = None,
+        inputs_embeds: torch.Tensor | None = None,
+        labels: torch.Tensor | None = None,
+        indices: torch.Tensor | None = None,
+        cu_seqlens: torch.Tensor | None = None,
+        max_seqlen: int | None = None,
+        batch_size: int | None = None,
+        seq_len: int | None = None,
+        output_attentions: bool | None = None,
+        output_hidden_states: bool | None = None,
+        return_dict: bool | None = None,
+        **kwargs,
+    ) -> tuple[torch.Tensor] | tuple[torch.Tensor, typing.Any] | SequenceClassifierOutput:
+        r"""
+        sliding_window_mask (`torch.Tensor` of shape `(batch_size, sequence_length)`, *optional*):
+            Mask to avoid performing attention on padding or far-away tokens. In ModernBert, only every few layers
+            perform global attention, while the rest perform local attention. This mask is used to avoid attending to
+            far-away tokens in the local attention layers when not using Flash Attention.
+        labels (`torch.LongTensor` of shape `(batch_size,)`, *optional*):
+            Labels for computing the sequence classification/regression loss. Indices should be in `[0, ...,
+            config.num_labels - 1]`. If `config.num_labels == 1` a regression loss is computed (Mean-Square loss), If
+            `config.num_labels > 1` a classification loss is computed (Cross-Entropy).
+        indices (`torch.Tensor` of shape `(total_unpadded_tokens,)`, *optional*):
+            Indices of the non-padding tokens in the input sequence. Used for unpadding the output.
+        cu_seqlens (`torch.Tensor` of shape `(batch + 1,)`, *optional*):
+            Cumulative sequence lengths of the input sequences. Used to index the unpadded tensors.
+        max_seqlen (`int`, *optional*):
+            Maximum sequence length in the batch excluding padding tokens. Used to unpad input_ids & pad output tensors.
+        batch_size (`int`, *optional*):
+            Batch size of the input sequences. Used to pad the output tensors.
+        seq_len (`int`, *optional*):
+            Sequence length of the input sequences including padding tokens. Used to pad the output tensors.
+        """
+        return_dict = return_dict if return_dict is not None else self.config.use_return_dict
+        self._maybe_set_compile()
+
+        if input_ids is not None:
+            self.warn_if_padding_and_no_attention_mask(input_ids, attention_mask)
+
+        if batch_size is None and seq_len is None:
+            if inputs_embeds is not None:
+                batch_size, seq_len = inputs_embeds.shape[:2]
+            else:
+                batch_size, seq_len = input_ids.shape[:2]  # type: ignore
+        device = input_ids.device if input_ids is not None else inputs_embeds.device  # type: ignore
+
+        if attention_mask is None:
+            attention_mask = torch.ones((batch_size, seq_len), device=device, dtype=torch.bool)  # type: ignore
+
+        # Ensure output_hidden_states is True in case pooling mode requires all hidden states
+        output_hidden_states = True
+
+        outputs = self.model(
+            input_ids=input_ids,
+            attention_mask=attention_mask,
+            sliding_window_mask=sliding_window_mask,
+            position_ids=position_ids,
+            inputs_embeds=inputs_embeds,
+            indices=indices,
+            cu_seqlens=cu_seqlens,
+            max_seqlen=max_seqlen,
+            batch_size=batch_size,
+            seq_len=seq_len,
+            output_attentions=output_attentions,
+            output_hidden_states=output_hidden_states,
+            return_dict=return_dict,
+        )
+        last_hidden_state = outputs[0]
+        hidden_states = outputs[1]
+
+        last_hidden_state = _pool_modchembert_output(
+            self,
+            last_hidden_state,
+            hidden_states,
+            typing.cast(torch.Tensor, attention_mask),
+        )
+        pooled_output = self.head(last_hidden_state)
+        pooled_output = self.drop(pooled_output)
+        logits = self.classifier(pooled_output)
+
+        loss = None
+        if labels is not None:
+            if self.config.problem_type is None:
+                if self.num_labels == 1:
+                    self.config.problem_type = "regression"
+                elif self.num_labels > 1 and (labels.dtype == torch.long or labels.dtype == torch.int):
+                    self.config.problem_type = "single_label_classification"
+                else:
+                    self.config.problem_type = "multi_label_classification"
+
+            if self.config.problem_type == "regression":
+                loss_fct = MSELoss()
+                if self.num_labels == 1:
+                    loss = loss_fct(logits.squeeze(), labels.squeeze())
+                else:
+                    loss = loss_fct(logits, labels)
+            elif self.config.problem_type == "single_label_classification":
+                loss_fct = CrossEntropyLoss()
+                loss = loss_fct(logits.view(-1, self.num_labels), labels.view(-1))
+            elif self.config.problem_type == "multi_label_classification":
+                loss_fct = BCEWithLogitsLoss()
+                loss = loss_fct(logits, labels)
+
+        if not return_dict:
+            output = (logits,)
+            return ((loss,) + output) if loss is not None else output
+
+        return SequenceClassifierOutput(
+            loss=loss,
+            logits=logits,
+            hidden_states=outputs.hidden_states,
+            attentions=outputs.attentions,
+        )
+
+
+def _pool_modchembert_output(
+    module: ModChemBertForSequenceClassification,
+    last_hidden_state: torch.Tensor,
+    hidden_states: list[torch.Tensor],
+    attention_mask: torch.Tensor,
+):
+    """
+    Apply pooling strategy to hidden states for sequence-level classification/regression tasks.
+
+    This function implements various pooling strategies to aggregate sequence representations
+    into a single vector for downstream classification or regression tasks. The pooling method
+    is determined by the `classifier_pooling` configuration parameter.
+
+    Available pooling strategies:
+    - cls: Use the CLS token ([CLS]) representation from the last hidden state
+    - mean: Average pooling over all tokens in the sequence (attention-weighted)
+    - max_cls: Element-wise max pooling over the last k hidden states, then take CLS token
+    - cls_mha: Multi-head attention with CLS token as query and full sequence as keys/values
+    - max_seq_mha: Max pooling over last k states + multi-head attention with CLS as query
+    - max_seq_mean: Max pooling over last k hidden states, then mean pooling over sequence
+    - sum_mean: Sum all hidden states across layers, then mean pool over sequence
+    - sum_sum: Sum all hidden states across layers, then sum pool over sequence
+    - mean_sum: Mean all hidden states across layers, then sum pool over sequence
+    - mean_mean: Mean all hidden states across layers, then mean pool over sequence
+
+    Args:
+        module: The model instance containing configuration and pooling attention if needed
+        last_hidden_state: Final layer hidden states of shape (batch_size, seq_len, hidden_size)
+        hidden_states: List of hidden states from all layers, each of shape (batch_size, seq_len, hidden_size)
+        attention_mask: Attention mask of shape (batch_size, seq_len) indicating valid tokens
+
+    Returns:
+        torch.Tensor: Pooled representation of shape (batch_size, hidden_size)
+
+    Note:
+        Some pooling strategies (cls_mha, max_seq_mha) require the module to have a pooling_attn
+        attribute containing a ModChemBertPoolingAttention instance.
+    """
+    config = typing.cast(ModChemBertConfig, module.config)
+    if config.classifier_pooling == "cls":
+        last_hidden_state = last_hidden_state[:, 0]
+    elif config.classifier_pooling == "mean":
+        last_hidden_state = (last_hidden_state * attention_mask.unsqueeze(-1)).sum(dim=1) / attention_mask.sum(
+            dim=1, keepdim=True
+        )
+    elif config.classifier_pooling == "max_cls":
+        k_hidden_states = hidden_states[-config.classifier_pooling_last_k :]
+        theta = torch.stack(k_hidden_states, dim=1)  # (batch, k, seq_len, hidden)
+        pooled_seq = torch.max(theta, dim=1).values  # Element-wise max over k -> (batch, seq_len, hidden)
+        last_hidden_state = pooled_seq[:, 0, :]  # (batch, hidden)
+    elif config.classifier_pooling == "cls_mha":
+        # Similar to max_seq_mha but without the max pooling step
+        # Query is CLS token (position 0); Keys/Values are full sequence
+        q = last_hidden_state[:, 0, :].unsqueeze(1)  # (batch, 1, hidden)
+        q = q.expand(-1, last_hidden_state.shape[1], -1)  # (batch, seq_len, hidden)
+        attn_out: torch.Tensor = module.pooling_attn(  # type: ignore
+            q=q, kv=last_hidden_state, attention_mask=attention_mask
+        )  # (batch, seq_len, hidden)
+        last_hidden_state = torch.mean(attn_out, dim=1)
+    elif config.classifier_pooling == "max_seq_mha":
+        k_hidden_states = hidden_states[-config.classifier_pooling_last_k :]
+        theta = torch.stack(k_hidden_states, dim=1)  # (batch, k, seq_len, hidden)
+        pooled_seq = torch.max(theta, dim=1).values  # Element-wise max over k -> (batch, seq_len, hidden)
+        # Query is pooled CLS token (position 0); Keys/Values are pooled sequence
+        q = pooled_seq[:, 0, :].unsqueeze(1)  # (batch, 1, hidden)
+        q = q.expand(-1, pooled_seq.shape[1], -1)  # (batch, seq_len, hidden)
+        attn_out: torch.Tensor = module.pooling_attn(  # type: ignore
+            q=q, kv=pooled_seq, attention_mask=attention_mask
+        )  # (batch, seq_len, hidden)
+        last_hidden_state = torch.mean(attn_out, dim=1)
+    elif config.classifier_pooling == "max_seq_mean":
+        k_hidden_states = hidden_states[-config.classifier_pooling_last_k :]
+        theta = torch.stack(k_hidden_states, dim=1)  # (batch, k, seq_len, hidden)
+        pooled_seq = torch.max(theta, dim=1).values  # Element-wise max over k -> (batch, seq_len, hidden)
+        last_hidden_state = torch.mean(pooled_seq, dim=1)  # Mean over sequence length
+    elif config.classifier_pooling == "sum_mean":
+        # ChemLM uses the mean of all hidden states
+        # which outperforms using just the last layer mean or the cls embedding
+        # https://doi.org/10.1038/s42004-025-01484-4
+        # https://static-content.springer.com/esm/art%3A10.1038%2Fs42004-025-01484-4/MediaObjects/42004_2025_1484_MOESM2_ESM.pdf
+        all_hidden_states = torch.stack(hidden_states)
+        w = torch.sum(all_hidden_states, dim=0)
+        last_hidden_state = torch.mean(w, dim=1)
+    elif config.classifier_pooling == "sum_sum":
+        all_hidden_states = torch.stack(hidden_states)
+        w = torch.sum(all_hidden_states, dim=0)
+        last_hidden_state = torch.sum(w, dim=1)
+    elif config.classifier_pooling == "mean_sum":
+        all_hidden_states = torch.stack(hidden_states)
+        w = torch.mean(all_hidden_states, dim=0)
+        last_hidden_state = torch.sum(w, dim=1)
+    elif config.classifier_pooling == "mean_mean":
+        all_hidden_states = torch.stack(hidden_states)
+        w = torch.mean(all_hidden_states, dim=0)
+        last_hidden_state = torch.mean(w, dim=1)
+    return last_hidden_state
+
+
+__all__ = [
+    "ModChemBertForMaskedLM",
+    "ModChemBertForSequenceClassification",
+]

special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,2554 @@
+{
+  "version": "1.0",
+  "truncation": {
+    "direction": "Right",
+    "max_length": 256,
+    "strategy": "LongestFirst",
+    "stride": 0
+  },
+  "padding": {
+    "strategy": "BatchLongest",
+    "direction": "Right",
+    "pad_to_multiple_of": 8,
+    "pad_id": 2,
+    "pad_type_id": 0,
+    "pad_token": "[PAD]"
+  },
+  "added_tokens": [
+    {
+      "id": 0,
+      "content": "[CLS]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 1,
+      "content": "[SEP]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2,
+      "content": "[PAD]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 3,
+      "content": "[MASK]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2361,
+      "content": "[UNK]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    }
+  ],
+  "normalizer": null,
+  "pre_tokenizer": {
+    "type": "ByteLevel",
+    "add_prefix_space": false,
+    "trim_offsets": true,
+    "use_regex": true
+  },
+  "post_processor": {
+    "type": "TemplateProcessing",
+    "single": [
+      {
+        "SpecialToken": {
+          "id": "[CLS]",
+          "type_id": 0
+        }
+      },
+      {
+        "Sequence": {
+          "id": "A",
+          "type_id": 0
+        }
+      },
+      {
+        "SpecialToken": {
+          "id": "[SEP]",
+          "type_id": 0
+        }
+      }
+    ],
+    "pair": [
+      {
+        "SpecialToken": {
+          "id": "[CLS]",
+          "type_id": 0
+        }
+      },
+      {
+        "Sequence": {
+          "id": "A",
+          "type_id": 0
+        }
+      },
+      {
+        "SpecialToken": {
+          "id": "[SEP]",
+          "type_id": 0
+        }
+      },
+      {
+        "Sequence": {
+          "id": "B",
+          "type_id": 0
+        }
+      },
+      {
+        "SpecialToken": {
+          "id": "[SEP]",
+          "type_id": 0
+        }
+      }
+    ],
+    "special_tokens": {
+      "[CLS]": {
+        "id": "[CLS]",
+        "ids": [
+          0
+        ],
+        "tokens": [
+          "[CLS]"
+        ]
+      },
+      "[MASK]": {
+        "id": "[MASK]",
+        "ids": [
+          3
+        ],
+        "tokens": [
+          "[MASK]"
+        ]
+      },
+      "[PAD]": {
+        "id": "[PAD]",
+        "ids": [
+          2
+        ],
+        "tokens": [
+          "[PAD]"
+        ]
+      },
+      "[SEP]": {
+        "id": "[SEP]",
+        "ids": [
+          1
+        ],
+        "tokens": [
+          "[SEP]"
+        ]
+      },
+      "[UNK]": {
+        "id": "[UNK]",
+        "ids": [
+          2361
+        ],
+        "tokens": [
+          "[UNK]"
+        ]
+      }
+    }
+  },
+  "decoder": {
+    "type": "ByteLevel",
+    "add_prefix_space": false,
+    "trim_offsets": true,
+    "use_regex": true
+  },
+  "model": {
+    "type": "BPE",
+    "dropout": null,
+    "unk_token": "[UNK]",
+    "continuing_subword_prefix": null,
+    "end_of_word_suffix": null,
+    "fuse_unk": false,
+    "byte_fallback": false,
+    "ignore_merges": false,
+    "vocab": {
+      "[CLS]": 0,
+      "[SEP]": 1,
+      "[PAD]": 2,
+      "[MASK]": 3,
+      "C": 4,
+      "c": 5,
+      "(": 6,
+      ")": 7,
+      "1": 8,
+      "O": 9,
+      "N": 10,
+      "2": 11,
+      "=": 12,
+      "n": 13,
+      "3": 14,
+      "[C@H]": 15,
+      "[C@@H]": 16,
+      "F": 17,
+      "S": 18,
+      "4": 19,
+      "Cl": 20,
+      "-": 21,
+      "o": 22,
+      "s": 23,
+      "[nH]": 24,
+      "#": 25,
+      "/": 26,
+      "Br": 27,
+      "[C@]": 28,
+      "[C@@]": 29,
+      "[N+]": 30,
+      "[O-]": 31,
+      "5": 32,
+      "\\": 33,
+      ".": 34,
+      "I": 35,
+      "6": 36,
+      "[S@]": 37,
+      "[S@@]": 38,
+      "P": 39,
+      "[N-]": 40,
+      "[Si]": 41,
+      "7": 42,
+      "[n+]": 43,
+      "[2H]": 44,
+      "8": 45,
+      "[NH+]": 46,
+      "B": 47,
+      "9": 48,
+      "[C-]": 49,
+      "[Na+]": 50,
+      "[Cl-]": 51,
+      "[c-]": 52,
+      "[CH]": 53,
+      "%10": 54,
+      "[NH2+]": 55,
+      "[P+]": 56,
+      "[B]": 57,
+      "[I-]": 58,
+      "%11": 59,
+      "[CH2-]": 60,
+      "[O+]": 61,
+      "[NH3+]": 62,
+      "[C]": 63,
+      "[Br-]": 64,
+      "[IH2]": 65,
+      "[S-]": 66,
+      "[cH-]": 67,
+      "%12": 68,
+      "[nH+]": 69,
+      "[B-]": 70,
+      "[K+]": 71,
+      "[Sn]": 72,
+      "[Se]": 73,
+      "[CH-]": 74,
+      "[HH]": 75,
+      "[Y]": 76,
+      "[n-]": 77,
+      "[CH3-]": 78,
+      "[SiH]": 79,
+      "[S+]": 80,
+      "%13": 81,
+      "[SiH2]": 82,
+      "[Li+]": 83,
+      "[NH-]": 84,
+      "%14": 85,
+      "[Na]": 86,
+      "[CH2]": 87,
+      "[O-2]": 88,
+      "[U+2]": 89,
+      "[W]": 90,
+      "[Al]": 91,
+      "[P@]": 92,
+      "[Fe+2]": 93,
+      "[PH+]": 94,
+      "%15": 95,
+      "[Cl+3]": 96,
+      "[Zn+2]": 97,
+      "[Ir]": 98,
+      "[Mg+2]": 99,
+      "[Pt+2]": 100,
+      "[OH2+]": 101,
+      "[As]": 102,
+      "[Fe]": 103,
+      "[OH+]": 104,
+      "[Zr+2]": 105,
+      "[3H]": 106,
+      "[Ge]": 107,
+      "[SiH3]": 108,
+      "[OH-]": 109,
+      "[NH4+]": 110,
+      "[Cu+2]": 111,
+      "[P@@]": 112,
+      "p": 113,
+      "[Pt]": 114,
+      "%16": 115,
+      "[Ca+2]": 116,
+      "[Zr]": 117,
+      "[F-]": 118,
+      "[C+]": 119,
+      "[Ti]": 120,
+      "[P-]": 121,
+      "[V]": 122,
+      "[se]": 123,
+      "[U]": 124,
+      "[O]": 125,
+      "[Ni+2]": 126,
+      "[Zn]": 127,
+      "[Co]": 128,
+      "[Ni]": 129,
+      "[Pd+2]": 130,
+      "[Cu]": 131,
+      "%17": 132,
+      "[Cu+]": 133,
+      "[Te]": 134,
+      "[H+]": 135,
+      "[CH+]": 136,
+      "[Li]": 137,
+      "[Pd]": 138,
+      "[Mo]": 139,
+      "[Ru+2]": 140,
+      "[o+]": 141,
+      "[Re]": 142,
+      "[SH+]": 143,
+      "%18": 144,
+      "[Ac]": 145,
+      "[Cr]": 146,
+      "[NH2-]": 147,
+      "[K]": 148,
+      "[13CH2]": 149,
+      "[c]": 150,
+      "[Zr+4]": 151,
+      "[Tl]": 152,
+      "[13C]": 153,
+      "[Mn]": 154,
+      "[N@+]": 155,
+      "[Hg]": 156,
+      "[Rh]": 157,
+      "[Ti+4]": 158,
+      "[Sb]": 159,
+      "[Co+2]": 160,
+      "[Ag+]": 161,
+      "[Ru]": 162,
+      "%19": 163,
+      "[N@@+]": 164,
+      "[Ti+2]": 165,
+      "[Al+3]": 166,
+      "[Pb]": 167,
+      "[I+]": 168,
+      "[18F]": 169,
+      "[s+]": 170,
+      "[Rb+]": 171,
+      "[Ba+2]": 172,
+      "[H-]": 173,
+      "[Fe+3]": 174,
+      "[Ir+3]": 175,
+      "[13cH]": 176,
+      "%20": 177,
+      "[AlH2]": 178,
+      "[Au+]": 179,
+      "[13c]": 180,
+      "[SH2+]": 181,
+      "[Sn+2]": 182,
+      "[Mn+2]": 183,
+      "[Si-]": 184,
+      "[Ag]": 185,
+      "[N]": 186,
+      "[Bi]": 187,
+      "%21": 188,
+      "[In]": 189,
+      "[CH2+]": 190,
+      "[Y+3]": 191,
+      "[Ga]": 192,
+      "%22": 193,
+      "[Co+3]": 194,
+      "[Au]": 195,
+      "[13CH3]": 196,
+      "[Mg]": 197,
+      "[Cs+]": 198,
+      "[W+2]": 199,
+      "[Hf]": 200,
+      "[Zn+]": 201,
+      "[Se-]": 202,
+      "[S-2]": 203,
+      "[Ca]": 204,
+      "[pH]": 205,
+      "[ClH+]": 206,
+      "[Ti+3]": 207,
+      "%23": 208,
+      "[Ru+]": 209,
+      "[SH-]": 210,
+      "[13CH]": 211,
+      "[IH+]": 212,
+      "[Hf+4]": 213,
+      "[Rf]": 214,
+      "[OH3+]": 215,
+      "%24": 216,
+      "[Pt+4]": 217,
+      "[Zr+3]": 218,
+      "[PH3+]": 219,
+      "[Sr+2]": 220,
+      "[Cd+2]": 221,
+      "[Cd]": 222,
+      "%25": 223,
+      "[Os]": 224,
+      "[BH-]": 225,
+      "[Sn+4]": 226,
+      "[Cr+3]": 227,
+      "[Ru+3]": 228,
+      "[PH2+]": 229,
+      "[Rh+2]": 230,
+      "[V+2]": 231,
+      "%26": 232,
+      "[Gd+3]": 233,
+      "[Pb+2]": 234,
+      "[PH]": 235,
+      "[Hg+]": 236,
+      "[Mo+2]": 237,
+      "[AlH]": 238,
+      "[Sn+]": 239,
+      "%27": 240,
+      "[Pd+]": 241,
+      "b": 242,
+      "[Rh+3]": 243,
+      "[Hg+2]": 244,
+      "[15NH]": 245,
+      "[14C]": 246,
+      "%28": 247,
+      "[Mn+3]": 248,
+      "[Si+]": 249,
+      "[SeH]": 250,
+      "[13C@H]": 251,
+      "[NH]": 252,
+      "[Ga+3]": 253,
+      "[SiH-]": 254,
+      "[13C@@H]": 255,
+      "[Ce]": 256,
+      "[Au+3]": 257,
+      "[Bi+3]": 258,
+      "[15N]": 259,
+      "%29": 260,
+      "[BH3-]": 261,
+      "[14cH]": 262,
+      "[Ti+]": 263,
+      "[Gd]": 264,
+      "[cH+]": 265,
+      "[Cr+2]": 266,
+      "[Sb-]": 267,
+      "%30": 268,
+      "[Be+2]": 269,
+      "[Al+]": 270,
+      "[te]": 271,
+      "[11CH3]": 272,
+      "[Sm]": 273,
+      "[Pr]": 274,
+      "[La]": 275,
+      "%31": 276,
+      "[Al-]": 277,
+      "[Ta]": 278,
+      "[125I]": 279,
+      "[BH2-]": 280,
+      "[Nb]": 281,
+      "[Si@]": 282,
+      "%32": 283,
+      "[14c]": 284,
+      "[Sb+3]": 285,
+      "[Ba]": 286,
+      "%33": 287,
+      "[Os+2]": 288,
+      "[Si@@]": 289,
+      "[La+3]": 290,
+      "[15n]": 291,
+      "[15NH2]": 292,
+      "[Nd+3]": 293,
+      "%34": 294,
+      "[14CH2]": 295,
+      "[18O]": 296,
+      "[Nd]": 297,
+      "[GeH]": 298,
+      "[Ni+3]": 299,
+      "[Eu]": 300,
+      "[Dy+3]": 301,
+      "[Sc]": 302,
+      "%36": 303,
+      "[Se-2]": 304,
+      "[As+]": 305,
+      "%35": 306,
+      "[AsH]": 307,
+      "[Tb]": 308,
+      "[Sb+5]": 309,
+      "[Se+]": 310,
+      "[Ce+3]": 311,
+      "[c+]": 312,
+      "[In+3]": 313,
+      "[SnH]": 314,
+      "[Mo+4]": 315,
+      "%37": 316,
+      "[V+4]": 317,
+      "[Eu+3]": 318,
+      "[Hf+2]": 319,
+      "%38": 320,
+      "[Pt+]": 321,
+      "[p+]": 322,
+      "[123I]": 323,
+      "[Tl+]": 324,
+      "[Sm+3]": 325,
+      "%39": 326,
+      "[Yb+3]": 327,
+      "%40": 328,
+      "[Yb]": 329,
+      "[Os+]": 330,
+      "%41": 331,
+      "[10B]": 332,
+      "[Sc+3]": 333,
+      "[Al+2]": 334,
+      "%42": 335,
+      "[Sr]": 336,
+      "[Tb+3]": 337,
+      "[Po]": 338,
+      "[Tc]": 339,
+      "[PH-]": 340,
+      "[AlH3]": 341,
+      "[Ar]": 342,
+      "[U+4]": 343,
+      "[SnH2]": 344,
+      "[Cl+2]": 345,
+      "[si]": 346,
+      "[Fe+]": 347,
+      "[14CH3]": 348,
+      "[U+3]": 349,
+      "[Cl+]": 350,
+      "%43": 351,
+      "[GeH2]": 352,
+      "%44": 353,
+      "[Er+3]": 354,
+      "[Mo+3]": 355,
+      "[I+2]": 356,
+      "[Fe+4]": 357,
+      "[99Tc]": 358,
+      "%45": 359,
+      "[11C]": 360,
+      "%46": 361,
+      "[SnH3]": 362,
+      "[S]": 363,
+      "[Te+]": 364,
+      "[Er]": 365,
+      "[Lu+3]": 366,
+      "[11B]": 367,
+      "%47": 368,
+      "%48": 369,
+      "[P]": 370,
+      "[Tm]": 371,
+      "[Th]": 372,
+      "[Dy]": 373,
+      "[Pr+3]": 374,
+      "[Ta+5]": 375,
+      "[Nb+5]": 376,
+      "[Rb]": 377,
+      "[GeH3]": 378,
+      "[Br+2]": 379,
+      "%49": 380,
+      "[131I]": 381,
+      "[Fm]": 382,
+      "[Cs]": 383,
+      "[BH4-]": 384,
+      "[Lu]": 385,
+      "[15nH]": 386,
+      "%50": 387,
+      "[Ru+6]": 388,
+      "[b-]": 389,
+      "[Ho]": 390,
+      "[Th+4]": 391,
+      "[Ru+4]": 392,
+      "%52": 393,
+      "[14CH]": 394,
+      "%51": 395,
+      "[Cr+6]": 396,
+      "[18OH]": 397,
+      "[Ho+3]": 398,
+      "[Ce+4]": 399,
+      "[Bi+2]": 400,
+      "[Co+]": 401,
+      "%53": 402,
+      "[Yb+2]": 403,
+      "[Fe+6]": 404,
+      "[Be]": 405,
+      "%54": 406,
+      "[SH3+]": 407,
+      "[Np]": 408,
+      "[As-]": 409,
+      "%55": 410,
+      "[14C@@H]": 411,
+      "[Ir+2]": 412,
+      "[GaH3]": 413,
+      "[p-]": 414,
+      "[GeH4]": 415,
+      "[Sn+3]": 416,
+      "[Os+4]": 417,
+      "%56": 418,
+      "[14C@H]": 419,
+      "[sH+]": 420,
+      "[19F]": 421,
+      "[Eu+2]": 422,
+      "[TlH]": 423,
+      "%57": 424,
+      "[Cr+4]": 425,
+      "%58": 426,
+      "[B@@-]": 427,
+      "[SiH+]": 428,
+      "[At]": 429,
+      "[Am]": 430,
+      "[Fe+5]": 431,
+      "[AsH2]": 432,
+      "[Si+4]": 433,
+      "[B@-]": 434,
+      "[Pu]": 435,
+      "[SbH]": 436,
+      "[P-2]": 437,
+      "[Tm+3]": 438,
+      "*": 439,
+      "%59": 440,
+      "[se+]": 441,
+      "%60": 442,
+      "[oH+]": 443,
+      "[1H]": 444,
+      "[15N+]": 445,
+      "[124I]": 446,
+      "[S@@+]": 447,
+      "[P-3]": 448,
+      "[H]": 449,
+      "[IH2+]": 450,
+      "[TeH]": 451,
+      "[Xe]": 452,
+      "[PH4+]": 453,
+      "[Cr+]": 454,
+      "[Cm]": 455,
+      "[I+3]": 456,
+      "%61": 457,
+      "[Nb+2]": 458,
+      "[Ru+5]": 459,
+      "%62": 460,
+      "[Ta+2]": 461,
+      "[Tc+4]": 462,
+      "[CH3+]": 463,
+      "[Pm]": 464,
+      "[Si@H]": 465,
+      "[No]": 466,
+      "%63": 467,
+      "[Cr+5]": 468,
+      "[Th+2]": 469,
+      "[Zn-2]": 470,
+      "[13C@]": 471,
+      "[Lr]": 472,
+      "%64": 473,
+      "[99Tc+3]": 474,
+      "%65": 475,
+      "[13C@@]": 476,
+      "%66": 477,
+      "[Fe-]": 478,
+      "[17O]": 479,
+      "[siH]": 480,
+      "[Sb+]": 481,
+      "[OH]": 482,
+      "[IH]": 483,
+      "[11CH2]": 484,
+      "[Cf]": 485,
+      "[SiH2+]": 486,
+      "[Gd+2]": 487,
+      "[In+]": 488,
+      "[Si@@H]": 489,
+      "[Mn+]": 490,
+      "[99Tc+4]": 491,
+      "[Ga-]": 492,
+      "%67": 493,
+      "[S@+]": 494,
+      "[Ge+4]": 495,
+      "[Tl+3]": 496,
+      "[16OH]": 497,
+      "%68": 498,
+      "[2H-]": 499,
+      "[Ra]": 500,
+      "[si-]": 501,
+      "[NiH2]": 502,
+      "[P@@H]": 503,
+      "[Rh+]": 504,
+      "[12C]": 505,
+      "[35S]": 506,
+      "[32P]": 507,
+      "[SiH2-]": 508,
+      "[AlH2+]": 509,
+      "[16O]": 510,
+      "%69": 511,
+      "[BiH]": 512,
+      "[BiH2]": 513,
+      "[Zn-]": 514,
+      "[BH]": 515,
+      "[Tc+3]": 516,
+      "[Ir+]": 517,
+      "[Ni+]": 518,
+      "%70": 519,
+      "[InH2]": 520,
+      "[InH]": 521,
+      "[Nb+3]": 522,
+      "[PbH]": 523,
+      "[Bi+]": 524,
+      "%71": 525,
+      "[As+3]": 526,
+      "%72": 527,
+      "[18O-]": 528,
+      "[68Ga+3]": 529,
+      "%73": 530,
+      "[Pa]": 531,
+      "[76Br]": 532,
+      "[Tc+5]": 533,
+      "[pH+]": 534,
+      "[64Cu+2]": 535,
+      "[Ru+8]": 536,
+      "%74": 537,
+      "[PH2-]": 538,
+      "[Si+2]": 539,
+      "[17OH]": 540,
+      "[RuH]": 541,
+      "[111In+3]": 542,
+      "[AlH+]": 543,
+      "%75": 544,
+      "%76": 545,
+      "[W+]": 546,
+      "[SbH2]": 547,
+      "[PoH]": 548,
+      "[Ru-]": 549,
+      "[XeH]": 550,
+      "[Tc+2]": 551,
+      "[13C-]": 552,
+      "[Br+]": 553,
+      "[Pt-2]": 554,
+      "[Es]": 555,
+      "[Cu-]": 556,
+      "[Mg+]": 557,
+      "[3HH]": 558,
+      "[P@H]": 559,
+      "[ClH2+]": 560,
+      "%77": 561,
+      "[SH]": 562,
+      "[Au-]": 563,
+      "[2HH]": 564,
+      "%78": 565,
+      "[Sn-]": 566,
+      "[11CH]": 567,
+      "[PdH2]": 568,
+      "0": 569,
+      "[Os+6]": 570,
+      "%79": 571,
+      "[Mo+]": 572,
+      "%80": 573,
+      "[al]": 574,
+      "[PbH2]": 575,
+      "[64Cu]": 576,
+      "[Cl]": 577,
+      "[12CH3]": 578,
+      "%81": 579,
+      "[Tc+7]": 580,
+      "[11c]": 581,
+      "%82": 582,
+      "[Li-]": 583,
+      "[99Tc+5]": 584,
+      "[He]": 585,
+      "[12c]": 586,
+      "[Kr]": 587,
+      "[RuH+2]": 588,
+      "[35Cl]": 589,
+      "[Pd-2]": 590,
+      "[GaH2]": 591,
+      "[4H]": 592,
+      "[Sg]": 593,
+      "[Cu-2]": 594,
+      "[Br+3]": 595,
+      "%83": 596,
+      "[37Cl]": 597,
+      "[211At]": 598,
+      "[IrH+2]": 599,
+      "[Mt]": 600,
+      "[Ir-2]": 601,
+      "[In-]": 602,
+      "[12cH]": 603,
+      "[12CH2]": 604,
+      "[RuH2]": 605,
+      "[99Tc+7]": 606,
+      "%84": 607,
+      "[15n+]": 608,
+      "[ClH2+2]": 609,
+      "[16N]": 610,
+      "[111In]": 611,
+      "[Tc+]": 612,
+      "[Ru-2]": 613,
+      "[12CH]": 614,
+      "[si+]": 615,
+      "[Tc+6]": 616,
+      "%85": 617,
+      "%86": 618,
+      "[90Y]": 619,
+      "[Pd-]": 620,
+      "[188Re]": 621,
+      "[RuH+]": 622,
+      "[NiH]": 623,
+      "[SiH3-]": 624,
+      "[14n]": 625,
+      "[CH3]": 626,
+      "[14N]": 627,
+      "[10BH2]": 628,
+      "%88": 629,
+      "%89": 630,
+      "%90": 631,
+      "[34S]": 632,
+      "[77Br]": 633,
+      "[GaH]": 634,
+      "[Br]": 635,
+      "[Ge@]": 636,
+      "[B@@H-]": 637,
+      "[CuH]": 638,
+      "[SiH4]": 639,
+      "[3H-]": 640,
+      "%87": 641,
+      "%91": 642,
+      "%92": 643,
+      "[67Cu]": 644,
+      "[I]": 645,
+      "[177Lu]": 646,
+      "[ReH]": 647,
+      "[67Ga+3]": 648,
+      "[Db]": 649,
+      "[177Lu+3]": 650,
+      "[AlH2-]": 651,
+      "[Si+3]": 652,
+      "[Ti-2]": 653,
+      "[RuH+3]": 654,
+      "[al+]": 655,
+      "[68Ga]": 656,
+      "[2H+]": 657,
+      "[B@H-]": 658,
+      "[WH2]": 659,
+      "[OsH]": 660,
+      "[Ir-3]": 661,
+      "[AlH-]": 662,
+      "[Bk]": 663,
+      "[75Se]": 664,
+      "[14C@]": 665,
+      "[Pt-]": 666,
+      "[N@@H+]": 667,
+      "[Nb-]": 668,
+      "[13NH2]": 669,
+      "%93": 670,
+      "[186Re]": 671,
+      "[Tb+4]": 672,
+      "[PtH]": 673,
+      "[IrH2]": 674,
+      "[Hg-2]": 675,
+      "[AlH3-]": 676,
+      "[PdH+]": 677,
+      "[Md]": 678,
+      "[RhH+2]": 679,
+      "[11cH]": 680,
+      "[Co-2]": 681,
+      "[15N-]": 682,
+      "[ZrH2]": 683,
+      "%94": 684,
+      "[Hg-]": 685,
+      "[127I]": 686,
+      "[AsH2+]": 687,
+      "[MoH2]": 688,
+      "[Te+4]": 689,
+      "[14C@@]": 690,
+      "[As+5]": 691,
+      "[SnH+3]": 692,
+      "[Ge@@]": 693,
+      "[6Li+]": 694,
+      "[WH]": 695,
+      "[Ne]": 696,
+      "[14NH2]": 697,
+      "[14NH]": 698,
+      "[12C@@H]": 699,
+      "[Os+7]": 700,
+      "[RhH]": 701,
+      "[Al-3]": 702,
+      "[SnH+]": 703,
+      "[15NH3+]": 704,
+      "[Zr+]": 705,
+      "[197Hg+]": 706,
+      "%95": 707,
+      "%96": 708,
+      "[90Y+3]": 709,
+      "[Os-2]": 710,
+      "[98Tc+5]": 711,
+      "[15NH3]": 712,
+      "[bH-]": 713,
+      "[33P]": 714,
+      "[Zr-2]": 715,
+      "[15O]": 716,
+      "[Rh-]": 717,
+      "[PbH3]": 718,
+      "[PH2]": 719,
+      "[Ni-]": 720,
+      "[CuH+]": 721,
+      "%97": 722,
+      "%98": 723,
+      "%99": 724,
+      "[Os+5]": 725,
+      "[PtH+]": 726,
+      "[ReH4]": 727,
+      "[16NH]": 728,
+      "[82Br]": 729,
+      "[W-]": 730,
+      "[18F-]": 731,
+      "[15NH4+]": 732,
+      "[Se+4]": 733,
+      "[SeH-]": 734,
+      "[67Cu+2]": 735,
+      "[12C@H]": 736,
+      "[AsH3]": 737,
+      "[HgH]": 738,
+      "[10B-]": 739,
+      "[99Tc+6]": 740,
+      "[117Sn+4]": 741,
+      "[Te@]": 742,
+      "[P@+]": 743,
+      "[35SH]": 744,
+      "[SeH+]": 745,
+      "[Ni-2]": 746,
+      "[Al-2]": 747,
+      "[TeH2]": 748,
+      "[Bh]": 749,
+      "[99Tc+2]": 750,
+      "[Os+8]": 751,
+      "[PH-2]": 752,
+      "[7Li+]": 753,
+      "[14nH]": 754,
+      "[AlH+2]": 755,
+      "[18FH]": 756,
+      "[SnH4]": 757,
+      "[18O-2]": 758,
+      "[IrH]": 759,
+      "[13N]": 760,
+      "[Te@@]": 761,
+      "[Rh-3]": 762,
+      "[15NH+]": 763,
+      "[AsH3+]": 764,
+      "[SeH2]": 765,
+      "[AsH+]": 766,
+      "[CoH2]": 767,
+      "[16NH2]": 768,
+      "[AsH-]": 769,
+      "[203Hg+]": 770,
+      "[P@@+]": 771,
+      "[166Ho+3]": 772,
+      "[60Co+3]": 773,
+      "[13CH2-]": 774,
+      "[SeH2+]": 775,
+      "[75Br]": 776,
+      "[TlH2]": 777,
+      "[80Br]": 778,
+      "[siH+]": 779,
+      "[Ca+]": 780,
+      "[153Sm+3]": 781,
+      "[PdH]": 782,
+      "[225Ac]": 783,
+      "[13CH3-]": 784,
+      "[AlH4-]": 785,
+      "[FeH]": 786,
+      "[13CH-]": 787,
+      "[14C-]": 788,
+      "[11C-]": 789,
+      "[153Sm]": 790,
+      "[Re-]": 791,
+      "[te+]": 792,
+      "[13CH4]": 793,
+      "[ClH+2]": 794,
+      "[8CH2]": 795,
+      "[99Mo]": 796,
+      "[ClH3+3]": 797,
+      "[SbH3]": 798,
+      "[25Mg+2]": 799,
+      "[16N+]": 800,
+      "[SnH2+]": 801,
+      "[11C@H]": 802,
+      "[122I]": 803,
+      "[Re-2]": 804,
+      "[RuH2+2]": 805,
+      "[ZrH]": 806,
+      "[Bi-]": 807,
+      "[Pr+]": 808,
+      "[Rn]": 809,
+      "[Fr]": 810,
+      "[36Cl]": 811,
+      "[18o]": 812,
+      "[YH]": 813,
+      "[79Br]": 814,
+      "[121I]": 815,
+      "[113In+3]": 816,
+      "[TaH]": 817,
+      "[RhH2]": 818,
+      "[Ta-]": 819,
+      "[67Ga]": 820,
+      "[ZnH+]": 821,
+      "[SnH2-]": 822,
+      "[OsH2]": 823,
+      "[16F]": 824,
+      "[FeH2]": 825,
+      "[14O]": 826,
+      "[PbH2+2]": 827,
+      "[BH2]": 828,
+      "[6H]": 829,
+      "[125Te]": 830,
+      "[197Hg]": 831,
+      "[TaH2]": 832,
+      "[TaH3]": 833,
+      "[76As]": 834,
+      "[Nb-2]": 835,
+      "[14N+]": 836,
+      "[125I-]": 837,
+      "[33S]": 838,
+      "[IH2+2]": 839,
+      "[NH2]": 840,
+      "[PtH2]": 841,
+      "[MnH]": 842,
+      "[19C]": 843,
+      "[17F]": 844,
+      "[1H-]": 845,
+      "[SnH4+2]": 846,
+      "[Mn-2]": 847,
+      "[15NH2+]": 848,
+      "[TiH2]": 849,
+      "[ReH7]": 850,
+      "[Cd-2]": 851,
+      "[Fe-3]": 852,
+      "[SH2]": 853,
+      "[17O-]": 854,
+      "[siH-]": 855,
+      "[CoH+]": 856,
+      "[VH]": 857,
+      "[10BH]": 858,
+      "[Ru-3]": 859,
+      "[13O]": 860,
+      "[5H]": 861,
+      "[15n-]": 862,
+      "[153Gd]": 863,
+      "[12C@]": 864,
+      "[11CH3-]": 865,
+      "[IrH3]": 866,
+      "[RuH3]": 867,
+      "[74Se]": 868,
+      "[Se@]": 869,
+      "[Hf+]": 870,
+      "[77Se]": 871,
+      "[166Ho]": 872,
+      "[59Fe+2]": 873,
+      "[203Hg]": 874,
+      "[18OH-]": 875,
+      "[8CH]": 876,
+      "[12C@@]": 877,
+      "[11CH4]": 878,
+      "[15C]": 879,
+      "[249Cf]": 880,
+      "[PbH4]": 881,
+      "[64Zn]": 882,
+      "[99Tc+]": 883,
+      "[14c-]": 884,
+      "[149Pm]": 885,
+      "[IrH4]": 886,
+      "[Se@@]": 887,
+      "[13OH]": 888,
+      "[14CH3-]": 889,
+      "[28Si]": 890,
+      "[Rh-2]": 891,
+      "[Fe-2]": 892,
+      "[131I-]": 893,
+      "[51Cr]": 894,
+      "[62Cu+2]": 895,
+      "[81Br]": 896,
+      "[121Sb]": 897,
+      "[7Li]": 898,
+      "[89Zr+4]": 899,
+      "[SbH3+]": 900,
+      "[11C@@H]": 901,
+      "[98Tc]": 902,
+      "[59Fe+3]": 903,
+      "[BiH2+]": 904,
+      "[SbH+]": 905,
+      "[TiH]": 906,
+      "[14NH3]": 907,
+      "[15OH]": 908,
+      "[119Sn]": 909,
+      "[201Hg]": 910,
+      "[MnH+]": 911,
+      "[201Tl]": 912,
+      "[51Cr+3]": 913,
+      "[123I-]": 914,
+      "[MoH]": 915,
+      "[AlH6-3]": 916,
+      "[MnH2]": 917,
+      "[WH3]": 918,
+      "[213Bi+3]": 919,
+      "[SnH2+2]": 920,
+      "[123IH]": 921,
+      "[13CH+]": 922,
+      "[Zr-]": 923,
+      "[74As]": 924,
+      "[13C+]": 925,
+      "[32P+]": 926,
+      "[KrH]": 927,
+      "[SiH+2]": 928,
+      "[ClH3+2]": 929,
+      "[13NH]": 930,
+      "[9CH2]": 931,
+      "[ZrH2+2]": 932,
+      "[87Sr+2]": 933,
+      "[35s]": 934,
+      "[239Pu]": 935,
+      "[198Au]": 936,
+      "[241Am]": 937,
+      "[203Hg+2]": 938,
+      "[V+]": 939,
+      "[YH2]": 940,
+      "[195Pt]": 941,
+      "[203Pb]": 942,
+      "[RuH4]": 943,
+      "[ThH2]": 944,
+      "[AuH]": 945,
+      "[66Ga+3]": 946,
+      "[11B-]": 947,
+      "[F]": 948,
+      "[24Na+]": 949,
+      "[85Sr+2]": 950,
+      "[201Tl+]": 951,
+      "[14CH4]": 952,
+      "[32S]": 953,
+      "[TeH2+]": 954,
+      "[ClH2+3]": 955,
+      "[AgH]": 956,
+      "[Ge@H]": 957,
+      "[44Ca+2]": 958,
+      "[Os-]": 959,
+      "[31P]": 960,
+      "[15nH+]": 961,
+      "[SbH4]": 962,
+      "[TiH+]": 963,
+      "[Ba+]": 964,
+      "[57Co+2]": 965,
+      "[Ta+]": 966,
+      "[125IH]": 967,
+      "[77As]": 968,
+      "[129I]": 969,
+      "[Fe-4]": 970,
+      "[Ta-2]": 971,
+      "[19O]": 972,
+      "[12O]": 973,
+      "[BiH3]": 974,
+      "[237Np]": 975,
+      "[252Cf]": 976,
+      "[86Y]": 977,
+      "[Cr-2]": 978,
+      "[89Y]": 979,
+      "[195Pt+2]": 980,
+      "[si+2]": 981,
+      "[58Fe+2]": 982,
+      "[Hs]": 983,
+      "[S@@H]": 984,
+      "[8CH4]": 985,
+      "[164Dy+3]": 986,
+      "[47Ca+2]": 987,
+      "[57Co]": 988,
+      "[NbH2]": 989,
+      "[ReH2]": 990,
+      "[ZnH2]": 991,
+      "[CrH2]": 992,
+      "[17NH]": 993,
+      "[ZrH3]": 994,
+      "[RhH3]": 995,
+      "[12C-]": 996,
+      "[18O+]": 997,
+      "[Bi-2]": 998,
+      "[ClH4+3]": 999,
+      "[Ni-3]": 1000,
+      "[Ag-]": 1001,
+      "[111In-]": 1002,
+      "[Mo-2]": 1003,
+      "[55Fe+3]": 1004,
+      "[204Hg+]": 1005,
+      "[35Cl-]": 1006,
+      "[211Pb]": 1007,
+      "[75Ge]": 1008,
+      "[8B]": 1009,
+      "[TeH3]": 1010,
+      "[SnH3+]": 1011,
+      "[Zr-3]": 1012,
+      "[28F]": 1013,
+      "[249Bk]": 1014,
+      "[169Yb]": 1015,
+      "[34SH]": 1016,
+      "[6Li]": 1017,
+      "[94Tc]": 1018,
+      "[197Au]": 1019,
+      "[195Pt+4]": 1020,
+      "[169Yb+3]": 1021,
+      "[32Cl]": 1022,
+      "[82Se]": 1023,
+      "[159Gd+3]": 1024,
+      "[213Bi]": 1025,
+      "[CoH+2]": 1026,
+      "[36S]": 1027,
+      "[35P]": 1028,
+      "[Ru-4]": 1029,
+      "[Cr-3]": 1030,
+      "[60Co]": 1031,
+      "[1H+]": 1032,
+      "[18CH2]": 1033,
+      "[Cd-]": 1034,
+      "[152Sm+3]": 1035,
+      "[106Ru]": 1036,
+      "[238Pu]": 1037,
+      "[220Rn]": 1038,
+      "[45Ca+2]": 1039,
+      "[89Sr+2]": 1040,
+      "[239Np]": 1041,
+      "[90Sr+2]": 1042,
+      "[137Cs+]": 1043,
+      "[165Dy]": 1044,
+      "[68GaH3]": 1045,
+      "[65Zn+2]": 1046,
+      "[89Zr]": 1047,
+      "[BiH2+2]": 1048,
+      "[62Cu]": 1049,
+      "[165Dy+3]": 1050,
+      "[238U]": 1051,
+      "[105Rh+3]": 1052,
+      "[70Zn]": 1053,
+      "[12B]": 1054,
+      "[12OH]": 1055,
+      "[18CH]": 1056,
+      "[17CH]": 1057,
+      "[42K]": 1058,
+      "[76Br-]": 1059,
+      "[71As]": 1060,
+      "[NbH3]": 1061,
+      "[ReH3]": 1062,
+      "[OsH-]": 1063,
+      "[WH4]": 1064,
+      "[MoH3]": 1065,
+      "[OsH4]": 1066,
+      "[RuH6]": 1067,
+      "[PtH3]": 1068,
+      "[CuH2]": 1069,
+      "[CoH3]": 1070,
+      "[TiH4]": 1071,
+      "[64Zn+2]": 1072,
+      "[Si-2]": 1073,
+      "[79BrH]": 1074,
+      "[14CH2-]": 1075,
+      "[PtH2+2]": 1076,
+      "[Os-3]": 1077,
+      "[29Si]": 1078,
+      "[Ti-]": 1079,
+      "[Se+6]": 1080,
+      "[22Na+]": 1081,
+      "[42K+]": 1082,
+      "[131Cs+]": 1083,
+      "[86Rb+]": 1084,
+      "[134Cs+]": 1085,
+      "[209Po]": 1086,
+      "[208Po]": 1087,
+      "[81Rb+]": 1088,
+      "[203Tl+]": 1089,
+      "[Zr-4]": 1090,
+      "[148Sm]": 1091,
+      "[147Sm]": 1092,
+      "[37Cl-]": 1093,
+      "[12CH4]": 1094,
+      "[Ge@@H]": 1095,
+      "[63Cu]": 1096,
+      "[13CH2+]": 1097,
+      "[AsH2-]": 1098,
+      "[CeH]": 1099,
+      "[SnH-]": 1100,
+      "[UH]": 1101,
+      "[9c]": 1102,
+      "[21CH3]": 1103,
+      "[TeH+]": 1104,
+      "[57Co+3]": 1105,
+      "[8BH2]": 1106,
+      "[12BH2]": 1107,
+      "[19BH2]": 1108,
+      "[9BH2]": 1109,
+      "[YbH2]": 1110,
+      "[CrH+2]": 1111,
+      "[208Bi]": 1112,
+      "[152Gd]": 1113,
+      "[61Cu]": 1114,
+      "[115In]": 1115,
+      "[60Co+2]": 1116,
+      "[13NH2-]": 1117,
+      "[120I]": 1118,
+      "[18OH2]": 1119,
+      "[75SeH]": 1120,
+      "[SbH2+]": 1121,
+      "[144Ce]": 1122,
+      "[16n]": 1123,
+      "[113In]": 1124,
+      "[22nH]": 1125,
+      "[129I-]": 1126,
+      "[InH3]": 1127,
+      "[32PH3]": 1128,
+      "[234U]": 1129,
+      "[235U]": 1130,
+      "[59Fe]": 1131,
+      "[82Rb+]": 1132,
+      "[65Zn]": 1133,
+      "[244Cm]": 1134,
+      "[147Pm]": 1135,
+      "[91Y]": 1136,
+      "[237Pu]": 1137,
+      "[231Pa]": 1138,
+      "[253Cf]": 1139,
+      "[127Te]": 1140,
+      "[187Re]": 1141,
+      "[236Np]": 1142,
+      "[235Np]": 1143,
+      "[72Zn]": 1144,
+      "[253Es]": 1145,
+      "[159Dy]": 1146,
+      "[62Zn]": 1147,
+      "[101Tc]": 1148,
+      "[149Tb]": 1149,
+      "[124I-]": 1150,
+      "[SeH3+]": 1151,
+      "[210Pb]": 1152,
+      "[40K]": 1153,
+      "[210Po]": 1154,
+      "[214Pb]": 1155,
+      "[218Po]": 1156,
+      "[214Po]": 1157,
+      "[7Be]": 1158,
+      "[212Pb]": 1159,
+      "[205Pb]": 1160,
+      "[209Pb]": 1161,
+      "[123Te]": 1162,
+      "[202Pb]": 1163,
+      "[72As]": 1164,
+      "[201Pb]": 1165,
+      "[70As]": 1166,
+      "[73Ge]": 1167,
+      "[200Pb]": 1168,
+      "[198Pb]": 1169,
+      "[66Ga]": 1170,
+      "[73Se]": 1171,
+      "[195Pb]": 1172,
+      "[199Pb]": 1173,
+      "[144Ce+3]": 1174,
+      "[235U+2]": 1175,
+      "[90Tc]": 1176,
+      "[114In+3]": 1177,
+      "[128I]": 1178,
+      "[100Tc+]": 1179,
+      "[82Br-]": 1180,
+      "[191Pt+2]": 1181,
+      "[191Pt+4]": 1182,
+      "[193Pt+4]": 1183,
+      "[31PH3]": 1184,
+      "[125I+2]": 1185,
+      "[131I+2]": 1186,
+      "[125Te+4]": 1187,
+      "[82Sr+2]": 1188,
+      "[149Sm]": 1189,
+      "[81BrH]": 1190,
+      "[129Xe]": 1191,
+      "[193Pt+2]": 1192,
+      "[123I+2]": 1193,
+      "[Cr-]": 1194,
+      "[Co-]": 1195,
+      "[227Th+4]": 1196,
+      "[249Cf+3]": 1197,
+      "[252Cf+3]": 1198,
+      "[187Os]": 1199,
+      "[16O-]": 1200,
+      "[17O+]": 1201,
+      "[16OH-]": 1202,
+      "[98Tc+7]": 1203,
+      "[58Co+2]": 1204,
+      "[69Ga+3]": 1205,
+      "[57Fe+2]": 1206,
+      "[43K+]": 1207,
+      "[16C]": 1208,
+      "[52Fe+3]": 1209,
+      "[SeH5]": 1210,
+      "[194Pb]": 1211,
+      "[196Pb]": 1212,
+      "[197Pb]": 1213,
+      "[213Pb]": 1214,
+      "[9B]": 1215,
+      "[19B]": 1216,
+      "[11CH-]": 1217,
+      "[9CH]": 1218,
+      "[20OH]": 1219,
+      "[25OH]": 1220,
+      "[8cH]": 1221,
+      "[TiH+3]": 1222,
+      "[SnH6+3]": 1223,
+      "[N@H+]": 1224,
+      "[52Mn+2]": 1225,
+      "[64Ga]": 1226,
+      "[13B]": 1227,
+      "[216Bi]": 1228,
+      "[117Sn+2]": 1229,
+      "[232Th]": 1230,
+      "[SnH+2]": 1231,
+      "[BiH5]": 1232,
+      "[77Kr]": 1233,
+      "[103Cd]": 1234,
+      "[62Ni]": 1235,
+      "[LaH3]": 1236,
+      "[SmH3]": 1237,
+      "[EuH3]": 1238,
+      "[MoH5]": 1239,
+      "[64Ni]": 1240,
+      "[66Zn]": 1241,
+      "[68Zn]": 1242,
+      "[186W]": 1243,
+      "[FeH4]": 1244,
+      "[MoH4]": 1245,
+      "[HgH2]": 1246,
+      "[15NH2-]": 1247,
+      "[UH2]": 1248,
+      "[204Hg]": 1249,
+      "[GaH4-]": 1250,
+      "[ThH4]": 1251,
+      "[WH6]": 1252,
+      "[PtH4]": 1253,
+      "[VH2]": 1254,
+      "[UH3]": 1255,
+      "[FeH3]": 1256,
+      "[RuH5]": 1257,
+      "[BiH4]": 1258,
+      "[80Br-]": 1259,
+      "[CeH3]": 1260,
+      "[37ClH]": 1261,
+      "[157Gd+3]": 1262,
+      "[205Tl]": 1263,
+      "[203Tl]": 1264,
+      "[62Cu+]": 1265,
+      "[64Cu+]": 1266,
+      "[61Cu+]": 1267,
+      "[37SH2]": 1268,
+      "[30Si]": 1269,
+      "[28Al]": 1270,
+      "[19OH2]": 1271,
+      "[8He]": 1272,
+      "[6He]": 1273,
+      "[153Pm]": 1274,
+      "[209Bi]": 1275,
+      "[66Zn+2]": 1276,
+      "[10CH4]": 1277,
+      "[191Ir]": 1278,
+      "[66Cu]": 1279,
+      "[16O+]": 1280,
+      "[25O]": 1281,
+      "[10c]": 1282,
+      "[Co-3]": 1283,
+      "[Sn@@]": 1284,
+      "[17OH-]": 1285,
+      "[206Po]": 1286,
+      "[204Po]": 1287,
+      "[202Po]": 1288,
+      "[201Po]": 1289,
+      "[200Po]": 1290,
+      "[199Po]": 1291,
+      "[198Po]": 1292,
+      "[197Po]": 1293,
+      "[196Po]": 1294,
+      "[195Po]": 1295,
+      "[194Po]": 1296,
+      "[193Po]": 1297,
+      "[192Po]": 1298,
+      "[191Po]": 1299,
+      "[190Po]": 1300,
+      "[217Po]": 1301,
+      "[BiH4-]": 1302,
+      "[TeH4]": 1303,
+      "[222Ra]": 1304,
+      "[62Ga]": 1305,
+      "[39Ar]": 1306,
+      "[144Sm]": 1307,
+      "[58Fe]": 1308,
+      "[153Eu]": 1309,
+      "[85Rb]": 1310,
+      "[171Yb]": 1311,
+      "[172Yb]": 1312,
+      "[114Cd]": 1313,
+      "[51Fe]": 1314,
+      "[142Ce]": 1315,
+      "[207Tl]": 1316,
+      "[92Mo]": 1317,
+      "[115Sn]": 1318,
+      "[140Ce]": 1319,
+      "[202Hg]": 1320,
+      "[180W]": 1321,
+      "[182W]": 1322,
+      "[183W]": 1323,
+      "[184W]": 1324,
+      "[96Mo]": 1325,
+      "[47Ti]": 1326,
+      "[111Cd]": 1327,
+      "[143Nd]": 1328,
+      "[145Nd]": 1329,
+      "[126Te]": 1330,
+      "[128Te]": 1331,
+      "[130Te]": 1332,
+      "[185Re]": 1333,
+      "[97Mo]": 1334,
+      "[98Mo]": 1335,
+      "[183Re]": 1336,
+      "[52V]": 1337,
+      "[80Se]": 1338,
+      "[87Kr]": 1339,
+      "[137Xe]": 1340,
+      "[196Au]": 1341,
+      "[146Ce]": 1342,
+      "[88Kr]": 1343,
+      "[51Ti]": 1344,
+      "[138Xe]": 1345,
+      "[112Cd]": 1346,
+      "[116Sn]": 1347,
+      "[120Sn]": 1348,
+      "[28SiH3]": 1349,
+      "[35S-]": 1350,
+      "[15NH-]": 1351,
+      "[13CH3+]": 1352,
+      "[34S+]": 1353,
+      "[34s]": 1354,
+      "[SiH4-]": 1355,
+      "[100Tc+5]": 1356,
+      "[NiH2+2]": 1357,
+      "[239Th]": 1358,
+      "[186Lu]": 1359,
+      "[AuH3]": 1360,
+      "[I@@-]": 1361,
+      "[XeH2]": 1362,
+      "[B+]": 1363,
+      "[16CH2]": 1364,
+      "[8C]": 1365,
+      "[TaH5]": 1366,
+      "[FeH4-]": 1367,
+      "[19C@H]": 1368,
+      "[10NH]": 1369,
+      "[FeH6-3]": 1370,
+      "[22CH]": 1371,
+      "[25N]": 1372,
+      "[25N+]": 1373,
+      "[25N-]": 1374,
+      "[21CH2]": 1375,
+      "[18cH]": 1376,
+      "[113I]": 1377,
+      "[ScH3]": 1378,
+      "[30PH3]": 1379,
+      "[43Ca+2]": 1380,
+      "[41Ca+2]": 1381,
+      "[106Cd]": 1382,
+      "[122Sn]": 1383,
+      "[18CH3]": 1384,
+      "[58Co+3]": 1385,
+      "[98Tc+4]": 1386,
+      "[70Ge]": 1387,
+      "[76Ge]": 1388,
+      "[108Cd]": 1389,
+      "[116Cd]": 1390,
+      "[130Xe]": 1391,
+      "[94Mo]": 1392,
+      "[124Sn]": 1393,
+      "[186Os]": 1394,
+      "[188Os]": 1395,
+      "[190Os]": 1396,
+      "[192Os]": 1397,
+      "[106Pd]": 1398,
+      "[110Pd]": 1399,
+      "[120Te]": 1400,
+      "[132Ba]": 1401,
+      "[134Ba]": 1402,
+      "[136Ba]": 1403,
+      "[136Ce]": 1404,
+      "[138Ce]": 1405,
+      "[156Dy]": 1406,
+      "[158Dy]": 1407,
+      "[160Dy]": 1408,
+      "[163Dy]": 1409,
+      "[162Er]": 1410,
+      "[164Er]": 1411,
+      "[167Er]": 1412,
+      "[176Hf]": 1413,
+      "[26Mg]": 1414,
+      "[144Nd]": 1415,
+      "[150Nd]": 1416,
+      "[41K]": 1417,
+      "[46Ti]": 1418,
+      "[48Ti]": 1419,
+      "[49Ti]": 1420,
+      "[50Ti]": 1421,
+      "[170Yb]": 1422,
+      "[173Yb]": 1423,
+      "[91Zr]": 1424,
+      "[92Zr]": 1425,
+      "[96Zr]": 1426,
+      "[34S-]": 1427,
+      "[CuH2-]": 1428,
+      "[38Cl]": 1429,
+      "[25Mg]": 1430,
+      "[51V]": 1431,
+      "[93Nb]": 1432,
+      "[95Mo]": 1433,
+      "[45Sc]": 1434,
+      "[123Sb]": 1435,
+      "[139La]": 1436,
+      "[9Be]": 1437,
+      "[99Y+3]": 1438,
+      "[99Y]": 1439,
+      "[156Ho]": 1440,
+      "[67Zn]": 1441,
+      "[144Ce+4]": 1442,
+      "[210Tl]": 1443,
+      "[42Ca]": 1444,
+      "[54Fe]": 1445,
+      "[193Ir]": 1446,
+      "[92Nb]": 1447,
+      "[141Cs]": 1448,
+      "[52Cr]": 1449,
+      "[35ClH]": 1450,
+      "[46Ca]": 1451,
+      "[139Cs]": 1452,
+      "[65Cu]": 1453,
+      "[71Ga]": 1454,
+      "[60Ni]": 1455,
+      "[16NH3]": 1456,
+      "[148Nd]": 1457,
+      "[72Ge]": 1458,
+      "[161Dy]": 1459,
+      "[49Ca]": 1460,
+      "[43Ca]": 1461,
+      "[8Be]": 1462,
+      "[48Ca]": 1463,
+      "[44Ca]": 1464,
+      "[120Xe]": 1465,
+      "[80Rb]": 1466,
+      "[215At]": 1467,
+      "[180Re]": 1468,
+      "[146Sm]": 1469,
+      "[19Ne]": 1470,
+      "[74Kr]": 1471,
+      "[134La]": 1472,
+      "[76Kr]": 1473,
+      "[219Fr]": 1474,
+      "[121Xe]": 1475,
+      "[220Fr]": 1476,
+      "[216At]": 1477,
+      "[223Ac]": 1478,
+      "[218At]": 1479,
+      "[37Ar]": 1480,
+      "[135I]": 1481,
+      "[110Cd]": 1482,
+      "[94Tc+7]": 1483,
+      "[86Y+3]": 1484,
+      "[135I-]": 1485,
+      "[15O-2]": 1486,
+      "[151Eu+3]": 1487,
+      "[161Tb+3]": 1488,
+      "[197Hg+2]": 1489,
+      "[109Cd+2]": 1490,
+      "[191Os+4]": 1491,
+      "[170Tm+3]": 1492,
+      "[205Bi+3]": 1493,
+      "[233U+4]": 1494,
+      "[126Sb+3]": 1495,
+      "[127Sb+3]": 1496,
+      "[132Cs+]": 1497,
+      "[136Eu+3]": 1498,
+      "[136Eu]": 1499,
+      "[125Sn+4]": 1500,
+      "[175Yb+3]": 1501,
+      "[100Mo]": 1502,
+      "[22Ne]": 1503,
+      "[13c-]": 1504,
+      "[13NH4+]": 1505,
+      "[17C]": 1506,
+      "[9C]": 1507,
+      "[31S]": 1508,
+      "[31SH]": 1509,
+      "[133I]": 1510,
+      "[126I]": 1511,
+      "[36SH]": 1512,
+      "[30S]": 1513,
+      "[32SH]": 1514,
+      "[19CH2]": 1515,
+      "[19c]": 1516,
+      "[18c]": 1517,
+      "[15F]": 1518,
+      "[10C]": 1519,
+      "[RuH-]": 1520,
+      "[62Zn+2]": 1521,
+      "[32ClH]": 1522,
+      "[33ClH]": 1523,
+      "[78BrH]": 1524,
+      "[12Li+]": 1525,
+      "[12Li]": 1526,
+      "[233Ra]": 1527,
+      "[68Ge+4]": 1528,
+      "[44Sc+3]": 1529,
+      "[91Y+3]": 1530,
+      "[106Ru+3]": 1531,
+      "[PoH2]": 1532,
+      "[AtH]": 1533,
+      "[55Fe]": 1534,
+      "[233U]": 1535,
+      "[210PoH2]": 1536,
+      "[230Th]": 1537,
+      "[228Th]": 1538,
+      "[222Rn]": 1539,
+      "[35SH2]": 1540,
+      "[227Th]": 1541,
+      "[192Ir]": 1542,
+      "[133Xe]": 1543,
+      "[81Kr]": 1544,
+      "[95Zr]": 1545,
+      "[240Pu]": 1546,
+      "[54Mn]": 1547,
+      "[103Ru]": 1548,
+      "[95Nb]": 1549,
+      "[109Cd]": 1550,
+      "[141Ce]": 1551,
+      "[85Kr]": 1552,
+      "[110Ag]": 1553,
+      "[58Co]": 1554,
+      "[241Pu]": 1555,
+      "[234Th]": 1556,
+      "[140La]": 1557,
+      "[63Ni]": 1558,
+      "[152Eu]": 1559,
+      "[132IH]": 1560,
+      "[226Rn]": 1561,
+      "[154Eu]": 1562,
+      "[36ClH]": 1563,
+      "[228Ac]": 1564,
+      "[155Eu]": 1565,
+      "[106Rh]": 1566,
+      "[243Am]": 1567,
+      "[227Ac]": 1568,
+      "[243Cm]": 1569,
+      "[236U]": 1570,
+      "[144Pr]": 1571,
+      "[232U]": 1572,
+      "[32SH2]": 1573,
+      "[88Y]": 1574,
+      "[82BrH]": 1575,
+      "[135IH]": 1576,
+      "[242Cm]": 1577,
+      "[115Cd]": 1578,
+      "[242Pu]": 1579,
+      "[46Sc]": 1580,
+      "[56Mn]": 1581,
+      "[234Pa]": 1582,
+      "[41Ar]": 1583,
+      "[147Nd]": 1584,
+      "[187W]": 1585,
+      "[151Sm]": 1586,
+      "[59Ni]": 1587,
+      "[233Pa]": 1588,
+      "[52Mn]": 1589,
+      "[94Nb]": 1590,
+      "[219Rn]": 1591,
+      "[236Pu]": 1592,
+      "[13NH3]": 1593,
+      "[93Zr]": 1594,
+      "[51Cr+6]": 1595,
+      "[TlH3]": 1596,
+      "[123Xe]": 1597,
+      "[160Tb]": 1598,
+      "[170Tm]": 1599,
+      "[182Ta]": 1600,
+      "[175Yb]": 1601,
+      "[93Mo]": 1602,
+      "[143Ce]": 1603,
+      "[191Os]": 1604,
+      "[126IH]": 1605,
+      "[48V]": 1606,
+      "[113Cd]": 1607,
+      "[47Sc]": 1608,
+      "[181Hf]": 1609,
+      "[185W]": 1610,
+      "[143Pr]": 1611,
+      "[191Pt]": 1612,
+      "[181W]": 1613,
+      "[33PH3]": 1614,
+      "[97Ru]": 1615,
+      "[97Tc]": 1616,
+      "[111Ag]": 1617,
+      "[169Er]": 1618,
+      "[107Pd]": 1619,
+      "[103Ru+2]": 1620,
+      "[34SH2]": 1621,
+      "[137Ce]": 1622,
+      "[242Am]": 1623,
+      "[117SnH2]": 1624,
+      "[57Ni]": 1625,
+      "[239U]": 1626,
+      "[60Cu]": 1627,
+      "[250Cf]": 1628,
+      "[193Au]": 1629,
+      "[69Zn]": 1630,
+      "[55Co]": 1631,
+      "[139Ce]": 1632,
+      "[127Xe]": 1633,
+      "[159Gd]": 1634,
+      "[56Co]": 1635,
+      "[177Hf]": 1636,
+      "[244Pu]": 1637,
+      "[38ClH]": 1638,
+      "[142Pr]": 1639,
+      "[199Hg]": 1640,
+      "[179Hf]": 1641,
+      "[178Hf]": 1642,
+      "[237U]": 1643,
+      "[156Eu]": 1644,
+      "[157Eu]": 1645,
+      "[105Ru]": 1646,
+      "[171Tm]": 1647,
+      "[199Au]": 1648,
+      "[155Sm]": 1649,
+      "[80BrH]": 1650,
+      "[108Ag]": 1651,
+      "[128IH]": 1652,
+      "[48Sc]": 1653,
+      "[45Ti]": 1654,
+      "[176Lu]": 1655,
+      "[121SnH2]": 1656,
+      "[148Pm]": 1657,
+      "[57Fe]": 1658,
+      "[10BH3]": 1659,
+      "[96Tc]": 1660,
+      "[133IH]": 1661,
+      "[143Pm]": 1662,
+      "[105Rh]": 1663,
+      "[130IH]": 1664,
+      "[134IH]": 1665,
+      "[131IH]": 1666,
+      "[71Zn]": 1667,
+      "[105Ag]": 1668,
+      "[97Zr]": 1669,
+      "[235Pu]": 1670,
+      "[231Th]": 1671,
+      "[109Pd]": 1672,
+      "[93Y]": 1673,
+      "[190Ir]": 1674,
+      "[135Xe]": 1675,
+      "[53Mn]": 1676,
+      "[134Ce]": 1677,
+      "[234Np]": 1678,
+      "[240Am]": 1679,
+      "[246Cf]": 1680,
+      "[240Cm]": 1681,
+      "[241Cm]": 1682,
+      "[226Th]": 1683,
+      "[39ClH]": 1684,
+      "[229Th]": 1685,
+      "[245Cm]": 1686,
+      "[240U]": 1687,
+      "[240Np]": 1688,
+      "[249Cm]": 1689,
+      "[243Pu]": 1690,
+      "[145Pm]": 1691,
+      "[199Pt]": 1692,
+      "[246Bk]": 1693,
+      "[193Pt]": 1694,
+      "[230U]": 1695,
+      "[250Cm]": 1696,
+      "[44Ti]": 1697,
+      "[175Hf]": 1698,
+      "[254Fm]": 1699,
+      "[255Fm]": 1700,
+      "[257Fm]": 1701,
+      "[92Y]": 1702,
+      "[188Ir]": 1703,
+      "[171Lu]": 1704,
+      "[257Md]": 1705,
+      "[247Bk]": 1706,
+      "[121IH]": 1707,
+      "[250Bk]": 1708,
+      "[179Lu]": 1709,
+      "[224Ac]": 1710,
+      "[195Hg]": 1711,
+      "[244Am]": 1712,
+      "[246Pu]": 1713,
+      "[194Au]": 1714,
+      "[252Fm]": 1715,
+      "[173Hf]": 1716,
+      "[246Cm]": 1717,
+      "[135Ce]": 1718,
+      "[49Cr]": 1719,
+      "[248Cf]": 1720,
+      "[247Cm]": 1721,
+      "[248Cm]": 1722,
+      "[174Ta]": 1723,
+      "[176Ta]": 1724,
+      "[154Tb]": 1725,
+      "[172Ta]": 1726,
+      "[177Ta]": 1727,
+      "[175Ta]": 1728,
+      "[180Ta]": 1729,
+      "[158Tb]": 1730,
+      "[115Ag]": 1731,
+      "[189Os]": 1732,
+      "[251Cf]": 1733,
+      "[145Pr]": 1734,
+      "[147Pr]": 1735,
+      "[76BrH]": 1736,
+      "[102Rh]": 1737,
+      "[238Np]": 1738,
+      "[185Os]": 1739,
+      "[246Am]": 1740,
+      "[233Np]": 1741,
+      "[166Dy]": 1742,
+      "[254Es]": 1743,
+      "[244Cf]": 1744,
+      "[193Os]": 1745,
+      "[245Am]": 1746,
+      "[245Bk]": 1747,
+      "[239Am]": 1748,
+      "[238Am]": 1749,
+      "[97Nb]": 1750,
+      "[245Pu]": 1751,
+      "[254Cf]": 1752,
+      "[188W]": 1753,
+      "[250Es]": 1754,
+      "[251Es]": 1755,
+      "[237Am]": 1756,
+      "[182Hf]": 1757,
+      "[258Md]": 1758,
+      "[232Np]": 1759,
+      "[238Cm]": 1760,
+      "[60Fe]": 1761,
+      "[109Pd+2]": 1762,
+      "[234Pu]": 1763,
+      "[141Ce+3]": 1764,
+      "[136Nd]": 1765,
+      "[136Pr]": 1766,
+      "[173Ta]": 1767,
+      "[110Ru]": 1768,
+      "[147Tb]": 1769,
+      "[253Fm]": 1770,
+      "[139Nd]": 1771,
+      "[178Re]": 1772,
+      "[177Re]": 1773,
+      "[200Au]": 1774,
+      "[182Re]": 1775,
+      "[156Tb]": 1776,
+      "[155Tb]": 1777,
+      "[157Tb]": 1778,
+      "[161Tb]": 1779,
+      "[161Ho]": 1780,
+      "[167Tm]": 1781,
+      "[173Lu]": 1782,
+      "[179Ta]": 1783,
+      "[171Er]": 1784,
+      "[44Sc]": 1785,
+      "[49Sc]": 1786,
+      "[49V]": 1787,
+      "[51Mn]": 1788,
+      "[90Nb]": 1789,
+      "[88Nb]": 1790,
+      "[88Zr]": 1791,
+      "[36SH2]": 1792,
+      "[174Yb]": 1793,
+      "[178Lu]": 1794,
+      "[179W]": 1795,
+      "[83BrH]": 1796,
+      "[107Cd]": 1797,
+      "[75BrH]": 1798,
+      "[62Co]": 1799,
+      "[48Cr]": 1800,
+      "[63Zn]": 1801,
+      "[102Ag]": 1802,
+      "[154Sm]": 1803,
+      "[168Er]": 1804,
+      "[65Ni]": 1805,
+      "[137La]": 1806,
+      "[187Ir]": 1807,
+      "[144Pm]": 1808,
+      "[146Pm]": 1809,
+      "[160Gd]": 1810,
+      "[166Yb]": 1811,
+      "[162Dy]": 1812,
+      "[47V]": 1813,
+      "[141Nd]": 1814,
+      "[141Sm]": 1815,
+      "[166Er]": 1816,
+      "[150Sm]": 1817,
+      "[146Eu]": 1818,
+      "[149Eu]": 1819,
+      "[174Lu]": 1820,
+      "[17NH3]": 1821,
+      "[102Ru]": 1822,
+      "[170Hf]": 1823,
+      "[188Pt]": 1824,
+      "[61Ni]": 1825,
+      "[56Ni]": 1826,
+      "[149Gd]": 1827,
+      "[151Gd]": 1828,
+      "[141Pm]": 1829,
+      "[147Gd]": 1830,
+      "[146Gd]": 1831,
+      "[161Er]": 1832,
+      "[103Ag]": 1833,
+      "[145Eu]": 1834,
+      "[153Tb]": 1835,
+      "[155Dy]": 1836,
+      "[184Re]": 1837,
+      "[180Os]": 1838,
+      "[182Os]": 1839,
+      "[186Pt]": 1840,
+      "[181Os]": 1841,
+      "[181Re]": 1842,
+      "[151Tb]": 1843,
+      "[178Ta]": 1844,
+      "[178W]": 1845,
+      "[189Pt]": 1846,
+      "[194Hg]": 1847,
+      "[145Sm]": 1848,
+      "[150Tb]": 1849,
+      "[132La]": 1850,
+      "[158Gd]": 1851,
+      "[104Ag]": 1852,
+      "[193Hg]": 1853,
+      "[94Ru]": 1854,
+      "[137Pr]": 1855,
+      "[155Ho]": 1856,
+      "[117Cd]": 1857,
+      "[99Ru]": 1858,
+      "[146Nd]": 1859,
+      "[218Rn]": 1860,
+      "[95Y]": 1861,
+      "[79Kr]": 1862,
+      "[120IH]": 1863,
+      "[138Pr]": 1864,
+      "[100Pd]": 1865,
+      "[166Tm]": 1866,
+      "[90Mo]": 1867,
+      "[151Nd]": 1868,
+      "[231U]": 1869,
+      "[138Nd]": 1870,
+      "[89Nb]": 1871,
+      "[98Nb]": 1872,
+      "[162Ho]": 1873,
+      "[142Sm]": 1874,
+      "[186Ta]": 1875,
+      "[104Tc]": 1876,
+      "[184Ta]": 1877,
+      "[185Ta]": 1878,
+      "[170Er]": 1879,
+      "[107Rh]": 1880,
+      "[131La]": 1881,
+      "[169Lu]": 1882,
+      "[74BrH]": 1883,
+      "[150Pm]": 1884,
+      "[172Tm]": 1885,
+      "[197Pt]": 1886,
+      "[230Pu]": 1887,
+      "[170Lu]": 1888,
+      "[86Zr]": 1889,
+      "[176W]": 1890,
+      "[177W]": 1891,
+      "[101Pd]": 1892,
+      "[105Pd]": 1893,
+      "[108Pd]": 1894,
+      "[149Nd]": 1895,
+      "[164Ho]": 1896,
+      "[159Ho]": 1897,
+      "[167Ho]": 1898,
+      "[176Yb]": 1899,
+      "[156Sm]": 1900,
+      "[77BrH]": 1901,
+      "[189Re]": 1902,
+      "[99Rh]": 1903,
+      "[100Rh]": 1904,
+      "[151Pm]": 1905,
+      "[232Pa]": 1906,
+      "[228Pa]": 1907,
+      "[230Pa]": 1908,
+      "[66Ni]": 1909,
+      "[194Os]": 1910,
+      "[135La]": 1911,
+      "[138La]": 1912,
+      "[141La]": 1913,
+      "[142La]": 1914,
+      "[195Ir]": 1915,
+      "[96Nb]": 1916,
+      "[157Ho]": 1917,
+      "[183Hf]": 1918,
+      "[162Tm]": 1919,
+      "[172Er]": 1920,
+      "[148Eu]": 1921,
+      "[150Eu]": 1922,
+      "[15CH4]": 1923,
+      "[89Kr]": 1924,
+      "[143La]": 1925,
+      "[58Ni]": 1926,
+      "[61Co]": 1927,
+      "[158Eu]": 1928,
+      "[165Er]": 1929,
+      "[167Yb]": 1930,
+      "[173Tm]": 1931,
+      "[175Tm]": 1932,
+      "[172Hf]": 1933,
+      "[172Lu]": 1934,
+      "[93Tc]": 1935,
+      "[177Yb]": 1936,
+      "[124IH]": 1937,
+      "[194Ir]": 1938,
+      "[147Eu]": 1939,
+      "[101Mo]": 1940,
+      "[180Hf]": 1941,
+      "[189Ir]": 1942,
+      "[87Y]": 1943,
+      "[43Sc]": 1944,
+      "[195Au]": 1945,
+      "[112Ag]": 1946,
+      "[84BrH]": 1947,
+      "[106Ag]": 1948,
+      "[109Ag]": 1949,
+      "[101Rh]": 1950,
+      "[162Yb]": 1951,
+      "[228Rn]": 1952,
+      "[139Pr]": 1953,
+      "[94Y]": 1954,
+      "[201Au]": 1955,
+      "[40PH3]": 1956,
+      "[110Ag+]": 1957,
+      "[104Cd]": 1958,
+      "[133Ba+2]": 1959,
+      "[226Ac]": 1960,
+      "[145Gd]": 1961,
+      "[186Ir]": 1962,
+      "[184Ir]": 1963,
+      "[224Rn]": 1964,
+      "[185Ir]": 1965,
+      "[182Ir]": 1966,
+      "[184Hf]": 1967,
+      "[200Pt]": 1968,
+      "[227Pa]": 1969,
+      "[178Yb]": 1970,
+      "[72Br-]": 1971,
+      "[72BrH]": 1972,
+      "[248Am]": 1973,
+      "[238Th]": 1974,
+      "[161Gd]": 1975,
+      "[35S-2]": 1976,
+      "[107Ag]": 1977,
+      "[FeH6-4]": 1978,
+      "[89Sr]": 1979,
+      "[SnH3-]": 1980,
+      "[SeH3]": 1981,
+      "[TeH3+]": 1982,
+      "[SbH4+]": 1983,
+      "[AsH4+]": 1984,
+      "[4He]": 1985,
+      "[AsH3-]": 1986,
+      "[1HH]": 1987,
+      "[3H+]": 1988,
+      "[82Rb]": 1989,
+      "[85Sr]": 1990,
+      "[90Sr]": 1991,
+      "[137Cs]": 1992,
+      "[133Ba]": 1993,
+      "[131Cs]": 1994,
+      "[SbH5]": 1995,
+      "[224Ra]": 1996,
+      "[22Na]": 1997,
+      "[210Bi]": 1998,
+      "[214Bi]": 1999,
+      "[228Ra]": 2000,
+      "[127Sb]": 2001,
+      "[136Cs]": 2002,
+      "[125Sb]": 2003,
+      "[134Cs]": 2004,
+      "[140Ba]": 2005,
+      "[45Ca]": 2006,
+      "[206Pb]": 2007,
+      "[207Pb]": 2008,
+      "[24Na]": 2009,
+      "[86Rb]": 2010,
+      "[212Bi]": 2011,
+      "[208Pb]": 2012,
+      "[124Sb]": 2013,
+      "[204Pb]": 2014,
+      "[44K]": 2015,
+      "[129Te]": 2016,
+      "[113Sn]": 2017,
+      "[204Tl]": 2018,
+      "[87Sr]": 2019,
+      "[208Tl]": 2020,
+      "[87Rb]": 2021,
+      "[47Ca]": 2022,
+      "[135Cs]": 2023,
+      "[216Po]": 2024,
+      "[137Ba]": 2025,
+      "[207Bi]": 2026,
+      "[212Po]": 2027,
+      "[79Se]": 2028,
+      "[223Ra]": 2029,
+      "[86Sr]": 2030,
+      "[122Sb]": 2031,
+      "[26Al]": 2032,
+      "[32Si]": 2033,
+      "[126Sn]": 2034,
+      "[225Ra]": 2035,
+      "[114In]": 2036,
+      "[72Ga]": 2037,
+      "[132Te]": 2038,
+      "[10Be]": 2039,
+      "[125Sn]": 2040,
+      "[73As]": 2041,
+      "[206Bi]": 2042,
+      "[117Sn]": 2043,
+      "[40Ca]": 2044,
+      "[41Ca]": 2045,
+      "[89Rb]": 2046,
+      "[116In]": 2047,
+      "[129Sb]": 2048,
+      "[91Sr]": 2049,
+      "[71Ge]": 2050,
+      "[139Ba]": 2051,
+      "[69Ga]": 2052,
+      "[120Sb]": 2053,
+      "[121Sn]": 2054,
+      "[123Sn]": 2055,
+      "[131Te]": 2056,
+      "[77Ge]": 2057,
+      "[135Ba]": 2058,
+      "[82Sr]": 2059,
+      "[43K]": 2060,
+      "[131Ba]": 2061,
+      "[92Sr]": 2062,
+      "[88Rb]": 2063,
+      "[129Cs]": 2064,
+      "[144Cs]": 2065,
+      "[127Cs]": 2066,
+      "[200Tl]": 2067,
+      "[202Tl]": 2068,
+      "[141Ba]": 2069,
+      "[117Sb]": 2070,
+      "[116Sb]": 2071,
+      "[78As]": 2072,
+      "[131Sb]": 2073,
+      "[126Sb]": 2074,
+      "[128Sb]": 2075,
+      "[130Sb]": 2076,
+      "[67Ge]": 2077,
+      "[68Ge]": 2078,
+      "[78Ge]": 2079,
+      "[66Ge]": 2080,
+      "[223Fr]": 2081,
+      "[132Cs]": 2082,
+      "[125Cs]": 2083,
+      "[138Cs]": 2084,
+      "[133Te]": 2085,
+      "[84Rb]": 2086,
+      "[83Rb]": 2087,
+      "[81Rb]": 2088,
+      "[142Ba]": 2089,
+      "[200Bi]": 2090,
+      "[115Sb]": 2091,
+      "[194Tl]": 2092,
+      "[70Se]": 2093,
+      "[112In]": 2094,
+      "[118Sb]": 2095,
+      "[70Ga]": 2096,
+      "[27Mg]": 2097,
+      "[202Bi]": 2098,
+      "[83Se]": 2099,
+      "[9Li]": 2100,
+      "[69As]": 2101,
+      "[79Rb]": 2102,
+      "[81Sr]": 2103,
+      "[83Sr]": 2104,
+      "[78Se]": 2105,
+      "[109In]": 2106,
+      "[29Al]": 2107,
+      "[118Sn]": 2108,
+      "[117In]": 2109,
+      "[119Sb]": 2110,
+      "[114Sn]": 2111,
+      "[138Ba]": 2112,
+      "[69Ge]": 2113,
+      "[73Ga]": 2114,
+      "[74Ge]": 2115,
+      "[206Tl]": 2116,
+      "[199Tl]": 2117,
+      "[130Cs]": 2118,
+      "[28Mg]": 2119,
+      "[116Te]": 2120,
+      "[112Sn]": 2121,
+      "[126Ba]": 2122,
+      "[211Bi]": 2123,
+      "[81Se]": 2124,
+      "[127Sn]": 2125,
+      "[143Cs]": 2126,
+      "[134Te]": 2127,
+      "[80Sr]": 2128,
+      "[45K]": 2129,
+      "[215Po]": 2130,
+      "[207Po]": 2131,
+      "[111Sn]": 2132,
+      "[211Po]": 2133,
+      "[128Ba]": 2134,
+      "[198Tl]": 2135,
+      "[227Ra]": 2136,
+      "[213Po]": 2137,
+      "[220Ra]": 2138,
+      "[128Sn]": 2139,
+      "[203Po]": 2140,
+      "[205Po]": 2141,
+      "[65Ga]": 2142,
+      "[197Tl]": 2143,
+      "[88Sr]": 2144,
+      "[110In]": 2145,
+      "[31Si]": 2146,
+      "[201Bi]": 2147,
+      "[121Te]": 2148,
+      "[205Bi]": 2149,
+      "[203Bi]": 2150,
+      "[195Tl]": 2151,
+      "[209Tl]": 2152,
+      "[110Sn]": 2153,
+      "[222Fr]": 2154,
+      "[207At]": 2155,
+      "[119In]": 2156,
+      "[As@]": 2157,
+      "[129IH]": 2158,
+      "[157Dy]": 2159,
+      "[111IH]": 2160,
+      "[230Ra]": 2161,
+      "[144Pr+3]": 2162,
+      "[SiH3+]": 2163,
+      "[3He]": 2164,
+      "[AsH5]": 2165,
+      "[72Se]": 2166,
+      "[95Tc]": 2167,
+      "[103Pd]": 2168,
+      "[121Sn+2]": 2169,
+      "[211Rn]": 2170,
+      "[38SH2]": 2171,
+      "[127IH]": 2172,
+      "[74Br-]": 2173,
+      "[133I-]": 2174,
+      "[100Tc+4]": 2175,
+      "[100Tc]": 2176,
+      "[36Cl-]": 2177,
+      "[89Y+3]": 2178,
+      "[104Rh]": 2179,
+      "[152Sm]": 2180,
+      "[226Ra]": 2181,
+      "[19FH]": 2182,
+      "[104Pd]": 2183,
+      "[148Gd]": 2184,
+      "[157Lu]": 2185,
+      "[33SH2]": 2186,
+      "[121I-]": 2187,
+      "[17FH]": 2188,
+      "[71Se]": 2189,
+      "[157Sm]": 2190,
+      "[148Tb]": 2191,
+      "[164Dy]": 2192,
+      "[15OH2]": 2193,
+      "[15O+]": 2194,
+      "[39K]": 2195,
+      "[40Ar]": 2196,
+      "[50Cr+3]": 2197,
+      "[50Cr]": 2198,
+      "[52Ti]": 2199,
+      "[103Pd+2]": 2200,
+      "[130Ba]": 2201,
+      "[142Pm]": 2202,
+      "[153Gd+3]": 2203,
+      "[151Eu]": 2204,
+      "[103Rh]": 2205,
+      "[124Xe]": 2206,
+      "[152Tb]": 2207,
+      "[17OH2]": 2208,
+      "[20Ne]": 2209,
+      "[52Fe]": 2210,
+      "[94Zr+4]": 2211,
+      "[94Zr]": 2212,
+      "[149Pr]": 2213,
+      "[16OH2]": 2214,
+      "[53Cr+6]": 2215,
+      "[53Cr]": 2216,
+      "[81Br-]": 2217,
+      "[112Pd]": 2218,
+      "[125Xe]": 2219,
+      "[155Gd]": 2220,
+      "[157Gd]": 2221,
+      "[168Yb]": 2222,
+      "[184Os]": 2223,
+      "[166Tb]": 2224,
+      "[221Fr]": 2225,
+      "[212Ra]": 2226,
+      "[75Br-]": 2227,
+      "[79Br-]": 2228,
+      "[113Ag]": 2229,
+      "[23Na]": 2230,
+      "[34Cl-]": 2231,
+      "[34ClH]": 2232,
+      "[38Cl-]": 2233,
+      "[56Fe]": 2234,
+      "[68Cu]": 2235,
+      "[77Br-]": 2236,
+      "[90Zr+4]": 2237,
+      "[90Zr]": 2238,
+      "[102Pd]": 2239,
+      "[154Eu+3]": 2240,
+      "[57Mn]": 2241,
+      "[165Tm]": 2242,
+      "[152Dy]": 2243,
+      "[217At]": 2244,
+      "[77se]": 2245,
+      "[13cH-]": 2246,
+      "[122Te]": 2247,
+      "[156Gd]": 2248,
+      "[124Te]": 2249,
+      "[53Ni]": 2250,
+      "[131Xe]": 2251,
+      "[174Hf+4]": 2252,
+      "[174Hf]": 2253,
+      "[76Se]": 2254,
+      "[168Tm]": 2255,
+      "[167Dy]": 2256,
+      "[154Gd]": 2257,
+      "[95Ru]": 2258,
+      "[210At]": 2259,
+      "[85Br]": 2260,
+      "[59Co]": 2261,
+      "[122Xe]": 2262,
+      "[27Al]": 2263,
+      "[54Cr]": 2264,
+      "[198Hg]": 2265,
+      "[85Rb+]": 2266,
+      "[214Tl]": 2267,
+      "[229Rn]": 2268,
+      "[218Pb]": 2269,
+      "[218Bi]": 2270,
+      "[167Tm+3]": 2271,
+      "[18o+]": 2272,
+      "[P@@H+]": 2273,
+      "[P@H+]": 2274,
+      "[13N+]": 2275,
+      "[212Pb+2]": 2276,
+      "[217Bi]": 2277,
+      "[249Cf+2]": 2278,
+      "[18OH3+]": 2279,
+      "[90Sr-]": 2280,
+      "[Cf+3]": 2281,
+      "[200Hg]": 2282,
+      "[86Tc]": 2283,
+      "[141Pr+3]": 2284,
+      "[141Pr]": 2285,
+      "[16nH]": 2286,
+      "[14NH4+]": 2287,
+      "[132Xe]": 2288,
+      "[83Kr]": 2289,
+      "[70Zn+2]": 2290,
+      "[137Ba+2]": 2291,
+      "[36Ar]": 2292,
+      "[38Ar]": 2293,
+      "[21Ne]": 2294,
+      "[126Xe]": 2295,
+      "[136Xe]": 2296,
+      "[128Xe]": 2297,
+      "[134Xe]": 2298,
+      "[84Kr]": 2299,
+      "[86Kr]": 2300,
+      "[78Kr]": 2301,
+      "[80Kr]": 2302,
+      "[82Kr]": 2303,
+      "[67Zn+2]": 2304,
+      "[65Cu+2]": 2305,
+      "[110Te]": 2306,
+      "[58Fe+3]": 2307,
+      "[142Nd]": 2308,
+      "[38K]": 2309,
+      "[198Au+3]": 2310,
+      "[122IH]": 2311,
+      "[38PH3]": 2312,
+      "[130I-]": 2313,
+      "[40K+]": 2314,
+      "[38K+]": 2315,
+      "[28Mg+2]": 2316,
+      "[208Tl+]": 2317,
+      "[13OH2]": 2318,
+      "[198Bi]": 2319,
+      "[192Bi]": 2320,
+      "[194Bi]": 2321,
+      "[196Bi]": 2322,
+      "[132I-]": 2323,
+      "[83Sr+2]": 2324,
+      "[169Er+3]": 2325,
+      "[122I-]": 2326,
+      "[120I-]": 2327,
+      "[92Sr+2]": 2328,
+      "[126I-]": 2329,
+      "[24Mg]": 2330,
+      "[84Sr]": 2331,
+      "[118Pd+2]": 2332,
+      "[118Pd]": 2333,
+      "[AsH4]": 2334,
+      "[127I-]": 2335,
+      "[9C-]": 2336,
+      "[11CH3+]": 2337,
+      "[17B]": 2338,
+      "[7B]": 2339,
+      "[4HH]": 2340,
+      "[18C-]": 2341,
+      "[22CH3-]": 2342,
+      "[22CH4]": 2343,
+      "[17C-]": 2344,
+      "[15CH3]": 2345,
+      "[16CH3]": 2346,
+      "[11NH3]": 2347,
+      "[21NH3]": 2348,
+      "[11N-]": 2349,
+      "[11NH]": 2350,
+      "[16CH]": 2351,
+      "[17CH2]": 2352,
+      "[99Ru+2]": 2353,
+      "[181Ta+2]": 2354,
+      "[181Ta]": 2355,
+      "[20CH]": 2356,
+      "[32PH2]": 2357,
+      "[55Fe+2]": 2358,
+      "[SH3]": 2359,
+      "[S@H]": 2360,
+      "[UNK]": 2361
+    },
+    "merges": []
+  }
+}

tokenizer_config.json

@@ -0,0 +1,53 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2361": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "clean_up_tokenization_spaces": false,
+  "cls_token": "[CLS]",
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_max_length": 256,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": "[UNK]"
+}