barek2k2
/

bert_hipaa_sensitive_db_schema

Text Classification

mHealth Application

column name classifier

data field classifier

Model card Files Files and versions

barek2k2 commited on May 2, 2025

Commit

ee1e508

·

1 Parent(s): f0bf3b9

Readme updated with performance analysis

Files changed (1) hide show

README.md +22 -2

README.md CHANGED Viewed

@@ -95,8 +95,28 @@ This LLM model is provided for research and educational purposes only. Always ve
 ---
 ## 📊 Model Performance Analysis
-![Analysis](./LLM-BERT-BASE-Model-Analysis.png)
 ### Limitations

 ---
 ## 📊 Model Performance Analysis
+## 📊 Model Performance Table
+**Table 1: Changing hyperparameters and results**
+| Step   | Learning Rate | Batch Size | Epoch | Weight Decay | Precision | Recall | F1 Score | Accuracy |
+|--------|---------------|------------|-------|---------------|-----------|--------|----------|----------|
+| 1      | 0             | 16         | 1     | 0.001         | 0.0000    | 0.0000 | 0.0000   | 36.78%   |
+| 2      | 1e-1          | 16         | 1     | 0.001         | 0.6321    | 1.0000 | 0.7746   | 63.21%   |
+| 3      | 1e-1          | 32         | 1     | 0.001         | 0.6321    | 1.0000 | 0.7746   | 63.21%   |
+| 4      | 1e-1          | 32         | 2     | 0.001         | 0.6321    | 1.0000 | 0.7746   | 63.21%   |
+| 5      | 1e-1          | 32         | 3     | 0.001         | 0.6321    | 1.0000 | 0.7746   | 63.21%   |
+| 6      | 1e-1          | 32         | 3     | 0.01          | 0.6321    | 1.0000 | 0.7746   | 63.21%   |
+| 7      | 2e-1          | 32         | 4     | 0.01          | 0.6321    | 1.0000 | 0.7746   | 63.21%   |
+| 8      | 3e-4          | 32         | 4     | 0.01          | 0.6331    | 0.9982 | 0.7748   | 63.32%   |
+| 9      | 2e-4          | 32         | 4     | 0.01          | 0.9908    | 0.9730 | 0.9818   | 97.72%   |
+| 10     | 1e-5          | 32         | 4     | 0.01          | 0.9964    | 0.9928 | 0.9946   | 99.31%   |
+| 11     | 1e-5          | 32         | 5     | 0.01          | 0.9964    | 0.9928 | 0.9946   | 99.31%   |
+| **12** | **1e-5**      | **16**     | **5** | **0.01**      | **1.0000**| **0.9964** | **0.9982**   | **99.72%**   |
+| 13     | 1e-5          | 16         | 5     | 0.1           | 1.0000    | 0.9946 | 0.9973   | 99.65%   |
+| 14     | 1e-5          | 32         | 5     | 0.1           | 1.0000    | 0.9946 | 0.9973   | 99.65%   |
+| 15     | 1e-5          | 32         | 5     | 1.0           | 0.9964    | 0.9946 | 0.9946   | 99.54%   |
+| 16     | 1e-6          | 32         | 5     | 1.0           | 0.8342    | 0.9153 | 0.8729   | 83.15%   |
 ### Limitations