conceptnetUk commited on
Commit
1f00475
·
verified ·
1 Parent(s): c20c1b2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -58
README.md CHANGED
@@ -1,65 +1,36 @@
1
  ---
2
- library_name: transformers
3
- license: apache-2.0
4
- base_model: distilbert-base-multilingual-cased
 
 
 
 
 
 
 
5
  tags:
6
- - generated_from_trainer
7
- metrics:
8
- - accuracy
9
- model-index:
10
- - name: intent-classifier
11
- results: []
 
12
  ---
13
 
14
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
- should probably proofread and complete it, then remove this comment. -->
16
 
17
- # intent-classifier
18
 
19
- This model is a fine-tuned version of [distilbert-base-multilingual-cased](https://huggingface.co/distilbert-base-multilingual-cased) on the None dataset.
20
- It achieves the following results on the evaluation set:
21
- - Loss: 0.0071
22
- - Accuracy: 1.0
 
23
 
24
- ## Model description
25
-
26
- More information needed
27
-
28
- ## Intended uses & limitations
29
-
30
- More information needed
31
-
32
- ## Training and evaluation data
33
-
34
- More information needed
35
-
36
- ## Training procedure
37
-
38
- ### Training hyperparameters
39
-
40
- The following hyperparameters were used during training:
41
- - learning_rate: 5e-05
42
- - train_batch_size: 16
43
- - eval_batch_size: 32
44
- - seed: 42
45
- - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
- - lr_scheduler_type: linear
47
- - num_epochs: 5
48
-
49
- ### Training results
50
-
51
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
- |:-------------:|:-----:|:----:|:---------------:|:--------:|
53
- | No log | 1.0 | 38 | 0.2696 | 0.9342 |
54
- | No log | 2.0 | 76 | 0.0652 | 0.9868 |
55
- | No log | 3.0 | 114 | 0.0401 | 0.9934 |
56
- | No log | 4.0 | 152 | 0.0075 | 1.0 |
57
- | No log | 5.0 | 190 | 0.0071 | 1.0 |
58
-
59
-
60
- ### Framework versions
61
-
62
- - Transformers 5.15.1
63
- - Pytorch 2.11.0+cpu
64
- - Datasets 4.0.0
65
- - Tokenizers 0.22.2
 
1
  ---
2
+ language:
3
+ - en
4
+ - fr
5
+ - es
6
+ - de
7
+ - it
8
+ - pt
9
+ - zh
10
+ - ar
11
+ - ru
12
  tags:
13
+ - text-classification
14
+ - intent-classification
15
+ - enterprise-ai
16
+ - voice-ai
17
+ - multilingual
18
+ - distilbert
19
+ license: mit
20
  ---
21
 
22
+ # ConceptNet Intent Classifier
 
23
 
24
+ Fine-tuned `distilbert-base-multilingual-cased` on the ConceptNet 4-layer enterprise voice intent taxonomy.
25
 
26
+ ## Accuracy
27
+ - Standard test set: **100%** (epochs 4 and 5)
28
+ - Adversarial holdout: **99.3%** (independently verified — Hugging Face community)
29
+ - Fast-path classifier: **83%** · <5ms latency
30
+ - Dataset: 757 examples across 9 languages
31
 
32
+ ## Independent Evaluation
33
+ Independently tested by the Hugging Face community (john6666):
34
+ - Confirmed 99.315% on reconstructed public test split
35
+ - Grouped lexical-family holdout: 99.78%
36
+ - Conclusion: "The obvious train/test leakage explanation did not survive that