conceptnetUk commited on
Commit
c20c1b2
·
verified ·
1 Parent(s): ae0fed8

End of training

Browse files
Files changed (4) hide show
  1. README.md +50 -55
  2. config.json +1 -1
  3. model.safetensors +1 -1
  4. training_args.bin +2 -2
README.md CHANGED
@@ -1,70 +1,65 @@
1
  ---
2
- language:
3
- - en
4
- - fr
5
- - es
6
- - de
7
- - it
8
- - pt
9
- - zh
10
- - ar
11
- - ru
12
  tags:
13
- - text-classification
14
- - intent-classification
15
- - enterprise-ai
16
- - voice-ai
17
- - multilingual
18
- - distilbert
19
- license: mit
20
  ---
21
 
22
- # ConceptNet Intent Classifier
 
23
 
24
- Fine-tuned `distilbert-base-multilingual-cased` on the ConceptNet 4-layer enterprise voice intent taxonomy.
25
 
26
- ## Independent Evaluation August 2026
 
 
 
27
 
28
- Independently tested by the Hugging Face community (John6666):
29
- - Neural model: **99.315%** on reconstructed public test split
30
- - Grouped lexical-family holdout: **99.78%**
31
- - Conclusion: "The obvious train/test leakage explanation did not survive that check"
32
 
33
- ## Accuracy
34
- - Fast-path classifier: **83%** · <5ms latency
35
- - Neural model: **98.6%** (99.3% independently verified)
36
- - L3 Predictive precision: **100%**
37
- - Dataset: 757 examples across 9 languages (updated with L3 paraphrase diversity)
38
 
39
- ## Cascade Performance
40
- | Threshold | Fast coverage | Fast accuracy | Final accuracy |
41
- |-----------|--------------|---------------|----------------|
42
- | 0.50 | 69.2% | 95.0% | 95.9% |
43
- | 0.55 | 60.3% | 98.9% | 98.6% |
44
- | 0.65 | 43.2% | 100% | 99.3% |
45
 
46
- ## Layer Precedence (mixed semantics)
47
- When a command contains signals from multiple layers: **L4 > L3 > L2 > L1**
48
 
49
- ## The 4 Layers
50
- - **L1 Basic** — "Do X" — immediate execution
51
- - **L2 Context-Aware** — "Do X when Y" — conditional
52
- - **L3 Predictive** — "Do X before/ahead of/prior to Y" — proactive
53
- - **L4 Autonomous** — "Do X always" — persistent agent
54
 
55
- ## Languages
56
- English · French · Spanish · German · Italian · Portuguese · Chinese · Arabic · Russian
57
 
58
- ## Usage
59
- ```python
60
- from transformers import pipeline
61
- classifier = pipeline("text-classification", model="conceptnetUk/intent-classifier")
62
- classifier("Send the report when the contract is signed")
63
- ```
64
 
65
- ## Links
66
- - Sandbox: https://conceptnet.co.uk/sandbox/
67
- - GitHub: https://github.com/wushu75/ConceptNet
68
- - Website: https://conceptnet.co.uk
69
 
70
- 2026 ConceptNet Ltd · Patents pending*
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: distilbert-base-multilingual-cased
 
 
 
 
 
 
 
5
  tags:
6
+ - generated_from_trainer
7
+ metrics:
8
+ - accuracy
9
+ model-index:
10
+ - name: intent-classifier
11
+ results: []
 
12
  ---
13
 
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
 
17
+ # intent-classifier
18
 
19
+ This model is a fine-tuned version of [distilbert-base-multilingual-cased](https://huggingface.co/distilbert-base-multilingual-cased) on the None dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.0071
22
+ - Accuracy: 1.0
23
 
24
+ ## Model description
 
 
 
25
 
26
+ More information needed
 
 
 
 
27
 
28
+ ## Intended uses & limitations
 
 
 
 
 
29
 
30
+ More information needed
 
31
 
32
+ ## Training and evaluation data
 
 
 
 
33
 
34
+ More information needed
 
35
 
36
+ ## Training procedure
 
 
 
 
 
37
 
38
+ ### Training hyperparameters
 
 
 
39
 
40
+ The following hyperparameters were used during training:
41
+ - learning_rate: 5e-05
42
+ - train_batch_size: 16
43
+ - eval_batch_size: 32
44
+ - seed: 42
45
+ - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
+ - lr_scheduler_type: linear
47
+ - num_epochs: 5
48
+
49
+ ### Training results
50
+
51
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
53
+ | No log | 1.0 | 38 | 0.2696 | 0.9342 |
54
+ | No log | 2.0 | 76 | 0.0652 | 0.9868 |
55
+ | No log | 3.0 | 114 | 0.0401 | 0.9934 |
56
+ | No log | 4.0 | 152 | 0.0075 | 1.0 |
57
+ | No log | 5.0 | 190 | 0.0071 | 1.0 |
58
+
59
+
60
+ ### Framework versions
61
+
62
+ - Transformers 5.15.1
63
+ - Pytorch 2.11.0+cpu
64
+ - Datasets 4.0.0
65
+ - Tokenizers 0.22.2
config.json CHANGED
@@ -35,7 +35,7 @@
35
  "sinusoidal_pos_embds": false,
36
  "tie_weights_": true,
37
  "tie_word_embeddings": true,
38
- "transformers_version": "5.15.0",
39
  "use_cache": false,
40
  "vocab_size": 119547
41
  }
 
35
  "sinusoidal_pos_embds": false,
36
  "tie_weights_": true,
37
  "tie_word_embeddings": true,
38
+ "transformers_version": "5.15.1",
39
  "use_cache": false,
40
  "vocab_size": 119547
41
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4934ed4bfeb0c9e04a857e53a6df65403c823fb89c76469db2caf273836eaebf
3
  size 541323528
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ab5f4ca713f098792b03b17ccba6a42bb3a3ec2f7f9624950b4576bd8452e30
3
  size 541323528
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a7e7fc8cad10b25f6f55e0d0b510aeb70b111eb30216129eb606911e9ab0f802
3
- size 5201
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:575a3ea3b4b2ff0e735dd4863828c480058f475a19882863e1013b9506a012ec
3
+ size 5265