dipesh commited on
Commit
deac9bf
·
1 Parent(s): 3c3282f
Files changed (4) hide show
  1. .gitattributes +1 -1
  2. README.md +39 -10
  3. config.json +65 -59
  4. tf_model.h5 +2 -2
.gitattributes CHANGED
@@ -24,4 +24,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
24
  *.xz filter=lfs diff=lfs merge=lfs -text
25
  *.zip filter=lfs diff=lfs merge=lfs -text
26
  *.zstandard filter=lfs diff=lfs merge=lfs -text
27
- *tfevents* filter=lfs diff=lfs merge=lfs -text
 
24
  *.xz filter=lfs diff=lfs merge=lfs -text
25
  *.zip filter=lfs diff=lfs merge=lfs -text
26
  *.zstandard filter=lfs diff=lfs merge=lfs -text
27
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -18,38 +18,60 @@ It achieves the following results on the evaluation set:
18
  - Train Sparse Categorical Accuracy: 0.9836
19
  - Validation Loss: 0.4073
20
  - Validation Sparse Categorical Accuracy: 0.9583
21
- - Epoch: 2
22
 
23
  ## Model description
24
 
25
- Base model: 'bert-base-cased'
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
26
 
27
  ## Intended uses & limitations
28
 
29
- Intent Classifications for Chatbot or Virtual Assistant
 
30
 
31
  ## Training and evaluation data
32
 
33
- More information needed
34
 
35
  ## Training procedure
36
 
37
- https://colab.research.google.com/drive/1tyXIbY875w0U8OuqEwfanecck5i-OfU6?usp=sharing
38
 
39
  ### Training hyperparameters
40
 
 
41
  The following hyperparameters were used during training:
42
  - optimizer: {'name': 'Adam', 'learning_rate': 5e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
43
  - training_precision: float32
44
 
45
  ### Training results
46
 
47
- | Train Loss | Train Sparse Categorical Accuracy | Validation Loss | Validation Sparse Categorical Accuracy | Epoch |
48
- |:----------:|:---------------------------------:|:---------------:|:--------------------------------------:|:-----:|
49
- | 2.5420 | 0.3224 | 1.9997 | 0.6806 | 0 |
50
- | 1.4238 | 0.8684 | 0.9106 | 0.9444 | 1 |
51
- | 0.6110 | 0.9836 | 0.4073 | 0.9583 | 2 |
52
 
 
53
 
54
  ### Framework versions
55
 
@@ -57,3 +79,10 @@ The following hyperparameters were used during training:
57
  - TensorFlow 2.8.0
58
  - Datasets 2.2.2
59
  - Tokenizers 0.12.1
 
 
 
 
 
 
 
 
18
  - Train Sparse Categorical Accuracy: 0.9836
19
  - Validation Loss: 0.4073
20
  - Validation Sparse Categorical Accuracy: 0.9583
21
+ - Epoch: 3
22
 
23
  ## Model description
24
 
25
+ Base model: 'bert-base-cased' can be used for intent classification. It trained on the [Intent-Classification-Commands](https://huggingface.co/datasets/dipesh/Intent-Classification-Commands) dataset. With the following classes-
26
+
27
+ ```
28
+ {
29
+ "0": "asking date",
30
+ "1": "asking time",
31
+ "2": "asking weather",
32
+ "3": "check internet speed",
33
+ "4": "click photo",
34
+ "5": "covid cases",
35
+ "6": "download youtube video",
36
+ "7": "goodbye",
37
+ "8": "greet",
38
+ "9": "open website",
39
+ "10": "play games",
40
+ "11": "play on youtube",
41
+ "12": "send email",
42
+ "13": "send whatsapp message",
43
+ "14": "take screenshot",
44
+ "15": "tell me about",
45
+ "16": "tell me joke",
46
+ "17": "tell me news"
47
+ }
48
+ ```
49
 
50
  ## Intended uses & limitations
51
 
52
+ Intent Classifications for Chatbot or Virtual Assistant.
53
+ Only supports the English language. It can't work in outside classes. But you can fine-tune it for your own use.
54
 
55
  ## Training and evaluation data
56
 
57
+ Dataset Used: [Intent-Classification-Commands](https://huggingface.co/datasets/dipesh/Intent-Classification-Commands)
58
 
59
  ## Training procedure
60
 
61
+ https://colab.research.google.com/drive/1KHg14glvhdV_ziOcY0pHm66PBYoBZMS0?usp=sharing
62
 
63
  ### Training hyperparameters
64
 
65
+
66
  The following hyperparameters were used during training:
67
  - optimizer: {'name': 'Adam', 'learning_rate': 5e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
68
  - training_precision: float32
69
 
70
  ### Training results
71
 
72
+ ![1.jpg](1.jpg)
 
 
 
 
73
 
74
+ ![2.jpg](2.jpg)
75
 
76
  ### Framework versions
77
 
 
79
  - TensorFlow 2.8.0
80
  - Datasets 2.2.2
81
  - Tokenizers 0.12.1
82
+
83
+
84
+ ## Connect me on-
85
+
86
+ * Subscribe to me on: https://youtube.com/techportofficial
87
+
88
+ * DM me on (for quick response): https://instagram.com/dipesh_pal17
config.json CHANGED
@@ -1,59 +1,65 @@
1
- {'_name_or_path': 'bert-base-cased',
2
- 'architectures': ['BertForSequenceClassification'],
3
- 'attention_probs_dropout_prob': 0.1,
4
- 'classifier_dropout': None,
5
- 'gradient_checkpointing': False,
6
- 'hidden_act': 'gelu',
7
- 'hidden_dropout_prob': 0.1,
8
- 'hidden_size': 768,
9
- 'id2label': {'0': 'asking date',
10
- '1': 'asking time',
11
- '10': 'open website',
12
- '11': 'play games',
13
- '12': 'play on youtube',
14
- '13': 'send email',
15
- '14': 'send whatsapp message',
16
- '15': 'take screenshot',
17
- '16': 'tell me about',
18
- '17': 'tell me joke',
19
- '18': 'tell me news',
20
- '2': 'asking weather',
21
- '3': 'check internet speed',
22
- '4': 'click photo',
23
- '5': 'conversation',
24
- '6': 'covid cases',
25
- '7': 'download youtube video',
26
- '8': 'goodbye',
27
- '9': 'greet'},
28
- 'initializer_range': 0.02,
29
- 'intermediate_size': 3072,
30
- 'label2id': {'asking date': '0',
31
- 'asking time': '1',
32
- 'asking weather': '2',
33
- 'check internet speed': '3',
34
- 'click photo': '4',
35
- 'conversation': '5',
36
- 'covid cases': '6',
37
- 'download youtube video': '7',
38
- 'goodbye': '8',
39
- 'greet': '9',
40
- 'open website': '10',
41
- 'play games': '11',
42
- 'play on youtube': '12',
43
- 'send email': '13',
44
- 'send whatsapp message': '14',
45
- 'take screenshot': '15',
46
- 'tell me about': '16',
47
- 'tell me joke': '17',
48
- 'tell me news': '18'},
49
- 'layer_norm_eps': 1e-12,
50
- 'max_position_embeddings': 512,
51
- 'model_type': 'bert',
52
- 'num_attention_heads': 12,
53
- 'num_hidden_layers': 12,
54
- 'pad_token_id': 0,
55
- 'position_embedding_type': 'absolute',
56
- 'transformers_version': '4.19.2',
57
- 'type_vocab_size': 2,
58
- 'use_cache': True,
59
- 'vocab_size': 28996}
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "bert-base-cased",
3
+ "architectures": [
4
+ "BertForSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "classifier_dropout": null,
8
+ "gradient_checkpointing": false,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "id2label": {
13
+ "0": "asking date",
14
+ "1": "asking time",
15
+ "2": "asking weather",
16
+ "3": "check internet speed",
17
+ "4": "click photo",
18
+ "5": "covid cases",
19
+ "6": "download youtube video",
20
+ "7": "goodbye",
21
+ "8": "greet",
22
+ "9": "open website",
23
+ "10": "play games",
24
+ "11": "play on youtube",
25
+ "12": "send email",
26
+ "13": "send whatsapp message",
27
+ "14": "take screenshot",
28
+ "15": "tell me about",
29
+ "16": "tell me joke",
30
+ "17": "tell me news"
31
+ },
32
+ "initializer_range": 0.02,
33
+ "intermediate_size": 3072,
34
+ "label2id": {
35
+ "asking date": "0",
36
+ "asking time": "1",
37
+ "asking weather": "2",
38
+ "check internet speed": "3",
39
+ "click photo": "4",
40
+ "covid cases": "5",
41
+ "download youtube video": "6",
42
+ "goodbye": "7",
43
+ "greet": "8",
44
+ "open website": "9",
45
+ "play games": "10",
46
+ "play on youtube": "11",
47
+ "send email": "12",
48
+ "send whatsapp message": "13",
49
+ "take screenshot": "14",
50
+ "tell me about": "15",
51
+ "tell me joke": "16",
52
+ "tell me news": "17"
53
+ },
54
+ "layer_norm_eps": 1e-12,
55
+ "max_position_embeddings": 512,
56
+ "model_type": "bert",
57
+ "num_attention_heads": 12,
58
+ "num_hidden_layers": 12,
59
+ "pad_token_id": 0,
60
+ "position_embedding_type": "absolute",
61
+ "transformers_version": "4.19.2",
62
+ "type_vocab_size": 2,
63
+ "use_cache": true,
64
+ "vocab_size": 28996
65
+ }
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:66a77ce0152d8d03255371add6c7932e72559963b8f8c0034fce5395e9ba2a64
3
- size 433587612
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60b1c53be86c50926d49749bada8891fb624d910c22d7a7e5becc3dde1300d54
3
+ size 433584536