Hugging Face's logo

aiface
/
CafeBERT_massive

Transformers
Safetensors
Generated from Trainer
Model card Files
xet
Community
aiface commited on
Commit
620eea5
·
verified ·
1 Parent(s): 2415957

Training in progress, epoch 1

Browse files
Files changed (5) hide show
  1. intent_report_test.txt +63 -63
  2. model.safetensors +1 -1
  3. model_predict_test.csv +0 -0
  4. slot_report_test.txt +60 -1
  5. training_args.bin +1 -1
intent_report_test.txt CHANGED
@@ -1,75 +1,75 @@
1
  precision recall f1-score support
2
 
3
- 0 0.83 0.98 0.90 88
4
- 1 0.42 0.97 0.59 36
5
- 2 0.83 0.97 0.89 35
6
- 3 0.70 0.74 0.72 35
7
- 4 0.86 0.92 0.89 26
8
  5 0.00 0.00 0.00 1
9
- 6 0.77 0.63 0.69 43
10
  7 0.00 0.00 0.00 4
11
- 8 0.60 0.67 0.63 18
12
- 9 0.88 0.97 0.92 72
13
- 10 0.91 1.00 0.95 39
14
- 11 0.45 1.00 0.62 15
15
- 12 0.60 0.45 0.51 169
16
- 13 0.94 0.95 0.94 156
17
- 14 0.31 0.69 0.43 13
18
- 15 0.73 0.67 0.70 12
19
- 16 0.80 0.55 0.65 22
20
- 17 0.80 0.62 0.70 26
21
- 18 0.00 0.00 0.00 27
22
- 19 0.70 0.84 0.76 31
23
- 20 0.66 0.61 0.63 41
24
- 21 0.69 0.69 0.69 39
25
- 22 0.80 0.85 0.82 124
26
- 23 0.82 0.68 0.74 34
27
- 24 0.00 0.00 0.00 10
28
- 25 1.00 0.42 0.59 19
29
- 26 0.67 0.84 0.74 57
30
- 27 0.81 0.52 0.63 25
31
- 28 0.00 0.00 0.00 6
32
- 29 0.00 0.00 0.00 6
33
- 30 0.84 0.96 0.90 67
34
- 31 0.00 0.00 0.00 21
35
- 32 0.72 0.72 0.72 126
36
- 33 0.86 0.94 0.90 114
37
- 34 0.92 0.88 0.90 26
38
- 35 0.00 0.00 0.00 11
39
- 36 0.73 0.79 0.76 72
40
  37 0.00 0.00 0.00 0
41
- 38 1.00 0.07 0.12 15
42
- 39 1.00 0.28 0.44 25
43
- 40 0.80 0.93 0.86 43
44
  41 0.00 0.00 0.00 3
45
- 42 0.85 0.55 0.67 51
46
- 43 0.92 0.31 0.46 36
47
- 44 0.96 0.91 0.94 119
48
- 45 0.75 0.93 0.83 176
49
- 46 0.89 0.78 0.83 32
50
- 47 0.93 0.81 0.87 81
51
- 48 0.73 0.90 0.80 41
52
- 49 0.63 0.78 0.70 141
53
- 50 0.86 0.93 0.89 209
54
- 51 0.86 0.91 0.89 35
55
- 52 0.95 0.86 0.90 21
56
- 53 0.91 0.83 0.87 52
57
- 54 0.88 0.96 0.92 23
58
- 55 0.65 0.65 0.65 20
59
- 56 0.90 0.97 0.93 36
60
- 57 0.97 0.80 0.88 35
61
- 58 0.77 0.73 0.75 63
62
- 59 0.78 0.82 0.80 51
63
 
64
- accuracy 0.78 2974
65
- macro avg 0.66 0.64 0.63 2974
66
- weighted avg 0.77 0.78 0.76 2974
67
 
68
  Confusion matrix:
69
  [[86 0 0 ... 0 0 0]
70
  [ 0 35 0 ... 0 0 0]
71
- [ 0 0 34 ... 0 0 0]
72
  ...
73
- [ 0 0 0 ... 28 0 0]
74
- [ 0 0 0 ... 0 46 0]
75
- [ 0 0 0 ... 0 0 42]]
 
1
  precision recall f1-score support
2
 
3
+ 0 0.86 0.98 0.91 88
4
+ 1 0.81 0.97 0.89 36
5
+ 2 1.00 0.74 0.85 35
6
+ 3 0.86 0.86 0.86 35
7
+ 4 0.86 0.96 0.91 26
8
  5 0.00 0.00 0.00 1
9
+ 6 0.74 0.81 0.78 43
10
  7 0.00 0.00 0.00 4
11
+ 8 1.00 0.67 0.80 18
12
+ 9 0.91 0.97 0.94 72
13
+ 10 0.97 1.00 0.99 39
14
+ 11 0.75 1.00 0.86 15
15
+ 12 0.62 0.62 0.62 169
16
+ 13 0.96 0.96 0.96 156
17
+ 14 0.69 0.69 0.69 13
18
+ 15 0.67 0.67 0.67 12
19
+ 16 0.95 0.82 0.88 22
20
+ 17 0.84 0.81 0.82 26
21
+ 18 0.92 0.85 0.88 27
22
+ 19 0.74 0.94 0.83 31
23
+ 20 0.97 0.71 0.82 41
24
+ 21 0.82 0.92 0.87 39
25
+ 22 0.83 0.90 0.86 124
26
+ 23 1.00 0.88 0.94 34
27
+ 24 1.00 0.80 0.89 10
28
+ 25 0.90 1.00 0.95 19
29
+ 26 0.89 0.86 0.88 57
30
+ 27 0.83 0.80 0.82 25
31
+ 28 0.40 0.33 0.36 6
32
+ 29 1.00 0.17 0.29 6
33
+ 30 0.93 0.97 0.95 67
34
+ 31 0.95 0.86 0.90 21
35
+ 32 0.81 0.79 0.80 126
36
+ 33 0.94 0.93 0.93 114
37
+ 34 0.96 0.92 0.94 26
38
+ 35 0.91 0.91 0.91 11
39
+ 36 0.79 0.89 0.84 72
40
  37 0.00 0.00 0.00 0
41
+ 38 1.00 0.47 0.64 15
42
+ 39 1.00 0.88 0.94 25
43
+ 40 0.89 0.95 0.92 43
44
  41 0.00 0.00 0.00 3
45
+ 42 0.78 0.84 0.81 51
46
+ 43 0.77 0.64 0.70 36
47
+ 44 0.95 0.94 0.95 119
48
+ 45 0.82 0.92 0.87 176
49
+ 46 0.84 0.97 0.90 32
50
+ 47 0.97 0.89 0.93 81
51
+ 48 0.95 1.00 0.98 41
52
+ 49 0.84 0.80 0.82 141
53
+ 50 0.95 0.91 0.93 209
54
+ 51 0.94 0.91 0.93 35
55
+ 52 1.00 1.00 1.00 21
56
+ 53 0.94 0.90 0.92 52
57
+ 54 0.92 0.96 0.94 23
58
+ 55 0.74 0.85 0.79 20
59
+ 56 0.97 0.97 0.97 36
60
+ 57 0.84 0.89 0.86 35
61
+ 58 0.94 0.76 0.84 63
62
+ 59 0.90 0.84 0.87 51
63
 
64
+ accuracy 0.87 2974
65
+ macro avg 0.82 0.79 0.79 2974
66
+ weighted avg 0.87 0.87 0.87 2974
67
 
68
  Confusion matrix:
69
  [[86 0 0 ... 0 0 0]
70
  [ 0 35 0 ... 0 0 0]
71
+ [ 0 0 26 ... 0 0 0]
72
  ...
73
+ [ 0 0 0 ... 31 0 0]
74
+ [ 0 0 0 ... 1 48 0]
75
+ [ 0 0 0 ... 1 0 43]]
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4d29efe8c00a6c30d99e8ee040c71694785e08a78ee93033dad6741deb9e85f
3
  size 2240311788
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15e86ef058df617d59b6f605a8458436f8548a57371a6135d895a1d68c14560a
3
  size 2240311788
model_predict_test.csv CHANGED
The diff for this file is too large to render. See raw diff
 
slot_report_test.txt CHANGED
@@ -1 +1,60 @@
1
- No slot entities in GOLD on TEST; all tokens labeled 'O'. Check span extraction/alignment from `annot_utt`.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ precision recall f1-score support
2
+
3
+ alarm_type 0.00 0.00 0.00 2
4
+ app_name 0.00 0.00 0.00 5
5
+ artist_name 0.00 0.00 0.00 52
6
+ audiobook_author 0.00 0.00 0.00 5
7
+ audiobook_name 0.00 0.00 0.00 22
8
+ business_name 0.00 0.00 0.00 89
9
+ business_type 0.00 0.00 0.00 27
10
+ change_amount 0.00 0.00 0.00 7
11
+ coffee_type 0.00 0.00 0.00 3
12
+ color_type 0.00 0.00 0.00 9
13
+ cooking_type 0.00 0.00 0.00 8
14
+ currency_name 0.01 0.02 0.01 50
15
+ date 0.00 0.00 0.00 365
16
+ definition_word 0.01 0.02 0.01 51
17
+ device_type 0.00 0.00 0.00 28
18
+ drink_type 0.00 0.00 0.00 1
19
+ email_address 0.00 0.00 0.00 9
20
+ email_folder 0.00 0.00 0.00 5
21
+ event_name 0.00 0.00 0.00 237
22
+ food_type 0.02 0.05 0.03 63
23
+ game_name 0.00 0.00 0.00 23
24
+ game_type 0.00 0.00 0.00 0
25
+ general_frequency 0.00 0.00 0.00 17
26
+ house_place 0.00 0.00 0.00 14
27
+ ingredient 0.00 0.00 0.00 5
28
+ joke_type 0.00 0.00 0.00 11
29
+ list_name 0.00 0.00 0.00 61
30
+ meal_type 0.00 0.00 0.00 13
31
+ media_type 0.11 0.20 0.14 119
32
+ movie_name 0.00 0.00 0.00 2
33
+ movie_type 0.00 0.00 0.00 3
34
+ music_album 0.00 0.00 0.00 1
35
+ music_descriptor 0.00 0.00 0.00 4
36
+ music_genre 0.00 0.00 0.00 44
37
+ news_topic 0.00 0.00 0.00 43
38
+ order_type 0.00 0.00 0.00 9
39
+ person 0.01 0.02 0.02 212
40
+ personal_info 0.00 0.00 0.00 13
41
+ place_name 0.00 0.00 0.00 257
42
+ player_setting 0.14 0.06 0.08 35
43
+ playlist_name 0.00 0.00 0.00 12
44
+ podcast_descriptor 0.00 0.00 0.00 21
45
+ podcast_name 0.00 0.00 0.00 16
46
+ radio_name 0.00 0.00 0.00 29
47
+ relation 0.00 0.00 0.00 53
48
+ song_name 0.00 0.00 0.00 34
49
+ time 0.00 0.00 0.00 161
50
+ time_zone 0.00 0.00 0.00 13
51
+ timeofday 0.00 0.00 0.00 48
52
+ transport_agency 0.00 0.00 0.00 9
53
+ transport_descriptor 0.00 0.00 0.00 2
54
+ transport_name 0.00 0.00 0.00 4
55
+ transport_type 0.01 0.02 0.01 63
56
+ weather_descriptor 0.00 0.00 0.00 48
57
+
58
+ micro avg 0.01 0.02 0.01 2437
59
+ macro avg 0.01 0.01 0.01 2437
60
+ weighted avg 0.01 0.02 0.01 2437
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c778f8eb8a77fbcf93583b33b879e0e40350a6fcdddb896989a85c5129099f8b
3
  size 5905
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4ba05a3e896789858252adbf0f9a3ec3415fe403452051d05f0f054ba54b83c
3
  size 5905