WildnerveAI commited on
Commit
9853097
·
verified ·
1 Parent(s): b57a415

Upload 4 files

Browse files
tokenizer_files/special_tokens_map.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+
2
+ {
3
+ "cls_token": "[CLS]",
4
+ "mask_token": "[MASK]",
5
+ "pad_token": "[PAD]",
6
+ "sep_token": "[SEP]",
7
+ "unk_token": "[UNK]"
8
+ }
tokenizer_files/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_files/tokenizer_config.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+
2
+ {
3
+ "do_lower_case": true,
4
+ "model_max_length": 512,
5
+ "special_tokens_map_file": "special_tokens_map.json",
6
+ "tokenizer_class": "BertTokenizer",
7
+ "vocab_file": "vocab.txt"
8
+ }
tokenizer_files/vocab.txt ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ how
2
+ do
3
+ i
4
+ implement
5
+ a
6
+ binary
7
+ search
8
+ algorithm
9
+ in
10
+ python
11
+ what
12
+ are
13
+ the
14
+ best
15
+ practices
16
+ for
17
+ restful
18
+ api
19
+ design
20
+ can
21
+ you
22
+ explain
23
+ concept
24
+ of
25
+ closures
26
+ javascript
27
+ difference
28
+ between
29
+ threading
30
+ and
31
+ multiprocessing
32
+ optimize
33
+ react
34
+ component
35
+ performance
36
+ polymorphism
37
+ object-oriented
38
+ use
39
+ decorators
40
+ manage
41
+ state
42
+ vue.js
43
+ application
44
+ asynchronous
45
+ programming
46
+ c++
47
+ handle
48
+ exceptions
49
+ java