mjbommar commited on
Commit
5e85a28
·
verified ·
1 Parent(s): c3ffebd

Add README

Browse files
Files changed (1) hide show
  1. README.md +24 -1
README.md CHANGED
@@ -1,7 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # Glaurung Binary Tokenizer 001
2
 
3
  **Production-ready 64K vocabulary BPE tokenizer for binary executables**
4
 
 
 
5
  ---
6
 
7
  ## Overview
@@ -445,7 +466,9 @@ HuggingFace: mjbommar/glaurung-binary-tokenizer-001
445
 
446
  ## License
447
 
448
- For research and educational purposes. See [mjbommar/glaurung-models](https://github.com/mjbommar/glaurung-models) for license details.
 
 
449
 
450
  ---
451
 
 
1
+ ---
2
+ language:
3
+ - code
4
+ license: apache-2.0
5
+ tags:
6
+ - binary-analysis
7
+ - tokenizer
8
+ - bpe
9
+ - malware-analysis
10
+ - reverse-engineering
11
+ - security
12
+ - x86-64
13
+ - arm64
14
+ - elf
15
+ - pe
16
+ library_name: tokenizers
17
+ pipeline_tag: feature-extraction
18
+ ---
19
+
20
  # Glaurung Binary Tokenizer 001
21
 
22
  **Production-ready 64K vocabulary BPE tokenizer for binary executables**
23
 
24
+ 🔗 **GitHub**: [mjbommar/glaurung](https://github.com/mjbommar/glaurung)
25
+
26
  ---
27
 
28
  ## Overview
 
466
 
467
  ## License
468
 
469
+ Apache License 2.0
470
+
471
+ This tokenizer is part of the [Glaurung](https://github.com/mjbommar/glaurung) project. See the [glaurung-models repository](https://github.com/mjbommar/glaurung-models) for full license details.
472
 
473
  ---
474