Files changed (1) hide show
  1. README.md +52 -0
README.md CHANGED
@@ -1,3 +1,55 @@
1
  ---
2
  license: eupl-1.2
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: eupl-1.2
3
+ tags:
4
+ - assembly
5
+ - arm64
6
+ - amd64
7
+ - risc-v
8
+ - i386
9
  ---
10
+
11
+ # Model Description
12
+ ASMTransformers is a project to train and use a machine learning model to compare assembly (ARM64, AMD64, RISC-V, i386) functions to a database of known functions,
13
+ to aid in the process of reverse engineering.
14
+
15
+ # Status
16
+ ?
17
+
18
+ # Relevant links
19
+ * [Github repo ASMtransformers](https://github.com/NetherlandsForensicInstitute/asmtransformers)
20
+
21
+ # Version
22
+ TODO: calver of new release
23
+
24
+ # Usage
25
+ TODO: do we refer to the inference file of our repo?
26
+
27
+ # Intended use
28
+ The model has been trained and tested to be used for similarity search of assembly code. It has not been trained/tested on any other languages than ARM64, AMD64, RISC-V or I386,
29
+ nor has it been tested on other downstream tasks.
30
+
31
+ # Architecture description
32
+ TODO: get model architecture like on the model card of the previous model
33
+ Don't forget to describe that during pretraining, the --mlm-prob parameter has been set to 0.4, in accordance to [paper](INSERT LINK)
34
+ Parameters used: epochs=19, eval_steps=10000, batch_size=512, gradient_accumulation_steps=1, mlm_prob=0.4, bf16=True, tf32=True
35
+
36
+ add estimated time it has cost to train:
37
+ pretraining:
38
+ finetuning: 4 hours on 1 NVIDIA H200
39
+
40
+ # Output
41
+ The model outputs embeddings that can be compared using cosine similarity
42
+
43
+ # Data
44
+ TODO: how did we get the data?
45
+
46
+ # Preprocessing
47
+ Several preprocessing steps have been taken, that differ slightly between architectures.
48
+ TODO: update to same as architecture.md in repo
49
+
50
+ # Performance
51
+ Performance was measured in two ways: Mean Reciprocal Rank (MRR) and Accuracy@1
52
+
53
+ -------------------------------------------------------------------------------------------------------------------------
54
+ |model|ARM64 mrr|ARM64 acc|AMD64 mrr|AMD64 acc|RISC-V mrr|RISC-V acc|I386 mrr|I386 acc|crosslingual mrr|crosslingual acc|
55
+ ---------------------------------------------------------------------------------------------------------------------------