Update README.md
#1
by afvanluenen - opened
README.md
CHANGED
|
@@ -1,3 +1,55 @@
|
|
| 1 |
---
|
| 2 |
license: eupl-1.2
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: eupl-1.2
|
| 3 |
+
tags:
|
| 4 |
+
- assembly
|
| 5 |
+
- arm64
|
| 6 |
+
- amd64
|
| 7 |
+
- risc-v
|
| 8 |
+
- i386
|
| 9 |
---
|
| 10 |
+
|
| 11 |
+
# Model Description
|
| 12 |
+
ASMTransformers is a project to train and use a machine learning model to compare assembly (ARM64, AMD64, RISC-V, i386) functions to a database of known functions,
|
| 13 |
+
to aid in the process of reverse engineering.
|
| 14 |
+
|
| 15 |
+
# Status
|
| 16 |
+
?
|
| 17 |
+
|
| 18 |
+
# Relevant links
|
| 19 |
+
* [Github repo ASMtransformers](https://github.com/NetherlandsForensicInstitute/asmtransformers)
|
| 20 |
+
|
| 21 |
+
# Version
|
| 22 |
+
TODO: calver of new release
|
| 23 |
+
|
| 24 |
+
# Usage
|
| 25 |
+
TODO: do we refer to the inference file of our repo?
|
| 26 |
+
|
| 27 |
+
# Intended use
|
| 28 |
+
The model has been trained and tested to be used for similarity search of assembly code. It has not been trained/tested on any other languages than ARM64, AMD64, RISC-V or I386,
|
| 29 |
+
nor has it been tested on other downstream tasks.
|
| 30 |
+
|
| 31 |
+
# Architecture description
|
| 32 |
+
TODO: get model architecture like on the model card of the previous model
|
| 33 |
+
Don't forget to describe that during pretraining, the --mlm-prob parameter has been set to 0.4, in accordance to [paper](INSERT LINK)
|
| 34 |
+
Parameters used: epochs=19, eval_steps=10000, batch_size=512, gradient_accumulation_steps=1, mlm_prob=0.4, bf16=True, tf32=True
|
| 35 |
+
|
| 36 |
+
add estimated time it has cost to train:
|
| 37 |
+
pretraining:
|
| 38 |
+
finetuning: 4 hours on 1 NVIDIA H200
|
| 39 |
+
|
| 40 |
+
# Output
|
| 41 |
+
The model outputs embeddings that can be compared using cosine similarity
|
| 42 |
+
|
| 43 |
+
# Data
|
| 44 |
+
TODO: how did we get the data?
|
| 45 |
+
|
| 46 |
+
# Preprocessing
|
| 47 |
+
Several preprocessing steps have been taken, that differ slightly between architectures.
|
| 48 |
+
TODO: update to same as architecture.md in repo
|
| 49 |
+
|
| 50 |
+
# Performance
|
| 51 |
+
Performance was measured in two ways: Mean Reciprocal Rank (MRR) and Accuracy@1
|
| 52 |
+
|
| 53 |
+
-------------------------------------------------------------------------------------------------------------------------
|
| 54 |
+
|model|ARM64 mrr|ARM64 acc|AMD64 mrr|AMD64 acc|RISC-V mrr|RISC-V acc|I386 mrr|I386 acc|crosslingual mrr|crosslingual acc|
|
| 55 |
+
---------------------------------------------------------------------------------------------------------------------------
|