| --- |
| license: mit |
| language: |
| - en |
| base_model: |
| - FacebookAI/roberta-base |
| pipeline_tag: feature-extraction |
| --- |
| |
| Consider this to be an alpha version of the LUSR model. |
|
|
| This checkpoint outperforms LUAR in machine-text detection and a task probes for stylistic features (mSTEL). |
|
|
| ### Contrastive Probing for Stylistic Features |
|
|
| | Model Name | Accuracy | |
| |--------------------------------|----------| |
| | LUAR-MUD | 3 | |
| | AnnaWegmann/Style-Embedding | 22.4 | |
| | LUSR | 22.2 | |
|
|
|
|
| ### Few-Shot Machine-text Detection, Query Size = 1 |
|
|
| | Model Name | pAUC(0.01) N=1 | N=2 | N=5 | |
| |----------------|----------------|------|------| |
| | Support Size | N=1 | N=2 | N=5 | |
| | LUAR-MUD | 0.63 | 0.74 | 0.89 | |
| | Anna Wegmann | 0.58 | 0.69 | 0.84 | |
| | LUSR | **0.70** | **0.83** | **0.97** | |
|
|
|
|
