File size: 734 Bytes
09669b8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
---
license: apache-2.0
pipeline_tag: text-classification
tags:
  - lfm2
  - data-use
  - gate
  - domain
  - multi-task
---

# datause-classifier-multitask

Fine-tune of `LiquidAI/LFM2.5-Encoder-230M` with two heads: a page `has_data` gate and a
document `teratopic` domain classifier.

## Labels
30 teratopic sector themes (see `encoder_labels.json`).

## Training
- base model: `LiquidAI/LFM2.5-Encoder-230M`
- epochs: 3
- learning rate: 2e-05
- max_length: 2048
- precision: bf16

## Evaluation (holdout)

### Gate (page has_data)
- threshold: 0.95
- precision: 0.9409
- recall: 0.8785
- F1: 0.9086
- % pages flagged negative: 0.4604

### Domain (teratopic)
- micro F1: 0.5245
- macro F1: 0.3940
- mean average precision: 0.5031