Object Detection
English
document-ai
form-field-detection
File size: 3,412 Bytes
17ccbba
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
---
license: other
license_name: nutrient-commercial
pipeline_tag: object-detection
language: [en]
tags:
  - object-detection
  - document-ai
  - form-field-detection
datasets:
  - nutrientdocs/form-field-v1-benchmark
metrics:
  - accuracy
---

# form-field-v1-medium Β· _commercial_

**The highest-accuracy tier of the `form-field-v1` detector family** β€” locates `Text`, `Choice`
(checkbox/radio), and `Signature` widgets on **empty, filled, and handwritten** document pages. ~34M params,
NMS-free, single-resolution 1216.

The runnable weights are commercial and are not downloadable from this repository β€” this public page is the
product specification and scorecard. Prefer a small, open model? See
[`form-field-v1-nano`](https://huggingface.co/nutrientdocs/form-field-v1-nano) (Apache-2.0).

- 🎯 **Try it:** [form-field-v1-demo](https://huggingface.co/spaces/nutrientdocs/form-field-v1-demo)
- πŸ† **Leaderboard:** [form-field-v1-leaderboard](https://huggingface.co/spaces/nutrientdocs/form-field-v1-leaderboard)
- πŸ“Š **Benchmark:** [form-field-v1-benchmark](https://huggingface.co/datasets/nutrientdocs/form-field-v1-benchmark)

## Results

COCO **mAP50-95** on the [`form-field-v1-benchmark`](https://huggingface.co/datasets/nutrientdocs/form-field-v1-benchmark),
one shared pycocotools scorer across all models.

| Model | Empty | Filled | Handwritten |
|---|---|---|---|
| **form-field-v1-medium** (this model) | **0.529** | **0.783** | **0.764** |
| FFDetr (baseline) | 0.461 | 0.170 | 0.225 |
| FFDNet-L (baseline) | 0.373 | 0.285 | 0.285 |

Per-class on empty (mAP50-95): Text 0.605 / Choice 0.614 / Signature 0.369. On the neutral CommonForms-test it
reaches 0.361. Full per-class breakdowns are on the
[leaderboard](https://huggingface.co/spaces/nutrientdocs/form-field-v1-leaderboard).

## Output

```json
[ { "box": [82, 164, 336, 41], "type": "Text", "score": 0.94 } ]
```

`box` is `[x, y, w, h]` in page pixels; `type` ∈ `Text`, `ChoiceButton`, `Signature`. Served as a single-file
ONNX graph (fp32 + fp16), verified to reproduce the benchmark (fp32 mAP 0.6909 / fp16 0.6860 over all variants).

## Intended use and limits

- Empty, filled, and handwritten digital/scanned forms are all supported.
- GPU/server model (~57 fps on an A100). For on-device CPU use `form-field-v1-nano` / `-small`.
- Very dense pages benefit from higher input resolution.

## License & data

Weights are offered under a commercial Nutrient license. Evaluation is public and reproducible via
[`form-field-v1-benchmark`](https://huggingface.co/datasets/nutrientdocs/form-field-v1-benchmark). The FFDetr
baseline is [FF-DETR / CommonForms](https://huggingface.co/jbarrow/FFDetr) by jbarrow, Apache-2.0.

> ### πŸ“© Get access
>
> `form-field-v1-medium` is commercial and its weights are not downloadable here. To run it on-prem, with
> documents staying in your infrastructure β€” **contact Nutrient:
> [nutrient.io/contact-sales](https://www.nutrient.io/contact-sales/).**

## About the author

<a href="https://nutrient.io/">
  <img src="https://avatars2.githubusercontent.com/u/1527679?v=3&s=200" height="80" />
</a>

This project is maintained and funded by [Nutrient](https://nutrient.io/) - The deterministic document infrastructure enterprises run their highest-stakes workflows on: replayable output, clear exceptions, and full audit trails on the messy, regulated documents where AI alone breaks.