ForumCore commited on
Commit
31eb9de
·
verified ·
1 Parent(s): 0c6a573

docs: DotCheck Hub card + license (no weights)

Browse files
Files changed (2) hide show
  1. CITATION.cff +10 -9
  2. README.md +78 -67
CITATION.cff CHANGED
@@ -1,6 +1,6 @@
1
  cff-version: 1.2.0
2
- message: "If you use DotCheck engines or cite measured gates, please cite as below."
3
- title: "DotCheck Vermeer, Valla, and Muybridge AI-likeness engines"
4
  authors:
5
  - name: "DotCheck"
6
  url: "https://dotcheck.ai"
@@ -8,14 +8,15 @@ repository-code: "https://huggingface.co/DotCheck"
8
  license: "other"
9
  date-released: "2026-07-26"
10
  abstract: >-
11
- DotCheck scores AI-likeness for images (Vermeer), text (Valla), and video
12
- frames (Muybridge) via closed in-house heads on frozen commercial-clean
13
- backbones. Public Hub pages document engines and gate metrics; weights are
14
- not redistributed. Product scoring system: Leviathan.
 
15
  keywords:
16
  - ai-detection
17
- - image-forensics
18
- - text-detection
19
  - video
20
  - siglip2
21
  - closed-weights
@@ -23,6 +24,6 @@ preferred-citation:
23
  type: soft
24
  authors:
25
  - name: "DotCheck"
26
- title: "DotCheck engines (Vermeer, Valla, Muybridge)"
27
  url: "https://dotcheck.ai/docs"
28
  year: 2026
 
1
  cff-version: 1.2.0
2
+ message: "If you cite DotCheck engines or measured holdout gates, use the citation below."
3
+ title: "DotCheck closed-weight AI-likeness engines (inhouse@5, inhouse-text@9, inhouse-video@2)"
4
  authors:
5
  - name: "DotCheck"
6
  url: "https://dotcheck.ai"
 
8
  license: "other"
9
  date-released: "2026-07-26"
10
  abstract: >-
11
+ DotCheck serves binary AI-likeness scores for images (wire inhouse@5 /
12
+ Vermeer), text (inhouse-text@9 / Valla, seven languages), and video frame
13
+ bags (inhouse-video@2 / Muybridge) using closed heads on frozen commercial-
14
+ clean backbones. Public Hub repos document architecture and holdout metrics;
15
+ .npz head weights are not redistributed.
16
  keywords:
17
  - ai-detection
18
+ - image-classification
19
+ - text-classification
20
  - video
21
  - siglip2
22
  - closed-weights
 
24
  type: soft
25
  authors:
26
  - name: "DotCheck"
27
+ title: "DotCheck engines (inhouse@5, inhouse-text@9, inhouse-video@2)"
28
  url: "https://dotcheck.ai/docs"
29
  year: 2026
README.md CHANGED
@@ -16,7 +16,6 @@ tags:
16
  - text-classification
17
  - ai-detection
18
  - multilingual
19
- - roberta
20
  - closed-weights
21
  - dotcheck
22
  - valla
@@ -29,118 +28,130 @@ model-index:
29
  results:
30
  - task:
31
  type: text-classification
32
- name: AI-likeness (text, English)
33
  dataset:
34
- name: DotCheck text gates EN (human vs holdout AI)
35
  type: other
36
  split: holdout
37
  metrics:
38
- - name: Human mean P(AI)
39
  type: mean_score_human
40
  value: 0.045
41
- - name: AI mean P(AI)
42
  type: mean_score_ai
43
  value: 0.909
44
- - name: Balanced accuracy @ thr
45
  type: balanced_accuracy
46
  value: 0.980
47
  source:
48
- name: DotCheck MODEL-CHOICE / Data.json
49
  url: https://dotcheck.ai/docs
50
  ---
51
 
52
- # Valla — DotCheck text engine (`inhouse-text@9`)
53
 
54
- **Valla** is DotCheck’s live **text** AI-likeness stack. It returns a probability [0, 1] (higher more AI-like) for a text segment, with an explicit `lang`.
55
 
56
- | | |
57
- |--|--|
58
- | **Product label** | Valla |
59
- | **Wire id (EN)** | `inhouse-text@9` |
60
- | **Public token** | Valla@9 |
61
- | **Live artifact (EN)** | `text_stack_head_v9.npz` |
62
- | **Bases** | [`Oxidane/tmr-ai-text-detector`](https://huggingface.co/Oxidane/tmr-ai-text-detector) (MIT) + [`fakespot-ai/roberta-base-ai-text-detection-v1`](https://huggingface.co/fakespot-ai/roberta-base-ai-text-detection-v1) (Apache-2.0) + DotCheck logistic head |
63
- | **Languages** | `en`, `es`, `pt`, `fr`, `it`, `de`, `nl` |
64
- | **Weights** | **Closed** not published on this Hub repo |
65
-
66
- Part of **Leviathan** (engines + generator-surface prior + shared content-hash cache).
67
 
68
  ## Model description
69
 
70
- Two frozen text detectors (TMR + Fakespot) produce features; DotCheck logistic heads (one EN + six language heads) map to P(AI). Serve loads **one shared** base pair for all seven heads. Request language must be supported; unsupported languages fail closed (no silent fallback).
71
 
72
- This repository is **documentation only**. It does **not** contain `.npz` or checkpoint files.
73
 
74
- ## Evaluation English public claims
75
 
76
- Lockstep with `Data.json` / MODEL-CHOICE:
77
 
78
- | Gate | Measured |
79
- |------|---------:|
80
- | Human mean P(AI) | **0.045** |
81
- | AI mean P(AI) | **0.909** |
82
- | Balanced accuracy @ threshold | **0.980** |
 
 
 
83
 
84
- Wiki-monitor mean is ~\<0.001 vs prior live (see MODEL-CHOICE). No live ChatGPT/Claude scrape holdout is published.
85
 
86
- ## Evaluation language heads (holdout gates)
87
 
88
- Same absolute floors as EN (`humanMax` / `aiMin` / `balMin` in `Data.json`). Cite MODEL-CHOICE evidence JSONs:
 
 
 
 
 
89
 
90
- | Lang | Engine | Human mean | AI mean | bal_acc |
91
- |------|--------|----------:|--------:|--------:|
92
- | es | `inhouse-text-es_v2` | **0.088** | **0.953** | **0.972** |
93
- | pt | `inhouse-text-pt_BR_v1` | **0.103** | **0.945** | **0.928** |
94
- | fr | `inhouse-text-fr_v2` | **0.082** | **0.976** | **0.975** |
95
- | it | `inhouse-text-it_v1` | **0.069** | **0.986** | **0.972** |
96
- | de | `inhouse-text-de_v1` | **0.064** | **0.968** | **0.958** |
97
- | nl | `inhouse-text-nl_v1` | **0.101** | **0.978** | **0.933** |
98
 
99
- Public marketing claims for text remain the **English** floats above unless a surface explicitly shows a language table.
100
 
101
- ## Intended use
 
 
 
 
 
102
 
103
- - AI-likeness scoring for supported languages inside DotCheck product surfaces.
104
- - Citation of measured gates with attribution.
105
 
106
- ### Out of scope
107
 
108
- - `from_pretrained` on `DotCheck/valla-text-v9` for DotCheck head weights (not published).
109
- - Unsupported languages (no silent English fallback in product).
110
- - Authorship or plagiarism legal determinations.
111
 
112
- ## How to use
 
 
 
 
113
 
114
- **Do not** call `from_pretrained` on DotCheck head repos.
115
 
116
- 1. **Check:** [https://dotcheck.ai/check](https://dotcheck.ai/check) Free/guest daily limits apply.
117
- 2. **Pro API:** create a `dc_…` key in [Dashboard](https://dotcheck.ai/dashboard). Docs: [https://dotcheck.ai/api](https://dotcheck.ai/api)
118
 
119
- ```bash
120
- curl -sS -X POST "https://dotcheck-server-c221c1f32c68.herokuapp.com/analyze-text" \
121
- -H "Authorization: Bearer dc_YOUR_KEY" \
122
- -H "Content-Type: application/json" \
123
- -d "{\"text\":\"Your paragraph here…\",\"lang\":\"en\"}"
124
- ```
 
 
125
 
126
- Keys are managed only in Dashboard (Pro). Confirm stays opt-in on Pro.
127
 
128
- How: [https://dotcheck.ai/how](https://dotcheck.ai/how) · Docs: [https://dotcheck.ai/docs](https://dotcheck.ai/docs)
 
129
 
130
- ## Training and evaluation data
131
 
132
- English fit AI: Qwen2.5-7B + Mistral-7B (multi-temp); holdout AI: Qwen2.5-1.5B. Humans: hard-negative wiki / WikiText / Gutenberg mix (see MODEL-CHOICE). Language heads: prose Wiki + wiki-style prompts; English absolute floors. Commercial-clean only.
 
 
133
 
134
  ## Limitations
135
 
136
- - Short / heavily edited / machine-translated text can be unstable.
137
- - Only seven languages are live.
138
- - Detector scores are not generator attribution.
139
 
140
  ## License
141
 
142
- Custom **DotCheck Inference License (Closed Weights)** — [`LICENSE`](../LICENSE). Upstream TMR / Fakespot licenses in [`NOTICE`](../NOTICE).
143
 
144
  ## Citation
145
 
146
- [`CITATION.cff`](../CITATION.cff) · Docs [https://dotcheck.ai/docs](https://dotcheck.ai/docs) · token **Valla@9** / wire `inhouse-text@9`.
 
16
  - text-classification
17
  - ai-detection
18
  - multilingual
 
19
  - closed-weights
20
  - dotcheck
21
  - valla
 
28
  results:
29
  - task:
30
  type: text-classification
31
+ name: binary AI-likeness (text, en)
32
  dataset:
33
+ name: DotCheck text holdout EN
34
  type: other
35
  split: holdout
36
  metrics:
37
+ - name: mean_P_AI_human
38
  type: mean_score_human
39
  value: 0.045
40
+ - name: mean_P_AI_ai
41
  type: mean_score_ai
42
  value: 0.909
43
+ - name: balanced_accuracy
44
  type: balanced_accuracy
45
  value: 0.980
46
  source:
47
+ name: text_gates_v9 / Data.json
48
  url: https://dotcheck.ai/docs
49
  ---
50
 
51
+ # DotCheck/valla-text-v9
52
 
53
+ Closed-weight **text** AI-likeness stack for DotCheck serve. Hub repo = card + license only (no `.npz`).
54
 
55
+ | Field | Value |
56
+ |-------|--------|
57
+ | Hub id | `DotCheck/valla-text-v9` |
58
+ | Wire id (EN) | `inhouse-text@9` |
59
+ | Label | Valla |
60
+ | EN artifact | `text_stack_head_v9.npz` |
61
+ | Feature bases | [`Oxidane/tmr-ai-text-detector`](https://huggingface.co/Oxidane/tmr-ai-text-detector) (MIT), [`fakespot-ai/roberta-base-ai-text-detection-v1`](https://huggingface.co/fakespot-ai/roberta-base-ai-text-detection-v1) (Apache-2.0) |
62
+ | Heads | EN + `es_v2` / `pt_BR_v1` / `fr_v2` / `it_v1` / `de_v1` / `nl_v1` (separate `.npz`) |
63
+ | Output | `p [0,1]` P(AI-like) |
64
+ | Serve | CPU FastAPI `POST /v1/analyze-text` + required `lang` |
65
+ | `lang` | `en\|es\|pt\|fr\|it\|de\|nl` (`pt` `pt_BR` head) |
66
 
67
  ## Model description
68
 
69
+ Frozen TMR + Fakespot encoders shared feature vector language-specific logistic head. Serve loads **one** base pair for all seven heads. Unsupported `lang` fail closed (`unsupported_language`; no silent EN fallback).
70
 
71
+ Text hygiene (TC1) applied before hash/score: strip wiki-style cites, collapse whitespace, drop `#category` tokens (mirrored in Express / extension).
72
 
73
+ **Files in this repo:** card + license artifacts only. Heads: private `DotCheck/heads-live-private`.
74
 
75
+ ## Architecture
76
 
77
+ ```text
78
+ raw text
79
+ text_clean (TC1)
80
+ TMR + Fakespot frozen forward (shared)
81
+ concat / stack features
82
+ → lang-selected logistic head (npz)
83
+ → p_AI
84
+ ```
85
 
86
+ ## Inference
87
 
88
+ Do **not** `from_pretrained("DotCheck/valla-text-v9")` for DotCheck heads.
89
 
90
+ ```bash
91
+ curl -sS -X POST "https://dotcheck-server-c221c1f32c68.herokuapp.com/analyze-text" \
92
+ -H "Authorization: Bearer dc_YOUR_KEY" \
93
+ -H "Content-Type: application/json" \
94
+ -d "{\"text\":\"...\",\"lang\":\"en\"}"
95
+ ```
96
 
97
+ UI: https://dotcheck.ai/check · API: https://dotcheck.ai/api · docs: https://dotcheck.ai/docs
98
+ Min length / FUP enforced at Express (product policy).
 
 
 
 
 
 
99
 
100
+ ## Training data
101
 
102
+ | | EN | Other langs |
103
+ |--|----|-------------|
104
+ | Fit AI | Qwen2.5-7B + Mistral-7B (multi-temp) | open models, wiki-style prompts |
105
+ | Holdout AI | **Qwen2.5-1.5B** | per-lang holdouts (~200/200) |
106
+ | Human | hard-neg wiki / WikiText / Gutenberg mix | Wikipedia lead prose |
107
+ | License | commercial-clean only (no NC banned sets) | same |
108
 
109
+ No published holdout from live ChatGPT/Claude scrapes. Evidence: `text_gates_v9.json`, `text_gates_{lang}.json`.
 
110
 
111
+ ## Evaluation
112
 
113
+ ### English (public claim SSOT)
 
 
114
 
115
+ | Metric | Target | Measured |
116
+ |--------|--------|---------:|
117
+ | mean P(AI) \| human | ≤ 0.12 | **0.045** |
118
+ | mean P(AI) \| AI | ≥ 0.85 | **0.909** |
119
+ | bal_acc @ thr | ≥ 0.90 | **0.980** |
120
 
121
+ Also: beat prior `@6` holdout; wiki-monitor mean ~\<0.001; OOD / RAID-lite protocol OK (`TEXT_GATES_OK`).
122
 
123
+ ### Language heads (holdout; same absolute floors)
 
124
 
125
+ | Lang | Wire | Human | AI | bal_acc |
126
+ |------|------|------:|---:|--------:|
127
+ | es | `inhouse-text-es_v2` | 0.088 | 0.953 | 0.972 |
128
+ | pt | `inhouse-text-pt_BR_v1` | 0.103 | 0.945 | 0.928 |
129
+ | fr | `inhouse-text-fr_v2` | 0.082 | 0.976 | 0.975 |
130
+ | it | `inhouse-text-it_v1` | 0.069 | 0.986 | 0.972 |
131
+ | de | `inhouse-text-de_v1` | 0.064 | 0.968 | 0.958 |
132
+ | nl | `inhouse-text-nl_v1` | 0.101 | 0.978 | 0.933 |
133
 
134
+ ## Intended use
135
 
136
+ - Supported-language AI-likeness scoring in DotCheck inference.
137
+ - Citation of the tables above.
138
 
139
+ ### Out of scope
140
 
141
+ - Head weight download from this Hub id.
142
+ - Languages outside `{en,es,pt,fr,it,de,nl}`.
143
+ - Plagiarism / authorship adjudication.
144
 
145
  ## Limitations
146
 
147
+ - Short, MT-heavy, or heavily edited text: higher variance.
148
+ - Seven languages only.
149
+ - Output is not generator attribution.
150
 
151
  ## License
152
 
153
+ [`LICENSE`](LICENSE). Upstream TMR / Fakespot: [`NOTICE`](NOTICE).
154
 
155
  ## Citation
156
 
157
+ [`CITATION.cff`](CITATION.cff) · wire `inhouse-text@9` / Valla@9 · https://dotcheck.ai/docs