File size: 2,226 Bytes
36f5ed6
146b589
 
 
 
 
 
 
 
 
36f5ed6
 
146b589
36f5ed6
146b589
36f5ed6
146b589
36f5ed6
0cd3150
36f5ed6
146b589
36f5ed6
146b589
36f5ed6
146b589
36f5ed6
146b589
36f5ed6
146b589
 
 
 
 
 
 
 
 
 
 
36f5ed6
146b589
36f5ed6
146b589
 
 
 
 
 
 
36f5ed6
146b589
36f5ed6
146b589
 
36f5ed6
146b589
 
 
 
 
36f5ed6
146b589
36f5ed6
146b589
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
---
language: en
license: mit
tags:
  - text-classification
  - roberta
  - sludge
  - administrative-burden
  - consumer-complaints
base_model: roberta-base
---

# sludge-process-roberta

Fine-tuned [RoBERTa-base](https://huggingface.co/roberta-base) classifier for detecting **process sludge** (barriers to action — excessive procedural friction) in consumer financial complaint narratives.

Developed and validated in:

> Chesterfield, A., Gillespie, A., Goddard, A. and Krpan, D. (2026). *Feeling the Friction: Developing and validating text classifiers for sludge in consumer complaints.* (manuscript in preparation)

Code and data: [GitHub](https://github.com/AlexChesterfield/sludge-classifiers) | Companion model: [sludge-informational-roberta](https://huggingface.co/AlexChesterfield/sludge-informational-roberta)

## What this model detects

**Process sludge** = barriers to action: excessive procedural friction such as repeated documentation requests, unnecessary steps, or being passed between departments without resolution. Binary classification: 1 = process sludge present, 0 = absent.

## Training details

| Parameter | Value |
|-----------|-------|
| Base model | roberta-base |
| Training samples | 825 (85% stratified split of n=971) |
| Test samples | 146 (15% held-out, evaluated once) |
| Epochs | 4 |
| Learning rate | 2e-5 |
| Batch size | 8 |
| Warmup ratio | 0.1 |
| Class weighting | Balanced |
| Random seed | 42 |

## Performance (held-out test set, n=146)

| Metric | Score |
|--------|-------|
| MCC | 0.796 |
| F1 | 0.863 |
| Precision | 0.800 |
| Recall | 0.936 |
| Accuracy | 0.904 |

## How to use

```python
from transformers import pipeline

classifier = pipeline("text-classification", model="AlexChesterfield/sludge-process-roberta")
complaint = "I called five times and each time was transferred to a different department."
result = classifier(complaint)
# LABEL_1 = sludge present, LABEL_0 = absent
```

## Citation

```bibtex
@article{chesterfield2026sludge,
  title={Feeling the Friction: Developing and validating text classifiers for sludge in consumer complaints},
  author={Chesterfield, Alexandra and Gillespie, Alex and Goddard, Alex and Krpan, Dario},
  year={2026}
}
```