crp-intent-setfit / README.md
ConstantinosVidiniotis's picture
Upload README.md with huggingface_hub
a21f6f7 verified
|
Raw
History Blame Contribute Delete
2.47 kB
---
license: other
pipeline_tag: text-classification
library_name: setfit
base_model: sentence-transformers/all-MiniLM-L6-v2
tags:
- setfit
- sentence-transformers
- text-classification
- crp
- context-relay-protocol
- intent-classification
- speech-acts
widget:
- text: Please scan the repository for compliance issues.
- text: What is the current deployment status?
- text: I believe the server is down.
- text: This is frustrating and slow.
inference: true
model-index:
- name: crp-intent-setfit
results:
- task:
type: text-classification
name: Speech-act classification (4-class)
dataset:
name: CRP speech-act held-out mix
type: banking77
metrics:
- type: accuracy
value: 0.934
name: Held-out accuracy (2,000 examples)
verified: false
---
# CRP Intent / Speech-Act Classifier
A SetFit sentence-transformer classifier that maps a user turn into one of four CRP speech acts: `request`, `question`, `assertion`, or `expressive`. Trained on Banking77, SNIPS, and synthetic CRP-style templates. Used by `crp.isa.intent` to decide how a turn should be routed and framed in the positioned agent loop.
## Model description
- **Architecture:** SetFit on `sentence-transformers/all-MiniLM-L6-v2` (22M params).
- **Labels:** `request`, `question`, `assertion`, `expressive`.
- **Held-out accuracy:** 0.934 (2,000-example held-out slice from the training mix).
- **Production prompt score:** 18/20 correctly classified.
- **Inference budget:** ~10 ms on CPU; governed by `crp.ml.registry.ModelManager`.
## Intended use
```python
from setfit import SetFitModel
model = SetFitModel.from_pretrained('AutoCyberAI/crp-intent-setfit')
print(model.predict(['Please scan the repository for compliance issues.'])) # ['request']
```
## Limitations
- The model is trained on English banking/intent datasets plus synthetic CRP templates; performance may degrade on code-heavy or non-English inputs.
- It is an advisory classifier — the rule-based fallback in `crp.isa.intent` remains the degraded path if the model is unavailable or the latency budget is exceeded.
## Citation
```bibtex
@misc{crp-intent-setfit,
title={{CRP Intent / Speech-Act Classifier}},
author={{AutoCyber AI}},
year={2026},
howpublished={\url{https://huggingface.co/AutoCyberAI/crp-intent-setfit}}
}
```
---
*This model is part of the Context Relay Protocol (CRP) v6 Phase A managed-model suite. Learn more at https://crprotocol.io.*