JC commited on
Commit
ad4f7ab
·
verified ·
1 Parent(s): c72ca87

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -3
README.md CHANGED
@@ -1,3 +1,34 @@
1
- ---
2
- license: gpl-3.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - fr
4
+ - en
5
+ tags:
6
+ - text-classification
7
+ - yes-no
8
+ - onnx
9
+ - distillation
10
+ license: gpl-3.0
11
+ pipeline_tag: text-classification
12
+ ---
13
+
14
+ # ForSureLLM — yes/no/unknown classifier
15
+
16
+ Source : https://github.com/jcfossati/ForSureLLM
17
+
18
+ Basic analysis of english and french language for yes/no detection.
19
+ When knowing the question and waiting a yes/no answer, asking a frontier LLM is overkill using to much resources, and latency is high for a limited action.
20
+
21
+ ## Stats
22
+
23
+ Distilled via KL-divergence on soft labels.
24
+ MiniLM-L12-v2 multilingual backbone, fine-tuned + int8 quantized.
25
+
26
+ - Accuracy: 91.4%
27
+ - ECE: 0.007 (calibrated)
28
+ - Latency: 2.5ms CPU
29
+ - Size: 113 MB
30
+
31
+ ## Usage
32
+
33
+ - Interaction between an application and the user featuring free-form text input.
34
+ - Chatbot asking user and needed a yes/no answer