File size: 900 Bytes
27c46c6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
================================================================================
COUNSELOR MODEL BENCHMARK REPORT
================================================================================

PERFORMANCE COMPARISON:
----------------------------------------

LENGTH_SCORE:
  Base Model:      0.809 (±0.153)
  Fine-tuned Model: 0.840 (±0.174)
  Improvement:      +3.8%

QUESTION_SCORE:
  Base Model:      0.660 (±0.474)
  Fine-tuned Model: 0.850 (±0.357)
  Improvement:      +28.8%

SUPPORT_SCORE:
  Base Model:      0.248 (±0.184)
  Fine-tuned Model: 0.088 (±0.124)
  Improvement:      -64.5%

EMPATHY_SCORE:
  Base Model:      0.262 (±0.086)
  Fine-tuned Model: 0.152 (±0.114)
  Improvement:      -42.0%

========================================
OVERALL PERFORMANCE:
  Base Model:       0.495
  Fine-tuned Model: 0.483
  Overall Improvement: -2.5%
========================================