Spaces:

MukulRay
/

EmpathRAG

Running

App Files Files Community

EmpathRAG / eval

309 kB

Ctrl+K

4 contributors

History: 36 commits

MukulRay

Strict cleanup: remove internal handoff docs, neutralize teammate/sprint naming in public docs

091059d 5 days ago

fixtures
Strict cleanup: remove internal handoff docs, neutralize teammate/sprint naming in public docs 5 days ago
README_multiturn_eval.md

586 Bytes
Strict cleanup: remove internal handoff docs, neutralize teammate/sprint naming in public docs 5 days ago
ablation_results.json

1.24 kB
Fix Condition C ablation - pure FAISS order, no safety score bias - mean=0.50 about 1 month ago
adversarial_probes.json

6.29 kB
Add eval suite: test prompts, adversarial probes, BERTScore references (Day 12) about 1 month ago
adversarial_results.json

14.9 kB
Start v2 safety hardening 20 days ago
adversarial_results_t050.json

9.21 kB
eval: save adversarial results at both t=0.50 and t=0.85, reset production threshold to 0.50 (Day 14) about 1 month ago
adversarial_results_t085.json

9.22 kB
eval: save adversarial results at both t=0.50 and t=0.85, reset production threshold to 0.50 (Day 14) about 1 month ago
audit_resource_urls.py

6.83 kB
V4.2 part 1: fix broken ISSS URL, ship URL audit + Karthik data brief 6 days ago
bertscore_references.json

13.5 kB
Add eval suite: test prompts, adversarial probes, BERTScore references (Day 12) about 1 month ago
bertscore_results.json

5.6 kB
Add conversation memory, fix Gradio stack, improve SYSTEM_PROMPT, log human eval turns about 1 month ago
build_bertscore_references.py

4.39 kB
Add eval suite: test prompts, adversarial probes, BERTScore references (Day 12) about 1 month ago
condition_a.py

1.61 kB
feat: eval scripts — BM25 baseline, adversarial probes, BERTScore, RAGAS, Wilcoxon (Day 14) about 1 month ago
ingest_core_dataset_v2.py

15.6 kB
Prepare Core dataset intake and resource registry 16 days ago
keyword_filter.py

1.38 kB
Day 1: data pipeline, session tracker, query router, adversarial probes, Colab training notebooks about 1 month ago
multiturn_safety_supplement.jsonl

16.7 kB
Add Eval B safety supplement 12 days ago
multiturn_scenarios.jsonl

38.1 kB
Ingest Core dataset and harden router policy 12 days ago
prepare_karthik_dataset.py

5.68 kB
Implement EmpathRAG Core hybrid router 16 days ago
run_ablation.py

9.03 kB
Start v2 safety hardening 20 days ago
run_ablation_eval.py

9.82 kB
V4.3: prompt-injection audit, input length cap, per-layer ablation, unguarded baseline, limitations restored 6 days ago
run_adversarial.py

6.08 kB
Start v2 safety hardening 20 days ago
run_bertscore.py

3.18 kB
fix: guardrail dual-import path, bertscore key names, ragas reuse pipeline.llm (Day 14) about 1 month ago
run_curated_retrieval_audit.py

2.34 kB
Add curated corpus integration scaffold 20 days ago
run_empathrag_core_eval.py

7.41 kB
Polish peer helper and scope handling 16 days ago
run_karthik_eval_delivery.py

5.6 kB
Add Karthik eval harness and safety patches 16 days ago
run_multiturn_eval.py

7.63 kB
Add Eval B safety supplement 12 days ago
run_ragas.py

7.64 kB
Start v2 safety hardening 20 days ago
run_router_eval.py

2.91 kB
Implement EmpathRAG Core hybrid router 16 days ago
run_unguarded_baseline.py

10.5 kB
V4.3: prompt-injection audit, input length cap, per-layer ablation, unguarded baseline, limitations restored 6 days ago
run_wilcoxon.py

5.66 kB
Start v2 safety hardening 20 days ago
smoke_test_results.json

1.43 kB
Start v2 safety hardening 20 days ago
sweep_diversity_probes.py

10.2 kB
Diversity probe sweep + V1->V4 narrative README + HF Spaces entry + DV/incomplete fixes 5 days ago
sweep_f1_stage_isss.py

8.22 kB
V4: streaming, controlled paraphrasing, support plan, voice, sweeps 8 days ago
sweep_fairness_spot_check.py

8.26 kB
V4: streaming, controlled paraphrasing, support plan, voice, sweeps 8 days ago
sweep_prompt_injection.py

9.88 kB
V4.3: prompt-injection audit, input length cap, per-layer ablation, unguarded baseline, limitations restored 6 days ago
sweep_rephraser_drift.py

13.4 kB
V4: streaming, controlled paraphrasing, support plan, voice, sweeps 8 days ago
sweep_sycophancy_probes.py

8.95 kB
V4.2 part 3: sycophancy guard, F-1 flag decay, incomplete-message handler 6 days ago
test_prompts.json

8.92 kB
Add eval suite: test prompts, adversarial probes, BERTScore references (Day 12) about 1 month ago
train_ml_router.py

1.5 kB
Implement EmpathRAG Core hybrid router 16 days ago
validate_eval_delivery.py

6.55 kB
Checkpoint V2 curated support navigator 16 days ago
wilcoxon_results.json

920 Bytes
fix: MistralJudge JSON extraction for DeepEval faithfulness, commit Wilcoxon results (Day 15) about 1 month ago