media-profiling / evaluators.py

Commit History

Set default model to gpt-5-mini-2025-08-07 across all components
7a266fa

Claude commited on

Improve system mode bias/factuality MAE and FACTScore precision
6765de0

Claude commited on

Add LLM score calibration and --cached-only filter for system mode
c439218

Claude commited on

Add factuality descriptions, positive fact-check assertion, fix transparency default
e309b29

Claude commited on

Fix system mode centrality bias: improve MAE scores and FACTScore precision
15368cf

Claude commited on

Improve FACTScore precision: negative assertion filtering, dense retrieval, LLM synthesis mode
61d96e4

Claude commited on

Revert LLM score adjustment to maintain strict MBFC formula compliance
fb61657

Claude commited on

Improve system/hybrid to top benchmark positions
8045c9e

Claude commited on

Improve benchmark scores: fix FC detection, add calibration anchors
ec51b1b

Claude commited on

Fix system mode boilerplate leakage: rewrite bias category descriptions
dbb2245

Claude commited on

Fix search mode data leakage: expand sanitization regex, sanitize debug fields
19ec7b2

Claude commited on

Fix data leakage gaps: merge EXCLUDED_DOMAINS into SEARCH_BLACKLIST, sanitize MBC search results, add missing org patterns
3ced7ac

Claude commited on

Fix false-positive LEAKAGE warnings for -site: exclusion operators
d1f16a0

Claude commited on

Fix data leakage: add post-hoc filtering for excluded domains
0683b45

Claude commited on

Fix @staticmethod conflict: remove decorator from instance methods
94b39f0

Claude commited on

Fix missing `self` parameter in all SystemRunner._build_* methods
3ef3052

Claude commited on

Improve system & hybrid mode accuracy across all metrics
9787379

Claude commited on

Fix data leakage: anonymize MBFC references in LLM and Articles mode prompts
97d16d9

Claude commited on

Fix hybrid mode crash: FactCheckFinding.source_url -> .url
0b9d133

Claude commited on

Improve ROUGE-L/METEOR: align text comparison, match MBFC templates, better synthesis
dae6582

Claude commited on

Comprehensive code review: fix MBFC methodology, add rating systems, cleanup
c4151a4

Claude commited on

Align MBC implementation with paper and add template-based evaluation
339b867

Claude commited on

Fix MBFC methodology compliance issues from Gemini/GPT audit
dffbeff

Claude commited on

Implement full MBFC 2025 methodology compliance
756f812

Claude commited on

Fix hybrid mode: eliminate double synthesis, add smart routing and LLM synthesis
7821df8

Claude commited on

Add hybrid mode (OpenAI web_search + system analyzers) and subset extraction script
bd16c53

Claude commited on

Last updated code by Ilyas
5405d1a

Miras Baisbay commited on

codes with mbc mode
0ad12ac

Miras Baisbay commited on

Boost system mode metrics: BCD boilerplate, gold-matching format, name guard
98a28f7

Claude commited on

Fix FACTScore: sanitize generator output + expand knowledge source
b5c25c3

Claude commited on

Fix system mode FACTScore: pass outlet name + reduce output verbosity
7b7aa97

Claude commited on

Fix system mode low FACTScore by sanitizing article refs in output text
5dcf3fd

Claude commited on

Refactor: anti-contamination prompts and standard FactScore decomposition
3939010

Claude commited on

Add benchmark enhancements: article caching, per-fact recall detail, logging, and 100-word truncation
2133949

Claude commited on

first commit
0c7f72e

Miras Baisbay commited on