SatFetch / src /evaluation /README.md
karansharmaworkspace's picture
Upload 68 files
f343f06 verified
|
Raw
History Blame Contribute Delete
685 Bytes

Evaluation Module

Metrics and ground truth management for retrieval evaluation.

Files

File Description
metrics.py F1@K, precision, recall, timing statistics
ground_truth.py Ground truth label management

Metrics

Metric Description
F1@5 Precision@5 x Recall@5
F1@10 Precision@10 x Recall@10
Same-Modal F1 F1 for same-modality queries
Cross-Modal F1 F1 for cross-modality queries

Usage

from src.evaluation.metrics import compute_f1

# Compute F1@K
f1_score = compute_f1(
    predicted_indices=result.indices,
    ground_truth_indices=gt_indices,
    k=5
)