Commit History

feat: add presentationidx metric
e887b28

Ilia Tambovtsev commited on

feat: implement BestChunkMatch metric
d06b625

Ilia Tambovtsev commited on

style: indent prompts
487514f

Ilia Tambovtsev commited on

feat: log n questions
a2dc318

Ilia Tambovtsev commited on

feat: configure logging all params, move preprocessing to be a feature of a storage
dfee524

Ilia Tambovtsev commited on

feat: fix async eval to be really async
24e252a

Ilia Tambovtsev commited on

feat: configure cli and implement saving eval results to gsheets
364b978

Ilia Tambovtsev commited on

feat: configure benchmarking and add scorer pick to cli
3d1392a

Ilia Tambovtsev commited on

feat: add async support in evaluation. partially add uploading results to gsheets
16fd4fe

Ilia Tambovtsev commited on

feat: implement retrieval with llm reranking
e37d064

Ilia Tambovtsev commited on

feat: add logging to evaluation
2cb5a84

Ilia Tambovtsev commited on

refactor: add oop to make metrics consistent
45b6d99

Ilia Tambovtsev commited on

feat: setup mlflow evaluation
2c56f66

Ilia Tambovtsev commited on

feat: add mlflow evaluation
9e00936

Ilia Tambovtsev commited on

feat: setup metrics. add llm relevance
934d3e0

Ilia Tambovtsev commited on

feat: implement model evaluation
1603571

Ilia Tambovtsev commited on