Commit History

feat: setup number of examples per page
c558638

Ilia Tambovtsev commited on

refactor: remove duplicate regex
9541a9b

Ilia Tambovtsev commited on

fix: remove too much examples
8eeefaa

Ilia Tambovtsev commited on

feat: implement load collection from dotenv in webapp
fdfe2ec

Ilia Tambovtsev commited on

fix: type in examples
99f57b8

Ilia Tambovtsev commited on

feat: add examples to gradio
feb545e

Ilia Tambovtsev commited on

feat: add setting up collection from .env
087cf3c

redmelonberry commited on

feat: add presentationidx metric
e887b28

Ilia Tambovtsev commited on

feat: add links to presentations and questions in webapp
b105b1d

Ilia Tambovtsev commited on

feat: configure params, add description
188b538

Ilia Tambovtsev commited on

ci: add missing import
ed34fc4

Ilia Tambovtsev commited on

ci: update default params
1a673ed

Ilia Tambovtsev commited on

feat: add option to copy collection contents to another collection
c1f9144

Ilia Tambovtsev commited on

fix: reimplement async things to be compatible with gradio
159a530

Ilia Tambovtsev commited on

feat: implement BestChunkMatch metric
d06b625

Ilia Tambovtsev commited on

fix: make async query storage call and use super()
683b3ae

Ilia Tambovtsev commited on

style: indent prompts
487514f

Ilia Tambovtsev commited on

feat: log n questions
a2dc318

Ilia Tambovtsev commited on

doc: update cli docs
afb9c30

Ilia Tambovtsev commited on

feat: add more corner cases to regex
7a0766b

Ilia Tambovtsev commited on

feat: configure logging all params, move preprocessing to be a feature of a storage
dfee524

Ilia Tambovtsev commited on

feat: fix async eval to be really async
24e252a

Ilia Tambovtsev commited on

feat: implement reffering to sheet by name
0c02234

Ilia Tambovtsev commited on

feat: configure cli and implement saving eval results to gsheets
364b978

Ilia Tambovtsev commited on

feat: configure benchmarking and add scorer pick to cli
3d1392a

Ilia Tambovtsev commited on

feat: implement testing preprocessing with gsheets
8c92162

Ilia Tambovtsev commited on

feat: add async support in evaluation. partially add uploading results to gsheets
16fd4fe

Ilia Tambovtsev commited on

feat: add evaluation cli
365d87f

Ilia Tambovtsev commited on

feat: implement prompt preprocessing with regex
c7e0ef5

Ilia Tambovtsev commited on

feat: implement retrieval with llm reranking
e37d064

Ilia Tambovtsev commited on

feat: add logging to evaluation
2cb5a84

Ilia Tambovtsev commited on

refactor: delete unused file
d4b4f3a

Ilia Tambovtsev commited on

feat: TODO configure rag
9a9e3f7

Ilia Tambovtsev commited on

refactor: add oop to make metrics consistent
45b6d99

Ilia Tambovtsev commited on

feat: setup mlflow evaluation
2c56f66

Ilia Tambovtsev commited on

feat: add async pipelines
c413127

Ilia Tambovtsev commited on

feat: add mlflow evaluation
9e00936

Ilia Tambovtsev commited on

feat: update eda
d570714

Ilia Tambovtsev commited on

fix: import ChatOpenAI without warnings
0802329

Ilia Tambovtsev commited on

feat: setup metrics. add llm relevance
934d3e0

Ilia Tambovtsev commited on

style: remove newlined params in functions
3705b3d

Ilia Tambovtsev commited on

refactor: parameterize formatting of output
8dae32e

Ilia Tambovtsev commited on

feat: implement model evaluation
1603571

Ilia Tambovtsev commited on

refactor: move ModelConfigs up
e00e21a

Ilia Tambovtsev commited on

feat: add scorers which are not weighted
d8b3813

Ilia Tambovtsev commited on

feat: add Scorers: exp, step, linear
0693054

Ilia Tambovtsev commited on

fix: import chatopenai properly?
39758ef

Ilia Tambovtsev commited on

refactor: return only text from presentation format.
bc2b128

Ilia Tambovtsev commited on

feat: implement scoring model. Add notebook with testing
07b053e

Ilia Tambovtsev commited on

feat: start working on scores
c459d77

Ilia Tambovtsev commited on