Commit History

  1. feat: setup number of examples per page

    Ilia Tambovtsev
    c558638
  2. refactor: remove duplicate regex

    Ilia Tambovtsev
    9541a9b
  3. fix: remove too much examples

    Ilia Tambovtsev
    8eeefaa
  4. feat: implement load collection from dotenv in webapp

    Ilia Tambovtsev
    fdfe2ec
  5. fix: type in examples

    Ilia Tambovtsev
    99f57b8
  6. feat: add examples to gradio

    Ilia Tambovtsev
    feb545e
  7. feat: add setting up collection from .env

    087cf3c
  8. feat: add presentationidx metric

    Ilia Tambovtsev
    e887b28
  9. feat: add links to presentations and questions in webapp

    Ilia Tambovtsev
    b105b1d

  1. feat: configure params, add description

    Ilia Tambovtsev
    188b538
  2. ci: add missing import

    Ilia Tambovtsev
    ed34fc4
  3. ci: update default params

    Ilia Tambovtsev
    1a673ed

  1. feat: add option to copy collection contents to another collection

    Ilia Tambovtsev
    c1f9144
  2. fix: reimplement async things to be compatible with gradio

    Ilia Tambovtsev
    159a530

  1. feat: implement BestChunkMatch metric

    Ilia Tambovtsev
    d06b625
  2. fix: make async query storage call and use super()

    Ilia Tambovtsev
    683b3ae
  3. style: indent prompts

    Ilia Tambovtsev
    487514f

  1. feat: log n questions

    Ilia Tambovtsev
    a2dc318
  2. doc: update cli docs

    Ilia Tambovtsev
    afb9c30
  3. feat: add more corner cases to regex

    Ilia Tambovtsev
    7a0766b
  4. feat: configure logging all params, move preprocessing to be a feature of a storage

    Ilia Tambovtsev
    dfee524
  5. feat: fix async eval to be really async

    Ilia Tambovtsev
    24e252a
  6. feat: implement reffering to sheet by name

    Ilia Tambovtsev
    0c02234
  7. feat: configure cli and implement saving eval results to gsheets

    Ilia Tambovtsev
    364b978

  1. feat: configure benchmarking and add scorer pick to cli

    Ilia Tambovtsev
    3d1392a
  2. feat: implement testing preprocessing with gsheets

    Ilia Tambovtsev
    8c92162
  3. feat: add async support in evaluation. partially add uploading results to gsheets

    Ilia Tambovtsev
    16fd4fe
  4. feat: add evaluation cli

    Ilia Tambovtsev
    365d87f

  1. feat: implement prompt preprocessing with regex

    Ilia Tambovtsev
    c7e0ef5
  2. feat: implement retrieval with llm reranking

    Ilia Tambovtsev
    e37d064

  1. feat: add logging to evaluation

    Ilia Tambovtsev
    2cb5a84

  1. refactor: delete unused file

    Ilia Tambovtsev
    d4b4f3a

  1. feat: TODO configure rag

    Ilia Tambovtsev
    9a9e3f7

  1. refactor: add oop to make metrics consistent

    Ilia Tambovtsev
    45b6d99
  2. feat: setup mlflow evaluation

    Ilia Tambovtsev
    2c56f66

  1. feat: add async pipelines

    Ilia Tambovtsev
    c413127

  1. feat: add mlflow evaluation

    Ilia Tambovtsev
    9e00936

  1. feat: update eda

    Ilia Tambovtsev
    d570714

  1. fix: import ChatOpenAI without warnings

    Ilia Tambovtsev
    0802329
  2. feat: setup metrics. add llm relevance

    Ilia Tambovtsev
    934d3e0

  1. style: remove newlined params in functions

    Ilia Tambovtsev
    3705b3d
  2. refactor: parameterize formatting of output

    Ilia Tambovtsev
    8dae32e
  3. feat: implement model evaluation

    Ilia Tambovtsev
    1603571

  1. refactor: move ModelConfigs up

    Ilia Tambovtsev
    e00e21a

  1. feat: add scorers which are not weighted

    Ilia Tambovtsev
    d8b3813

  1. feat: add Scorers: exp, step, linear

    Ilia Tambovtsev
    0693054

  1. fix: import chatopenai properly?

    Ilia Tambovtsev
    39758ef

  1. refactor: return only text from presentation format.

    Ilia Tambovtsev
    bc2b128
  2. feat: implement scoring model. Add notebook with testing

    Ilia Tambovtsev
    07b053e

  1. feat: start working on scores

    Ilia Tambovtsev
    c459d77