Commit History

  1. add CoAct traj and fix viz page

    c9f7744

  1. add collapsable

    f5de982
  2. update instruction

    1d7a98e
  3. remove all the with hint result

    d786aec
  4. cleanup metrics and fix repo

    84f76a1
  5. cleanup metrics and fix repo

    66b7775
  6. add llama-3.1 result

    fb96108
  7. rename file

    e3056b0
  8. rename OpenDevin to OpenHands

    adf5af2

  1. bump streamlit ver

    85a962a
  2. fix typo

    91ef200
  3. update app file

    bbf74e2
  4. fix visualizer with latest streamlit feature

    248fd06
  5. add 2nd run

    --global
    455affb

  1. add gpt-4o-mini result

    Xingyao Wang
    3d1d4f1

  1. Revert "add result from gpt-4o-mini"⁠

    Xingyao Wang
    12597ea
  2. add result from gpt-4o-mini

    Xingyao Wang
    3d406f5

  1. update the last missing instance

    Xingyao Wang
    1aaf82f
  2. update result from pr2489

    Xingyao Wang
    fc34a41

  1. remove keys

    Xingyao Wang
    77dbd55
  2. revoke keys

    Xingyao Wang
    a34dfe3
  3. add gpqa result

    Xingyao Wang
    804693c

  1. update v1.8 perf

    Xingyao Wang
    ec5bc65

  1. add result for v1.8 no-hint gpt4o

    Xingyao Wang
    bd3dee6

  1. fix model_name in updated metadat

    Xingyao Wang
    df68ce0
  2. add v1.8 result

    Xingyao Wang
    bb84cd4

  1. update results using new ver of swebench

    Xingyao Wang
    091b42e

  1. set n error/stuck/cost to 0 for CodeAct exp run below v1.5

    Xingyao Wang
    d2b6426
  2. by default not showing with hint result

    Xingyao Wang
    ba8f82b
  3. add claude-3.5 result

    Xingyao Wang
    1aa3b7d

  1. support loading report with new format

    Xingyao Wang
    e2ddd17
  2. update gitignore

    Xingyao Wang
    98bdf36
  3. update old result w/ swe-bench latest harness;⁠

    Xingyao Wang
    68dee1f

  1. improved patch apply

    Xingyao Wang
    9071da3
  2. improved patch apply

    Xingyao Wang
    a4e8ae8

  1. add report field

    Xingyao Wang
    5abf617

  1. Add CodeAct 1.6 no hint

    Verified signature
    f47ed15
  2. fix visualizer

    Xingyao Wang
    913979f

  1. feat: add gpqa results (#8)⁠

    Verified signature
    833a91e

  1. fix visualizer to only display eval_report when it exists

    Xingyao Wang
    a4c5e33

  1. add result for codeact 1.6

    Xingyao Wang
    03f74db
  2. only show swe bench on visualizer

    Xingyao Wang
    705a1e5
  3. change test_result to bool

    Xingyao Wang
    1ae8615
  4. fix fine-grained report; support visualization while running

    Xingyao Wang
    7eb2653
  5. add gpt-4-1106 results for codeact swe

    Xingyao Wang
    bb237c5
  6. Merge commit 'edc3858a6ea5d0c7317b630024203af60e146b52'

    Xingyao Wang
    f55ef7f
  7. update all swebench lite

    Xingyao Wang
    78d8859
  8. Update outputs/miniwob/README.md

    Verified signature
    edc3858
  9. Update outputs/webarena/README.md

    Verified signature
    c89a626
  10. Create README.md

    Verified signature
    cfa8976