nanochat / scripts /base_eval.py

Commit History

  1. nuke huggingface and its giant dependency footprint from orbit. datasets still todo

    Andrej Karpathy
    4186540

  1. delete the whole report thing i think it was a bad idea it just bloats the code. doing this subtracts 540 LOC

    Andrej Karpathy
    f10bd75

  1. delete autocast, an unnecessary thorn in my side, manage dtypes directly

    Andrej Karpathy
    1076f97

  1. small touchups to the eval script, re-order items etc, cosmetic

    Andrej Karpathy
    8ebc14b

  1. merge two files base_loss and base_eval into a single file, it's nicer this way, and unify the huggingface code associated with both

    Andrej Karpathy
    0307997

  1. bugfix

    ea42298
  2. bugfix keep same args style in scripts/base_eval.py

    7840049

  1. bugfix save and load ckpt from model_tag dir

    92c6654

  1. add explicit UTF-8 encoding

    svlandeg
    c72b8b2
  2. fix: open JSONL and results CSV with UTF-8 encoding for portability

    226953b

  1. move eval bundle download to be lazy and inside the python code so that we can substantially simplify the run bash scripts

    Andrej Karpathy
    cf587ac
  2. delete pandas dep in base_eval use csv instead

    Andrej Karpathy
    7d2c4a3

  1. typo fixes in scripts

    svlandeg
    8c9b004

  1. many small tweaks. base, eval, core work now i think

    karpathy
    df600b6
  2. add autodetect of device and related stuff. getting weird warnings/errors still, so wip

    karpathy
    786119d

  1. initial commit

    karpathy
    3a5e0bc