nanochat / scripts /chat_eval.py

Commit History

  1. delete spurious 'cute' bloat that doesn't matter to a serious research stack

    Andrej Karpathy
    950a1dc

  1. Merge branch 'master' into feat/small_fixes

    svlandeg
    07e2103
  2. delete the whole report thing i think it was a bad idea it just bloats the code. doing this subtracts 540 LOC

    Andrej Karpathy
    f10bd75

  1. add required -i to example chat_eval scripts

    svlandeg
    bc78a71

  1. print CORE score in chat_eval

    svlandeg
    c2082b3

  1. delete autocast, an unnecessary thorn in my side, manage dtypes directly

    Andrej Karpathy
    1076f97

  1. remove leftover mid references (#491)

    Sofie Van Landeghem
    Unverified signature
    72b9064

  1. nuke midtraining from orbit, it's not as needed now that we have a BOS-aligned dataloader. Also change the README a lot. midtrianing is not yet fully properly erased across the board, but good enough for step 1

    Andrej Karpathy
    1ddaad1

  1. Fix args in readme (#438)⁠

    Sofie Van Landeghem
    Unverified signature
    d4ea28d

  1. fix typos

    svlandeg
    a2fb3c8

  1. typo fixes in scripts

    svlandeg
    8c9b004

  1. add the SpellingBee task so that nanochat can count r in strawberry etc. along the way we had to add a bunch of new functionality, e.g. extend the calculator to support the count function of python. possibly the current TaskMixture uses way too many synthetic examples of SpellingBee because the eval gives us exactly 100% performance on spelling. We can tune this later to reclaim some wall clock time here I think

    Andrej Karpathy
    8892470

  1. upgrading all other files to be able to use cpu/mps as well as cuda. various minor other changes ,e.g. changing max_iterations to num_iterations in sft script for consistency in naming

    karpathy
    2e9669e

  1. initial commit

    karpathy
    3a5e0bc