HeliumLM / checkpoints

Commit History

  1. Add: Vanilla model trained on the entire tinystories dataset. Delete: Previous vanilla models that were trained on 25%, 50% and 75% of the dataset.

    17304b3
  2. Add: Vanilla model trained on 75% of the dataset

    dba2ce3
  3. Add: Heliumlm vanilla trained on 50% of the dataset

    de77f2e

  1. Add: New Vanilla model trained on 25% of data with no ignore_index in loss function

    2f0ad37

  1. Add: Vanilla SwiGLU

    efe8343
  2. Delete: bad models

    d17726f

  1. Added gitignore and new primer model

    7810a73
  2. Removed bad models

    0e6109c

  1. Upload checkpoints/heliumlm-primer-iter-10000.pt with huggingface_hub

    Verified signature
    5ee2798
  2. Upload checkpoints/heliumlm-primer-iter-5000.pt with huggingface_hub

    Verified signature
    9fe88c8

  1. Upload checkpoints/heliumlm-final-phase2-model-iter-2000.pt with huggingface_hub

    Verified signature
    e7898d6
  2. Upload checkpoints/heliumlm-final-phase2-model-iter-2000.pt with huggingface_hub

    Verified signature
    81e7ba4
  3. Upload checkpoints/heliumlm-final-phase2-model-iter-2000.pt with huggingface_hub

    Verified signature
    fedfcfb
  4. Added first model of the final phase

    26e1200
  5. Upload checkpoints/heliumlm-final-phase-25percent-model-iter-2000.pt with huggingface_hub

    Verified signature
    2701b81
  6. Upload checkpoints/heliumlm-final-phase-25percent-model-iter-2000.pt with huggingface_hub

    Verified signature
    c607631

  1. Upload checkpoints/heliumlm-final-phase-25percent-model-iter-2000.pt with huggingface_hub

    Verified signature
    151482c
  2. Deleted irrelevant models and added grammatically correct model trained in phases on entire tinystories dataset (using quartely batch technique)

    9b2a30c
  3. Upload checkpoints/heliumlm-phases4-model-iter-2000.pt with huggingface_hub

    Verified signature
    2df87c0
  4. Upload checkpoints/heliumlm-phases3-model-iter-2000.pt with huggingface_hub

    Verified signature
    d886592
  5. Upload checkpoints/heliumlm-phases2-model-iter-2000.pt with huggingface_hub

    Verified signature
    1107eca
  6. Upload checkpoints/heliumlm-phases-model-iter-2000.pt with huggingface_hub

    Verified signature
    b261901
  7. Deleted phase models

    69549f3
  8. Upload checkpoints/heliumlm-phase4-75percent-model-iter-2000.pt with huggingface_hub

    Verified signature
    d8dccf1

  1. Upload checkpoints/heliumlm-phase2-50-75percent-model-iter-2000.pt with huggingface_hub

    Verified signature
    36792d2
  2. Upload checkpoints/heliumlm-phase2-25-50percent-model-iter-2000.pt with huggingface_hub

    Verified signature
    d8596f1
  3. Upload checkpoints/heliumlm-phase2-25-50percent-model-iter-2000.pt with huggingface_hub

    Verified signature
    7f5e883
  4. Upload checkpoints/heliumlm-phase1-25percent-model-iter-2000.pt with huggingface_hub

    Verified signature
    4f66e95

  1. Removed uneccessary models and renamed models for better understanding

    0640050
  2. Upload checkpoints/helium-distill-4-08-model-iter-14000.pt with huggingface_hub

    Verified signature
    4d13b81
  3. Upload checkpoints/helium-distill-4-08-model-iter-12000.pt with huggingface_hub

    Verified signature
    8fe5ab8
  4. Upload checkpoints/helium-distill-4-08-model-iter-10000.pt with huggingface_hub

    Verified signature
    d30efbe
  5. Upload checkpoints/helium-distill-4-08-model-iter-8000.pt with huggingface_hub

    Verified signature
    43bf400
  6. Upload checkpoints/helium-distill-4-08-model-iter-6000.pt with huggingface_hub

    Verified signature
    e0fe4f8
  7. Upload checkpoints/helium-distill-4-08-model-iter-4000.pt with huggingface_hub

    Verified signature
    b353e5e
  8. Upload checkpoints/helium-distill-4-08-model-iter-2000.pt with huggingface_hub

    Verified signature
    e9679f3

  1. Upload checkpoints/mini_model_iter_8000.pt with huggingface_hub

    Verified signature
    428f659
  2. Upload checkpoints/mini_model_iter_6000.pt with huggingface_hub

    Verified signature
    526fd26
  3. Upload checkpoints/mini_model_iter_4000.pt with huggingface_hub

    Verified signature
    820c93a
  4. Upload checkpoints/mini_model_iter_2000.pt with huggingface_hub

    Verified signature
    b447161
  5. Upload checkpoints/model_iter_4000.pt with huggingface_hub

    Verified signature
    aaa4a78
  6. Upload checkpoints/model_iter_2000.pt with huggingface_hub

    Verified signature
    9faedc2