Hugging Face's logo

ViuAI
/
ViuAI-500M

Text Generation
PyTorch
English
viuai
sarus
sarus-500m
slm
small-language-model
causal-lm
dpo
sft
edge-ai
conversational
Model card Files
xet
 Community
ViuAI-500M

Commit History

Yesterday

  1. Update Kaggle Dual T4 runner with DDP 4x32 batch sizing

    ViuAI
    Verified signature
    4d548d5

  2. Add DDP barrier after evaluate for Kaggle Dual T4 multi-GPU

    ViuAI
    Verified signature
    76cede9

  3. Restore exact overnight settings: 16x16 with USE_CHECKPOINT=1 and auto gcc compile detection

    ViuAI
    Verified signature
    34b89eb

  4. Restore exact overnight settings: 16x16 with USE_CHECKPOINT=True

    ViuAI
    Verified signature
    2311100

  5. Turbo Speed Config: USE_CHECKPOINT=0, MICRO_BATCH=8, GRAD_ACCUM=32

    ViuAI
    Verified signature
    1dfc027

  6. Speed optimization: ce_chunk=1024, disable checkpointing on 32GB GPUs

    ViuAI
    Verified signature
    6e2753e

  7. Speed optimization: ce_chunk=1024, disable checkpointing on 32GB GPUs

    ViuAI
    Verified signature
    15f3ac7

  8. Update RTX 5090 runner to copy fresh files into ./working/code/ as well

    ViuAI
    Verified signature
    18d519c

  9. Fix device not ready: optimize CE loss, disable z_loss, and stabilize prefetcher

    ViuAI
    Verified signature
    398ba06

  10. Fix device not ready: optimize CE loss, disable z_loss, and stabilize prefetcher

    ViuAI
    Verified signature
    02e9665

  11. Fix device not ready: optimize CE loss, disable z_loss, and stabilize prefetcher

    ViuAI
    Verified signature
    3907164

  12. Set USE_COMPILE=0 in RTX 5090 runner to bypass Triton gcc dependency

    ViuAI
    Verified signature
    3104bbb

  13. Add graceful fallback for torch.compile when gcc is missing

    ViuAI
    Verified signature
    7385121

  14. Update RTX 5090 Blackwell runner with 2-step setup instructions

    ViuAI
    Verified signature
    6fe4289

  15. Fix sm_120 compatibility & unwrap model on single GPU

    ViuAI
    Verified signature
    a726761

  16. Upload runners/RTX_5090_BLACKWELL_PRETRAIN.txt with huggingface_hub

    ViuAI
    Verified signature
    71e7e36

  17. Upload runners/NVIDIA_H200_TITAN_PRETRAIN.txt with huggingface_hub

    ViuAI
    Verified signature
    d90246b

  18. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    7b09781

  19. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    0232fd4

  20. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    64becdb

2 days ago

  1. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    7bfed8a

  2. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    aedcf58

  3. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    7bbcf24

  4. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    4318ba5

  5. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    03fd391

  6. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    c057106

  7. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    c11eab9

  8. Upload runners/RTX_5090_BLACKWELL_PRETRAIN.txt with huggingface_hub

    ViuAI
    Verified signature
    584ac9e

  9. Upload runners/RTX_5090_BLACKWELL_PRETRAIN.txt with huggingface_hub

    ViuAI
    Verified signature
    979c7ab

  10. Upload CLOUD_GPU_CREDENTIALS_AND_SSH.md with huggingface_hub

    ViuAI
    Verified signature
    3e2986a

  11. Upload runners/RTX_5090_BLACKWELL_PRETRAIN.txt with huggingface_hub

    ViuAI
    Verified signature
    74d9164

  12. Upload code/train.py with huggingface_hub

    ViuAI
    Verified signature
    2195e60

  13. Upload runners/RTX_5090_BLACKWELL_PRETRAIN.txt with huggingface_hub

    ViuAI
    Verified signature
    42de753

  14. Upload code/train.py with huggingface_hub

    ViuAI
    Verified signature
    63d5a10

  15. Upload runners/RTX_5090_BLACKWELL_PRETRAIN.txt with huggingface_hub

    ViuAI
    Verified signature
    e1746b9

  16. Upload code/train.py with huggingface_hub

    ViuAI
    Verified signature
    aa5a6f7

  17. Upload runners/NVIDIA_H200_TITAN_PRETRAIN.txt with huggingface_hub

    ViuAI
    Verified signature
    904a722

  18. Upload code/train.py with huggingface_hub

    ViuAI
    Verified signature
    5709201

  19. Upload runners/RTX_5090_BLACKWELL_PRETRAIN.txt with huggingface_hub

    ViuAI
    Verified signature
    5acc110

  20. Upload code/train.py with huggingface_hub

    ViuAI
    Verified signature
    5c733e9

  21. Upload runners/RTX_5090_BLACKWELL_PRETRAIN.txt with huggingface_hub

    ViuAI
    Verified signature
    04cad79

  22. Upload checkpoints/ckpt_latest.pt with huggingface_hub

    ViuAI
    Verified signature
    80dbee5

3 days ago

  1. Add dedicated RTX 4090 turbo training runner

    ViuAI
    Verified signature
    9a97e8b

  2. Update Rental GPU Jupyter Notebook runner with auto-detect VRAM

    ViuAI
    Verified signature
    1e37f13

  3. Add permanent Rental GPU Jupyter Notebook Playbook

    ViuAI
    Verified signature
    9191a59

  4. Add advanced XLA MXU hardware flags and vectorized prefetching for TPU v5e-8

    ViuAI
    Verified signature
    d77dcf9

  5. Add async CUDA prefetcher and vectorized batching for max GPU throughput

    ViuAI
    Verified signature
    10a0e76

  6. Add Kaggle TPU v5e-8 continuation training runner

    ViuAI
    Verified signature
    6e9b6ba

  7. Add TPU v5e-8 8-core distributed training script

    ViuAI
    Verified signature
    a520b81

  8. Enable true hardware FP16 Tensor Cores for Turing/T4 (compute_cap < 8)

    ViuAI
    Verified signature
    70446bd