Minor Code cleanup in utils file

Made change to cleaning code, modified number of warmpu step, getting eval samples from validation split

Updated code to work with streaming version

Merge branch 'main' of https://huggingface.co/amankhandelia/panini into main

initial commit

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

adding model weights pytorch

removing pytorch model (intentionally-testing)

mc4 epoch14 exported torch config & tokenizer

Adding torch model

Pytorch export fix

Merge branch 'main' of https://huggingface.co/flax-community/roberta-hindi into main

Fix PyTorch Model conversion

Update README.md

Update README.md

Added downstream tasks results

Update README.md

Convert mc4-epoch8 model to PyTorch

Convert latest model to PyTorch

Merge branch 'main' of https://huggingface.co/flax-community/roberta-hindi into main

initial commit

mc4 epoch14

mc4epoch8

mc4 with grouptext epoch 6

mc4 epoch8

mc4 epoch2

Converted latest model to torch model

Merge branch 'diff-tokenizer' into main

Model trained on OSCAR and kaggle dataset final epoch

Updated torch model and fixed typo in conversion script

Added latest model

Merge branch 'diff-tokenizer' of https://huggingface.co/flax-community/roberta-pretraining-hindi into diff-tokenizer

Updated tokenizer kagglemodels_and_oscar_hindi_only

Merge branch 'main' of https://huggingface.co/flax-community/roberta-pretraining-hindi into main

Add Flax to PyTorch model conversion script

tzz

Updated README

Created README.MD and updated default text

Add converted PyTorch model

Saving weights and logs of epoch 8

Saving weights and logs of epoch 7

Saving weights and logs of epoch 6

Saving weights and logs of epoch 5

Saving weights and logs of epoch 4

Saving weights and logs of epoch 3