End of training

README.md

@@ -1,4 +1,5 @@
 ---
+library_name: transformers
 tags:
 - generated_from_trainer
 model-index:
@@ -9,18 +10,17 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/priyanshipal/huggingface/runs/upry9j53)
 # eval_cache_hindi_only
 
 This model was trained from scratch on an unknown dataset.
 It achieves the following results on the evaluation set:
 - eval_loss: 2.2188
-- eval_model_preparation_time: 0.0045
+- eval_model_preparation_time: 0.0044
 - eval_cer: 0.4569
 - eval_wer: 0.5264
-- eval_runtime: 31.2077
-- eval_samples_per_second: 18.329
-- eval_steps_per_second: 1.154
+- eval_runtime: 39.8784
+- eval_samples_per_second: 14.344
+- eval_steps_per_second: 0.903
 - step: 0
 
 ## Model description
@@ -54,7 +54,7 @@ The following hyperparameters were used during training:
 
 ### Framework versions
 
-- Transformers 4.43.1
+- Transformers 4.45.2
 - Pytorch 2.4.0
 - Datasets 2.20.0
-- Tokenizers 0.19.1
+- Tokenizers 0.20.1

all_results.json

@@ -1,10 +1,10 @@
 {
     "eval_cer": 0.45689757252812313,
     "eval_loss": 2.218759059906006,
-    "eval_model_preparation_time": 0.0045,
-    "eval_runtime": 31.2077,
+    "eval_model_preparation_time": 0.0044,
+    "eval_runtime": 39.8784,
     "eval_samples": 572,
-    "eval_samples_per_second": 18.329,
-    "eval_steps_per_second": 1.154,
+    "eval_samples_per_second": 14.344,
+    "eval_steps_per_second": 0.903,
     "eval_wer": 0.5264004680415387
 }

config.json

@@ -102,7 +102,7 @@
     1
   ],
   "torch_dtype": "float32",
-  "transformers_version": "4.43.1",
+  "transformers_version": "4.45.2",
   "use_weighted_layer_sum": false,
   "vocab_size": 151,
   "xvector_output_dim": 512

eval_results.json

@@ -1,10 +1,10 @@
 {
     "eval_cer": 0.45689757252812313,
     "eval_loss": 2.218759059906006,
-    "eval_model_preparation_time": 0.0045,
-    "eval_runtime": 31.2077,
+    "eval_model_preparation_time": 0.0044,
+    "eval_runtime": 39.8784,
     "eval_samples": 572,
-    "eval_samples_per_second": 18.329,
-    "eval_steps_per_second": 1.154,
+    "eval_samples_per_second": 14.344,
+    "eval_steps_per_second": 0.903,
     "eval_wer": 0.5264004680415387
 }

evalonlyhindi_indicwav2vec_MUCS_warmup500_s300shuff100_2144517.out

@@ -307,3 +307,45 @@ last prediction string लता द्वारा अनुवादित ह
 
 
 
+wandb: - 0.005 MB of 0.005 MB uploaded
+wandb: Run history:
+wandb:                    eval/cer ▁
+wandb:                   eval/loss ▁
+wandb: eval/model_preparation_time ▁
+wandb:                eval/runtime ▁
+wandb:     eval/samples_per_second ▁
+wandb:       eval/steps_per_second ▁
+wandb:                    eval/wer ▁
+wandb:                    eval_cer ▁
+wandb:                   eval_loss ▁
+wandb: eval_model_preparation_time ▁
+wandb:                eval_runtime ▁
+wandb:                eval_samples ▁
+wandb:     eval_samples_per_second ▁
+wandb:       eval_steps_per_second ▁
+wandb:                    eval_wer ▁
+wandb:           train/global_step ▁▁
+wandb: 
+wandb: Run summary:
+wandb:                    eval/cer 0.4569
+wandb:                   eval/loss 2.21876
+wandb: eval/model_preparation_time 0.0045
+wandb:                eval/runtime 31.2077
+wandb:     eval/samples_per_second 18.329
+wandb:       eval/steps_per_second 1.154
+wandb:                    eval/wer 0.5264
+wandb:                    eval_cer 0.4569
+wandb:                   eval_loss 2.21876
+wandb: eval_model_preparation_time 0.0045
+wandb:                eval_runtime 31.2077
+wandb:                eval_samples 572
+wandb:     eval_samples_per_second 18.329
+wandb:       eval_steps_per_second 1.154
+wandb:                    eval_wer 0.5264
+wandb:           train/global_step 0
+wandb: 
+wandb: 🚀 View run eval_pd20000_w500_s300_shuff100_hinglish at: https://wandb.ai/priyanshipal/huggingface/runs/upry9j53
+wandb: ⭐️ View project at: https://wandb.ai/priyanshipal/huggingface
+wandb: Synced 6 W&B file(s), 0 media file(s), 0 artifact file(s) and 0 other file(s)
+wandb: Find logs at: ./wandb/run-20240822_174142-upry9j53/logs
+wandb: WARNING The new W&B backend becomes opt-out in version 0.18.0; try it out with `wandb.require("core")`! See https://wandb.me/wandb-core for more information.

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7d8d438794391e3bf26a9530b1ace42edaca09a85e6347831ad44994aa46da18
-size 5432
+oid sha256:d2cbc4a2b03e9738021be3965f5083d23904411fa2d3c32ac712544fd2ddf0d6
+size 5496

transliteratedevalonlyhindi_indicwav2vec_MUCS_warmup500_s300shuff100_3707642.out

@@ -0,0 +1,3 @@
+  File "/scratch/elec/puhe/p/palp3/MUCS/eval_script_indicwav2vec.py", line 695
+    '''
+IndentationError: unexpected indent

transliteratedevalonlyhindi_indicwav2vec_MUCS_warmup500_s300shuff100_3707729.out

@@ -0,0 +1,20 @@
+/scratch/work/palp3/myenv/lib/python3.11/site-packages/transformers/utils/generic.py:311: FutureWarning: `torch.utils._pytree._register_pytree_node` is deprecated. Please use `torch.utils._pytree.register_pytree_node` instead.
+  torch.utils._pytree._register_pytree_node(
+Traceback (most recent call last):
+  File "/scratch/elec/puhe/p/palp3/MUCS/eval_script_indicwav2vec.py", line 40, in <module>
+    import datasets
+  File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/__init__.py", line 17, in <module>
+    from .arrow_dataset import Dataset
+  File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/arrow_dataset.py", line 76, in <module>
+    from .arrow_reader import ArrowReader
+  File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/arrow_reader.py", line 32, in <module>
+    from .download.download_config import DownloadConfig
+  File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/download/__init__.py", line 9, in <module>
+    from .download_manager import DownloadManager, DownloadMode
+  File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/download/download_manager.py", line 33, in <module>
+    from ..utils import tqdm as hf_tqdm
+  File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/utils/__init__.py", line 17, in <module>
+    from .info_utils import VerificationMode
+  File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/utils/info_utils.py", line 5, in <module>
+    from huggingface_hub.utils import insecure_hashlib
+ImportError: cannot import name 'insecure_hashlib' from 'huggingface_hub.utils' (/scratch/work/palp3/myenv/lib/python3.11/site-packages/huggingface_hub/utils/__init__.py)

transliteratedevalonlyhindi_indicwav2vec_MUCS_warmup500_s300shuff100_3708006.out

@@ -0,0 +1,100 @@
+wandb: Currently logged in as: priyanshi-pal (priyanshipal). Use `wandb login --relogin` to force relogin
+wandb: wandb version 0.18.3 is available!  To upgrade, please run:
+wandb:  $ pip install wandb --upgrade
+wandb: Tracking run with wandb version 0.17.6
+wandb: Run data is saved locally in /scratch/elec/t405-puhe/p/palp3/MUCS/wandb/run-20241014_231835-vogh0pi1
+wandb: Run `wandb offline` to turn off syncing.
+wandb: Syncing run transliterated_wer_glamorous_tree_37
+wandb: ⭐️ View project at https://wandb.ai/priyanshipal/huggingface
+wandb: 🚀 View run at https://wandb.ai/priyanshipal/huggingface/runs/vogh0pi1
+/scratch/work/palp3/myenv/lib/python3.11/site-packages/transformers/training_args.py:1545: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead
+  warnings.warn(
+/scratch/work/palp3/myenv/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py:991: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
+  warnings.warn(
+/scratch/work/palp3/myenv/lib/python3.11/site-packages/transformers/models/auto/feature_extraction_auto.py:331: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
+  warnings.warn(
+Wav2Vec2CTCTokenizer(name_or_path='', vocab_size=149, model_max_length=1000000000000000019884624838656, is_fast=False, padding_side='right', truncation_side='right', special_tokens={'bos_token': '<s>', 'eos_token': '</s>', 'unk_token': '[UNK]', 'pad_token': '[PAD]'}, clean_up_tokenization_spaces=False),  added_tokens_decoder={
+	147: AddedToken("[UNK]", rstrip=True, lstrip=True, single_word=False, normalized=False, special=False),
+	148: AddedToken("[PAD]", rstrip=True, lstrip=True, single_word=False, normalized=False, special=False),
+	149: AddedToken("<s>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
+	150: AddedToken("</s>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
+}
+CHECK MODEL PARAMS Wav2Vec2ForCTC(
+  (wav2vec2): Wav2Vec2Model(
+    (feature_extractor): Wav2Vec2FeatureEncoder(
+      (conv_layers): ModuleList(
+        (0): Wav2Vec2LayerNormConvLayer(
+          (conv): Conv1d(1, 512, kernel_size=(10,), stride=(5,))
+          (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
+          (activation): GELUActivation()
+        )
+        (1-4): 4 x Wav2Vec2LayerNormConvLayer(
+          (conv): Conv1d(512, 512, kernel_size=(3,), stride=(2,))
+          (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
+          (activation): GELUActivation()
+        )
+        (5-6): 2 x Wav2Vec2LayerNormConvLayer(
+          (conv): Conv1d(512, 512, kernel_size=(2,), stride=(2,))
+          (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
+          (activation): GELUActivation()
+        )
+      )
+    )
+    (feature_projection): Wav2Vec2FeatureProjection(
+      (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
+      (projection): Linear(in_features=512, out_features=1024, bias=True)
+      (dropout): Dropout(p=0.3, inplace=False)
+    )
+    (encoder): Wav2Vec2EncoderStableLayerNorm(
+      (pos_conv_embed): Wav2Vec2PositionalConvEmbedding(
+        (conv): ParametrizedConv1d(
+          1024, 1024, kernel_size=(128,), stride=(1,), padding=(64,), groups=16
+          (parametrizations): ModuleDict(
+            (weight): ParametrizationList(
+              (0): _WeightNorm()
+            )
+          )
+        )
+        (padding): Wav2Vec2SamePadLayer()
+        (activation): GELUActivation()
+      )
+      (layer_norm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)
+      (dropout): Dropout(p=0.2, inplace=False)
+      (layers): ModuleList(
+        (0-23): 24 x Wav2Vec2EncoderLayerStableLayerNorm(
+          (attention): Wav2Vec2SdpaAttention(
+            (k_proj): Linear(in_features=1024, out_features=1024, bias=True)
+            (v_proj): Linear(in_features=1024, out_features=1024, bias=True)
+            (q_proj): Linear(in_features=1024, out_features=1024, bias=True)
+            (out_proj): Linear(in_features=1024, out_features=1024, bias=True)
+          )
+          (dropout): Dropout(p=0.2, inplace=False)
+          (layer_norm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)
+          (feed_forward): Wav2Vec2FeedForward(
+            (intermediate_dropout): Dropout(p=0.0, inplace=False)
+            (intermediate_dense): Linear(in_features=1024, out_features=4096, bias=True)
+            (intermediate_act_fn): GELUActivation()
+            (output_dense): Linear(in_features=4096, out_features=1024, bias=True)
+            (output_dropout): Dropout(p=0.2, inplace=False)
+          )
+          (final_layer_norm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)
+        )
+      )
+    )
+  )
+  (dropout): Dropout(p=0.0, inplace=False)
+  (lm_head): Linear(in_features=1024, out_features=151, bias=True)
+)
+check the eval set length 572
+Traceback (most recent call last):
+  File "/scratch/elec/puhe/p/palp3/MUCS/eval_script_indicwav2vec.py", line 826, in <module>
+    main()
+  File "/scratch/elec/puhe/p/palp3/MUCS/eval_script_indicwav2vec.py", line 691, in main
+    return metrics
+           ^^^^^^^
+UnboundLocalError: cannot access local variable 'metrics' where it is not associated with a value
+wandb: - 0.011 MB of 0.011 MB uploaded
+wandb: ⭐️ View project at: https://wandb.ai/priyanshipal/huggingface
+wandb: Synced 6 W&B file(s), 0 media file(s), 0 artifact file(s) and 0 other file(s)
+wandb: Find logs at: ./wandb/run-20241014_231835-vogh0pi1/logs
+wandb: WARNING The new W&B backend becomes opt-out in version 0.18.0; try it out with `wandb.require("core")`! See https://wandb.me/wandb-core for more information.

transliteratedevalonlyhindi_indicwav2vec_MUCS_warmup500_s300shuff100_3708271.out

@@ -0,0 +1,147 @@
+wandb: Currently logged in as: priyanshi-pal (priyanshipal). Use `wandb login --relogin` to force relogin
+wandb: wandb version 0.18.3 is available!  To upgrade, please run:
+wandb:  $ pip install wandb --upgrade
+wandb: Tracking run with wandb version 0.17.6
+wandb: Run data is saved locally in /scratch/elec/t405-puhe/p/palp3/MUCS/wandb/run-20241014_232133-214gwh3b
+wandb: Run `wandb offline` to turn off syncing.
+wandb: Syncing run transliterated_wer_glamorous_tree_37
+wandb: ⭐️ View project at https://wandb.ai/priyanshipal/huggingface
+wandb: 🚀 View run at https://wandb.ai/priyanshipal/huggingface/runs/214gwh3b
+/scratch/work/palp3/myenv/lib/python3.11/site-packages/transformers/training_args.py:1545: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead
+  warnings.warn(
+/scratch/work/palp3/myenv/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py:991: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
+  warnings.warn(
+/scratch/work/palp3/myenv/lib/python3.11/site-packages/transformers/models/auto/feature_extraction_auto.py:331: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
+  warnings.warn(
+/scratch/work/palp3/myenv/lib/python3.11/site-packages/accelerate/accelerator.py:488: FutureWarning: `torch.cuda.amp.GradScaler(args...)` is deprecated. Please use `torch.amp.GradScaler('cuda', args...)` instead.
+  self.scaler = torch.cuda.amp.GradScaler(**kwargs)
+max_steps is given, it will override any value given in num_train_epochs
+Wav2Vec2CTCTokenizer(name_or_path='', vocab_size=149, model_max_length=1000000000000000019884624838656, is_fast=False, padding_side='right', truncation_side='right', special_tokens={'bos_token': '<s>', 'eos_token': '</s>', 'unk_token': '[UNK]', 'pad_token': '[PAD]'}, clean_up_tokenization_spaces=False),  added_tokens_decoder={
+	147: AddedToken("[UNK]", rstrip=True, lstrip=True, single_word=False, normalized=False, special=False),
+	148: AddedToken("[PAD]", rstrip=True, lstrip=True, single_word=False, normalized=False, special=False),
+	149: AddedToken("<s>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
+	150: AddedToken("</s>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
+}
+CHECK MODEL PARAMS Wav2Vec2ForCTC(
+  (wav2vec2): Wav2Vec2Model(
+    (feature_extractor): Wav2Vec2FeatureEncoder(
+      (conv_layers): ModuleList(
+        (0): Wav2Vec2LayerNormConvLayer(
+          (conv): Conv1d(1, 512, kernel_size=(10,), stride=(5,))
+          (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
+          (activation): GELUActivation()
+        )
+        (1-4): 4 x Wav2Vec2LayerNormConvLayer(
+          (conv): Conv1d(512, 512, kernel_size=(3,), stride=(2,))
+          (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
+          (activation): GELUActivation()
+        )
+        (5-6): 2 x Wav2Vec2LayerNormConvLayer(
+          (conv): Conv1d(512, 512, kernel_size=(2,), stride=(2,))
+          (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
+          (activation): GELUActivation()
+        )
+      )
+    )
+    (feature_projection): Wav2Vec2FeatureProjection(
+      (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
+      (projection): Linear(in_features=512, out_features=1024, bias=True)
+      (dropout): Dropout(p=0.3, inplace=False)
+    )
+    (encoder): Wav2Vec2EncoderStableLayerNorm(
+      (pos_conv_embed): Wav2Vec2PositionalConvEmbedding(
+        (conv): ParametrizedConv1d(
+          1024, 1024, kernel_size=(128,), stride=(1,), padding=(64,), groups=16
+          (parametrizations): ModuleDict(
+            (weight): ParametrizationList(
+              (0): _WeightNorm()
+            )
+          )
+        )
+        (padding): Wav2Vec2SamePadLayer()
+        (activation): GELUActivation()
+      )
+      (layer_norm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)
+      (dropout): Dropout(p=0.2, inplace=False)
+      (layers): ModuleList(
+        (0-23): 24 x Wav2Vec2EncoderLayerStableLayerNorm(
+          (attention): Wav2Vec2SdpaAttention(
+            (k_proj): Linear(in_features=1024, out_features=1024, bias=True)
+            (v_proj): Linear(in_features=1024, out_features=1024, bias=True)
+            (q_proj): Linear(in_features=1024, out_features=1024, bias=True)
+            (out_proj): Linear(in_features=1024, out_features=1024, bias=True)
+          )
+          (dropout): Dropout(p=0.2, inplace=False)
+          (layer_norm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)
+          (feed_forward): Wav2Vec2FeedForward(
+            (intermediate_dropout): Dropout(p=0.0, inplace=False)
+            (intermediate_dense): Linear(in_features=1024, out_features=4096, bias=True)
+            (intermediate_act_fn): GELUActivation()
+            (output_dense): Linear(in_features=4096, out_features=1024, bias=True)
+            (output_dropout): Dropout(p=0.2, inplace=False)
+          )
+          (final_layer_norm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)
+        )
+      )
+    )
+  )
+  (dropout): Dropout(p=0.0, inplace=False)
+  (lm_head): Linear(in_features=1024, out_features=151, bias=True)
+)
+check the eval set length 572
+10/14/2024 23:21:46 - INFO - __main__ - *** Evaluate ***
+/scratch/work/palp3/myenv/lib/python3.11/site-packages/transformers/models/wav2vec2/processing_wav2vec2.py:157: UserWarning: `as_target_processor` is deprecated and will be removed in v5 of Transformers. You can process your labels by using the argument `text` of the regular `__call__` method (either in the same call as your audio inputs, or in a separate call.
+  warnings.warn(
+
  0%|          | 0/36 [00:00<?, ?it/s]
  6%|▌         | 2/36 [00:01<00:26,  1.30it/s]
  8%|▊         | 3/36 [00:02<00:33,  1.00s/it]
 11%|█         | 4/36 [00:04<00:41,  1.29s/it]
 14%|█▍        | 5/36 [00:06<00:42,  1.38s/it]
 17%|█▋        | 6/36 [00:07<00:41,  1.38s/it]
 19%|█▉        | 7/36 [00:08<00:35,  1.22s/it]
 22%|██▏       | 8/36 [00:08<00:27,  1.03it/s]
 25%|██▌       | 9/36 [00:09<00:22,  1.19it/s]
 28%|██▊       | 10/36 [00:10<00:20,  1.24it/s]
 31%|███       | 11/36 [00:11<00:20,  1.22it/s]
 33%|███▎      | 12/36 [00:11<00:19,  1.22it/s]
 36%|███▌      | 13/36 [00:12<00:17,  1.28it/s]
 39%|███▉      | 14/36 [00:12<00:14,  1.48it/s]
 42%|████▏     | 15/36 [00:13<00:12,  1.67it/s]
 44%|████▍     | 16/36 [00:13<00:10,  1.83it/s]
 47%|████▋     | 17/36 [00:14<00:09,  1.92it/s]
 50%|█████     | 18/36 [00:14<00:09,  1.86it/s]
 53%|█████▎    | 19/36 [00:15<00:09,  1.77it/s]
 56%|█████▌    | 20/36 [00:15<00:08,  1.83it/s]
 58%|█████▊    | 21/36 [00:16<00:07,  1.97it/s]
 61%|██████    | 22/36 [00:16<00:07,  1.97it/s]
 64%|██████▍   | 23/36 [00:17<00:06,  1.93it/s]
 67%|██████▋   | 24/36 [00:17<00:06,  1.92it/s]
 69%|██████▉   | 25/36 [00:18<00:05,  1.84it/s]
 72%|███████▏  | 26/36 [00:19<00:05,  1.86it/s]
 75%|███████▌  | 27/36 [00:19<00:04,  1.95it/s]
 78%|███████▊  | 28/36 [00:20<00:04,  1.62it/s]
 81%|████████  | 29/36 [00:22<00:06,  1.08it/s]
 83%|████████▎ | 30/36 [00:23<00:06,  1.07s/it]
 86%|████████▌ | 31/36 [00:25<00:06,  1.34s/it]
 89%|████████▉ | 32/36 [00:26<00:04,  1.12s/it]
 92%|█████████▏| 33/36 [00:26<00:02,  1.04it/s]
 94%|█████████▍| 34/36 [00:27<00:01,  1.21it/s]
 97%|█████████▋| 35/36 [00:27<00:00,  1.36it/s]
+/scratch/work/palp3/myenv/lib/python3.11/site-packages/huggingface_hub/hf_api.py:3889: UserWarning: It seems that you are about to commit a data file (json/default-b60d5edd0f197c71/0.0.0/7483f22a71512872c377524b97484f6d20c275799bb9e7cd8fb3198178d8220a/json-train.arrow) to a model repository. You are sure this is intended? If you are trying to upload a dataset, please set `repo_type='dataset'` or `--repo-type=dataset` in a CLI.
+  warnings.warn(
+Printing predictions for a few samples:
+Sample 1:
+  Reference (English): हम उनका उपयोग ऐसे ही कर सकते हैं या आवश्यकता अनुसार कुछ बदलाव करके उपयोग कर सकते हैं
+######
+  Prediction (English): हम उनका उपयोग ऐसे ही कर सकते हैं
+
+
+
+Sample 2:
+  Reference (English): अतः शीर्षक इस तरह से जोड़ सकते हैं
+######
+  Prediction (English): अतः शीर्ष है
+
+
+
+Sample 3:
+  Reference (English): प्रेसेंटेशन के अंत में आपने स्लाइड की एक कॉपी बना ली है
+######
+  Prediction (English): presentation के अंत में आपने स ैंैं
+
+
+
+Sample 4:
+  Reference (English): चलिए अब फोंट्स और फोंट्स को फॉर्मेट करने के कुछ तरीके देखते हैं
+######
+  Prediction (English): चलिए अब fonts और fonts को format करने के कुछ तरीके देेहं
+
+
+
+Sample 5:
+  Reference (English): यह एक डायलॉग बॉक्स खोलेगा जिसमें हम अपनी आवश्यकतानुसार फॉन्ट स्टाइल और साइज़ सेट कर सकते हैं
+######
+  Prediction (English): यह एक dialog box खोलेगा जिसमें हम अपनी आवश्यकत हैहै
+
+
+
+Last Reference string यह स्क्रिप्ट लता द्वारा अनुवादित है आईआईटी मुंबई की ओर से मैं रवि कुमार अब आपसे विदा लेता हूँहमसे जुड़ने के लिए धन्यवाद
+
+
+Last Prediction string लता द्वारा अनुवादित है आई आई टी मुmबई की ओर से मैं रवि कुमार अब आपसे विदा लेता हूँ हमसे जुड़ने के लिए धन्यवाद
+***** eval metrics *****
+  eval_cer                    =     0.4569
+  eval_loss                   =     2.2188
+  eval_model_preparation_time =     0.0044
+  eval_runtime                = 0:00:39.87
+  eval_samples                =        572
+  eval_samples_per_second     =     14.344
+  eval_steps_per_second       =      0.903
+  eval_wer                    =     0.5264
+