2026-07-05 21:50:14 INFO: Logging to: train_outputs/sft/hyper_lora/20260705-215014_Uk1MOUhC/debug.log
2026-07-05 21:50:14 DEBUG: CMD: scripts/train_custom_sft.py configs/t4_llama3b_config.yaml --model_dir=Guilherme34/Firefly-V3 --emb_model=Alibaba-NLP/gte-large-en-v1.5 --warmup_frac=0.1 --lr=1e-4 --n_tasks_per_batch=2 --n_points_per_task=1 --grad_accum_steps=4 --epochs=2 --n_descs_per_ds=16 --n_train_ds=8 --exp_setup=hyper_lora --encoder_type=linear --l2_reg_generated_w=1e-3 --label_smoothing=0.1 --neftune_noise_alpha=5 --weight_decay=1e-2 --hypernet_latent_size=128 --head_in_size=256 --inp_max_len=256 --batch_size=6 --val_batch_size=8 --save_freq=100 --skip_eval=True --target_modules=q_proj,k_proj,v_proj,o_proj,gate_proj,up_proj,down_proj
2026-07-05 21:50:14 DEBUG: args: TrainingArguments(config=None, training_task='sft', model_dir='Guilherme34/Firefly-V3', emb_model='Alibaba-NLP/gte-large-en-v1.5', exp_setup='hyper_lora', sft_mode='causal_lm', equally_weight_sample=True, train_ds_names=['boolq', 'winogrande', 'piqa', 'hellaswag', 'arc_easy', 'arc_challenge', 'openbookqa', 'gsm8k'], n_train_ds=8, n_descs_per_ds=16, inp_max_len=256, target_modules=['q_proj', 'k_proj', 'v_proj', 'o_proj', 'gate_proj', 'up_proj', 'down_proj'], shared_AB_head=False, autoreg_gen=False, learnable_pos_emb=False, learnable_AB_offset=False, hypernet_latent_size=128, head_in_size=256, head_use_bias=False, use_per_task_emb=True, use_one_hot_task_emb=False, use_inp_as_desc=False, use_per_sample_desc=False, use_default_desc=False, n_points_per_task=1, use_hierarchical_sampler=False, also_val_on_train=False, lr=0.0001, l2_reg_generated_w=0.001, weight_decay=0.01, label_smoothing=0.1, grad_accum_steps=4, epochs=2, batch_size=6, val_batch_size=8, warmup_frac=0.1, neftune_noise_alpha=5.0, max_grad_norm=1.0, logging_freq=100, val_freq=10000, model_watch_freq=5000, save_freq=100, seed=42, debug=False, notes=None, keep_only_best=True, skip_eval=True, eval_ds_info={}, additional_eval_descs=[], save_to_base_model_dir=False, n_tasks_per_batch=2, mt_lora_path=None, encoder_type='linear', n_embs_per_sampled_task=None, pred_z_score=True, factorized=False, delta_w_scaling=10000)
2026-07-05 21:50:14 DEBUG: Is CUDA available: True
2026-07-05 21:50:14 DEBUG: CUDA device: Tesla T4
2026-07-05 21:50:14 DEBUG: peft_config:
LoraConfig(task_type='CAUSAL_LM', peft_type=<PeftType.LORA: 'LORA'>, auto_mapping=None, peft_version='0.19.1', base_model_name_or_path='Guilherme34/Firefly-V3', revision=None, inference_mode=False, r=8, target_modules={'v_proj', 'down_proj', 'up_proj', 'gate_proj', 'q_proj', 'o_proj', 'k_proj'}, exclude_modules=None, lora_alpha=16, lora_dropout=0.05, fan_in_fan_out=False, bias='none', use_rslora=True, modules_to_save=None, init_lora_weights=True, layers_to_transform=None, layers_pattern=None, rank_pattern={}, alpha_pattern={}, megatron_config=None, megatron_core='megatron.core', trainable_token_indices=None, loftq_config={}, eva_config=None, corda_config=None, lora_ga_config=None, use_dora=False, alora_invocation_tokens=None, use_qalora=False, qalora_group_size=16, layer_replication=None, runtime_config=LoraRuntimeConfig(ephemeral_gpu_offload=False), lora_bias=False, target_parameters=None, use_bdlora=None, arrow_config=None, ensure_weight_tying=False)
2026-07-05 21:50:15 DEBUG: Using selector: EpollSelector
2026-07-05 21:50:15 DEBUG: Popen(['git', 'version'], cwd=/content/text-to-lora, stdin=None, shell=False, universal_newlines=False)
2026-07-05 21:50:15 DEBUG: Popen(['git', 'version'], cwd=/content/text-to-lora, stdin=None, shell=False, universal_newlines=False)
2026-07-05 21:50:15 DEBUG: sys.platform='linux', git_executable='git'
2026-07-05 21:50:15 DEBUG: Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/content/text-to-lora, stdin=None, shell=False, universal_newlines=False)
2026-07-05 21:50:15 DEBUG: sys.platform='linux', git_executable='git'
2026-07-05 21:50:15 DEBUG: sys.platform='linux', git_executable='git'
2026-07-05 21:50:15 DEBUG: Popen(['git', 'cat-file', '--batch-check'], cwd=/content/text-to-lora, stdin=<valid stream>, shell=False, universal_newlines=False)
2026-07-05 21:50:16 DEBUG: [RANK 0] Initialized WandB project hypermod_sft
2026-07-05 21:50:16 DEBUG: [RANK 0] Make sure to log any initial configurations with `self.store_init_configuration` before training!
2026-07-05 21:50:16 DEBUG: [RANK 0] Stored initial configuration hyperparameters to WandB
2026-07-05 21:50:16 DEBUG: Model init kwargs: {'pretrained_model_name_or_path': 'Guilherme34/Firefly-V3', 'device_map': device(type='cuda'), 'torch_dtype': torch.bfloat16, 'trust_remote_code': True, 'output_hidden_states': True, 'output_attentions': False, 'attn_implementation': 'sdpa', 'use_cache': False}
2026-07-05 21:50:16 DEBUG: Starting new HTTPS connection (1): huggingface.co:443
2026-07-05 21:50:17 DEBUG: https://huggingface.co:443 "HEAD /Guilherme34/Firefly-V3/resolve/main/config.json HTTP/1.1" 307 0
2026-07-05 21:50:17 DEBUG: https://huggingface.co:443 "HEAD /api/resolve-cache/models/Guilherme34/Firefly-V3/b8a79e9e22bb888f872aef0f5c1475923f5edcf7/config.json HTTP/1.1" 200 0
2026-07-05 21:50:38 DEBUG: https://huggingface.co:443 "HEAD /Guilherme34/Firefly-V3/resolve/main/generation_config.json HTTP/1.1" 404 0
2026-07-05 21:50:38 DEBUG: Loading bitsandbytes native library from: /usr/local/lib/python3.12/dist-packages/bitsandbytes/libbitsandbytes_cuda121.so
2026-07-05 21:50:43 DEBUG: https://huggingface.co:443 "HEAD /Guilherme34/Firefly-V3/resolve/main/tokenizer_config.json HTTP/1.1" 307 0
2026-07-05 21:50:43 DEBUG: https://huggingface.co:443 "HEAD /api/resolve-cache/models/Guilherme34/Firefly-V3/b8a79e9e22bb888f872aef0f5c1475923f5edcf7/tokenizer_config.json HTTP/1.1" 200 0
2026-07-05 21:50:45 DEBUG: Model config: LlamaConfig {
  "_attn_implementation_autoset": true,
  "_name_or_path": "Guilherme34/Firefly-V3",
  "architectures": [
    "LlamaForCausalLM"
  ],
  "attention_bias": false,
  "attention_dropout": 0.0,
  "bos_token_id": 128000,
  "dtype": "bfloat16",
  "eos_token_id": 128009,
  "head_dim": 128,
  "hidden_act": "silu",
  "hidden_size": 3072,
  "initializer_range": 0.02,
  "intermediate_size": 8192,
  "max_position_embeddings": 131072,
  "mlp_bias": false,
  "model_type": "llama",
  "num_attention_heads": 24,
  "num_hidden_layers": 28,
  "num_key_value_heads": 8,
  "output_hidden_states": true,
  "pretraining_tp": 1,
  "rms_norm_eps": 1e-05,
  "rope_scaling": {
    "factor": 32.0,
    "high_freq_factor": 4.0,
    "low_freq_factor": 1.0,
    "original_max_position_embeddings": 8192,
    "rope_type": "llama3"
  },
  "rope_theta": 500000.0,
  "tie_word_embeddings": true,
  "torch_dtype": "bfloat16",
  "transformers_version": "4.46.2",
  "use_cache": false,
  "vocab_size": 128256
}

2026-07-05 21:50:45 DEBUG: Model: PeftModel(
  (base_model): LoraModel(
    (model): LlamaForCausalLM(
      (model): LlamaModel(
        (embed_tokens): Embedding(128256, 3072)
        (layers): ModuleList(
          (0-27): 28 x LlamaDecoderLayer(
            (self_attn): LlamaSdpaAttention(
              (q_proj): lora.Linear(
                (base_layer): Linear(in_features=3072, out_features=3072, bias=False)
                (lora_dropout): ModuleDict(
                  (default): Dropout(p=0.05, inplace=False)
                )
                (lora_A): ModuleDict(
                  (default): Linear(in_features=3072, out_features=8, bias=False)
                )
                (lora_B): ModuleDict(
                  (default): Linear(in_features=8, out_features=3072, bias=False)
                )
                (lora_embedding_A): ParameterDict()
                (lora_embedding_B): ParameterDict()
                (lora_magnitude_vector): ModuleDict()
              )
              (k_proj): lora.Linear(
                (base_layer): Linear(in_features=3072, out_features=1024, bias=False)
                (lora_dropout): ModuleDict(
                  (default): Dropout(p=0.05, inplace=False)
                )
                (lora_A): ModuleDict(
                  (default): Linear(in_features=3072, out_features=8, bias=False)
                )
                (lora_B): ModuleDict(
                  (default): Linear(in_features=8, out_features=1024, bias=False)
                )
                (lora_embedding_A): ParameterDict()
                (lora_embedding_B): ParameterDict()
                (lora_magnitude_vector): ModuleDict()
              )
              (v_proj): lora.Linear(
                (base_layer): Linear(in_features=3072, out_features=1024, bias=False)
                (lora_dropout): ModuleDict(
                  (default): Dropout(p=0.05, inplace=False)
                )
                (lora_A): ModuleDict(
                  (default): Linear(in_features=3072, out_features=8, bias=False)
                )
                (lora_B): ModuleDict(
                  (default): Linear(in_features=8, out_features=1024, bias=False)
                )
                (lora_embedding_A): ParameterDict()
                (lora_embedding_B): ParameterDict()
                (lora_magnitude_vector): ModuleDict()
              )
              (o_proj): lora.Linear(
                (base_layer): Linear(in_features=3072, out_features=3072, bias=False)
                (lora_dropout): ModuleDict(
                  (default): Dropout(p=0.05, inplace=False)
                )
                (lora_A): ModuleDict(
                  (default): Linear(in_features=3072, out_features=8, bias=False)
                )
                (lora_B): ModuleDict(
                  (default): Linear(in_features=8, out_features=3072, bias=False)
                )
                (lora_embedding_A): ParameterDict()
                (lora_embedding_B): ParameterDict()
                (lora_magnitude_vector): ModuleDict()
              )
              (rotary_emb): LlamaRotaryEmbedding()
            )
            (mlp): LlamaMLP(
              (gate_proj): lora.Linear(
                (base_layer): Linear(in_features=3072, out_features=8192, bias=False)
                (lora_dropout): ModuleDict(
                  (default): Dropout(p=0.05, inplace=False)
                )
                (lora_A): ModuleDict(
                  (default): Linear(in_features=3072, out_features=8, bias=False)
                )
                (lora_B): ModuleDict(
                  (default): Linear(in_features=8, out_features=8192, bias=False)
                )
                (lora_embedding_A): ParameterDict()
                (lora_embedding_B): ParameterDict()
                (lora_magnitude_vector): ModuleDict()
              )
              (up_proj): lora.Linear(
                (base_layer): Linear(in_features=3072, out_features=8192, bias=False)
                (lora_dropout): ModuleDict(
                  (default): Dropout(p=0.05, inplace=False)
                )
                (lora_A): ModuleDict(
                  (default): Linear(in_features=3072, out_features=8, bias=False)
                )
                (lora_B): ModuleDict(
                  (default): Linear(in_features=8, out_features=8192, bias=False)
                )
                (lora_embedding_A): ParameterDict()
                (lora_embedding_B): ParameterDict()
                (lora_magnitude_vector): ModuleDict()
              )
              (down_proj): lora.Linear(
                (base_layer): Linear(in_features=8192, out_features=3072, bias=False)
                (lora_dropout): ModuleDict(
                  (default): Dropout(p=0.05, inplace=False)
                )
                (lora_A): ModuleDict(
                  (default): Linear(in_features=8192, out_features=8, bias=False)
                )
                (lora_B): ModuleDict(
                  (default): Linear(in_features=8, out_features=3072, bias=False)
                )
                (lora_embedding_A): ParameterDict()
                (lora_embedding_B): ParameterDict()
                (lora_magnitude_vector): ModuleDict()
              )
              (act_fn): SiLU()
            )
            (input_layernorm): LlamaRMSNorm((3072,), eps=1e-05)
            (post_attention_layernorm): LlamaRMSNorm((3072,), eps=1e-05)
          )
        )
        (norm): LlamaRMSNorm((3072,), eps=1e-05)
        (rotary_emb): LlamaRotaryEmbedding()
      )
      (lm_head): Linear(in_features=3072, out_features=128256, bias=False)
    )
  )
)
2026-07-05 21:50:45 DEBUG: is_intx_model: True
2026-07-05 21:50:45 DEBUG: Tokenizer: PreTrainedTokenizerFast(name_or_path='Guilherme34/Firefly-V3', vocab_size=128000, model_max_length=131072, is_fast=True, padding_side='right', truncation_side='left', special_tokens={'bos_token': '<|begin_of_text|>', 'eos_token': '<|eot_id|>', 'pad_token': '<|end_of_text|>'}, clean_up_tokenization_spaces=True),  added_tokens_decoder={
	128000: AddedToken("<|begin_of_text|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128001: AddedToken("<|end_of_text|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128002: AddedToken("<|reserved_special_token_0|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128003: AddedToken("<|reserved_special_token_1|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128004: AddedToken("<|finetune_right_pad_id|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128005: AddedToken("<|reserved_special_token_2|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128006: AddedToken("<|start_header_id|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128007: AddedToken("<|end_header_id|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128008: AddedToken("<|eom_id|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128009: AddedToken("<|eot_id|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128010: AddedToken("<|python_tag|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128011: AddedToken("<|reserved_special_token_3|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128012: AddedToken("<|reserved_special_token_4|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128013: AddedToken("<|reserved_special_token_5|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128014: AddedToken("<|reserved_special_token_6|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128015: AddedToken("<|reserved_special_token_7|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128016: AddedToken("<|reserved_special_token_8|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128017: AddedToken("<|reserved_special_token_9|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128018: AddedToken("<|reserved_special_token_10|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128019: AddedToken("<|reserved_special_token_11|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128020: AddedToken("<|reserved_special_token_12|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128021: AddedToken("<|reserved_special_token_13|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128022: AddedToken("<|reserved_special_token_14|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128023: AddedToken("<|reserved_special_token_15|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128024: AddedToken("<|reserved_special_token_16|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128025: AddedToken("<|reserved_special_token_17|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128026: AddedToken("<|reserved_special_token_18|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128027: AddedToken("<|reserved_special_token_19|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128028: AddedToken("<|reserved_special_token_20|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128029: AddedToken("<|reserved_special_token_21|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128030: AddedToken("<|reserved_special_token_22|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128031: AddedToken("<|reserved_special_token_23|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128032: AddedToken("<|reserved_special_token_24|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128033: AddedToken("<|reserved_special_token_25|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128034: AddedToken("<|reserved_special_token_26|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128035: AddedToken("<|reserved_special_token_27|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128036: AddedToken("<|reserved_special_token_28|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128037: AddedToken("<|reserved_special_token_29|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128038: AddedToken("<|reserved_special_token_30|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128039: AddedToken("<|reserved_special_token_31|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128040: AddedToken("<|reserved_special_token_32|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128041: AddedToken("<|reserved_special_token_33|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128042: AddedToken("<|reserved_special_token_34|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128043: AddedToken("<|reserved_special_token_35|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128044: AddedToken("<|reserved_special_token_36|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128045: AddedToken("<|reserved_special_token_37|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128046: AddedToken("<|reserved_special_token_38|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128047: AddedToken("<|reserved_special_token_39|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128048: AddedToken("<|reserved_special_token_40|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128049: AddedToken("<|reserved_special_token_41|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128050: AddedToken("<|reserved_special_token_42|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128051: AddedToken("<|reserved_special_token_43|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128052: AddedToken("<|reserved_special_token_44|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128053: AddedToken("<|reserved_special_token_45|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128054: AddedToken("<|reserved_special_token_46|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128055: AddedToken("<|reserved_special_token_47|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128056: AddedToken("<|reserved_special_token_48|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128057: AddedToken("<|reserved_special_token_49|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128058: AddedToken("<|reserved_special_token_50|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128059: AddedToken("<|reserved_special_token_51|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128060: AddedToken("<|reserved_special_token_52|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128061: AddedToken("<|reserved_special_token_53|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128062: AddedToken("<|reserved_special_token_54|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128063: AddedToken("<|reserved_special_token_55|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128064: AddedToken("<|reserved_special_token_56|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128065: AddedToken("<|reserved_special_token_57|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128066: AddedToken("<|reserved_special_token_58|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128067: AddedToken("<|reserved_special_token_59|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128068: AddedToken("<|reserved_special_token_60|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128069: AddedToken("<|reserved_special_token_61|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128070: AddedToken("<|reserved_special_token_62|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128071: AddedToken("<|reserved_special_token_63|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128072: AddedToken("<|reserved_special_token_64|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128073: AddedToken("<|reserved_special_token_65|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128074: AddedToken("<|reserved_special_token_66|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128075: AddedToken("<|reserved_special_token_67|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128076: AddedToken("<|reserved_special_token_68|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128077: AddedToken("<|reserved_special_token_69|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128078: AddedToken("<|reserved_special_token_70|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128079: AddedToken("<|reserved_special_token_71|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128080: AddedToken("<|reserved_special_token_72|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128081: AddedToken("<|reserved_special_token_73|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128082: AddedToken("<|reserved_special_token_74|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128083: AddedToken("<|reserved_special_token_75|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128084: AddedToken("<|reserved_special_token_76|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128085: AddedToken("<|reserved_special_token_77|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128086: AddedToken("<|reserved_special_token_78|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128087: AddedToken("<|reserved_special_token_79|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128088: AddedToken("<|reserved_special_token_80|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128089: AddedToken("<|reserved_special_token_81|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128090: AddedToken("<|reserved_special_token_82|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128091: AddedToken("<|reserved_special_token_83|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128092: AddedToken("<|reserved_special_token_84|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128093: AddedToken("<|reserved_special_token_85|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128094: AddedToken("<|reserved_special_token_86|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128095: AddedToken("<|reserved_special_token_87|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128096: AddedToken("<|reserved_special_token_88|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128097: AddedToken("<|reserved_special_token_89|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128098: AddedToken("<|reserved_special_token_90|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128099: AddedToken("<|reserved_special_token_91|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128100: AddedToken("<|reserved_special_token_92|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128101: AddedToken("<|reserved_special_token_93|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128102: AddedToken("<|reserved_special_token_94|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128103: AddedToken("<|reserved_special_token_95|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128104: AddedToken("<|reserved_special_token_96|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128105: AddedToken("<|reserved_special_token_97|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128106: AddedToken("<|reserved_special_token_98|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128107: AddedToken("<|reserved_special_token_99|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128108: AddedToken("<|reserved_special_token_100|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128109: AddedToken("<|reserved_special_token_101|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128110: AddedToken("<|reserved_special_token_102|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128111: AddedToken("<|reserved_special_token_103|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128112: AddedToken("<|reserved_special_token_104|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128113: AddedToken("<|reserved_special_token_105|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128114: AddedToken("<|reserved_special_token_106|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128115: AddedToken("<|reserved_special_token_107|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128116: AddedToken("<|reserved_special_token_108|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128117: AddedToken("<|reserved_special_token_109|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128118: AddedToken("<|reserved_special_token_110|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128119: AddedToken("<|reserved_special_token_111|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128120: AddedToken("<|reserved_special_token_112|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128121: AddedToken("<|reserved_special_token_113|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128122: AddedToken("<|reserved_special_token_114|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128123: AddedToken("<|reserved_special_token_115|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128124: AddedToken("<|reserved_special_token_116|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128125: AddedToken("<|reserved_special_token_117|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128126: AddedToken("<|reserved_special_token_118|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128127: AddedToken("<|reserved_special_token_119|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128128: AddedToken("<|reserved_special_token_120|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128129: AddedToken("<|reserved_special_token_121|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128130: AddedToken("<|reserved_special_token_122|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128131: AddedToken("<|reserved_special_token_123|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128132: AddedToken("<|reserved_special_token_124|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128133: AddedToken("<|reserved_special_token_125|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128134: AddedToken("<|reserved_special_token_126|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128135: AddedToken("<|reserved_special_token_127|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128136: AddedToken("<|reserved_special_token_128|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128137: AddedToken("<|reserved_special_token_129|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128138: AddedToken("<|reserved_special_token_130|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128139: AddedToken("<|reserved_special_token_131|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128140: AddedToken("<|reserved_special_token_132|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128141: AddedToken("<|reserved_special_token_133|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128142: AddedToken("<|reserved_special_token_134|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128143: AddedToken("<|reserved_special_token_135|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128144: AddedToken("<|reserved_special_token_136|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128145: AddedToken("<|reserved_special_token_137|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128146: AddedToken("<|reserved_special_token_138|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128147: AddedToken("<|reserved_special_token_139|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128148: AddedToken("<|reserved_special_token_140|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128149: AddedToken("<|reserved_special_token_141|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128150: AddedToken("<|reserved_special_token_142|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128151: AddedToken("<|reserved_special_token_143|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128152: AddedToken("<|reserved_special_token_144|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128153: AddedToken("<|reserved_special_token_145|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128154: AddedToken("<|reserved_special_token_146|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128155: AddedToken("<|reserved_special_token_147|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128156: AddedToken("<|reserved_special_token_148|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128157: AddedToken("<|reserved_special_token_149|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128158: AddedToken("<|reserved_special_token_150|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128159: AddedToken("<|reserved_special_token_151|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128160: AddedToken("<|reserved_special_token_152|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128161: AddedToken("<|reserved_special_token_153|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128162: AddedToken("<|reserved_special_token_154|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128163: AddedToken("<|reserved_special_token_155|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128164: AddedToken("<|reserved_special_token_156|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128165: AddedToken("<|reserved_special_token_157|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128166: AddedToken("<|reserved_special_token_158|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128167: AddedToken("<|reserved_special_token_159|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128168: AddedToken("<|reserved_special_token_160|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128169: AddedToken("<|reserved_special_token_161|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128170: AddedToken("<|reserved_special_token_162|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128171: AddedToken("<|reserved_special_token_163|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128172: AddedToken("<|reserved_special_token_164|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128173: AddedToken("<|reserved_special_token_165|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128174: AddedToken("<|reserved_special_token_166|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128175: AddedToken("<|reserved_special_token_167|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128176: AddedToken("<|reserved_special_token_168|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128177: AddedToken("<|reserved_special_token_169|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128178: AddedToken("<|reserved_special_token_170|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128179: AddedToken("<|reserved_special_token_171|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128180: AddedToken("<|reserved_special_token_172|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128181: AddedToken("<|reserved_special_token_173|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128182: AddedToken("<|reserved_special_token_174|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128183: AddedToken("<|reserved_special_token_175|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128184: AddedToken("<|reserved_special_token_176|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128185: AddedToken("<|reserved_special_token_177|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128186: AddedToken("<|reserved_special_token_178|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128187: AddedToken("<|reserved_special_token_179|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128188: AddedToken("<|reserved_special_token_180|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128189: AddedToken("<|reserved_special_token_181|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128190: AddedToken("<|reserved_special_token_182|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128191: AddedToken("<|reserved_special_token_183|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128192: AddedToken("<|reserved_special_token_184|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128193: AddedToken("<|reserved_special_token_185|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128194: AddedToken("<|reserved_special_token_186|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128195: AddedToken("<|reserved_special_token_187|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128196: AddedToken("<|reserved_special_token_188|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128197: AddedToken("<|reserved_special_token_189|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128198: AddedToken("<|reserved_special_token_190|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128199: AddedToken("<|reserved_special_token_191|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128200: AddedToken("<|reserved_special_token_192|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128201: AddedToken("<|reserved_special_token_193|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128202: AddedToken("<|reserved_special_token_194|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128203: AddedToken("<|reserved_special_token_195|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128204: AddedToken("<|reserved_special_token_196|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128205: AddedToken("<|reserved_special_token_197|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128206: AddedToken("<|reserved_special_token_198|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128207: AddedToken("<|reserved_special_token_199|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128208: AddedToken("<|reserved_special_token_200|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128209: AddedToken("<|reserved_special_token_201|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128210: AddedToken("<|reserved_special_token_202|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128211: AddedToken("<|reserved_special_token_203|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128212: AddedToken("<|reserved_special_token_204|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128213: AddedToken("<|reserved_special_token_205|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128214: AddedToken("<|reserved_special_token_206|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128215: AddedToken("<|reserved_special_token_207|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128216: AddedToken("<|reserved_special_token_208|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128217: AddedToken("<|reserved_special_token_209|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128218: AddedToken("<|reserved_special_token_210|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128219: AddedToken("<|reserved_special_token_211|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128220: AddedToken("<|reserved_special_token_212|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128221: AddedToken("<|reserved_special_token_213|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128222: AddedToken("<|reserved_special_token_214|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128223: AddedToken("<|reserved_special_token_215|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128224: AddedToken("<|reserved_special_token_216|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128225: AddedToken("<|reserved_special_token_217|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128226: AddedToken("<|reserved_special_token_218|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128227: AddedToken("<|reserved_special_token_219|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128228: AddedToken("<|reserved_special_token_220|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128229: AddedToken("<|reserved_special_token_221|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128230: AddedToken("<|reserved_special_token_222|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128231: AddedToken("<|reserved_special_token_223|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128232: AddedToken("<|reserved_special_token_224|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128233: AddedToken("<|reserved_special_token_225|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128234: AddedToken("<|reserved_special_token_226|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128235: AddedToken("<|reserved_special_token_227|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128236: AddedToken("<|reserved_special_token_228|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128237: AddedToken("<|reserved_special_token_229|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128238: AddedToken("<|reserved_special_token_230|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128239: AddedToken("<|reserved_special_token_231|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128240: AddedToken("<|reserved_special_token_232|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128241: AddedToken("<|reserved_special_token_233|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128242: AddedToken("<|reserved_special_token_234|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128243: AddedToken("<|reserved_special_token_235|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128244: AddedToken("<|reserved_special_token_236|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128245: AddedToken("<|reserved_special_token_237|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128246: AddedToken("<|reserved_special_token_238|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128247: AddedToken("<|reserved_special_token_239|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128248: AddedToken("<|reserved_special_token_240|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128249: AddedToken("<|reserved_special_token_241|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128250: AddedToken("<|reserved_special_token_242|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128251: AddedToken("<|reserved_special_token_243|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128252: AddedToken("<|reserved_special_token_244|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128253: AddedToken("<|reserved_special_token_245|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128254: AddedToken("<|reserved_special_token_246|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
	128255: AddedToken("<|reserved_special_token_247|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
}
2026-07-05 21:50:45 DEBUG: layer_indices: tensor([ 0,  1,  2,  3,  4,  5,  6,  7,  8,  9, 10, 11, 12, 13, 14, 15, 16, 17,
        18, 19, 20, 21, 22, 23, 24, 25, 26, 27], device='cuda:0')
2026-07-05 21:50:46 DEBUG: https://huggingface.co:443 "HEAD /Alibaba-NLP/gte-large-en-v1.5/resolve/main/config.json HTTP/1.1" 307 0
2026-07-05 21:50:46 DEBUG: https://huggingface.co:443 "HEAD /api/resolve-cache/models/Alibaba-NLP/gte-large-en-v1.5/104333d6af6f97649377c2afbde10a7704870c7b/config.json HTTP/1.1" 200 0
2026-07-05 21:50:46 DEBUG: https://huggingface.co:443 "HEAD /Alibaba-NLP/new-impl/resolve/main/configuration.py HTTP/1.1" 307 0
2026-07-05 21:50:46 DEBUG: https://huggingface.co:443 "HEAD /api/resolve-cache/models/Alibaba-NLP/new-impl/40ced75c3017eb27626c9d4ea981bde21a2662f4/configuration.py HTTP/1.1" 200 0
2026-07-05 21:50:47 DEBUG: https://huggingface.co:443 "HEAD /Alibaba-NLP/new-impl/resolve/main/modeling.py HTTP/1.1" 307 0
2026-07-05 21:50:47 DEBUG: https://huggingface.co:443 "HEAD /api/resolve-cache/models/Alibaba-NLP/new-impl/40ced75c3017eb27626c9d4ea981bde21a2662f4/modeling.py HTTP/1.1" 200 0
2026-07-05 21:50:53 DEBUG: https://huggingface.co:443 "HEAD /Alibaba-NLP/gte-large-en-v1.5/resolve/main/tokenizer_config.json HTTP/1.1" 307 0
2026-07-05 21:50:53 DEBUG: https://huggingface.co:443 "HEAD /api/resolve-cache/models/Alibaba-NLP/gte-large-en-v1.5/104333d6af6f97649377c2afbde10a7704870c7b/tokenizer_config.json HTTP/1.1" 200 0
2026-07-05 21:50:54 DEBUG: emb_model: NewModel(
  (embeddings): NewEmbeddings(
    (word_embeddings): Embedding(30528, 1024, padding_idx=0)
    (rotary_emb): NTKScalingRotaryEmbedding()
    (token_type_embeddings): Embedding(2, 1024)
    (LayerNorm): LayerNorm((1024,), eps=1e-12, elementwise_affine=True)
    (dropout): Dropout(p=0.1, inplace=False)
  )
  (encoder): NewEncoder(
    (layer): ModuleList(
      (0-23): 24 x NewLayer(
        (attention): NewSdpaAttention(
          (qkv_proj): Linear(in_features=1024, out_features=3072, bias=True)
          (dropout): Dropout(p=0.0, inplace=False)
          (o_proj): Linear(in_features=1024, out_features=1024, bias=True)
        )
        (mlp): NewGatedMLP(
          (up_gate_proj): Linear(in_features=1024, out_features=8192, bias=False)
          (down_proj): Linear(in_features=4096, out_features=1024, bias=True)
          (act_fn): GELUActivation()
          (hidden_dropout): Dropout(p=0.1, inplace=False)
        )
        (attn_ln): LayerNorm((1024,), eps=1e-12, elementwise_affine=True)
        (mlp_ln): LayerNorm((1024,), eps=1e-12, elementwise_affine=True)
        (hidden_dropout): Dropout(p=0.1, inplace=False)
      )
    )
  )
)
2026-07-05 21:50:54 DEBUG: https://huggingface.co:443 "HEAD /Guilherme34/Firefly-V3/resolve/main/config.json HTTP/1.1" 307 0
2026-07-05 21:50:54 DEBUG: https://huggingface.co:443 "HEAD /api/resolve-cache/models/Guilherme34/Firefly-V3/b8a79e9e22bb888f872aef0f5c1475923f5edcf7/config.json HTTP/1.1" 200 0
2026-07-05 21:50:54 DEBUG: https://huggingface.co:443 "HEAD /Guilherme34/Firefly-V3/resolve/main/config.json HTTP/1.1" 307 0
2026-07-05 21:50:54 DEBUG: https://huggingface.co:443 "HEAD /api/resolve-cache/models/Guilherme34/Firefly-V3/b8a79e9e22bb888f872aef0f5c1475923f5edcf7/config.json HTTP/1.1" 200 0
2026-07-05 21:50:54 DEBUG: head_in_size: 256, output_size: 32768
2026-07-05 21:50:54 DEBUG: head_use_bias: True
2026-07-05 21:50:54 DEBUG: zeroing out head weights for v_proj
2026-07-05 21:50:54 DEBUG: head_in_size: 256, output_size: 90112
2026-07-05 21:50:54 DEBUG: head_use_bias: True
2026-07-05 21:50:54 DEBUG: zeroing out head weights for down_proj
2026-07-05 21:50:54 DEBUG: head_in_size: 256, output_size: 90112
2026-07-05 21:50:54 DEBUG: head_use_bias: True
2026-07-05 21:50:54 DEBUG: zeroing out head weights for up_proj
2026-07-05 21:50:54 DEBUG: head_in_size: 256, output_size: 90112
2026-07-05 21:50:54 DEBUG: head_use_bias: True
2026-07-05 21:50:54 DEBUG: zeroing out head weights for gate_proj
2026-07-05 21:50:54 DEBUG: head_in_size: 256, output_size: 49152
2026-07-05 21:50:54 DEBUG: head_use_bias: True
2026-07-05 21:50:54 DEBUG: zeroing out head weights for q_proj
2026-07-05 21:50:54 DEBUG: head_in_size: 256, output_size: 49152
2026-07-05 21:50:54 DEBUG: head_use_bias: True
2026-07-05 21:50:54 DEBUG: zeroing out head weights for o_proj
2026-07-05 21:50:54 DEBUG: head_in_size: 256, output_size: 32768
2026-07-05 21:50:54 DEBUG: head_use_bias: True
2026-07-05 21:50:54 DEBUG: zeroing out head weights for k_proj
2026-07-05 21:50:54 DEBUG: peft_weights:
{'v_proj': {'lora_dropout': Dropout(p=0.05, inplace=False), 'lora_A': Linear(in_features=3072, out_features=8, bias=False), 'lora_B': Linear(in_features=8, out_features=1024, bias=False)}, 'down_proj': {'lora_dropout': Dropout(p=0.05, inplace=False), 'lora_A': Linear(in_features=8192, out_features=8, bias=False), 'lora_B': Linear(in_features=8, out_features=3072, bias=False)}, 'up_proj': {'lora_dropout': Dropout(p=0.05, inplace=False), 'lora_A': Linear(in_features=3072, out_features=8, bias=False), 'lora_B': Linear(in_features=8, out_features=8192, bias=False)}, 'gate_proj': {'lora_dropout': Dropout(p=0.05, inplace=False), 'lora_A': Linear(in_features=3072, out_features=8, bias=False), 'lora_B': Linear(in_features=8, out_features=8192, bias=False)}, 'q_proj': {'lora_dropout': Dropout(p=0.05, inplace=False), 'lora_A': Linear(in_features=3072, out_features=8, bias=False), 'lora_B': Linear(in_features=8, out_features=3072, bias=False)}, 'o_proj': {'lora_dropout': Dropout(p=0.05, inplace=False), 'lora_A': Linear(in_features=3072, out_features=8, bias=False), 'lora_B': Linear(in_features=8, out_features=3072, bias=False)}, 'k_proj': {'lora_dropout': Dropout(p=0.05, inplace=False), 'lora_A': Linear(in_features=3072, out_features=8, bias=False), 'lora_B': Linear(in_features=8, out_features=1024, bias=False)}}
2026-07-05 21:50:54 DEBUG: split_shapes: {'v_proj': [24576, 8192]}
2026-07-05 21:50:54 DEBUG: split_shapes: {'v_proj': [24576, 8192], 'down_proj': [65536, 24576]}
2026-07-05 21:50:54 DEBUG: split_shapes: {'v_proj': [24576, 8192], 'down_proj': [65536, 24576], 'up_proj': [24576, 65536]}
2026-07-05 21:50:54 DEBUG: split_shapes: {'v_proj': [24576, 8192], 'down_proj': [65536, 24576], 'up_proj': [24576, 65536], 'gate_proj': [24576, 65536]}
2026-07-05 21:50:54 DEBUG: split_shapes: {'v_proj': [24576, 8192], 'down_proj': [65536, 24576], 'up_proj': [24576, 65536], 'gate_proj': [24576, 65536], 'q_proj': [24576, 24576]}
2026-07-05 21:50:54 DEBUG: split_shapes: {'v_proj': [24576, 8192], 'down_proj': [65536, 24576], 'up_proj': [24576, 65536], 'gate_proj': [24576, 65536], 'q_proj': [24576, 24576], 'o_proj': [24576, 24576]}
2026-07-05 21:50:54 DEBUG: split_shapes: {'v_proj': [24576, 8192], 'down_proj': [65536, 24576], 'up_proj': [24576, 65536], 'gate_proj': [24576, 65536], 'q_proj': [24576, 24576], 'o_proj': [24576, 24576], 'k_proj': [24576, 8192]}
2026-07-05 21:50:54 DEBUG: Hypermod: HyperModulator(
  (AB_offset): ParameterDict(
      (A): Object of type: ParameterDict
      (B): Object of type: ParameterDict
    (A): ParameterDict(
        (down_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x8192 (cuda:0)]
        (gate_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (k_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (o_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (q_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (up_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (v_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
    )
    (B): ParameterDict(
        (down_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x3072x8 (cuda:0)]
        (gate_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8192x8 (cuda:0)]
        (k_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x1024x8 (cuda:0)]
        (o_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x3072x8 (cuda:0)]
        (q_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x3072x8 (cuda:0)]
        (up_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8192x8 (cuda:0)]
        (v_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x1024x8 (cuda:0)]
    )
  )
  (mean_recon_target): ParameterDict(
      (A): Object of type: ParameterDict
      (B): Object of type: ParameterDict
    (A): ParameterDict(
        (down_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x8192 (cuda:0)]
        (gate_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (k_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (o_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (q_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (up_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (v_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
    )
    (B): ParameterDict(
        (down_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x3072x8 (cuda:0)]
        (gate_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8192x8 (cuda:0)]
        (k_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x1024x8 (cuda:0)]
        (o_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x3072x8 (cuda:0)]
        (q_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x3072x8 (cuda:0)]
        (up_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8192x8 (cuda:0)]
        (v_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x1024x8 (cuda:0)]
    )
  )
  (std_recon_target): ParameterDict(
      (A): Object of type: ParameterDict
      (B): Object of type: ParameterDict
    (A): ParameterDict(
        (down_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x8192 (cuda:0)]
        (gate_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (k_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (o_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (q_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (up_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
        (v_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8x3072 (cuda:0)]
    )
    (B): ParameterDict(
        (down_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x3072x8 (cuda:0)]
        (gate_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8192x8 (cuda:0)]
        (k_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x1024x8 (cuda:0)]
        (o_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x3072x8 (cuda:0)]
        (q_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x3072x8 (cuda:0)]
        (up_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x8192x8 (cuda:0)]
        (v_proj): Parameter containing: [torch.cuda.FloatTensor of size 28x1024x8 (cuda:0)]
    )
  )
  (task_encoder): TaskEncoder(
    (mlp): Sequential(
      (0): Linear(in_features=1024, out_features=64, bias=True)
      (1): LayerNorm((64,), eps=1e-05, elementwise_affine=True)
    )
  )
  (layer_depth_encoder): Sequential(
    (0): Embedding(28, 32)
    (1): LayerNorm((32,), eps=1e-05, elementwise_affine=True)
  )
  (layer_type_encoder): Sequential(
    (0): Embedding(7, 32)
    (1): LayerNorm((32,), eps=1e-05, elementwise_affine=True)
  )
  (mixer): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=128, out_features=512, bias=True)
    (2): SiLU()
    (3): Dropout(p=0.05, inplace=False)
    (4): Linear(in_features=512, out_features=128, bias=True)
    (5): SiLU()
    (6): Dropout(p=0.05, inplace=False)
  )
  (mlp1): MLPResidualBlock(
    (mlp): Sequential(
      (0): LayerNorm((128,), eps=1e-05, elementwise_affine=True)
      (1): Linear(in_features=128, out_features=512, bias=True)
      (2): SiLU()
      (3): Dropout(p=0.05, inplace=False)
      (4): Linear(in_features=512, out_features=128, bias=True)
      (5): SiLU()
      (6): Dropout(p=0.05, inplace=False)
    )
  )
  (mlp2): MLPResidualBlock(
    (mlp): Sequential(
      (0): LayerNorm((128,), eps=1e-05, elementwise_affine=True)
      (1): Linear(in_features=128, out_features=512, bias=True)
      (2): SiLU()
      (3): Dropout(p=0.05, inplace=False)
      (4): Linear(in_features=512, out_features=128, bias=True)
      (5): SiLU()
      (6): Dropout(p=0.05, inplace=False)
    )
  )
  (mlp3): Sequential(
    (0): LayerNorm((128,), eps=1e-05, elementwise_affine=True)
    (1): Linear(in_features=128, out_features=512, bias=True)
    (2): SiLU()
    (3): Dropout(p=0.05, inplace=False)
    (4): Linear(in_features=512, out_features=256, bias=True)
    (5): SiLU()
  )
  (heads): ModuleDict(
    (v_proj): Linear(in_features=256, out_features=32768, bias=True)
    (down_proj): Linear(in_features=256, out_features=90112, bias=True)
    (up_proj): Linear(in_features=256, out_features=90112, bias=True)
    (gate_proj): Linear(in_features=256, out_features=90112, bias=True)
    (q_proj): Linear(in_features=256, out_features=49152, bias=True)
    (o_proj): Linear(in_features=256, out_features=49152, bias=True)
    (k_proj): Linear(in_features=256, out_features=32768, bias=True)
  )
)
2026-07-05 21:50:54 DEBUG: Trainable model parameters:
2026-07-05 21:50:54 DEBUG: hypermod.task_encoder.mlp.0.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.task_encoder.mlp.0.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.task_encoder.mlp.1.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.task_encoder.mlp.1.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.layer_depth_encoder.0.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.layer_depth_encoder.1.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.layer_depth_encoder.1.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.layer_type_encoder.0.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.layer_type_encoder.1.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.layer_type_encoder.1.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mixer.1.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mixer.1.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mixer.4.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mixer.4.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp1.mlp.0.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp1.mlp.0.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp1.mlp.1.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp1.mlp.1.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp1.mlp.4.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp1.mlp.4.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp2.mlp.0.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp2.mlp.0.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp2.mlp.1.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp2.mlp.1.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp2.mlp.4.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp2.mlp.4.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp3.0.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp3.0.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp3.1.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp3.1.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp3.4.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.mlp3.4.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.v_proj.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.v_proj.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.down_proj.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.down_proj.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.up_proj.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.up_proj.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.gate_proj.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.gate_proj.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.q_proj.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.q_proj.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.o_proj.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.o_proj.bias, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.k_proj.weight, dtype:torch.float32
2026-07-05 21:50:54 DEBUG: hypermod.heads.k_proj.bias, dtype:torch.float32
2026-07-05 21:50:54 INFO: trainable params: 112,243,488 || all params: 3,373,621,024 || trainable%: 3.3271
2026-07-05 21:50:54 INFO: args.use_per_task_emb=True
args.use_inp_as_desc=False
args.use_per_sample_desc=False
2026-07-05 21:50:54 INFO: split_name='train', ds_names=['boolq', 'winogrande', 'piqa', 'hellaswag', 'arc_easy', 'arc_challenge', 'openbookqa', 'gsm8k']
2026-07-05 21:50:54 DEBUG: ds_name: boolq, ds_kwargs: {'path': 'google/boolq', 'split': 'train[:250]'}
2026-07-05 21:50:54 DEBUG: https://huggingface.co:443 "GET /api/datasets/google/boolq HTTP/1.1" 200 None
2026-07-05 21:50:54 DEBUG: Starting new HTTPS connection (1): s3.amazonaws.com:443
2026-07-05 21:50:54 DEBUG: https://s3.amazonaws.com:443 "HEAD /datasets.huggingface.co/datasets/datasets/google/boolq/google/boolq.py HTTP/1.1" 404 0
2026-07-05 21:50:55 DEBUG: https://huggingface.co:443 "GET /api/datasets/google/boolq HTTP/1.1" 200 None
2026-07-05 21:50:55 DEBUG: https://huggingface.co:443 "GET /api/datasets/google/boolq/revision/35b264d03638db9f4ce671b711558bf7ff0f80d5 HTTP/1.1" 200 None
2026-07-05 21:50:55 DEBUG: https://huggingface.co:443 "GET /api/datasets/google/boolq/tree/35b264d03638db9f4ce671b711558bf7ff0f80d5?recursive=False&expand=False HTTP/1.1" 200 291
2026-07-05 21:50:55 DEBUG: Starting new HTTPS connection (1): datasets-server.huggingface.co:443
2026-07-05 21:50:55 DEBUG: https://datasets-server.huggingface.co:443 "GET /info?dataset=google/boolq HTTP/1.1" 200 None
2026-07-05 21:50:55 DEBUG: https://huggingface.co:443 "GET /api/datasets/google/boolq/tree/35b264d03638db9f4ce671b711558bf7ff0f80d5/data?recursive=True&expand=False HTTP/1.1" 200 634
2026-07-05 21:50:55 DEBUG: Starting new HTTPS connection (1): huggingface.co:443
2026-07-05 21:50:55 DEBUG: https://huggingface.co:443 "GET /api/datasets/google/boolq/revision/35b264d03638db9f4ce671b711558bf7ff0f80d5 HTTP/1.1" 200 None
2026-07-05 21:50:55 DEBUG: Attempting to acquire lock 140584582129440 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_google___boolq_default_0.0.0_35b264d03638db9f4ce671b711558bf7ff0f80d5.lock
2026-07-05 21:50:55 DEBUG: Lock 140584582129440 acquired on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_google___boolq_default_0.0.0_35b264d03638db9f4ce671b711558bf7ff0f80d5.lock
2026-07-05 21:50:55 DEBUG: open file: /root/.cache/huggingface/datasets/google___boolq/default/0.0.0/35b264d03638db9f4ce671b711558bf7ff0f80d5/dataset_info.json
2026-07-05 21:50:55 DEBUG: Attempting to release lock 140584582129440 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_google___boolq_default_0.0.0_35b264d03638db9f4ce671b711558bf7ff0f80d5.lock
2026-07-05 21:50:55 DEBUG: Lock 140584582129440 released on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_google___boolq_default_0.0.0_35b264d03638db9f4ce671b711558bf7ff0f80d5.lock
2026-07-05 21:50:55 DEBUG: Attempting to acquire lock 140584408857968 on /root/.cache/huggingface/datasets/google___boolq/default/0.0.0/35b264d03638db9f4ce671b711558bf7ff0f80d5_builder.lock
2026-07-05 21:50:55 DEBUG: Lock 140584408857968 acquired on /root/.cache/huggingface/datasets/google___boolq/default/0.0.0/35b264d03638db9f4ce671b711558bf7ff0f80d5_builder.lock
2026-07-05 21:50:55 DEBUG: open file: /root/.cache/huggingface/datasets/google___boolq/default/0.0.0/35b264d03638db9f4ce671b711558bf7ff0f80d5/dataset_info.json
2026-07-05 21:50:55 DEBUG: Attempting to release lock 140584408857968 on /root/.cache/huggingface/datasets/google___boolq/default/0.0.0/35b264d03638db9f4ce671b711558bf7ff0f80d5_builder.lock
2026-07-05 21:50:55 DEBUG: Lock 140584408857968 released on /root/.cache/huggingface/datasets/google___boolq/default/0.0.0/35b264d03638db9f4ce671b711558bf7ff0f80d5_builder.lock
2026-07-05 21:50:55 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmp8lub3mfb
2026-07-05 21:50:56 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmp9yo9uue6
2026-07-05 21:50:56 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/2bbaf5adbbf9d755ce25c5ce1c917b364b57525fdd5933565cd3b643f466882a/data-00000-of-00001.arrow
2026-07-05 21:50:56 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/2bbaf5adbbf9d755ce25c5ce1c917b364b57525fdd5933565cd3b643f466882a/state.json
2026-07-05 21:50:56 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/2bbaf5adbbf9d755ce25c5ce1c917b364b57525fdd5933565cd3b643f466882a/dataset_info.json
2026-07-05 21:50:56 DEBUG: formatted example: {'question': ['do iran and afghanistan speak the same language', 'do good samaritan laws protect those who help at an accident', 'is windows movie maker part of windows essentials', 'is confectionary sugar the same as powdered sugar', 'is elder scrolls online the same as skyrim'], 'answer': [True, True, True, True, False], 'passage': ['Persian (/ˈpɜːrʒən, -ʃən/), also known by its endonym Farsi (فارسی fārsi (fɒːɾˈsiː) ( listen)), is one of the Western Iranian languages within the Indo-Iranian branch of the Indo-European language family. It is primarily spoken in Iran, Afghanistan (officially known as Dari since 1958), and Tajikistan (officially known as Tajiki since the Soviet era), and some other regions which historically were Persianate societies and considered part of Greater Iran. It is written in the Persian alphabet, a modified variant of the Arabic script, which itself evolved from the Aramaic alphabet.', "Good Samaritan laws offer legal protection to people who give reasonable assistance to those who are, or who they believe to be, injured, ill, in peril, or otherwise incapacitated. The protection is intended to reduce bystanders' hesitation to assist, for fear of being sued or prosecuted for unintentional injury or wrongful death. An example of such a law in common-law areas of Canada: a good Samaritan doctrine is a legal principle that prevents a rescuer who has voluntarily helped a victim in distress from being successfully sued for wrongdoing. Its purpose is to keep people from being reluctant to help a stranger in need for fear of legal repercussions should they make some mistake in treatment. By contrast, a duty to rescue law requires people to offer assistance and holds those who fail to do so liable.", 'Windows Movie Maker (formerly known as Windows Live Movie Maker in Windows 7) is a discontinued video editing software by Microsoft. It is a part of Windows Essentials software suite and offers the ability to create and edit videos as well as to publish them on OneDrive, Facebook, Vimeo, YouTube, and Flickr.', "Powdered sugar, also called confectioners' sugar, icing sugar, and icing cake, is a finely ground sugar produced by milling granulated sugar into a powdered state. It usually contains a small amount of anti-caking agent to prevent clumping and improve flow. Although most often produced in a factory, powdered sugar can also be made by processing ordinary granulated sugar in a coffee grinder, or by crushing it by hand in a mortar and pestle.", 'As with other games in The Elder Scrolls series, the game is set on the continent of Tamriel. The events of the game occur a millennium before those of The Elder Scrolls V: Skyrim and around 800 years before The Elder Scrolls III: Morrowind and The Elder Scrolls IV: Oblivion. It has a broadly similar structure to Skyrim, with two separate conflicts progressing at the same time, one with the fate of the world in the balance, and one where the prize is supreme power on Tamriel. In The Elder Scrolls Online, the first struggle is against the Daedric Prince Molag Bal, who is attempting to meld the plane of Mundus with his realm of Coldharbour, and the second is to capture the vacant imperial throne, contested by three alliances of the mortal races. The player character has been sacrificed to Molag Bal, and Molag Bal has stolen their soul, the recovery of which is the primary game objective.'], 'text': ['<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Persian (/ˈpɜːrʒən, -ʃən/), also known by its endonym Farsi (فارسی fārsi (fɒːɾˈsiː) ( listen)), is one of the Western Iranian languages within the Indo-Iranian branch of the Indo-European language family. It is primarily spoken in Iran, Afghanistan (officially known as Dari since 1958), and Tajikistan (officially known as Tajiki since the Soviet era), and some other regions which historically were Persianate societies and considered part of Greater Iran. It is written in the Persian alphabet, a modified variant of the Arabic script, which itself evolved from the Aramaic alphabet.\n\nQuestion: do iran and afghanistan speak the same language?\n\nPlease answer with only `true` or `false` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>True<|eot_id|>', "<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Good Samaritan laws offer legal protection to people who give reasonable assistance to those who are, or who they believe to be, injured, ill, in peril, or otherwise incapacitated. The protection is intended to reduce bystanders' hesitation to assist, for fear of being sued or prosecuted for unintentional injury or wrongful death. An example of such a law in common-law areas of Canada: a good Samaritan doctrine is a legal principle that prevents a rescuer who has voluntarily helped a victim in distress from being successfully sued for wrongdoing. Its purpose is to keep people from being reluctant to help a stranger in need for fear of legal repercussions should they make some mistake in treatment. By contrast, a duty to rescue law requires people to offer assistance and holds those who fail to do so liable.\n\nQuestion: do good samaritan laws protect those who help at an accident?\n\nPlease answer with only `true` or `false` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>True<|eot_id|>", '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Windows Movie Maker (formerly known as Windows Live Movie Maker in Windows 7) is a discontinued video editing software by Microsoft. It is a part of Windows Essentials software suite and offers the ability to create and edit videos as well as to publish them on OneDrive, Facebook, Vimeo, YouTube, and Flickr.\n\nQuestion: is windows movie maker part of windows essentials?\n\nPlease answer with only `true` or `false` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>True<|eot_id|>', "<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Powdered sugar, also called confectioners' sugar, icing sugar, and icing cake, is a finely ground sugar produced by milling granulated sugar into a powdered state. It usually contains a small amount of anti-caking agent to prevent clumping and improve flow. Although most often produced in a factory, powdered sugar can also be made by processing ordinary granulated sugar in a coffee grinder, or by crushing it by hand in a mortar and pestle.\n\nQuestion: is confectionary sugar the same as powdered sugar?\n\nPlease answer with only `true` or `false` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>True<|eot_id|>", '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>As with other games in The Elder Scrolls series, the game is set on the continent of Tamriel. The events of the game occur a millennium before those of The Elder Scrolls V: Skyrim and around 800 years before The Elder Scrolls III: Morrowind and The Elder Scrolls IV: Oblivion. It has a broadly similar structure to Skyrim, with two separate conflicts progressing at the same time, one with the fate of the world in the balance, and one where the prize is supreme power on Tamriel. In The Elder Scrolls Online, the first struggle is against the Daedric Prince Molag Bal, who is attempting to meld the plane of Mundus with his realm of Coldharbour, and the second is to capture the vacant imperial throne, contested by three alliances of the mortal races. The player character has been sacrificed to Molag Bal, and Molag Bal has stolen their soul, the recovery of which is the primary game objective.\n\nQuestion: is elder scrolls online the same as skyrim?\n\nPlease answer with only `true` or `false` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>False<|eot_id|>']}
2026-07-05 21:50:56 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmplldn40ny
2026-07-05 21:50:56 DEBUG: tokenized example: {'input_ids': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 59742, 1122, 47325, 135, 230, 79, 133, 250, 135, 238, 81, 134, 240, 99638, 77, 11, 482, 134, 225, 99638, 77, 14, 705, 1101, 3967, 555, 1202, 842, 7987, 435, 61114, 320, 21604, 36138, 100513, 282, 31757, 5544, 72, 320, 69, 133, 240, 135, 238, 133, 122, 135, 230, 6455, 135, 238, 8, 320, 9020, 5850, 374, 832, 315, 279, 11104, 28501, 15823, 2949, 279, 76985, 22197, 6713, 1122, 9046, 315, 279, 76985, 88735, 4221, 3070, 13, 1102, 374, 15871, 22066, 304, 10471, 11, 21139, 320, 33912, 398, 3967, 439, 423, 2850, 2533, 220, 6280, 23, 705, 323, 67799, 1609, 9121, 320, 33912, 398, 3967, 439, 67799, 7723, 2533, 279, 19953, 11639, 705, 323, 1063, 1023, 13918, 902, 35901, 1051, 50961, 349, 34775, 323, 6646, 961, 315, 33381, 10471, 13, 1102, 374, 5439, 304, 279, 50961, 28890, 11, 264, 11041, 11678, 315, 279, 35217, 5429, 11, 902, 5196, 28995, 505, 279, 1676, 3105, 292, 28890, 382, 14924, 25, 656, 6348, 276, 323, 8136, 16083, 9121, 6604, 279, 1890, 4221, 1980, 5618, 4320, 449, 1193, 1595, 1904, 63, 477, 1595, 3934, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 2575, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 15571, 86356, 13145, 7016, 3085, 5897, 9313, 311, 1274, 889, 3041, 13579, 13291, 311, 1884, 889, 527, 11, 477, 889, 814, 4510, 311, 387, 11, 15902, 11, 5986, 11, 304, 60392, 11, 477, 6062, 94130, 33337, 13, 578, 9313, 374, 10825, 311, 8108, 83483, 388, 6, 65437, 311, 7945, 11, 369, 8850, 315, 1694, 42184, 477, 58559, 369, 70576, 278, 11134, 477, 93732, 4648, 13, 1556, 3187, 315, 1778, 264, 2383, 304, 4279, 31412, 5789, 315, 7008, 25, 264, 1695, 86356, 13145, 33235, 374, 264, 5897, 17966, 430, 29034, 264, 13208, 8977, 889, 706, 54523, 9087, 264, 11996, 304, 35104, 505, 1694, 7946, 42184, 369, 65328, 13, 11699, 7580, 374, 311, 2567, 1274, 505, 1694, 44040, 311, 1520, 264, 35058, 304, 1205, 369, 8850, 315, 5897, 81909, 1288, 814, 1304, 1063, 16930, 304, 6514, 13, 3296, 13168, 11, 264, 14523, 311, 17629, 2383, 7612, 1274, 311, 3085, 13291, 323, 10187, 1884, 889, 3775, 311, 656, 779, 35473, 382, 14924, 25, 656, 1695, 10167, 277, 13145, 7016, 6144, 1884, 889, 1520, 520, 459, 11677, 1980, 5618, 4320, 449, 1193, 1595, 1904, 63, 477, 1595, 3934, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 2575, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 13466, 14270, 41628, 320, 70614, 3967, 439, 5632, 11406, 14270, 41628, 304, 5632, 220, 22, 8, 374, 264, 65259, 2835, 16039, 3241, 555, 5210, 13, 1102, 374, 264, 961, 315, 5632, 76260, 3241, 16578, 323, 6209, 279, 5845, 311, 1893, 323, 4600, 6946, 439, 1664, 439, 311, 3498, 1124, 389, 3861, 33557, 11, 5690, 11, 99925, 11, 13674, 11, 323, 55458, 382, 14924, 25, 374, 11276, 5818, 25214, 961, 315, 11276, 59886, 1980, 5618, 4320, 449, 1193, 1595, 1904, 63, 477, 1595, 3934, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 2575, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 67684, 1126, 291, 13465, 11, 1101, 2663, 390, 13421, 388, 6, 13465, 11, 76106, 13465, 11, 323, 76106, 19692, 11, 374, 264, 61802, 5015, 13465, 9124, 555, 46472, 16109, 7913, 13465, 1139, 264, 83583, 1614, 13, 1102, 6118, 5727, 264, 2678, 3392, 315, 7294, 1824, 1802, 8479, 311, 5471, 1206, 55432, 323, 7417, 6530, 13, 10541, 1455, 3629, 9124, 304, 264, 8803, 11, 83583, 13465, 649, 1101, 387, 1903, 555, 8863, 19664, 16109, 7913, 13465, 304, 264, 11033, 46641, 11, 477, 555, 14770, 433, 555, 1450, 304, 264, 58560, 323, 44885, 273, 382, 14924, 25, 374, 390, 13421, 661, 13465, 279, 1890, 439, 83583, 13465, 1980, 5618, 4320, 449, 1193, 1595, 1904, 63, 477, 1595, 3934, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 2575, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2170, 449, 1023, 3953, 304, 578, 39669, 79329, 4101, 11, 279, 1847, 374, 743, 389, 279, 32843, 315, 29988, 22811, 13, 578, 4455, 315, 279, 1847, 12446, 264, 89785, 1603, 1884, 315, 578, 39669, 79329, 650, 25, 66029, 323, 2212, 220, 4728, 1667, 1603, 578, 39669, 79329, 14767, 25, 87374, 485, 323, 578, 39669, 79329, 17244, 25, 56875, 344, 290, 13, 1102, 706, 264, 44029, 4528, 6070, 311, 66029, 11, 449, 1403, 8821, 26885, 76722, 520, 279, 1890, 892, 11, 832, 449, 279, 25382, 315, 279, 1917, 304, 279, 8335, 11, 323, 832, 1405, 279, 22643, 374, 44222, 2410, 389, 29988, 22811, 13, 763, 578, 39669, 79329, 8267, 11, 279, 1176, 14993, 374, 2403, 279, 14569, 291, 2265, 19912, 33518, 351, 19984, 11, 889, 374, 19969, 311, 71530, 279, 11277, 315, 67661, 355, 449, 813, 22651, 315, 24062, 13279, 15747, 11, 323, 279, 2132, 374, 311, 12602, 279, 49791, 35379, 44721, 11, 57310, 555, 2380, 70800, 315, 279, 49972, 21234, 13, 578, 2851, 3752, 706, 1027, 67904, 311, 33518, 351, 19984, 11, 323, 33518, 351, 19984, 706, 23130, 872, 13836, 11, 279, 13654, 315, 902, 374, 279, 6156, 1847, 16945, 382, 14924, 25, 374, 22916, 79664, 2930, 279, 1890, 439, 13180, 6417, 1980, 5618, 4320, 449, 1193, 1595, 1904, 63, 477, 1595, 3934, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 4139, 128009]], 'attention_mask': [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]], 'labels': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 59742, 1122, 47325, 135, 230, 79, 133, 250, 135, 238, 81, 134, 240, 99638, 77, 11, 482, 134, 225, 99638, 77, 14, 705, 1101, 3967, 555, 1202, 842, 7987, 435, 61114, 320, 21604, 36138, 100513, 282, 31757, 5544, 72, 320, 69, 133, 240, 135, 238, 133, 122, 135, 230, 6455, 135, 238, 8, 320, 9020, 5850, 374, 832, 315, 279, 11104, 28501, 15823, 2949, 279, 76985, 22197, 6713, 1122, 9046, 315, 279, 76985, 88735, 4221, 3070, 13, 1102, 374, 15871, 22066, 304, 10471, 11, 21139, 320, 33912, 398, 3967, 439, 423, 2850, 2533, 220, 6280, 23, 705, 323, 67799, 1609, 9121, 320, 33912, 398, 3967, 439, 67799, 7723, 2533, 279, 19953, 11639, 705, 323, 1063, 1023, 13918, 902, 35901, 1051, 50961, 349, 34775, 323, 6646, 961, 315, 33381, 10471, 13, 1102, 374, 5439, 304, 279, 50961, 28890, 11, 264, 11041, 11678, 315, 279, 35217, 5429, 11, 902, 5196, 28995, 505, 279, 1676, 3105, 292, 28890, 382, 14924, 25, 656, 6348, 276, 323, 8136, 16083, 9121, 6604, 279, 1890, 4221, 1980, 5618, 4320, 449, 1193, 1595, 1904, 63, 477, 1595, 3934, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 2575, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 15571, 86356, 13145, 7016, 3085, 5897, 9313, 311, 1274, 889, 3041, 13579, 13291, 311, 1884, 889, 527, 11, 477, 889, 814, 4510, 311, 387, 11, 15902, 11, 5986, 11, 304, 60392, 11, 477, 6062, 94130, 33337, 13, 578, 9313, 374, 10825, 311, 8108, 83483, 388, 6, 65437, 311, 7945, 11, 369, 8850, 315, 1694, 42184, 477, 58559, 369, 70576, 278, 11134, 477, 93732, 4648, 13, 1556, 3187, 315, 1778, 264, 2383, 304, 4279, 31412, 5789, 315, 7008, 25, 264, 1695, 86356, 13145, 33235, 374, 264, 5897, 17966, 430, 29034, 264, 13208, 8977, 889, 706, 54523, 9087, 264, 11996, 304, 35104, 505, 1694, 7946, 42184, 369, 65328, 13, 11699, 7580, 374, 311, 2567, 1274, 505, 1694, 44040, 311, 1520, 264, 35058, 304, 1205, 369, 8850, 315, 5897, 81909, 1288, 814, 1304, 1063, 16930, 304, 6514, 13, 3296, 13168, 11, 264, 14523, 311, 17629, 2383, 7612, 1274, 311, 3085, 13291, 323, 10187, 1884, 889, 3775, 311, 656, 779, 35473, 382, 14924, 25, 656, 1695, 10167, 277, 13145, 7016, 6144, 1884, 889, 1520, 520, 459, 11677, 1980, 5618, 4320, 449, 1193, 1595, 1904, 63, 477, 1595, 3934, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 2575, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 13466, 14270, 41628, 320, 70614, 3967, 439, 5632, 11406, 14270, 41628, 304, 5632, 220, 22, 8, 374, 264, 65259, 2835, 16039, 3241, 555, 5210, 13, 1102, 374, 264, 961, 315, 5632, 76260, 3241, 16578, 323, 6209, 279, 5845, 311, 1893, 323, 4600, 6946, 439, 1664, 439, 311, 3498, 1124, 389, 3861, 33557, 11, 5690, 11, 99925, 11, 13674, 11, 323, 55458, 382, 14924, 25, 374, 11276, 5818, 25214, 961, 315, 11276, 59886, 1980, 5618, 4320, 449, 1193, 1595, 1904, 63, 477, 1595, 3934, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 2575, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 67684, 1126, 291, 13465, 11, 1101, 2663, 390, 13421, 388, 6, 13465, 11, 76106, 13465, 11, 323, 76106, 19692, 11, 374, 264, 61802, 5015, 13465, 9124, 555, 46472, 16109, 7913, 13465, 1139, 264, 83583, 1614, 13, 1102, 6118, 5727, 264, 2678, 3392, 315, 7294, 1824, 1802, 8479, 311, 5471, 1206, 55432, 323, 7417, 6530, 13, 10541, 1455, 3629, 9124, 304, 264, 8803, 11, 83583, 13465, 649, 1101, 387, 1903, 555, 8863, 19664, 16109, 7913, 13465, 304, 264, 11033, 46641, 11, 477, 555, 14770, 433, 555, 1450, 304, 264, 58560, 323, 44885, 273, 382, 14924, 25, 374, 390, 13421, 661, 13465, 279, 1890, 439, 83583, 13465, 1980, 5618, 4320, 449, 1193, 1595, 1904, 63, 477, 1595, 3934, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 2575, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2170, 449, 1023, 3953, 304, 578, 39669, 79329, 4101, 11, 279, 1847, 374, 743, 389, 279, 32843, 315, 29988, 22811, 13, 578, 4455, 315, 279, 1847, 12446, 264, 89785, 1603, 1884, 315, 578, 39669, 79329, 650, 25, 66029, 323, 2212, 220, 4728, 1667, 1603, 578, 39669, 79329, 14767, 25, 87374, 485, 323, 578, 39669, 79329, 17244, 25, 56875, 344, 290, 13, 1102, 706, 264, 44029, 4528, 6070, 311, 66029, 11, 449, 1403, 8821, 26885, 76722, 520, 279, 1890, 892, 11, 832, 449, 279, 25382, 315, 279, 1917, 304, 279, 8335, 11, 323, 832, 1405, 279, 22643, 374, 44222, 2410, 389, 29988, 22811, 13, 763, 578, 39669, 79329, 8267, 11, 279, 1176, 14993, 374, 2403, 279, 14569, 291, 2265, 19912, 33518, 351, 19984, 11, 889, 374, 19969, 311, 71530, 279, 11277, 315, 67661, 355, 449, 813, 22651, 315, 24062, 13279, 15747, 11, 323, 279, 2132, 374, 311, 12602, 279, 49791, 35379, 44721, 11, 57310, 555, 2380, 70800, 315, 279, 49972, 21234, 13, 578, 2851, 3752, 706, 1027, 67904, 311, 33518, 351, 19984, 11, 323, 33518, 351, 19984, 706, 23130, 872, 13836, 11, 279, 13654, 315, 902, 374, 279, 6156, 1847, 16945, 382, 14924, 25, 374, 22916, 79664, 2930, 279, 1890, 439, 13180, 6417, 1980, 5618, 4320, 449, 1193, 1595, 1904, 63, 477, 1595, 3934, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 4139, 128009]]}
2026-07-05 21:50:56 DEBUG: Saving preprocessed dataset: c0c8f1994eb6c5f1a133e5604885b1ff2bc1a1816b19e74c3050202ab62f0f3b
2026-07-05 21:50:56 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/c0c8f1994eb6c5f1a133e5604885b1ff2bc1a1816b19e74c3050202ab62f0f3b/data-00000-of-00001.arrow
2026-07-05 21:50:56 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/c0c8f1994eb6c5f1a133e5604885b1ff2bc1a1816b19e74c3050202ab62f0f3b/state.json
2026-07-05 21:50:56 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/c0c8f1994eb6c5f1a133e5604885b1ff2bc1a1816b19e74c3050202ab62f0f3b/dataset_info.json
2026-07-05 21:50:56 DEBUG: ds_name: winogrande, ds_kwargs: {'name': 'winogrande_debiased', 'path': 'allenai/winogrande', 'split': 'train[:250]'}
2026-07-05 21:50:56 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/winogrande HTTP/1.1" 200 None
2026-07-05 21:50:56 DEBUG: Starting new HTTPS connection (1): s3.amazonaws.com:443
2026-07-05 21:50:56 DEBUG: https://s3.amazonaws.com:443 "HEAD /datasets.huggingface.co/datasets/datasets/allenai/winogrande/allenai/winogrande.py HTTP/1.1" 404 0
2026-07-05 21:50:56 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/winogrande HTTP/1.1" 200 None
2026-07-05 21:50:56 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/winogrande/revision/01e74176c63542e6b0bcb004dcdea22d94fb67b5 HTTP/1.1" 200 None
2026-07-05 21:50:57 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/winogrande/tree/01e74176c63542e6b0bcb004dcdea22d94fb67b5?recursive=False&expand=False HTTP/1.1" 200 814
2026-07-05 21:50:57 DEBUG: Starting new HTTPS connection (1): datasets-server.huggingface.co:443
2026-07-05 21:50:57 DEBUG: https://datasets-server.huggingface.co:443 "GET /info?dataset=allenai/winogrande HTTP/1.1" 200 None
2026-07-05 21:50:57 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/winogrande/tree/01e74176c63542e6b0bcb004dcdea22d94fb67b5/winogrande_debiased?recursive=True&expand=False HTTP/1.1" 200 984
2026-07-05 21:50:57 DEBUG: Starting new HTTPS connection (1): huggingface.co:443
2026-07-05 21:50:57 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/winogrande/revision/01e74176c63542e6b0bcb004dcdea22d94fb67b5 HTTP/1.1" 200 None
2026-07-05 21:50:57 DEBUG: Attempting to acquire lock 140584196158816 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___winogrande_winogrande_debiased_0.0.0_01e74176c63542e6b0bcb004dcdea22d94fb67b5.lock
2026-07-05 21:50:57 DEBUG: Lock 140584196158816 acquired on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___winogrande_winogrande_debiased_0.0.0_01e74176c63542e6b0bcb004dcdea22d94fb67b5.lock
2026-07-05 21:50:57 DEBUG: open file: /root/.cache/huggingface/datasets/allenai___winogrande/winogrande_debiased/0.0.0/01e74176c63542e6b0bcb004dcdea22d94fb67b5/dataset_info.json
2026-07-05 21:50:57 DEBUG: Attempting to release lock 140584196158816 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___winogrande_winogrande_debiased_0.0.0_01e74176c63542e6b0bcb004dcdea22d94fb67b5.lock
2026-07-05 21:50:57 DEBUG: Lock 140584196158816 released on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___winogrande_winogrande_debiased_0.0.0_01e74176c63542e6b0bcb004dcdea22d94fb67b5.lock
2026-07-05 21:50:57 DEBUG: Attempting to acquire lock 140584410652864 on /root/.cache/huggingface/datasets/allenai___winogrande/winogrande_debiased/0.0.0/01e74176c63542e6b0bcb004dcdea22d94fb67b5_builder.lock
2026-07-05 21:50:57 DEBUG: Lock 140584410652864 acquired on /root/.cache/huggingface/datasets/allenai___winogrande/winogrande_debiased/0.0.0/01e74176c63542e6b0bcb004dcdea22d94fb67b5_builder.lock
2026-07-05 21:50:57 DEBUG: open file: /root/.cache/huggingface/datasets/allenai___winogrande/winogrande_debiased/0.0.0/01e74176c63542e6b0bcb004dcdea22d94fb67b5/dataset_info.json
2026-07-05 21:50:57 DEBUG: Attempting to release lock 140584410652864 on /root/.cache/huggingface/datasets/allenai___winogrande/winogrande_debiased/0.0.0/01e74176c63542e6b0bcb004dcdea22d94fb67b5_builder.lock
2026-07-05 21:50:57 DEBUG: Lock 140584410652864 released on /root/.cache/huggingface/datasets/allenai___winogrande/winogrande_debiased/0.0.0/01e74176c63542e6b0bcb004dcdea22d94fb67b5_builder.lock
2026-07-05 21:50:57 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmp40zwxiuv
2026-07-05 21:50:57 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmprhul0brl
2026-07-05 21:50:57 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/54268fca1abb8e70bbe2845e61eae7b150d7128250a9970247529133dbcae0f3/data-00000-of-00001.arrow
2026-07-05 21:50:57 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/54268fca1abb8e70bbe2845e61eae7b150d7128250a9970247529133dbcae0f3/state.json
2026-07-05 21:50:57 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/54268fca1abb8e70bbe2845e61eae7b150d7128250a9970247529133dbcae0f3/dataset_info.json
2026-07-05 21:50:57 DEBUG: formatted example: {'sentence': ['John moved the couch from the garage to the backyard to create space. The _ is small.', 'The doctor diagnosed Justin with bipolar and Robert with anxiety. _ had terrible nerves recently.', 'Dennis drew up a business proposal to present to Logan because _ wants his investment.', 'Felicia unexpectedly made fried eggs for breakfast in the morning for Katrina and now _ owes a favor.', 'My shampoo did not lather easily on my Afro hair because the _ is too dirty.'], 'option1': ['garage', 'Justin', 'Dennis', 'Felicia', 'shampoo'], 'option2': ['backyard', 'Robert', 'Logan', 'Katrina', 'hair'], 'answer': ['1', '2', '1', '2', '2'], 'text': ['<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Given the following situation:\n\nJohn moved the couch from the garage to the backyard to create space. The _ is small.\n\nWhich option is correct?\n\nOption 1: garage\nOption 2: backyard\n\nYou must respond with either `1` or `2` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>1<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Given the following situation:\n\nThe doctor diagnosed Justin with bipolar and Robert with anxiety. _ had terrible nerves recently.\n\nWhich option is correct?\n\nOption 1: Justin\nOption 2: Robert\n\nYou must respond with either `1` or `2` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>2<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Given the following situation:\n\nDennis drew up a business proposal to present to Logan because _ wants his investment.\n\nWhich option is correct?\n\nOption 1: Dennis\nOption 2: Logan\n\nYou must respond with either `1` or `2` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>1<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Given the following situation:\n\nFelicia unexpectedly made fried eggs for breakfast in the morning for Katrina and now _ owes a favor.\n\nWhich option is correct?\n\nOption 1: Felicia\nOption 2: Katrina\n\nYou must respond with either `1` or `2` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>2<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Given the following situation:\n\nMy shampoo did not lather easily on my Afro hair because the _ is too dirty.\n\nWhich option is correct?\n\nOption 1: shampoo\nOption 2: hair\n\nYou must respond with either `1` or `2` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>2<|eot_id|>']}
2026-07-05 21:50:58 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmpf9w_kk5g
2026-07-05 21:50:58 DEBUG: tokenized example: {'input_ids': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 22818, 279, 2768, 6671, 1473, 13379, 7882, 279, 27240, 505, 279, 19833, 311, 279, 36760, 311, 1893, 3634, 13, 578, 721, 374, 2678, 382, 23956, 3072, 374, 4495, 1980, 5454, 220, 16, 25, 19833, 198, 5454, 220, 17, 25, 36760, 271, 2675, 2011, 6013, 449, 3060, 1595, 16, 63, 477, 1595, 17, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 16, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 22818, 279, 2768, 6671, 1473, 791, 10896, 29704, 23278, 449, 65919, 323, 8563, 449, 18547, 13, 721, 1047, 17936, 50581, 6051, 382, 23956, 3072, 374, 4495, 1980, 5454, 220, 16, 25, 23278, 198, 5454, 220, 17, 25, 8563, 271, 2675, 2011, 6013, 449, 3060, 1595, 16, 63, 477, 1595, 17, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 17, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 22818, 279, 2768, 6671, 1473, 35, 16550, 24465, 709, 264, 2626, 14050, 311, 3118, 311, 44146, 1606, 721, 6944, 813, 9341, 382, 23956, 3072, 374, 4495, 1980, 5454, 220, 16, 25, 35727, 198, 5454, 220, 17, 25, 44146, 271, 2675, 2011, 6013, 449, 3060, 1595, 16, 63, 477, 1595, 17, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 16, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 22818, 279, 2768, 6671, 1473, 98940, 24985, 51709, 1903, 41951, 19335, 369, 17954, 304, 279, 6693, 369, 69756, 323, 1457, 721, 69944, 264, 4799, 382, 23956, 3072, 374, 4495, 1980, 5454, 220, 16, 25, 27246, 24985, 198, 5454, 220, 17, 25, 69756, 271, 2675, 2011, 6013, 449, 3060, 1595, 16, 63, 477, 1595, 17, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 17, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 22818, 279, 2768, 6671, 1473, 5159, 63032, 1550, 539, 326, 1894, 6847, 389, 856, 94700, 7013, 1606, 279, 721, 374, 2288, 19108, 382, 23956, 3072, 374, 4495, 1980, 5454, 220, 16, 25, 63032, 198, 5454, 220, 17, 25, 7013, 271, 2675, 2011, 6013, 449, 3060, 1595, 16, 63, 477, 1595, 17, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 17, 128009]], 'attention_mask': [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]], 'labels': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 22818, 279, 2768, 6671, 1473, 13379, 7882, 279, 27240, 505, 279, 19833, 311, 279, 36760, 311, 1893, 3634, 13, 578, 721, 374, 2678, 382, 23956, 3072, 374, 4495, 1980, 5454, 220, 16, 25, 19833, 198, 5454, 220, 17, 25, 36760, 271, 2675, 2011, 6013, 449, 3060, 1595, 16, 63, 477, 1595, 17, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 16, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 22818, 279, 2768, 6671, 1473, 791, 10896, 29704, 23278, 449, 65919, 323, 8563, 449, 18547, 13, 721, 1047, 17936, 50581, 6051, 382, 23956, 3072, 374, 4495, 1980, 5454, 220, 16, 25, 23278, 198, 5454, 220, 17, 25, 8563, 271, 2675, 2011, 6013, 449, 3060, 1595, 16, 63, 477, 1595, 17, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 17, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 22818, 279, 2768, 6671, 1473, 35, 16550, 24465, 709, 264, 2626, 14050, 311, 3118, 311, 44146, 1606, 721, 6944, 813, 9341, 382, 23956, 3072, 374, 4495, 1980, 5454, 220, 16, 25, 35727, 198, 5454, 220, 17, 25, 44146, 271, 2675, 2011, 6013, 449, 3060, 1595, 16, 63, 477, 1595, 17, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 16, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 22818, 279, 2768, 6671, 1473, 98940, 24985, 51709, 1903, 41951, 19335, 369, 17954, 304, 279, 6693, 369, 69756, 323, 1457, 721, 69944, 264, 4799, 382, 23956, 3072, 374, 4495, 1980, 5454, 220, 16, 25, 27246, 24985, 198, 5454, 220, 17, 25, 69756, 271, 2675, 2011, 6013, 449, 3060, 1595, 16, 63, 477, 1595, 17, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 17, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 22818, 279, 2768, 6671, 1473, 5159, 63032, 1550, 539, 326, 1894, 6847, 389, 856, 94700, 7013, 1606, 279, 721, 374, 2288, 19108, 382, 23956, 3072, 374, 4495, 1980, 5454, 220, 16, 25, 63032, 198, 5454, 220, 17, 25, 7013, 271, 2675, 2011, 6013, 449, 3060, 1595, 16, 63, 477, 1595, 17, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 17, 128009]]}
2026-07-05 21:50:58 DEBUG: Saving preprocessed dataset: af83395e31951f454aeceb3434805de92a7f2631ea2f79fbf942a24cef7b0e9d
2026-07-05 21:50:58 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/af83395e31951f454aeceb3434805de92a7f2631ea2f79fbf942a24cef7b0e9d/data-00000-of-00001.arrow
2026-07-05 21:50:58 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/af83395e31951f454aeceb3434805de92a7f2631ea2f79fbf942a24cef7b0e9d/state.json
2026-07-05 21:50:58 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/af83395e31951f454aeceb3434805de92a7f2631ea2f79fbf942a24cef7b0e9d/dataset_info.json
2026-07-05 21:50:58 DEBUG: ds_name: piqa, ds_kwargs: {'path': 'ybisk/piqa', 'split': 'train[:250]'}
2026-07-05 21:50:58 DEBUG: https://huggingface.co:443 "GET /api/datasets/ybisk/piqa HTTP/1.1" 200 None
2026-07-05 21:50:58 DEBUG: https://huggingface.co:443 "GET /api/datasets/ybisk/piqa HTTP/1.1" 200 None
2026-07-05 21:50:58 DEBUG: https://huggingface.co:443 "GET /api/datasets/ybisk/piqa/tree/main?recursive=False&expand=False HTTP/1.1" 200 292
2026-07-05 21:50:58 DEBUG: https://huggingface.co:443 "GET /datasets/ybisk/piqa/resolve/main/piqa.py HTTP/1.1" 307 229
2026-07-05 21:50:58 DEBUG: https://huggingface.co:443 "GET /api/resolve-cache/datasets/ybisk/piqa/2e8ac2dffd59bac8c3c6714948f4c551a0848bb0/piqa.py?%2Fdatasets%2Fybisk%2Fpiqa%2Fresolve%2Fmain%2Fpiqa.py=&etag=%220f0d96172f9bf7aa10069374b3236ef083cfeb8e%22 HTTP/1.1" 200 None
2026-07-05 21:50:58 DEBUG: Starting new HTTPS connection (1): s3.amazonaws.com:443
2026-07-05 21:50:58 DEBUG: https://s3.amazonaws.com:443 "HEAD /datasets.huggingface.co/datasets/datasets/ybisk/piqa/ybisk/piqa.py HTTP/1.1" 404 0
2026-07-05 21:50:58 DEBUG: Starting new HTTPS connection (1): datasets-server.huggingface.co:443
2026-07-05 21:50:58 DEBUG: https://datasets-server.huggingface.co:443 "GET /parquet?dataset=ybisk/piqa HTTP/1.1" 501 None
2026-07-05 21:50:58 DEBUG: Starting new HTTPS connection (1): s3.amazonaws.com:443
2026-07-05 21:50:59 DEBUG: https://s3.amazonaws.com:443 "HEAD /datasets.huggingface.co/datasets/datasets/ybisk/piqa/ybisk/piqa.py HTTP/1.1" 404 0
2026-07-05 21:50:59 DEBUG: https://huggingface.co:443 "GET /api/datasets/ybisk/piqa/revision/main HTTP/1.1" 200 None
2026-07-05 21:50:59 DEBUG: https://huggingface.co:443 "GET /api/datasets/ybisk/piqa/tree/main?recursive=False&expand=False HTTP/1.1" 200 292
2026-07-05 21:50:59 DEBUG: Attempting to acquire lock 140584410531264 on /root/.cache/huggingface/modules/datasets_modules/datasets/ybisk--piqa.lock
2026-07-05 21:50:59 DEBUG: Lock 140584410531264 acquired on /root/.cache/huggingface/modules/datasets_modules/datasets/ybisk--piqa.lock
2026-07-05 21:50:59 DEBUG: Attempting to release lock 140584410531264 on /root/.cache/huggingface/modules/datasets_modules/datasets/ybisk--piqa.lock
2026-07-05 21:50:59 DEBUG: Lock 140584410531264 released on /root/.cache/huggingface/modules/datasets_modules/datasets/ybisk--piqa.lock
2026-07-05 21:50:59 DEBUG: Attempting to acquire lock 140584410244512 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_ybisk___piqa_plain_text_1.1.0_6c611c1a9bf220943c4174e117d3b660859665baf1d43156230116185312d011.lock
2026-07-05 21:50:59 DEBUG: Lock 140584410244512 acquired on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_ybisk___piqa_plain_text_1.1.0_6c611c1a9bf220943c4174e117d3b660859665baf1d43156230116185312d011.lock
2026-07-05 21:50:59 DEBUG: open file: /root/.cache/huggingface/datasets/ybisk___piqa/plain_text/1.1.0/6c611c1a9bf220943c4174e117d3b660859665baf1d43156230116185312d011/dataset_info.json
2026-07-05 21:50:59 DEBUG: Attempting to release lock 140584410244512 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_ybisk___piqa_plain_text_1.1.0_6c611c1a9bf220943c4174e117d3b660859665baf1d43156230116185312d011.lock
2026-07-05 21:50:59 DEBUG: Lock 140584410244512 released on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_ybisk___piqa_plain_text_1.1.0_6c611c1a9bf220943c4174e117d3b660859665baf1d43156230116185312d011.lock
2026-07-05 21:50:59 DEBUG: Attempting to acquire lock 140590702021712 on /root/.cache/huggingface/modules/datasets_modules/datasets/ybisk--piqa.lock
2026-07-05 21:50:59 DEBUG: Lock 140590702021712 acquired on /root/.cache/huggingface/modules/datasets_modules/datasets/ybisk--piqa.lock
2026-07-05 21:50:59 DEBUG: Attempting to release lock 140590702021712 on /root/.cache/huggingface/modules/datasets_modules/datasets/ybisk--piqa.lock
2026-07-05 21:50:59 DEBUG: Lock 140590702021712 released on /root/.cache/huggingface/modules/datasets_modules/datasets/ybisk--piqa.lock
2026-07-05 21:50:59 DEBUG: Attempting to acquire lock 140590702022672 on /root/.cache/huggingface/datasets/ybisk___piqa/plain_text/1.1.0/6c611c1a9bf220943c4174e117d3b660859665baf1d43156230116185312d011_builder.lock
2026-07-05 21:50:59 DEBUG: Lock 140590702022672 acquired on /root/.cache/huggingface/datasets/ybisk___piqa/plain_text/1.1.0/6c611c1a9bf220943c4174e117d3b660859665baf1d43156230116185312d011_builder.lock
2026-07-05 21:50:59 DEBUG: open file: /root/.cache/huggingface/datasets/ybisk___piqa/plain_text/1.1.0/6c611c1a9bf220943c4174e117d3b660859665baf1d43156230116185312d011/dataset_info.json
2026-07-05 21:50:59 DEBUG: Attempting to release lock 140590702022672 on /root/.cache/huggingface/datasets/ybisk___piqa/plain_text/1.1.0/6c611c1a9bf220943c4174e117d3b660859665baf1d43156230116185312d011_builder.lock
2026-07-05 21:50:59 DEBUG: Lock 140590702022672 released on /root/.cache/huggingface/datasets/ybisk___piqa/plain_text/1.1.0/6c611c1a9bf220943c4174e117d3b660859665baf1d43156230116185312d011_builder.lock
2026-07-05 21:50:59 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmpz9oks1pr
2026-07-05 21:50:59 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmpkwj8n5tc
2026-07-05 21:50:59 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/7ccece8617620f1a958af2e4390b9f21827e86b08a8e067104a69857b50e296d/data-00000-of-00001.arrow
2026-07-05 21:50:59 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/7ccece8617620f1a958af2e4390b9f21827e86b08a8e067104a69857b50e296d/state.json
2026-07-05 21:50:59 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/7ccece8617620f1a958af2e4390b9f21827e86b08a8e067104a69857b50e296d/dataset_info.json
2026-07-05 21:50:59 DEBUG: formatted example: {'goal': ["When boiling butter, when it's ready, you can", 'To permanently attach metal legs to a chair, you can', 'how do you indent something?', 'how do you shake something?', 'Clean tires'], 'sol1': ['Pour it onto a plate', 'Weld the metal together to get it to stay firmly in place', 'leave a space before starting the writing', 'move it up and down and side to side quickly.', 'Pour water, cape off caked on dirt. Use  speed wool to clean out crevices and sparrow spaces.'], 'sol2': ['Pour it into a jar', 'Nail the metal together to get it to stay firmly in place', 'press the spacebar', 'stir it very quickly.', 'Pour water, scrape off caked on dirt. Use a steel wool to clean out crevices and narrow spaces.'], 'label': [1, 0, 0, 0, 1], 'text': ['<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Choose the option that either answers the question, completes the sentence, or solves the problem. Pay attention to the properties of the objects in the question and how they interact with each other. If both options are correct, choose the one that is more convenient or more common.\n\n"""\nWhen boiling butter, when it\'s ready, you can\n"""\n\n0: Pour it onto a plate\n1: Pour it into a jar\n\nYou must respond with either `0` or `1` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>1<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Choose the option that either answers the question, completes the sentence, or solves the problem. Pay attention to the properties of the objects in the question and how they interact with each other. If both options are correct, choose the one that is more convenient or more common.\n\n"""\nTo permanently attach metal legs to a chair, you can\n"""\n\n0: Weld the metal together to get it to stay firmly in place\n1: Nail the metal together to get it to stay firmly in place\n\nYou must respond with either `0` or `1` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>0<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Choose the option that either answers the question, completes the sentence, or solves the problem. Pay attention to the properties of the objects in the question and how they interact with each other. If both options are correct, choose the one that is more convenient or more common.\n\n"""\nhow do you indent something?\n"""\n\n0: leave a space before starting the writing\n1: press the spacebar\n\nYou must respond with either `0` or `1` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>0<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Choose the option that either answers the question, completes the sentence, or solves the problem. Pay attention to the properties of the objects in the question and how they interact with each other. If both options are correct, choose the one that is more convenient or more common.\n\n"""\nhow do you shake something?\n"""\n\n0: move it up and down and side to side quickly.\n1: stir it very quickly.\n\nYou must respond with either `0` or `1` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>0<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Choose the option that either answers the question, completes the sentence, or solves the problem. Pay attention to the properties of the objects in the question and how they interact with each other. If both options are correct, choose the one that is more convenient or more common.\n\n"""\nClean tires\n"""\n\n0: Pour water, cape off caked on dirt. Use  speed wool to clean out crevices and sparrow spaces.\n1: Pour water, scrape off caked on dirt. Use a steel wool to clean out crevices and narrow spaces.\n\nYou must respond with either `0` or `1` without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>1<|eot_id|>']}
2026-07-05 21:50:59 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmph906mn0o
2026-07-05 21:50:59 DEBUG: tokenized example: {'input_ids': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 25017, 279, 3072, 430, 3060, 11503, 279, 3488, 11, 45695, 279, 11914, 11, 477, 68577, 279, 3575, 13, 11728, 6666, 311, 279, 6012, 315, 279, 6302, 304, 279, 3488, 323, 1268, 814, 16681, 449, 1855, 1023, 13, 1442, 2225, 2671, 527, 4495, 11, 5268, 279, 832, 430, 374, 810, 17125, 477, 810, 4279, 382, 7275, 4599, 50937, 14432, 11, 994, 433, 596, 5644, 11, 499, 649, 198, 15425, 15, 25, 27058, 433, 8800, 264, 12235, 198, 16, 25, 27058, 433, 1139, 264, 30695, 271, 2675, 2011, 6013, 449, 3060, 1595, 15, 63, 477, 1595, 16, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 16, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 25017, 279, 3072, 430, 3060, 11503, 279, 3488, 11, 45695, 279, 11914, 11, 477, 68577, 279, 3575, 13, 11728, 6666, 311, 279, 6012, 315, 279, 6302, 304, 279, 3488, 323, 1268, 814, 16681, 449, 1855, 1023, 13, 1442, 2225, 2671, 527, 4495, 11, 5268, 279, 832, 430, 374, 810, 17125, 477, 810, 4279, 382, 7275, 1271, 31859, 15866, 9501, 14535, 311, 264, 10716, 11, 499, 649, 198, 15425, 15, 25, 61586, 279, 9501, 3871, 311, 636, 433, 311, 4822, 32620, 304, 2035, 198, 16, 25, 75528, 279, 9501, 3871, 311, 636, 433, 311, 4822, 32620, 304, 2035, 271, 2675, 2011, 6013, 449, 3060, 1595, 15, 63, 477, 1595, 16, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 15, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 25017, 279, 3072, 430, 3060, 11503, 279, 3488, 11, 45695, 279, 11914, 11, 477, 68577, 279, 3575, 13, 11728, 6666, 311, 279, 6012, 315, 279, 6302, 304, 279, 3488, 323, 1268, 814, 16681, 449, 1855, 1023, 13, 1442, 2225, 2671, 527, 4495, 11, 5268, 279, 832, 430, 374, 810, 17125, 477, 810, 4279, 382, 7275, 5269, 656, 499, 17962, 2555, 5380, 15425, 15, 25, 5387, 264, 3634, 1603, 6041, 279, 4477, 198, 16, 25, 3577, 279, 3634, 2308, 271, 2675, 2011, 6013, 449, 3060, 1595, 15, 63, 477, 1595, 16, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 15, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 25017, 279, 3072, 430, 3060, 11503, 279, 3488, 11, 45695, 279, 11914, 11, 477, 68577, 279, 3575, 13, 11728, 6666, 311, 279, 6012, 315, 279, 6302, 304, 279, 3488, 323, 1268, 814, 16681, 449, 1855, 1023, 13, 1442, 2225, 2671, 527, 4495, 11, 5268, 279, 832, 430, 374, 810, 17125, 477, 810, 4279, 382, 7275, 5269, 656, 499, 27116, 2555, 5380, 15425, 15, 25, 3351, 433, 709, 323, 1523, 323, 3185, 311, 3185, 6288, 627, 16, 25, 23935, 433, 1633, 6288, 382, 2675, 2011, 6013, 449, 3060, 1595, 15, 63, 477, 1595, 16, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 15, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 25017, 279, 3072, 430, 3060, 11503, 279, 3488, 11, 45695, 279, 11914, 11, 477, 68577, 279, 3575, 13, 11728, 6666, 311, 279, 6012, 315, 279, 6302, 304, 279, 3488, 323, 1268, 814, 16681, 449, 1855, 1023, 13, 1442, 2225, 2671, 527, 4495, 11, 5268, 279, 832, 430, 374, 810, 17125, 477, 810, 4279, 382, 7275, 28629, 31800, 198, 15425, 15, 25, 27058, 3090, 11, 65392, 1022, 272, 7897, 389, 26351, 13, 5560, 220, 4732, 39640, 311, 4335, 704, 1922, 85, 1238, 323, 993, 6172, 12908, 627, 16, 25, 27058, 3090, 11, 58228, 1022, 272, 7897, 389, 26351, 13, 5560, 264, 9699, 39640, 311, 4335, 704, 1922, 85, 1238, 323, 15376, 12908, 382, 2675, 2011, 6013, 449, 3060, 1595, 15, 63, 477, 1595, 16, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 16, 128009]], 'attention_mask': [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]], 'labels': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 25017, 279, 3072, 430, 3060, 11503, 279, 3488, 11, 45695, 279, 11914, 11, 477, 68577, 279, 3575, 13, 11728, 6666, 311, 279, 6012, 315, 279, 6302, 304, 279, 3488, 323, 1268, 814, 16681, 449, 1855, 1023, 13, 1442, 2225, 2671, 527, 4495, 11, 5268, 279, 832, 430, 374, 810, 17125, 477, 810, 4279, 382, 7275, 4599, 50937, 14432, 11, 994, 433, 596, 5644, 11, 499, 649, 198, 15425, 15, 25, 27058, 433, 8800, 264, 12235, 198, 16, 25, 27058, 433, 1139, 264, 30695, 271, 2675, 2011, 6013, 449, 3060, 1595, 15, 63, 477, 1595, 16, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 16, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 25017, 279, 3072, 430, 3060, 11503, 279, 3488, 11, 45695, 279, 11914, 11, 477, 68577, 279, 3575, 13, 11728, 6666, 311, 279, 6012, 315, 279, 6302, 304, 279, 3488, 323, 1268, 814, 16681, 449, 1855, 1023, 13, 1442, 2225, 2671, 527, 4495, 11, 5268, 279, 832, 430, 374, 810, 17125, 477, 810, 4279, 382, 7275, 1271, 31859, 15866, 9501, 14535, 311, 264, 10716, 11, 499, 649, 198, 15425, 15, 25, 61586, 279, 9501, 3871, 311, 636, 433, 311, 4822, 32620, 304, 2035, 198, 16, 25, 75528, 279, 9501, 3871, 311, 636, 433, 311, 4822, 32620, 304, 2035, 271, 2675, 2011, 6013, 449, 3060, 1595, 15, 63, 477, 1595, 16, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 15, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 25017, 279, 3072, 430, 3060, 11503, 279, 3488, 11, 45695, 279, 11914, 11, 477, 68577, 279, 3575, 13, 11728, 6666, 311, 279, 6012, 315, 279, 6302, 304, 279, 3488, 323, 1268, 814, 16681, 449, 1855, 1023, 13, 1442, 2225, 2671, 527, 4495, 11, 5268, 279, 832, 430, 374, 810, 17125, 477, 810, 4279, 382, 7275, 5269, 656, 499, 17962, 2555, 5380, 15425, 15, 25, 5387, 264, 3634, 1603, 6041, 279, 4477, 198, 16, 25, 3577, 279, 3634, 2308, 271, 2675, 2011, 6013, 449, 3060, 1595, 15, 63, 477, 1595, 16, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 15, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 25017, 279, 3072, 430, 3060, 11503, 279, 3488, 11, 45695, 279, 11914, 11, 477, 68577, 279, 3575, 13, 11728, 6666, 311, 279, 6012, 315, 279, 6302, 304, 279, 3488, 323, 1268, 814, 16681, 449, 1855, 1023, 13, 1442, 2225, 2671, 527, 4495, 11, 5268, 279, 832, 430, 374, 810, 17125, 477, 810, 4279, 382, 7275, 5269, 656, 499, 27116, 2555, 5380, 15425, 15, 25, 3351, 433, 709, 323, 1523, 323, 3185, 311, 3185, 6288, 627, 16, 25, 23935, 433, 1633, 6288, 382, 2675, 2011, 6013, 449, 3060, 1595, 15, 63, 477, 1595, 16, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 15, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 25017, 279, 3072, 430, 3060, 11503, 279, 3488, 11, 45695, 279, 11914, 11, 477, 68577, 279, 3575, 13, 11728, 6666, 311, 279, 6012, 315, 279, 6302, 304, 279, 3488, 323, 1268, 814, 16681, 449, 1855, 1023, 13, 1442, 2225, 2671, 527, 4495, 11, 5268, 279, 832, 430, 374, 810, 17125, 477, 810, 4279, 382, 7275, 28629, 31800, 198, 15425, 15, 25, 27058, 3090, 11, 65392, 1022, 272, 7897, 389, 26351, 13, 5560, 220, 4732, 39640, 311, 4335, 704, 1922, 85, 1238, 323, 993, 6172, 12908, 627, 16, 25, 27058, 3090, 11, 58228, 1022, 272, 7897, 389, 26351, 13, 5560, 264, 9699, 39640, 311, 4335, 704, 1922, 85, 1238, 323, 15376, 12908, 382, 2675, 2011, 6013, 449, 3060, 1595, 15, 63, 477, 1595, 16, 63, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 16, 128009]]}
2026-07-05 21:50:59 DEBUG: Saving preprocessed dataset: 01cbc6163414ae6fcc8baff1b24c400c9b9f7dc29fe0d716f775fcdea50e2547
2026-07-05 21:50:59 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/01cbc6163414ae6fcc8baff1b24c400c9b9f7dc29fe0d716f775fcdea50e2547/data-00000-of-00001.arrow
2026-07-05 21:50:59 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/01cbc6163414ae6fcc8baff1b24c400c9b9f7dc29fe0d716f775fcdea50e2547/state.json
2026-07-05 21:50:59 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/01cbc6163414ae6fcc8baff1b24c400c9b9f7dc29fe0d716f775fcdea50e2547/dataset_info.json
2026-07-05 21:50:59 DEBUG: ds_name: hellaswag, ds_kwargs: {'path': 'Rowan/hellaswag', 'split': 'train[:250]'}
2026-07-05 21:51:00 DEBUG: https://huggingface.co:443 "GET /api/datasets/Rowan/hellaswag HTTP/1.1" 200 None
2026-07-05 21:51:00 DEBUG: Starting new HTTPS connection (1): s3.amazonaws.com:443
2026-07-05 21:51:00 DEBUG: https://s3.amazonaws.com:443 "HEAD /datasets.huggingface.co/datasets/datasets/Rowan/hellaswag/Rowan/hellaswag.py HTTP/1.1" 404 0
2026-07-05 21:51:00 DEBUG: https://huggingface.co:443 "GET /api/datasets/Rowan/hellaswag HTTP/1.1" 200 None
2026-07-05 21:51:00 DEBUG: https://huggingface.co:443 "GET /api/datasets/Rowan/hellaswag/revision/218ec52e09a7e7462a5400043bb9a69a41d06b76 HTTP/1.1" 200 None
2026-07-05 21:51:00 DEBUG: https://huggingface.co:443 "GET /api/datasets/Rowan/hellaswag/tree/218ec52e09a7e7462a5400043bb9a69a41d06b76?recursive=False&expand=False HTTP/1.1" 200 291
2026-07-05 21:51:00 DEBUG: Starting new HTTPS connection (1): datasets-server.huggingface.co:443
2026-07-05 21:51:00 DEBUG: https://datasets-server.huggingface.co:443 "GET /info?dataset=Rowan/hellaswag HTTP/1.1" 200 None
2026-07-05 21:51:00 DEBUG: https://huggingface.co:443 "GET /api/datasets/Rowan/hellaswag/tree/218ec52e09a7e7462a5400043bb9a69a41d06b76/data?recursive=True&expand=False HTTP/1.1" 200 949
2026-07-05 21:51:00 DEBUG: https://huggingface.co:443 "GET /api/datasets/Rowan/hellaswag/revision/218ec52e09a7e7462a5400043bb9a69a41d06b76 HTTP/1.1" 200 None
2026-07-05 21:51:00 DEBUG: Attempting to acquire lock 140584816078304 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_Rowan___hellaswag_default_0.0.0_218ec52e09a7e7462a5400043bb9a69a41d06b76.lock
2026-07-05 21:51:00 DEBUG: Lock 140584816078304 acquired on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_Rowan___hellaswag_default_0.0.0_218ec52e09a7e7462a5400043bb9a69a41d06b76.lock
2026-07-05 21:51:00 DEBUG: open file: /root/.cache/huggingface/datasets/Rowan___hellaswag/default/0.0.0/218ec52e09a7e7462a5400043bb9a69a41d06b76/dataset_info.json
2026-07-05 21:51:00 DEBUG: Attempting to release lock 140584816078304 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_Rowan___hellaswag_default_0.0.0_218ec52e09a7e7462a5400043bb9a69a41d06b76.lock
2026-07-05 21:51:00 DEBUG: Lock 140584816078304 released on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_Rowan___hellaswag_default_0.0.0_218ec52e09a7e7462a5400043bb9a69a41d06b76.lock
2026-07-05 21:51:00 DEBUG: Attempting to acquire lock 140584410419312 on /root/.cache/huggingface/datasets/Rowan___hellaswag/default/0.0.0/218ec52e09a7e7462a5400043bb9a69a41d06b76_builder.lock
2026-07-05 21:51:00 DEBUG: Lock 140584410419312 acquired on /root/.cache/huggingface/datasets/Rowan___hellaswag/default/0.0.0/218ec52e09a7e7462a5400043bb9a69a41d06b76_builder.lock
2026-07-05 21:51:00 DEBUG: open file: /root/.cache/huggingface/datasets/Rowan___hellaswag/default/0.0.0/218ec52e09a7e7462a5400043bb9a69a41d06b76/dataset_info.json
2026-07-05 21:51:00 DEBUG: Attempting to release lock 140584410419312 on /root/.cache/huggingface/datasets/Rowan___hellaswag/default/0.0.0/218ec52e09a7e7462a5400043bb9a69a41d06b76_builder.lock
2026-07-05 21:51:00 DEBUG: Lock 140584410419312 released on /root/.cache/huggingface/datasets/Rowan___hellaswag/default/0.0.0/218ec52e09a7e7462a5400043bb9a69a41d06b76_builder.lock
2026-07-05 21:51:01 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmp7vh_m3nm
2026-07-05 21:51:01 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmpd03t6jkv
2026-07-05 21:51:01 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/9c2d6f54ec0120ca89a7b2e933b846e9c5afb94a8f27219ee745ed878634a733/data-00000-of-00001.arrow
2026-07-05 21:51:01 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/9c2d6f54ec0120ca89a7b2e933b846e9c5afb94a8f27219ee745ed878634a733/state.json
2026-07-05 21:51:01 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/9c2d6f54ec0120ca89a7b2e933b846e9c5afb94a8f27219ee745ed878634a733/dataset_info.json
2026-07-05 21:51:01 DEBUG: formatted example: {'ind': [4, 8, 9, 12, 27], 'activity_label': ['Removing ice from car', 'Baking cookies', 'Baking cookies', 'Baking cookies', 'Getting a haircut'], 'ctx_a': ['Then, the man writes over the snow covering the window of a car, and a woman wearing winter clothes smiles.', 'A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them.', 'A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven.', 'A tray of potatoes is loaded into the oven and removed. A large tray of cake is flipped over and placed on counter.', 'The man in the center is demonstrating a hairstyle on the person wearing the blue shirt.'], 'ctx_b': ['then', 'the pans', 'a knife', 'a large tray of meat', 'the man in the blue shirt'], 'ctx': ['Then, the man writes over the snow covering the window of a car, and a woman wearing winter clothes smiles. then', 'A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. the pans', 'A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. a knife', 'A tray of potatoes is loaded into the oven and removed. A large tray of cake is flipped over and placed on counter. a large tray of meat', 'The man in the center is demonstrating a hairstyle on the person wearing the blue shirt. the man in the blue shirt'], 'endings': [[', the man adds wax to the windshield and cuts it.', ', a person board a ski lift, while two men supporting the head of the person wearing winter clothes snow as the we girls sled.', ', the man puts on a christmas coat, knitted with netting.', ', the man continues removing the snow on his car.'], ['contain egg yolks and baking soda.', 'are then sprinkled with brown sugar.', 'are placed in a strainer on the counter.', 'are filled with pastries and loaded into the oven.'], ['is seen moving on a board and cutting out its contents.', 'hits the peeled cheesecake, followed by sliced custard and still cooked ice cream.', 'etches a shape into the inside of the baked pans.', 'is used to cut cylinder shaped dough into rounds.'], ['is placed onto a baked potato.', ', ls, and pickles are placed in the oven.', 'is poured into a midden.', 'is prepared then it is removed from the oven by a helper when done.'], ['is standing on the sponge cutting the hair of the person wearing the blue shirt.', 'is doing the hairstyle with his hand and the hairspray.', 'sits on the chair next to the sink.', 'is being shown eye to eye.']], 'source_id': ['activitynet~v_-1IBHYS3L-Y', 'activitynet~v_-2dxp-mv2zo', 'activitynet~v_-2dxp-mv2zo', 'activitynet~v_-2dxp-mv2zo', 'activitynet~v_-JqLjPz-07E'], 'split': ['train', 'train', 'train', 'train', 'train'], 'split_type': ['indomain', 'indomain', 'indomain', 'indomain', 'indomain'], 'label': ['3', '3', '3', '3', '2'], 'text': ['<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>You are provided with an incomplete passage below as well as 4 choices of continuation with only one of them being the correct ending. Treat the endings as being labelled 0, 1, 2, 3 in order.\n\nPassage: Then, the man writes over the snow covering the window of a car, and a woman wearing winter clothes smiles. then\n\n0: , the man adds wax to the windshield and cuts it.\n1: , a person board a ski lift, while two men supporting the head of the person wearing winter clothes snow as the we girls sled.\n2: , the man puts on a christmas coat, knitted with netting.\n3: , the man continues removing the snow on his car.\n\nYou must respond with the only number corresponding to the correct ending (0,1,2,3) for the passage without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>3<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>You are provided with an incomplete passage below as well as 4 choices of continuation with only one of them being the correct ending. Treat the endings as being labelled 0, 1, 2, 3 in order.\n\nPassage: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. the pans\n\n0: contain egg yolks and baking soda.\n1: are then sprinkled with brown sugar.\n2: are placed in a strainer on the counter.\n3: are filled with pastries and loaded into the oven.\n\nYou must respond with the only number corresponding to the correct ending (0,1,2,3) for the passage without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>3<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>You are provided with an incomplete passage below as well as 4 choices of continuation with only one of them being the correct ending. Treat the endings as being labelled 0, 1, 2, 3 in order.\n\nPassage: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. a knife\n\n0: is seen moving on a board and cutting out its contents.\n1: hits the peeled cheesecake, followed by sliced custard and still cooked ice cream.\n2: etches a shape into the inside of the baked pans.\n3: is used to cut cylinder shaped dough into rounds.\n\nYou must respond with the only number corresponding to the correct ending (0,1,2,3) for the passage without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>3<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>You are provided with an incomplete passage below as well as 4 choices of continuation with only one of them being the correct ending. Treat the endings as being labelled 0, 1, 2, 3 in order.\n\nPassage: A tray of potatoes is loaded into the oven and removed. A large tray of cake is flipped over and placed on counter. a large tray of meat\n\n0: is placed onto a baked potato.\n1: , ls, and pickles are placed in the oven.\n2: is poured into a midden.\n3: is prepared then it is removed from the oven by a helper when done.\n\nYou must respond with the only number corresponding to the correct ending (0,1,2,3) for the passage without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>3<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>You are provided with an incomplete passage below as well as 4 choices of continuation with only one of them being the correct ending. Treat the endings as being labelled 0, 1, 2, 3 in order.\n\nPassage: The man in the center is demonstrating a hairstyle on the person wearing the blue shirt. the man in the blue shirt\n\n0: is standing on the sponge cutting the hair of the person wearing the blue shirt.\n1: is doing the hairstyle with his hand and the hairspray.\n2: sits on the chair next to the sink.\n3: is being shown eye to eye.\n\nYou must respond with the only number corresponding to the correct ending (0,1,2,3) for the passage without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>2<|eot_id|>']}
2026-07-05 21:51:01 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmpak4jwo_x
2026-07-05 21:51:01 DEBUG: tokenized example: {'input_ids': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2675, 527, 3984, 449, 459, 33243, 21765, 3770, 439, 1664, 439, 220, 19, 11709, 315, 42271, 449, 1193, 832, 315, 1124, 1694, 279, 4495, 13696, 13, 19409, 279, 77697, 439, 1694, 61336, 220, 15, 11, 220, 16, 11, 220, 17, 11, 220, 18, 304, 2015, 382, 12465, 425, 25, 5112, 11, 279, 893, 14238, 927, 279, 12056, 18702, 279, 3321, 315, 264, 1841, 11, 323, 264, 5333, 12512, 12688, 15447, 43632, 13, 1243, 271, 15, 25, 1174, 279, 893, 11621, 37123, 311, 279, 75039, 323, 15455, 433, 627, 16, 25, 1174, 264, 1732, 4580, 264, 29779, 12157, 11, 1418, 1403, 3026, 12899, 279, 2010, 315, 279, 1732, 12512, 12688, 15447, 12056, 439, 279, 584, 7724, 95512, 627, 17, 25, 1174, 279, 893, 9711, 389, 264, 54302, 23724, 11, 1168, 3847, 449, 4272, 1303, 627, 18, 25, 1174, 279, 893, 9731, 18054, 279, 12056, 389, 813, 1841, 382, 2675, 2011, 6013, 449, 279, 1193, 1396, 12435, 311, 279, 4495, 13696, 320, 15, 11, 16, 11, 17, 11, 18, 8, 369, 279, 21765, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 18, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2675, 527, 3984, 449, 459, 33243, 21765, 3770, 439, 1664, 439, 220, 19, 11709, 315, 42271, 449, 1193, 832, 315, 1124, 1694, 279, 4495, 13696, 13, 19409, 279, 77697, 439, 1694, 61336, 220, 15, 11, 220, 16, 11, 220, 17, 11, 220, 18, 304, 2015, 382, 12465, 425, 25, 362, 8954, 30806, 304, 4251, 14113, 5039, 264, 5729, 315, 28915, 64883, 304, 264, 3544, 9979, 32644, 1124, 13, 279, 64883, 271, 15, 25, 6782, 19151, 94582, 2857, 323, 28915, 39962, 627, 16, 25, 527, 1243, 51798, 839, 449, 14198, 13465, 627, 17, 25, 527, 9277, 304, 264, 610, 1780, 389, 279, 5663, 627, 18, 25, 527, 10409, 449, 3347, 4108, 323, 6799, 1139, 279, 24276, 382, 2675, 2011, 6013, 449, 279, 1193, 1396, 12435, 311, 279, 4495, 13696, 320, 15, 11, 16, 11, 17, 11, 18, 8, 369, 279, 21765, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 18, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2675, 527, 3984, 449, 459, 33243, 21765, 3770, 439, 1664, 439, 220, 19, 11709, 315, 42271, 449, 1193, 832, 315, 1124, 1694, 279, 4495, 13696, 13, 19409, 279, 77697, 439, 1694, 61336, 220, 15, 11, 220, 16, 11, 220, 17, 11, 220, 18, 304, 2015, 382, 12465, 425, 25, 362, 8954, 30806, 304, 4251, 14113, 5039, 264, 5729, 315, 28915, 64883, 304, 264, 3544, 9979, 32644, 1124, 13, 578, 64883, 527, 10409, 449, 3347, 4108, 323, 6799, 1139, 279, 24276, 13, 264, 22145, 271, 15, 25, 374, 3970, 7366, 389, 264, 4580, 323, 14713, 704, 1202, 8970, 627, 16, 25, 13280, 279, 83612, 43932, 79356, 11, 8272, 555, 48715, 16973, 569, 323, 2103, 30205, 10054, 12932, 627, 17, 25, 1880, 8696, 264, 6211, 1139, 279, 4871, 315, 279, 41778, 64883, 627, 18, 25, 374, 1511, 311, 4018, 35664, 27367, 31452, 1139, 20101, 382, 2675, 2011, 6013, 449, 279, 1193, 1396, 12435, 311, 279, 4495, 13696, 320, 15, 11, 16, 11, 17, 11, 18, 8, 369, 279, 21765, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 18, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2675, 527, 3984, 449, 459, 33243, 21765, 3770, 439, 1664, 439, 220, 19, 11709, 315, 42271, 449, 1193, 832, 315, 1124, 1694, 279, 4495, 13696, 13, 19409, 279, 77697, 439, 1694, 61336, 220, 15, 11, 220, 16, 11, 220, 17, 11, 220, 18, 304, 2015, 382, 12465, 425, 25, 362, 35788, 315, 35267, 374, 6799, 1139, 279, 24276, 323, 7108, 13, 362, 3544, 35788, 315, 19692, 374, 47180, 927, 323, 9277, 389, 5663, 13, 264, 3544, 35788, 315, 13339, 271, 15, 25, 374, 9277, 8800, 264, 41778, 39834, 627, 16, 25, 1174, 20170, 11, 323, 3820, 645, 527, 9277, 304, 279, 24276, 627, 17, 25, 374, 44033, 1139, 264, 296, 2924, 627, 18, 25, 374, 10235, 1243, 433, 374, 7108, 505, 279, 24276, 555, 264, 13438, 994, 2884, 382, 2675, 2011, 6013, 449, 279, 1193, 1396, 12435, 311, 279, 4495, 13696, 320, 15, 11, 16, 11, 17, 11, 18, 8, 369, 279, 21765, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 18, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2675, 527, 3984, 449, 459, 33243, 21765, 3770, 439, 1664, 439, 220, 19, 11709, 315, 42271, 449, 1193, 832, 315, 1124, 1694, 279, 4495, 13696, 13, 19409, 279, 77697, 439, 1694, 61336, 220, 15, 11, 220, 16, 11, 220, 17, 11, 220, 18, 304, 2015, 382, 12465, 425, 25, 578, 893, 304, 279, 4219, 374, 45296, 264, 96235, 389, 279, 1732, 12512, 279, 6437, 15845, 13, 279, 893, 304, 279, 6437, 15845, 271, 15, 25, 374, 11509, 389, 279, 69448, 14713, 279, 7013, 315, 279, 1732, 12512, 279, 6437, 15845, 627, 16, 25, 374, 3815, 279, 96235, 449, 813, 1450, 323, 279, 66060, 91704, 627, 17, 25, 23874, 389, 279, 10716, 1828, 311, 279, 19868, 627, 18, 25, 374, 1694, 6982, 8071, 311, 8071, 382, 2675, 2011, 6013, 449, 279, 1193, 1396, 12435, 311, 279, 4495, 13696, 320, 15, 11, 16, 11, 17, 11, 18, 8, 369, 279, 21765, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 17, 128009]], 'attention_mask': [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]], 'labels': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2675, 527, 3984, 449, 459, 33243, 21765, 3770, 439, 1664, 439, 220, 19, 11709, 315, 42271, 449, 1193, 832, 315, 1124, 1694, 279, 4495, 13696, 13, 19409, 279, 77697, 439, 1694, 61336, 220, 15, 11, 220, 16, 11, 220, 17, 11, 220, 18, 304, 2015, 382, 12465, 425, 25, 5112, 11, 279, 893, 14238, 927, 279, 12056, 18702, 279, 3321, 315, 264, 1841, 11, 323, 264, 5333, 12512, 12688, 15447, 43632, 13, 1243, 271, 15, 25, 1174, 279, 893, 11621, 37123, 311, 279, 75039, 323, 15455, 433, 627, 16, 25, 1174, 264, 1732, 4580, 264, 29779, 12157, 11, 1418, 1403, 3026, 12899, 279, 2010, 315, 279, 1732, 12512, 12688, 15447, 12056, 439, 279, 584, 7724, 95512, 627, 17, 25, 1174, 279, 893, 9711, 389, 264, 54302, 23724, 11, 1168, 3847, 449, 4272, 1303, 627, 18, 25, 1174, 279, 893, 9731, 18054, 279, 12056, 389, 813, 1841, 382, 2675, 2011, 6013, 449, 279, 1193, 1396, 12435, 311, 279, 4495, 13696, 320, 15, 11, 16, 11, 17, 11, 18, 8, 369, 279, 21765, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 18, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2675, 527, 3984, 449, 459, 33243, 21765, 3770, 439, 1664, 439, 220, 19, 11709, 315, 42271, 449, 1193, 832, 315, 1124, 1694, 279, 4495, 13696, 13, 19409, 279, 77697, 439, 1694, 61336, 220, 15, 11, 220, 16, 11, 220, 17, 11, 220, 18, 304, 2015, 382, 12465, 425, 25, 362, 8954, 30806, 304, 4251, 14113, 5039, 264, 5729, 315, 28915, 64883, 304, 264, 3544, 9979, 32644, 1124, 13, 279, 64883, 271, 15, 25, 6782, 19151, 94582, 2857, 323, 28915, 39962, 627, 16, 25, 527, 1243, 51798, 839, 449, 14198, 13465, 627, 17, 25, 527, 9277, 304, 264, 610, 1780, 389, 279, 5663, 627, 18, 25, 527, 10409, 449, 3347, 4108, 323, 6799, 1139, 279, 24276, 382, 2675, 2011, 6013, 449, 279, 1193, 1396, 12435, 311, 279, 4495, 13696, 320, 15, 11, 16, 11, 17, 11, 18, 8, 369, 279, 21765, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 18, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2675, 527, 3984, 449, 459, 33243, 21765, 3770, 439, 1664, 439, 220, 19, 11709, 315, 42271, 449, 1193, 832, 315, 1124, 1694, 279, 4495, 13696, 13, 19409, 279, 77697, 439, 1694, 61336, 220, 15, 11, 220, 16, 11, 220, 17, 11, 220, 18, 304, 2015, 382, 12465, 425, 25, 362, 8954, 30806, 304, 4251, 14113, 5039, 264, 5729, 315, 28915, 64883, 304, 264, 3544, 9979, 32644, 1124, 13, 578, 64883, 527, 10409, 449, 3347, 4108, 323, 6799, 1139, 279, 24276, 13, 264, 22145, 271, 15, 25, 374, 3970, 7366, 389, 264, 4580, 323, 14713, 704, 1202, 8970, 627, 16, 25, 13280, 279, 83612, 43932, 79356, 11, 8272, 555, 48715, 16973, 569, 323, 2103, 30205, 10054, 12932, 627, 17, 25, 1880, 8696, 264, 6211, 1139, 279, 4871, 315, 279, 41778, 64883, 627, 18, 25, 374, 1511, 311, 4018, 35664, 27367, 31452, 1139, 20101, 382, 2675, 2011, 6013, 449, 279, 1193, 1396, 12435, 311, 279, 4495, 13696, 320, 15, 11, 16, 11, 17, 11, 18, 8, 369, 279, 21765, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 18, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2675, 527, 3984, 449, 459, 33243, 21765, 3770, 439, 1664, 439, 220, 19, 11709, 315, 42271, 449, 1193, 832, 315, 1124, 1694, 279, 4495, 13696, 13, 19409, 279, 77697, 439, 1694, 61336, 220, 15, 11, 220, 16, 11, 220, 17, 11, 220, 18, 304, 2015, 382, 12465, 425, 25, 362, 35788, 315, 35267, 374, 6799, 1139, 279, 24276, 323, 7108, 13, 362, 3544, 35788, 315, 19692, 374, 47180, 927, 323, 9277, 389, 5663, 13, 264, 3544, 35788, 315, 13339, 271, 15, 25, 374, 9277, 8800, 264, 41778, 39834, 627, 16, 25, 1174, 20170, 11, 323, 3820, 645, 527, 9277, 304, 279, 24276, 627, 17, 25, 374, 44033, 1139, 264, 296, 2924, 627, 18, 25, 374, 10235, 1243, 433, 374, 7108, 505, 279, 24276, 555, 264, 13438, 994, 2884, 382, 2675, 2011, 6013, 449, 279, 1193, 1396, 12435, 311, 279, 4495, 13696, 320, 15, 11, 16, 11, 17, 11, 18, 8, 369, 279, 21765, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 18, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 2675, 527, 3984, 449, 459, 33243, 21765, 3770, 439, 1664, 439, 220, 19, 11709, 315, 42271, 449, 1193, 832, 315, 1124, 1694, 279, 4495, 13696, 13, 19409, 279, 77697, 439, 1694, 61336, 220, 15, 11, 220, 16, 11, 220, 17, 11, 220, 18, 304, 2015, 382, 12465, 425, 25, 578, 893, 304, 279, 4219, 374, 45296, 264, 96235, 389, 279, 1732, 12512, 279, 6437, 15845, 13, 279, 893, 304, 279, 6437, 15845, 271, 15, 25, 374, 11509, 389, 279, 69448, 14713, 279, 7013, 315, 279, 1732, 12512, 279, 6437, 15845, 627, 16, 25, 374, 3815, 279, 96235, 449, 813, 1450, 323, 279, 66060, 91704, 627, 17, 25, 23874, 389, 279, 10716, 1828, 311, 279, 19868, 627, 18, 25, 374, 1694, 6982, 8071, 311, 8071, 382, 2675, 2011, 6013, 449, 279, 1193, 1396, 12435, 311, 279, 4495, 13696, 320, 15, 11, 16, 11, 17, 11, 18, 8, 369, 279, 21765, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 17, 128009]]}
2026-07-05 21:51:01 DEBUG: Saving preprocessed dataset: 76ed8b027fc679f1e807424e26da05dd6610c636b23513c03a566c3807a6790d
2026-07-05 21:51:01 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/76ed8b027fc679f1e807424e26da05dd6610c636b23513c03a566c3807a6790d/data-00000-of-00001.arrow
2026-07-05 21:51:01 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/76ed8b027fc679f1e807424e26da05dd6610c636b23513c03a566c3807a6790d/state.json
2026-07-05 21:51:01 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/76ed8b027fc679f1e807424e26da05dd6610c636b23513c03a566c3807a6790d/dataset_info.json
2026-07-05 21:51:01 DEBUG: ds_name: arc_easy, ds_kwargs: {'name': 'ARC-Easy', 'path': 'allenai/ai2_arc', 'split': 'train[:250]'}
2026-07-05 21:51:01 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/ai2_arc HTTP/1.1" 200 None
2026-07-05 21:51:01 DEBUG: Starting new HTTPS connection (1): s3.amazonaws.com:443
2026-07-05 21:51:02 DEBUG: https://s3.amazonaws.com:443 "HEAD /datasets.huggingface.co/datasets/datasets/allenai/ai2_arc/allenai/ai2_arc.py HTTP/1.1" 404 0
2026-07-05 21:51:02 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/ai2_arc HTTP/1.1" 200 None
2026-07-05 21:51:02 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/ai2_arc/revision/210d026faf9955653af8916fad021475a3f00453 HTTP/1.1" 200 None
2026-07-05 21:51:02 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/ai2_arc/tree/210d026faf9955653af8916fad021475a3f00453?recursive=False&expand=False HTTP/1.1" 200 397
2026-07-05 21:51:02 DEBUG: Starting new HTTPS connection (1): datasets-server.huggingface.co:443
2026-07-05 21:51:02 DEBUG: https://datasets-server.huggingface.co:443 "GET /info?dataset=allenai/ai2_arc HTTP/1.1" 200 None
2026-07-05 21:51:02 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/ai2_arc/tree/210d026faf9955653af8916fad021475a3f00453/ARC-Challenge?recursive=True&expand=False HTTP/1.1" 200 966
2026-07-05 21:51:02 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/ai2_arc/revision/210d026faf9955653af8916fad021475a3f00453 HTTP/1.1" 200 None
2026-07-05 21:51:02 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/ai2_arc/tree/210d026faf9955653af8916fad021475a3f00453/ARC-Easy?recursive=True&expand=False HTTP/1.1" 200 951
2026-07-05 21:51:02 DEBUG: Attempting to acquire lock 140584409505408 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___ai2_arc_ARC-Easy_0.0.0_210d026faf9955653af8916fad021475a3f00453.lock
2026-07-05 21:51:02 DEBUG: Lock 140584409505408 acquired on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___ai2_arc_ARC-Easy_0.0.0_210d026faf9955653af8916fad021475a3f00453.lock
2026-07-05 21:51:02 DEBUG: open file: /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Easy/0.0.0/210d026faf9955653af8916fad021475a3f00453/dataset_info.json
2026-07-05 21:51:02 DEBUG: Attempting to release lock 140584409505408 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___ai2_arc_ARC-Easy_0.0.0_210d026faf9955653af8916fad021475a3f00453.lock
2026-07-05 21:51:02 DEBUG: Lock 140584409505408 released on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___ai2_arc_ARC-Easy_0.0.0_210d026faf9955653af8916fad021475a3f00453.lock
2026-07-05 21:51:02 DEBUG: Attempting to acquire lock 140584200434560 on /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Easy/0.0.0/210d026faf9955653af8916fad021475a3f00453_builder.lock
2026-07-05 21:51:02 DEBUG: Lock 140584200434560 acquired on /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Easy/0.0.0/210d026faf9955653af8916fad021475a3f00453_builder.lock
2026-07-05 21:51:02 DEBUG: open file: /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Easy/0.0.0/210d026faf9955653af8916fad021475a3f00453/dataset_info.json
2026-07-05 21:51:02 DEBUG: Attempting to release lock 140584200434560 on /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Easy/0.0.0/210d026faf9955653af8916fad021475a3f00453_builder.lock
2026-07-05 21:51:02 DEBUG: Lock 140584200434560 released on /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Easy/0.0.0/210d026faf9955653af8916fad021475a3f00453_builder.lock
2026-07-05 21:51:02 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmp3musoomf
2026-07-05 21:51:03 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmpcv641w0g
2026-07-05 21:51:03 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/64b5778bffc5a9aacd6231e06ca68b5428fc5b44ccbe86e271579c28e59c58a4/data-00000-of-00001.arrow
2026-07-05 21:51:03 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/64b5778bffc5a9aacd6231e06ca68b5428fc5b44ccbe86e271579c28e59c58a4/state.json
2026-07-05 21:51:03 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/64b5778bffc5a9aacd6231e06ca68b5428fc5b44ccbe86e271579c28e59c58a4/dataset_info.json
2026-07-05 21:51:03 DEBUG: formatted example: {'id': ['Mercury_7220990', 'MCAS_2007_8_5189', 'Mercury_SC_401169', 'MCAS_2004_8_27', 'NYSEDREGENTS_2006_8_10'], 'question': ['Which factor will most likely cause a person to develop a fever?', 'Lichens are symbiotic organisms made of green algae and fungi. What do the green algae supply to the fungi in this symbiotic relationship?', 'When a switch is used in an electrical circuit, the switch can', 'Which of the following is an example of an assistive device?', 'Rocks are classified as igneous, metamorphic, or sedimentary according to'], 'choices': [{'text': ['a leg muscle relaxing after exercise', 'a bacterial population in the bloodstream', 'several viral particles on the skin', 'carbohydrates being digested in the stomach'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['carbon dioxide', 'food', 'protection', 'water'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['cause the charge to build.', 'increase and decrease the voltage.', 'cause the current to change direction.', 'stop and start the flow of current.'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['contact lens', 'motorcycle', 'raincoat', 'coffee pot'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['their color', 'their shape', 'how they formed', 'the minerals they contain'], 'label': ['1', '2', '3', '4']}], 'answerKey': ['B', 'B', 'D', 'A', '3'], 'text': ['<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Answer the question below by choosing the correct choice.\n\nWhich factor will most likely cause a person to develop a fever?\n\nA: a leg muscle relaxing after exercise\nB: a bacterial population in the bloodstream\nC: several viral particles on the skin\nD: carbohydrates being digested in the stomach\n\nYou must respond with the letter corresponding to the correct choice without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>B<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Answer the question below by choosing the correct choice.\n\nLichens are symbiotic organisms made of green algae and fungi. What do the green algae supply to the fungi in this symbiotic relationship?\n\nA: carbon dioxide\nB: food\nC: protection\nD: water\n\nYou must respond with the letter corresponding to the correct choice without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>B<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Answer the question below by choosing the correct choice.\n\nWhen a switch is used in an electrical circuit, the switch can\n\nA: cause the charge to build.\nB: increase and decrease the voltage.\nC: cause the current to change direction.\nD: stop and start the flow of current.\n\nYou must respond with the letter corresponding to the correct choice without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>D<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Answer the question below by choosing the correct choice.\n\nWhich of the following is an example of an assistive device?\n\nA: contact lens\nB: motorcycle\nC: raincoat\nD: coffee pot\n\nYou must respond with the letter corresponding to the correct choice without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>A<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Answer the question below by choosing the correct choice.\n\nRocks are classified as igneous, metamorphic, or sedimentary according to\n\n1: their color\n2: their shape\n3: how they formed\n4: the minerals they contain\n\nYou must respond with the letter corresponding to the correct choice without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>3<|eot_id|>']}
2026-07-05 21:51:03 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmplnyemigx
2026-07-05 21:51:03 DEBUG: tokenized example: {'input_ids': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 23956, 8331, 690, 1455, 4461, 5353, 264, 1732, 311, 2274, 264, 34653, 1980, 32, 25, 264, 2531, 16124, 34948, 1306, 10368, 198, 33, 25, 264, 45964, 7187, 304, 279, 100216, 198, 34, 25, 3892, 29962, 19252, 389, 279, 6930, 198, 35, 25, 62345, 1694, 4170, 10185, 304, 279, 23152, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 33, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 43, 718, 729, 527, 67754, 62114, 44304, 1903, 315, 6307, 68951, 323, 81540, 13, 3639, 656, 279, 6307, 68951, 8312, 311, 279, 81540, 304, 420, 67754, 62114, 5133, 1980, 32, 25, 12782, 40589, 198, 33, 25, 3691, 198, 34, 25, 9313, 198, 35, 25, 3090, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 33, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 4599, 264, 3480, 374, 1511, 304, 459, 20314, 16622, 11, 279, 3480, 649, 271, 32, 25, 5353, 279, 6900, 311, 1977, 627, 33, 25, 5376, 323, 18979, 279, 22465, 627, 34, 25, 5353, 279, 1510, 311, 2349, 5216, 627, 35, 25, 3009, 323, 1212, 279, 6530, 315, 1510, 382, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 35, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 23956, 315, 279, 2768, 374, 459, 3187, 315, 459, 7945, 535, 3756, 1980, 32, 25, 3729, 18848, 198, 33, 25, 35404, 198, 34, 25, 11422, 68512, 198, 35, 25, 11033, 3419, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 32, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 49, 26246, 527, 21771, 439, 5335, 34172, 11, 88848, 41969, 11, 477, 59132, 661, 4184, 311, 271, 16, 25, 872, 1933, 198, 17, 25, 872, 6211, 198, 18, 25, 1268, 814, 14454, 198, 19, 25, 279, 34072, 814, 6782, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 18, 128009]], 'attention_mask': [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]], 'labels': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 23956, 8331, 690, 1455, 4461, 5353, 264, 1732, 311, 2274, 264, 34653, 1980, 32, 25, 264, 2531, 16124, 34948, 1306, 10368, 198, 33, 25, 264, 45964, 7187, 304, 279, 100216, 198, 34, 25, 3892, 29962, 19252, 389, 279, 6930, 198, 35, 25, 62345, 1694, 4170, 10185, 304, 279, 23152, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 33, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 43, 718, 729, 527, 67754, 62114, 44304, 1903, 315, 6307, 68951, 323, 81540, 13, 3639, 656, 279, 6307, 68951, 8312, 311, 279, 81540, 304, 420, 67754, 62114, 5133, 1980, 32, 25, 12782, 40589, 198, 33, 25, 3691, 198, 34, 25, 9313, 198, 35, 25, 3090, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 33, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 4599, 264, 3480, 374, 1511, 304, 459, 20314, 16622, 11, 279, 3480, 649, 271, 32, 25, 5353, 279, 6900, 311, 1977, 627, 33, 25, 5376, 323, 18979, 279, 22465, 627, 34, 25, 5353, 279, 1510, 311, 2349, 5216, 627, 35, 25, 3009, 323, 1212, 279, 6530, 315, 1510, 382, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 35, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 23956, 315, 279, 2768, 374, 459, 3187, 315, 459, 7945, 535, 3756, 1980, 32, 25, 3729, 18848, 198, 33, 25, 35404, 198, 34, 25, 11422, 68512, 198, 35, 25, 11033, 3419, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 32, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 49, 26246, 527, 21771, 439, 5335, 34172, 11, 88848, 41969, 11, 477, 59132, 661, 4184, 311, 271, 16, 25, 872, 1933, 198, 17, 25, 872, 6211, 198, 18, 25, 1268, 814, 14454, 198, 19, 25, 279, 34072, 814, 6782, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 18, 128009]]}
2026-07-05 21:51:03 DEBUG: Saving preprocessed dataset: b160c9895e9818714c1164683ca4e6614e82fad02a35c5374c4855473df8a30e
2026-07-05 21:51:03 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/b160c9895e9818714c1164683ca4e6614e82fad02a35c5374c4855473df8a30e/data-00000-of-00001.arrow
2026-07-05 21:51:03 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/b160c9895e9818714c1164683ca4e6614e82fad02a35c5374c4855473df8a30e/state.json
2026-07-05 21:51:03 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/b160c9895e9818714c1164683ca4e6614e82fad02a35c5374c4855473df8a30e/dataset_info.json
2026-07-05 21:51:03 DEBUG: ds_name: arc_challenge, ds_kwargs: {'name': 'ARC-Challenge', 'path': 'allenai/ai2_arc', 'split': 'train[:250]'}
2026-07-05 21:51:03 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/ai2_arc HTTP/1.1" 200 None
2026-07-05 21:51:03 DEBUG: Starting new HTTPS connection (1): s3.amazonaws.com:443
2026-07-05 21:51:03 DEBUG: https://s3.amazonaws.com:443 "HEAD /datasets.huggingface.co/datasets/datasets/allenai/ai2_arc/allenai/ai2_arc.py HTTP/1.1" 404 0
2026-07-05 21:51:03 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/ai2_arc HTTP/1.1" 200 None
2026-07-05 21:51:03 DEBUG: Starting new HTTPS connection (1): datasets-server.huggingface.co:443
2026-07-05 21:51:03 DEBUG: https://datasets-server.huggingface.co:443 "GET /info?dataset=allenai/ai2_arc HTTP/1.1" 200 None
2026-07-05 21:51:03 DEBUG: Attempting to acquire lock 140584408850048 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___ai2_arc_ARC-Challenge_0.0.0_210d026faf9955653af8916fad021475a3f00453.lock
2026-07-05 21:51:03 DEBUG: Lock 140584408850048 acquired on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___ai2_arc_ARC-Challenge_0.0.0_210d026faf9955653af8916fad021475a3f00453.lock
2026-07-05 21:51:03 DEBUG: open file: /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Challenge/0.0.0/210d026faf9955653af8916fad021475a3f00453/dataset_info.json
2026-07-05 21:51:03 DEBUG: Attempting to release lock 140584408850048 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___ai2_arc_ARC-Challenge_0.0.0_210d026faf9955653af8916fad021475a3f00453.lock
2026-07-05 21:51:03 DEBUG: Lock 140584408850048 released on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___ai2_arc_ARC-Challenge_0.0.0_210d026faf9955653af8916fad021475a3f00453.lock
2026-07-05 21:51:03 DEBUG: Attempting to acquire lock 140584410964160 on /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Challenge/0.0.0/210d026faf9955653af8916fad021475a3f00453_builder.lock
2026-07-05 21:51:03 DEBUG: Lock 140584410964160 acquired on /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Challenge/0.0.0/210d026faf9955653af8916fad021475a3f00453_builder.lock
2026-07-05 21:51:03 DEBUG: open file: /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Challenge/0.0.0/210d026faf9955653af8916fad021475a3f00453/dataset_info.json
2026-07-05 21:51:03 DEBUG: Attempting to release lock 140584410964160 on /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Challenge/0.0.0/210d026faf9955653af8916fad021475a3f00453_builder.lock
2026-07-05 21:51:03 DEBUG: Lock 140584410964160 released on /root/.cache/huggingface/datasets/allenai___ai2_arc/ARC-Challenge/0.0.0/210d026faf9955653af8916fad021475a3f00453_builder.lock
2026-07-05 21:51:03 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmpfrkvtzdb
2026-07-05 21:51:04 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmp5d93c4ja
2026-07-05 21:51:04 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/63f3ae8cc3d86a4fccccdb267efe8c4f15e6459e6af92f66ca9e273a187f57e7/data-00000-of-00001.arrow
2026-07-05 21:51:04 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/63f3ae8cc3d86a4fccccdb267efe8c4f15e6459e6af92f66ca9e273a187f57e7/state.json
2026-07-05 21:51:04 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/63f3ae8cc3d86a4fccccdb267efe8c4f15e6459e6af92f66ca9e273a187f57e7/dataset_info.json
2026-07-05 21:51:04 DEBUG: formatted example: {'id': ['Mercury_SC_415702', 'MCAS_2009_5_6516', 'Mercury_7233695', 'Mercury_7041615', 'Mercury_7041860'], 'question': ['George wants to warm his hands quickly by rubbing them. Which skin surface will produce the most heat?', 'Which of the following statements best explains why magnets usually stick to a refrigerator door?', 'A fold observed in layers of sedimentary rock most likely resulted from the', 'Which of these do scientists offer as the most recent explanation as to why many plants and animals died out at the end of the Mesozoic era?', 'A boat is acted on by a river current flowing north and by wind blowing on its sails. The boat travels northeast. In which direction is the wind most likely applying force to the sails of the boat?'], 'choices': [{'text': ['dry palms', 'wet palms', 'palms covered with oil', 'palms covered with lotion'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['The refrigerator door is smooth.', 'The refrigerator door contains iron.', 'The refrigerator door is a good conductor.', 'The refrigerator door has electric wires in it.'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['cooling of flowing magma.', 'converging of crustal plates.', 'deposition of river sediments.', 'solution of carbonate minerals.'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['worldwide disease', 'global mountain building', 'rise of mammals that preyed upon plants and animals', 'impact of an asteroid created dust that blocked the sunlight'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['west', 'east', 'north', 'south'], 'label': ['A', 'B', 'C', 'D']}], 'answerKey': ['A', 'B', 'B', 'D', 'B'], 'text': ['<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Answer the question below by choosing the correct choice.\n\nGeorge wants to warm his hands quickly by rubbing them. Which skin surface will produce the most heat?\n\nA: dry palms\nB: wet palms\nC: palms covered with oil\nD: palms covered with lotion\n\nYou must respond with the letter corresponding to the correct choice without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>A<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Answer the question below by choosing the correct choice.\n\nWhich of the following statements best explains why magnets usually stick to a refrigerator door?\n\nA: The refrigerator door is smooth.\nB: The refrigerator door contains iron.\nC: The refrigerator door is a good conductor.\nD: The refrigerator door has electric wires in it.\n\nYou must respond with the letter corresponding to the correct choice without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>B<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Answer the question below by choosing the correct choice.\n\nA fold observed in layers of sedimentary rock most likely resulted from the\n\nA: cooling of flowing magma.\nB: converging of crustal plates.\nC: deposition of river sediments.\nD: solution of carbonate minerals.\n\nYou must respond with the letter corresponding to the correct choice without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>B<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Answer the question below by choosing the correct choice.\n\nWhich of these do scientists offer as the most recent explanation as to why many plants and animals died out at the end of the Mesozoic era?\n\nA: worldwide disease\nB: global mountain building\nC: rise of mammals that preyed upon plants and animals\nD: impact of an asteroid created dust that blocked the sunlight\n\nYou must respond with the letter corresponding to the correct choice without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>D<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Answer the question below by choosing the correct choice.\n\nA boat is acted on by a river current flowing north and by wind blowing on its sails. The boat travels northeast. In which direction is the wind most likely applying force to the sails of the boat?\n\nA: west\nB: east\nC: north\nD: south\n\nYou must respond with the letter corresponding to the correct choice without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>B<|eot_id|>']}
2026-07-05 21:51:04 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmpbide9_3y
2026-07-05 21:51:04 DEBUG: tokenized example: {'input_ids': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 40052, 6944, 311, 8369, 813, 6206, 6288, 555, 57035, 1124, 13, 16299, 6930, 7479, 690, 8356, 279, 1455, 8798, 1980, 32, 25, 9235, 75818, 198, 33, 25, 14739, 75818, 198, 34, 25, 75818, 9960, 449, 5707, 198, 35, 25, 75818, 9960, 449, 87942, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 32, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 23956, 315, 279, 2768, 12518, 1888, 15100, 3249, 73780, 6118, 9396, 311, 264, 46044, 6134, 1980, 32, 25, 578, 46044, 6134, 374, 11113, 627, 33, 25, 578, 46044, 6134, 5727, 11245, 627, 34, 25, 578, 46044, 6134, 374, 264, 1695, 61856, 627, 35, 25, 578, 46044, 6134, 706, 9249, 36108, 304, 433, 382, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 33, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 32, 11816, 13468, 304, 13931, 315, 59132, 661, 7091, 1455, 4461, 19543, 505, 279, 271, 32, 25, 28015, 315, 36612, 64605, 627, 33, 25, 19873, 3252, 315, 40712, 278, 25485, 627, 34, 25, 65374, 315, 15140, 11163, 12843, 627, 35, 25, 6425, 315, 84443, 34072, 382, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 33, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 23956, 315, 1521, 656, 14248, 3085, 439, 279, 1455, 3293, 16540, 439, 311, 3249, 1690, 11012, 323, 10099, 8636, 704, 520, 279, 842, 315, 279, 36684, 96614, 292, 11639, 1980, 32, 25, 15603, 8624, 198, 33, 25, 3728, 16700, 4857, 198, 34, 25, 10205, 315, 56669, 430, 37693, 291, 5304, 11012, 323, 10099, 198, 35, 25, 5536, 315, 459, 55479, 3549, 16174, 430, 19857, 279, 40120, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 35, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 32, 15688, 374, 31532, 389, 555, 264, 15140, 1510, 36612, 10411, 323, 555, 10160, 41442, 389, 1202, 86105, 13, 578, 15688, 35292, 41929, 13, 763, 902, 5216, 374, 279, 10160, 1455, 4461, 19486, 5457, 311, 279, 86105, 315, 279, 15688, 1980, 32, 25, 9909, 198, 33, 25, 11226, 198, 34, 25, 10411, 198, 35, 25, 10007, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 33, 128009]], 'attention_mask': [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]], 'labels': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 40052, 6944, 311, 8369, 813, 6206, 6288, 555, 57035, 1124, 13, 16299, 6930, 7479, 690, 8356, 279, 1455, 8798, 1980, 32, 25, 9235, 75818, 198, 33, 25, 14739, 75818, 198, 34, 25, 75818, 9960, 449, 5707, 198, 35, 25, 75818, 9960, 449, 87942, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 32, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 23956, 315, 279, 2768, 12518, 1888, 15100, 3249, 73780, 6118, 9396, 311, 264, 46044, 6134, 1980, 32, 25, 578, 46044, 6134, 374, 11113, 627, 33, 25, 578, 46044, 6134, 5727, 11245, 627, 34, 25, 578, 46044, 6134, 374, 264, 1695, 61856, 627, 35, 25, 578, 46044, 6134, 706, 9249, 36108, 304, 433, 382, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 33, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 32, 11816, 13468, 304, 13931, 315, 59132, 661, 7091, 1455, 4461, 19543, 505, 279, 271, 32, 25, 28015, 315, 36612, 64605, 627, 33, 25, 19873, 3252, 315, 40712, 278, 25485, 627, 34, 25, 65374, 315, 15140, 11163, 12843, 627, 35, 25, 6425, 315, 84443, 34072, 382, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 33, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 23956, 315, 1521, 656, 14248, 3085, 439, 279, 1455, 3293, 16540, 439, 311, 3249, 1690, 11012, 323, 10099, 8636, 704, 520, 279, 842, 315, 279, 36684, 96614, 292, 11639, 1980, 32, 25, 15603, 8624, 198, 33, 25, 3728, 16700, 4857, 198, 34, 25, 10205, 315, 56669, 430, 37693, 291, 5304, 11012, 323, 10099, 198, 35, 25, 5536, 315, 459, 55479, 3549, 16174, 430, 19857, 279, 40120, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 35, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 16533, 279, 3488, 3770, 555, 19301, 279, 4495, 5873, 382, 32, 15688, 374, 31532, 389, 555, 264, 15140, 1510, 36612, 10411, 323, 555, 10160, 41442, 389, 1202, 86105, 13, 578, 15688, 35292, 41929, 13, 763, 902, 5216, 374, 279, 10160, 1455, 4461, 19486, 5457, 311, 279, 86105, 315, 279, 15688, 1980, 32, 25, 9909, 198, 33, 25, 11226, 198, 34, 25, 10411, 198, 35, 25, 10007, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 33, 128009]]}
2026-07-05 21:51:04 DEBUG: Saving preprocessed dataset: 6aa19d9e065e92906335612c279abae7fbbdf161d0e340924c9b9ce8bc3ca5c9
2026-07-05 21:51:04 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/6aa19d9e065e92906335612c279abae7fbbdf161d0e340924c9b9ce8bc3ca5c9/data-00000-of-00001.arrow
2026-07-05 21:51:04 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/6aa19d9e065e92906335612c279abae7fbbdf161d0e340924c9b9ce8bc3ca5c9/state.json
2026-07-05 21:51:04 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/6aa19d9e065e92906335612c279abae7fbbdf161d0e340924c9b9ce8bc3ca5c9/dataset_info.json
2026-07-05 21:51:04 DEBUG: ds_name: openbookqa, ds_kwargs: {'name': 'main', 'path': 'allenai/openbookqa', 'split': 'train[:250]'}
2026-07-05 21:51:04 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/openbookqa HTTP/1.1" 200 None
2026-07-05 21:51:04 DEBUG: Starting new HTTPS connection (1): s3.amazonaws.com:443
2026-07-05 21:51:04 DEBUG: https://s3.amazonaws.com:443 "HEAD /datasets.huggingface.co/datasets/datasets/allenai/openbookqa/allenai/openbookqa.py HTTP/1.1" 404 0
2026-07-05 21:51:04 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/openbookqa HTTP/1.1" 200 None
2026-07-05 21:51:05 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/openbookqa/revision/388097ea7776314e93a529163e0fea805b8a6454 HTTP/1.1" 200 None
2026-07-05 21:51:05 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/openbookqa/tree/388097ea7776314e93a529163e0fea805b8a6454?recursive=False&expand=False HTTP/1.1" 200 390
2026-07-05 21:51:05 DEBUG: Starting new HTTPS connection (1): datasets-server.huggingface.co:443
2026-07-05 21:51:05 DEBUG: https://datasets-server.huggingface.co:443 "GET /info?dataset=allenai/openbookqa HTTP/1.1" 200 None
2026-07-05 21:51:05 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/openbookqa/tree/388097ea7776314e93a529163e0fea805b8a6454/additional?recursive=True&expand=False HTTP/1.1" 200 955
2026-07-05 21:51:05 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/openbookqa/revision/388097ea7776314e93a529163e0fea805b8a6454 HTTP/1.1" 200 None
2026-07-05 21:51:05 DEBUG: Starting new HTTPS connection (1): huggingface.co:443
2026-07-05 21:51:05 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/openbookqa/revision/388097ea7776314e93a529163e0fea805b8a6454 HTTP/1.1" 200 None
2026-07-05 21:51:05 DEBUG: https://huggingface.co:443 "GET /api/datasets/allenai/openbookqa/tree/388097ea7776314e93a529163e0fea805b8a6454/main?recursive=True&expand=False HTTP/1.1" 200 937
2026-07-05 21:51:05 DEBUG: Attempting to acquire lock 140584410533760 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___openbookqa_main_0.0.0_388097ea7776314e93a529163e0fea805b8a6454.lock
2026-07-05 21:51:05 DEBUG: Lock 140584410533760 acquired on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___openbookqa_main_0.0.0_388097ea7776314e93a529163e0fea805b8a6454.lock
2026-07-05 21:51:05 DEBUG: open file: /root/.cache/huggingface/datasets/allenai___openbookqa/main/0.0.0/388097ea7776314e93a529163e0fea805b8a6454/dataset_info.json
2026-07-05 21:51:05 DEBUG: Attempting to release lock 140584410533760 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___openbookqa_main_0.0.0_388097ea7776314e93a529163e0fea805b8a6454.lock
2026-07-05 21:51:05 DEBUG: Lock 140584410533760 released on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_allenai___openbookqa_main_0.0.0_388097ea7776314e93a529163e0fea805b8a6454.lock
2026-07-05 21:51:05 DEBUG: Attempting to acquire lock 140584410533760 on /root/.cache/huggingface/datasets/allenai___openbookqa/main/0.0.0/388097ea7776314e93a529163e0fea805b8a6454_builder.lock
2026-07-05 21:51:05 DEBUG: Lock 140584410533760 acquired on /root/.cache/huggingface/datasets/allenai___openbookqa/main/0.0.0/388097ea7776314e93a529163e0fea805b8a6454_builder.lock
2026-07-05 21:51:05 DEBUG: open file: /root/.cache/huggingface/datasets/allenai___openbookqa/main/0.0.0/388097ea7776314e93a529163e0fea805b8a6454/dataset_info.json
2026-07-05 21:51:05 DEBUG: Attempting to release lock 140584410533760 on /root/.cache/huggingface/datasets/allenai___openbookqa/main/0.0.0/388097ea7776314e93a529163e0fea805b8a6454_builder.lock
2026-07-05 21:51:05 DEBUG: Lock 140584410533760 released on /root/.cache/huggingface/datasets/allenai___openbookqa/main/0.0.0/388097ea7776314e93a529163e0fea805b8a6454_builder.lock
2026-07-05 21:51:05 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmpbgi_me4l
2026-07-05 21:51:06 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmp4gjih75x
2026-07-05 21:51:06 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/a0dedad01d408ac62433117bf0f37681a3df1006c757584d9e07b3b89ad67f5a/data-00000-of-00001.arrow
2026-07-05 21:51:06 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/a0dedad01d408ac62433117bf0f37681a3df1006c757584d9e07b3b89ad67f5a/state.json
2026-07-05 21:51:06 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/a0dedad01d408ac62433117bf0f37681a3df1006c757584d9e07b3b89ad67f5a/dataset_info.json
2026-07-05 21:51:06 DEBUG: formatted example: {'id': ['7-980', '7-584', '7-870', '7-321', '9-732'], 'question_stem': ['The sun is responsible for', 'When standing miles away from Mount Rushmore', 'When food is reduced in the stomach', 'Stars are', 'You can make a telescope with a'], 'choices': [{'text': ['puppies learning new tricks', 'children growing up and getting old', 'flowers wilting in a vase', 'plants sprouting, blooming and wilting'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['the mountains seem very close', 'the mountains are boring', 'the mountains look the same as from up close', 'the mountains seem smaller than in photographs'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['the mind needs time to digest', 'take a second to digest what I said', 'nutrients are being deconstructed', "reader's digest is a body of works"], 'label': ['A', 'B', 'C', 'D']}, {'text': ['warm lights that float', 'made out of nitrate', 'great balls of gas burning billions of miles away', 'lights in the sky'], 'label': ['A', 'B', 'C', 'D']}, {'text': ['straw', 'Glass', 'Candle', 'mailing tube'], 'label': ['A', 'B', 'C', 'D']}], 'answerKey': ['D', 'D', 'C', 'C', 'D'], 'text': ['<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Complete the following passage or answer the question by choosing the correct choice.\n\n\nThe sun is responsible for\n\nA: puppies learning new tricks\nB: children growing up and getting old\nC: flowers wilting in a vase\nD: plants sprouting, blooming and wilting\n\nYou must respond with the letter corresponding to the correct choice (A,B,C,D) without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>D<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Complete the following passage or answer the question by choosing the correct choice.\n\n\nWhen standing miles away from Mount Rushmore\n\nA: the mountains seem very close\nB: the mountains are boring\nC: the mountains look the same as from up close\nD: the mountains seem smaller than in photographs\n\nYou must respond with the letter corresponding to the correct choice (A,B,C,D) without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>D<|eot_id|>', "<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Complete the following passage or answer the question by choosing the correct choice.\n\n\nWhen food is reduced in the stomach\n\nA: the mind needs time to digest\nB: take a second to digest what I said\nC: nutrients are being deconstructed\nD: reader's digest is a body of works\n\nYou must respond with the letter corresponding to the correct choice (A,B,C,D) without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>C<|eot_id|>", '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Complete the following passage or answer the question by choosing the correct choice.\n\n\nStars are\n\nA: warm lights that float\nB: made out of nitrate\nC: great balls of gas burning billions of miles away\nD: lights in the sky\n\nYou must respond with the letter corresponding to the correct choice (A,B,C,D) without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>C<|eot_id|>', '<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Complete the following passage or answer the question by choosing the correct choice.\n\n\nYou can make a telescope with a\n\nA: straw\nB: Glass\nC: Candle\nD: mailing tube\n\nYou must respond with the letter corresponding to the correct choice (A,B,C,D) without any explanation.<|eot_id|><|start_header_id|>assistant<|end_header_id|>D<|eot_id|>']}
2026-07-05 21:51:06 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmp011ftx4d
2026-07-05 21:51:06 DEBUG: tokenized example: {'input_ids': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 12833, 279, 2768, 21765, 477, 4320, 279, 3488, 555, 19301, 279, 4495, 5873, 4286, 791, 7160, 374, 8647, 369, 271, 32, 25, 57725, 6975, 502, 29862, 198, 33, 25, 2911, 7982, 709, 323, 3794, 2362, 198, 34, 25, 19837, 31331, 1303, 304, 264, 93484, 198, 35, 25, 11012, 8314, 11149, 11, 14545, 18238, 323, 31331, 1303, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 320, 32, 8324, 11541, 28365, 8, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 35, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 12833, 279, 2768, 21765, 477, 4320, 279, 3488, 555, 19301, 279, 4495, 5873, 4286, 4599, 11509, 8931, 3201, 505, 10640, 35175, 6518, 271, 32, 25, 279, 24405, 2873, 1633, 3345, 198, 33, 25, 279, 24405, 527, 28859, 198, 34, 25, 279, 24405, 1427, 279, 1890, 439, 505, 709, 3345, 198, 35, 25, 279, 24405, 2873, 9333, 1109, 304, 25232, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 320, 32, 8324, 11541, 28365, 8, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 35, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 12833, 279, 2768, 21765, 477, 4320, 279, 3488, 555, 19301, 279, 4495, 5873, 4286, 4599, 3691, 374, 11293, 304, 279, 23152, 271, 32, 25, 279, 4059, 3966, 892, 311, 21552, 198, 33, 25, 1935, 264, 2132, 311, 21552, 1148, 358, 1071, 198, 34, 25, 37493, 527, 1694, 409, 82678, 198, 35, 25, 6742, 596, 21552, 374, 264, 2547, 315, 4375, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 320, 32, 8324, 11541, 28365, 8, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 34, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 12833, 279, 2768, 21765, 477, 4320, 279, 3488, 555, 19301, 279, 4495, 5873, 4286, 62128, 527, 271, 32, 25, 8369, 13001, 430, 2273, 198, 33, 25, 1903, 704, 315, 25719, 7853, 198, 34, 25, 2294, 20953, 315, 6962, 20252, 33151, 315, 8931, 3201, 198, 35, 25, 13001, 304, 279, 13180, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 320, 32, 8324, 11541, 28365, 8, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 34, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 12833, 279, 2768, 21765, 477, 4320, 279, 3488, 555, 19301, 279, 4495, 5873, 4286, 2675, 649, 1304, 264, 56925, 449, 264, 271, 32, 25, 31107, 198, 33, 25, 21396, 198, 34, 25, 73997, 198, 35, 25, 33859, 14019, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 320, 32, 8324, 11541, 28365, 8, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 35, 128009]], 'attention_mask': [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]], 'labels': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 12833, 279, 2768, 21765, 477, 4320, 279, 3488, 555, 19301, 279, 4495, 5873, 4286, 791, 7160, 374, 8647, 369, 271, 32, 25, 57725, 6975, 502, 29862, 198, 33, 25, 2911, 7982, 709, 323, 3794, 2362, 198, 34, 25, 19837, 31331, 1303, 304, 264, 93484, 198, 35, 25, 11012, 8314, 11149, 11, 14545, 18238, 323, 31331, 1303, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 320, 32, 8324, 11541, 28365, 8, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 35, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 12833, 279, 2768, 21765, 477, 4320, 279, 3488, 555, 19301, 279, 4495, 5873, 4286, 4599, 11509, 8931, 3201, 505, 10640, 35175, 6518, 271, 32, 25, 279, 24405, 2873, 1633, 3345, 198, 33, 25, 279, 24405, 527, 28859, 198, 34, 25, 279, 24405, 1427, 279, 1890, 439, 505, 709, 3345, 198, 35, 25, 279, 24405, 2873, 9333, 1109, 304, 25232, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 320, 32, 8324, 11541, 28365, 8, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 35, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 12833, 279, 2768, 21765, 477, 4320, 279, 3488, 555, 19301, 279, 4495, 5873, 4286, 4599, 3691, 374, 11293, 304, 279, 23152, 271, 32, 25, 279, 4059, 3966, 892, 311, 21552, 198, 33, 25, 1935, 264, 2132, 311, 21552, 1148, 358, 1071, 198, 34, 25, 37493, 527, 1694, 409, 82678, 198, 35, 25, 6742, 596, 21552, 374, 264, 2547, 315, 4375, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 320, 32, 8324, 11541, 28365, 8, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 34, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 12833, 279, 2768, 21765, 477, 4320, 279, 3488, 555, 19301, 279, 4495, 5873, 4286, 62128, 527, 271, 32, 25, 8369, 13001, 430, 2273, 198, 33, 25, 1903, 704, 315, 25719, 7853, 198, 34, 25, 2294, 20953, 315, 6962, 20252, 33151, 315, 8931, 3201, 198, 35, 25, 13001, 304, 279, 13180, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 320, 32, 8324, 11541, 28365, 8, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 34, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 12833, 279, 2768, 21765, 477, 4320, 279, 3488, 555, 19301, 279, 4495, 5873, 4286, 2675, 649, 1304, 264, 56925, 449, 264, 271, 32, 25, 31107, 198, 33, 25, 21396, 198, 34, 25, 73997, 198, 35, 25, 33859, 14019, 271, 2675, 2011, 6013, 449, 279, 6661, 12435, 311, 279, 4495, 5873, 320, 32, 8324, 11541, 28365, 8, 2085, 904, 16540, 13, 128009, 128006, 78191, 128007, 35, 128009]]}
2026-07-05 21:51:06 DEBUG: Saving preprocessed dataset: 6f01cc5f2dd8afc2202d72593defc9d1f185a436016c2c98f30884505568f50c
2026-07-05 21:51:06 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/6f01cc5f2dd8afc2202d72593defc9d1f185a436016c2c98f30884505568f50c/data-00000-of-00001.arrow
2026-07-05 21:51:06 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/6f01cc5f2dd8afc2202d72593defc9d1f185a436016c2c98f30884505568f50c/state.json
2026-07-05 21:51:06 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/6f01cc5f2dd8afc2202d72593defc9d1f185a436016c2c98f30884505568f50c/dataset_info.json
2026-07-05 21:51:06 DEBUG: ds_name: gsm8k, ds_kwargs: {'name': 'main', 'path': 'gsm8k', 'split': 'train[:250]'}
2026-07-05 21:51:06 DEBUG: https://huggingface.co:443 "GET /api/datasets/gsm8k HTTP/1.1" 307 61
2026-07-05 21:51:06 DEBUG: https://huggingface.co:443 "GET /api/datasets/openai/gsm8k HTTP/1.1" 200 None
2026-07-05 21:51:06 DEBUG: Starting new HTTPS connection (1): s3.amazonaws.com:443
2026-07-05 21:51:06 DEBUG: https://s3.amazonaws.com:443 "HEAD /datasets.huggingface.co/datasets/datasets/gsm8k/gsm8k.py HTTP/1.1" 404 0
2026-07-05 21:51:07 DEBUG: https://huggingface.co:443 "GET /api/datasets/gsm8k HTTP/1.1" 307 61
2026-07-05 21:51:07 DEBUG: https://huggingface.co:443 "GET /api/datasets/openai/gsm8k HTTP/1.1" 200 None
2026-07-05 21:51:07 DEBUG: https://huggingface.co:443 "GET /api/datasets/gsm8k/revision/740312add88f781978c0658806c59bc2815b9866 HTTP/1.1" 307 111
2026-07-05 21:51:07 DEBUG: https://huggingface.co:443 "GET /api/datasets/openai/gsm8k/revision/740312add88f781978c0658806c59bc2815b9866 HTTP/1.1" 200 None
2026-07-05 21:51:07 DEBUG: https://huggingface.co:443 "GET /api/datasets/gsm8k/tree/740312add88f781978c0658806c59bc2815b9866?recursive=False&expand=False HTTP/1.1" 307 136
2026-07-05 21:51:07 DEBUG: https://huggingface.co:443 "GET /api/datasets/openai/gsm8k/tree/740312add88f781978c0658806c59bc2815b9866?recursive=False&expand=False HTTP/1.1" 200 483
2026-07-05 21:51:07 DEBUG: Starting new HTTPS connection (1): datasets-server.huggingface.co:443
2026-07-05 21:51:07 DEBUG: https://datasets-server.huggingface.co:443 "GET /info?dataset=gsm8k HTTP/1.1" 404 None
2026-07-05 21:51:07 DEBUG: https://huggingface.co:443 "GET /api/datasets/gsm8k/tree/740312add88f781978c0658806c59bc2815b9866/main?recursive=True&expand=False HTTP/1.1" 307 140
2026-07-05 21:51:07 DEBUG: https://huggingface.co:443 "GET /api/datasets/openai/gsm8k/tree/740312add88f781978c0658806c59bc2815b9866/main?recursive=True&expand=False HTTP/1.1" 200 626
2026-07-05 21:51:07 DEBUG: https://huggingface.co:443 "GET /api/datasets/gsm8k/revision/740312add88f781978c0658806c59bc2815b9866 HTTP/1.1" 307 111
2026-07-05 21:51:08 DEBUG: https://huggingface.co:443 "GET /api/datasets/openai/gsm8k/revision/740312add88f781978c0658806c59bc2815b9866 HTTP/1.1" 200 None
2026-07-05 21:51:08 DEBUG: Attempting to acquire lock 140584582127328 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_gsm8k_main_0.0.0_740312add88f781978c0658806c59bc2815b9866.lock
2026-07-05 21:51:08 DEBUG: Lock 140584582127328 acquired on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_gsm8k_main_0.0.0_740312add88f781978c0658806c59bc2815b9866.lock
2026-07-05 21:51:08 DEBUG: open file: /root/.cache/huggingface/datasets/gsm8k/main/0.0.0/740312add88f781978c0658806c59bc2815b9866/dataset_info.json
2026-07-05 21:51:08 DEBUG: Attempting to release lock 140584582127328 on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_gsm8k_main_0.0.0_740312add88f781978c0658806c59bc2815b9866.lock
2026-07-05 21:51:08 DEBUG: Lock 140584582127328 released on /root/.cache/huggingface/datasets/_root_.cache_huggingface_datasets_gsm8k_main_0.0.0_740312add88f781978c0658806c59bc2815b9866.lock
2026-07-05 21:51:08 DEBUG: Attempting to acquire lock 140584411126464 on /root/.cache/huggingface/datasets/gsm8k/main/0.0.0/740312add88f781978c0658806c59bc2815b9866_builder.lock
2026-07-05 21:51:08 DEBUG: Lock 140584411126464 acquired on /root/.cache/huggingface/datasets/gsm8k/main/0.0.0/740312add88f781978c0658806c59bc2815b9866_builder.lock
2026-07-05 21:51:08 DEBUG: open file: /root/.cache/huggingface/datasets/gsm8k/main/0.0.0/740312add88f781978c0658806c59bc2815b9866/dataset_info.json
2026-07-05 21:51:08 DEBUG: Attempting to release lock 140584411126464 on /root/.cache/huggingface/datasets/gsm8k/main/0.0.0/740312add88f781978c0658806c59bc2815b9866_builder.lock
2026-07-05 21:51:08 DEBUG: Lock 140584411126464 released on /root/.cache/huggingface/datasets/gsm8k/main/0.0.0/740312add88f781978c0658806c59bc2815b9866_builder.lock
2026-07-05 21:51:08 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmp0d7q2tlw
2026-07-05 21:51:08 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmpw23mfqb7
2026-07-05 21:51:08 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/4e1bf568311e639bd9b0c752fd21dbb952c9e211181c5b0789c2423c1b83a3eb/data-00000-of-00001.arrow
2026-07-05 21:51:08 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/4e1bf568311e639bd9b0c752fd21dbb952c9e211181c5b0789c2423c1b83a3eb/state.json
2026-07-05 21:51:08 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/4e1bf568311e639bd9b0c752fd21dbb952c9e211181c5b0789c2423c1b83a3eb/dataset_info.json
2026-07-05 21:51:08 DEBUG: formatted example: {'question': ['Natalia sold clips to 48 of her friends in April, and then she sold half as many clips in May. How many clips did Natalia sell altogether in April and May?', 'Weng earns $12 an hour for babysitting. Yesterday, she just did 50 minutes of babysitting. How much did she earn?', 'Betty is saving money for a new wallet which costs $100. Betty has only half of the money she needs. Her parents decided to give her $15 for that purpose, and her grandparents twice as much as her parents. How much more money does Betty need to buy the wallet?', 'Julie is reading a 120-page book. Yesterday, she was able to read 12 pages and today, she read twice as many pages as yesterday. If she wants to read half of the remaining pages tomorrow, how many pages should she read?', 'James writes a 3-page letter to 2 different friends twice a week.  How many pages does he write a year?'], 'answer': ['Natalia sold 48/2 = <<48/2=24>>24 clips in May.\nNatalia sold 48+24 = <<48+24=72>>72 clips altogether in April and May.\n#### 72', 'Weng earns 12/60 = $<<12/60=0.2>>0.2 per minute.\nWorking 50 minutes, she earned 0.2 x 50 = $<<0.2*50=10>>10.\n#### 10', "In the beginning, Betty has only 100 / 2 = $<<100/2=50>>50.\nBetty's grandparents gave her 15 * 2 = $<<15*2=30>>30.\nThis means, Betty needs 100 - 50 - 30 - 15 = $<<100-50-30-15=5>>5 more.\n#### 5", 'Maila read 12 x 2 = <<12*2=24>>24 pages today.\nSo she was able to read a total of 12 + 24 = <<12+24=36>>36 pages since yesterday.\nThere are 120 - 36 = <<120-36=84>>84 pages left to be read.\nSince she wants to read half of the remaining pages tomorrow, then she should read 84/2 = <<84/2=42>>42 pages.\n#### 42', 'He writes each friend 3*2=<<3*2=6>>6 pages a week\nSo he writes 6*2=<<6*2=12>>12 pages every week\nThat means he writes 12*52=<<12*52=624>>624 pages a year\n#### 624'], 'text': ["<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Please answer the following question: Natalia sold clips to 48 of her friends in April, and then she sold half as many clips in May. How many clips did Natalia sell altogether in April and May?<|eot_id|><|start_header_id|>assistant<|end_header_id|>Let's think step by step. Natalia sold 48/2 = <<48/2=24>>24 clips in May.\nNatalia sold 48+24 = <<48+24=72>>72 clips altogether in April and May.\n#### 72<|eot_id|>", "<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Please answer the following question: Weng earns $12 an hour for babysitting. Yesterday, she just did 50 minutes of babysitting. How much did she earn?<|eot_id|><|start_header_id|>assistant<|end_header_id|>Let's think step by step. Weng earns 12/60 = $<<12/60=0.2>>0.2 per minute.\nWorking 50 minutes, she earned 0.2 x 50 = $<<0.2*50=10>>10.\n#### 10<|eot_id|>", "<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Please answer the following question: Betty is saving money for a new wallet which costs $100. Betty has only half of the money she needs. Her parents decided to give her $15 for that purpose, and her grandparents twice as much as her parents. How much more money does Betty need to buy the wallet?<|eot_id|><|start_header_id|>assistant<|end_header_id|>Let's think step by step. In the beginning, Betty has only 100 / 2 = $<<100/2=50>>50.\nBetty's grandparents gave her 15 * 2 = $<<15*2=30>>30.\nThis means, Betty needs 100 - 50 - 30 - 15 = $<<100-50-30-15=5>>5 more.\n#### 5<|eot_id|>", "<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Please answer the following question: Julie is reading a 120-page book. Yesterday, she was able to read 12 pages and today, she read twice as many pages as yesterday. If she wants to read half of the remaining pages tomorrow, how many pages should she read?<|eot_id|><|start_header_id|>assistant<|end_header_id|>Let's think step by step. Maila read 12 x 2 = <<12*2=24>>24 pages today.\nSo she was able to read a total of 12 + 24 = <<12+24=36>>36 pages since yesterday.\nThere are 120 - 36 = <<120-36=84>>84 pages left to be read.\nSince she wants to read half of the remaining pages tomorrow, then she should read 84/2 = <<84/2=42>>42 pages.\n#### 42<|eot_id|>", "<|begin_of_text|><|start_header_id|>system<|end_header_id|><|eot_id|><|start_header_id|>user<|end_header_id|>Please answer the following question: James writes a 3-page letter to 2 different friends twice a week.  How many pages does he write a year?<|eot_id|><|start_header_id|>assistant<|end_header_id|>Let's think step by step. He writes each friend 3*2=<<3*2=6>>6 pages a week\nSo he writes 6*2=<<6*2=12>>12 pages every week\nThat means he writes 12*52=<<12*52=624>>624 pages a year\n#### 624<|eot_id|>"]}
2026-07-05 21:51:08 DEBUG: open file: /tmp/hf_datasets-0t0ro9tq/tmps9y5gtr5
2026-07-05 21:51:08 DEBUG: tokenized example: {'input_ids': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 5618, 4320, 279, 2768, 3488, 25, 42701, 689, 6216, 27203, 311, 220, 2166, 315, 1077, 4885, 304, 5936, 11, 323, 1243, 1364, 6216, 4376, 439, 1690, 27203, 304, 3297, 13, 2650, 1690, 27203, 1550, 42701, 689, 4662, 31155, 304, 5936, 323, 3297, 30, 128009, 128006, 78191, 128007, 10267, 596, 1781, 3094, 555, 3094, 13, 42701, 689, 6216, 220, 2166, 14, 17, 284, 1134, 2166, 14, 17, 28, 1187, 2511, 1187, 27203, 304, 3297, 627, 45, 4306, 689, 6216, 220, 2166, 10, 1187, 284, 1134, 2166, 10, 1187, 28, 5332, 2511, 5332, 27203, 31155, 304, 5936, 323, 3297, 627, 827, 220, 5332, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 5618, 4320, 279, 2768, 3488, 25, 468, 833, 64859, 400, 717, 459, 6596, 369, 71683, 15154, 13, 61133, 11, 1364, 1120, 1550, 220, 1135, 4520, 315, 71683, 15154, 13, 2650, 1790, 1550, 1364, 7380, 30, 128009, 128006, 78191, 128007, 10267, 596, 1781, 3094, 555, 3094, 13, 468, 833, 64859, 220, 717, 14, 1399, 284, 400, 2501, 717, 14, 1399, 28, 15, 13, 17, 2511, 15, 13, 17, 824, 9568, 627, 35078, 220, 1135, 4520, 11, 1364, 15662, 220, 15, 13, 17, 865, 220, 1135, 284, 400, 2501, 15, 13, 17, 9, 1135, 28, 605, 2511, 605, 627, 827, 220, 605, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 5618, 4320, 279, 2768, 3488, 25, 56111, 374, 14324, 3300, 369, 264, 502, 15435, 902, 7194, 400, 1041, 13, 56111, 706, 1193, 4376, 315, 279, 3300, 1364, 3966, 13, 6385, 6699, 6773, 311, 3041, 1077, 400, 868, 369, 430, 7580, 11, 323, 1077, 56435, 11157, 439, 1790, 439, 1077, 6699, 13, 2650, 1790, 810, 3300, 1587, 56111, 1205, 311, 3780, 279, 15435, 30, 128009, 128006, 78191, 128007, 10267, 596, 1781, 3094, 555, 3094, 13, 763, 279, 7314, 11, 56111, 706, 1193, 220, 1041, 611, 220, 17, 284, 400, 2501, 1041, 14, 17, 28, 1135, 2511, 1135, 627, 57299, 1919, 596, 56435, 6688, 1077, 220, 868, 353, 220, 17, 284, 400, 2501, 868, 9, 17, 28, 966, 2511, 966, 627, 2028, 3445, 11, 56111, 3966, 220, 1041, 482, 220, 1135, 482, 220, 966, 482, 220, 868, 284, 400, 2501, 1041, 12, 1135, 12, 966, 12, 868, 28, 20, 2511, 20, 810, 627, 827, 220, 20, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 5618, 4320, 279, 2768, 3488, 25, 42287, 374, 5403, 264, 220, 4364, 15463, 2363, 13, 61133, 11, 1364, 574, 3025, 311, 1373, 220, 717, 6959, 323, 3432, 11, 1364, 1373, 11157, 439, 1690, 6959, 439, 13985, 13, 1442, 1364, 6944, 311, 1373, 4376, 315, 279, 9861, 6959, 16986, 11, 1268, 1690, 6959, 1288, 1364, 1373, 30, 128009, 128006, 78191, 128007, 10267, 596, 1781, 3094, 555, 3094, 13, 15219, 64, 1373, 220, 717, 865, 220, 17, 284, 1134, 717, 9, 17, 28, 1187, 2511, 1187, 6959, 3432, 627, 4516, 1364, 574, 3025, 311, 1373, 264, 2860, 315, 220, 717, 489, 220, 1187, 284, 1134, 717, 10, 1187, 28, 1927, 2511, 1927, 6959, 2533, 13985, 627, 3947, 527, 220, 4364, 482, 220, 1927, 284, 1134, 4364, 12, 1927, 28, 5833, 2511, 5833, 6959, 2163, 311, 387, 1373, 627, 12834, 1364, 6944, 311, 1373, 4376, 315, 279, 9861, 6959, 16986, 11, 1243, 1364, 1288, 1373, 220, 5833, 14, 17, 284, 1134, 5833, 14, 17, 28, 2983, 2511, 2983, 6959, 627, 827, 220, 2983, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 5618, 4320, 279, 2768, 3488, 25, 7957, 14238, 264, 220, 18, 15463, 6661, 311, 220, 17, 2204, 4885, 11157, 264, 2046, 13, 220, 2650, 1690, 6959, 1587, 568, 3350, 264, 1060, 30, 128009, 128006, 78191, 128007, 10267, 596, 1781, 3094, 555, 3094, 13, 1283, 14238, 1855, 4333, 220, 18, 9, 17, 28, 2501, 18, 9, 17, 28, 21, 2511, 21, 6959, 264, 2046, 198, 4516, 568, 14238, 220, 21, 9, 17, 28, 2501, 21, 9, 17, 28, 717, 2511, 717, 6959, 1475, 2046, 198, 4897, 3445, 568, 14238, 220, 717, 9, 4103, 28, 2501, 717, 9, 4103, 28, 23000, 2511, 23000, 6959, 264, 1060, 198, 827, 220, 23000, 128009]], 'attention_mask': [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]], 'labels': [[128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 5618, 4320, 279, 2768, 3488, 25, 42701, 689, 6216, 27203, 311, 220, 2166, 315, 1077, 4885, 304, 5936, 11, 323, 1243, 1364, 6216, 4376, 439, 1690, 27203, 304, 3297, 13, 2650, 1690, 27203, 1550, 42701, 689, 4662, 31155, 304, 5936, 323, 3297, 30, 128009, 128006, 78191, 128007, 10267, 596, 1781, 3094, 555, 3094, 13, 42701, 689, 6216, 220, 2166, 14, 17, 284, 1134, 2166, 14, 17, 28, 1187, 2511, 1187, 27203, 304, 3297, 627, 45, 4306, 689, 6216, 220, 2166, 10, 1187, 284, 1134, 2166, 10, 1187, 28, 5332, 2511, 5332, 27203, 31155, 304, 5936, 323, 3297, 627, 827, 220, 5332, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 5618, 4320, 279, 2768, 3488, 25, 468, 833, 64859, 400, 717, 459, 6596, 369, 71683, 15154, 13, 61133, 11, 1364, 1120, 1550, 220, 1135, 4520, 315, 71683, 15154, 13, 2650, 1790, 1550, 1364, 7380, 30, 128009, 128006, 78191, 128007, 10267, 596, 1781, 3094, 555, 3094, 13, 468, 833, 64859, 220, 717, 14, 1399, 284, 400, 2501, 717, 14, 1399, 28, 15, 13, 17, 2511, 15, 13, 17, 824, 9568, 627, 35078, 220, 1135, 4520, 11, 1364, 15662, 220, 15, 13, 17, 865, 220, 1135, 284, 400, 2501, 15, 13, 17, 9, 1135, 28, 605, 2511, 605, 627, 827, 220, 605, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 5618, 4320, 279, 2768, 3488, 25, 56111, 374, 14324, 3300, 369, 264, 502, 15435, 902, 7194, 400, 1041, 13, 56111, 706, 1193, 4376, 315, 279, 3300, 1364, 3966, 13, 6385, 6699, 6773, 311, 3041, 1077, 400, 868, 369, 430, 7580, 11, 323, 1077, 56435, 11157, 439, 1790, 439, 1077, 6699, 13, 2650, 1790, 810, 3300, 1587, 56111, 1205, 311, 3780, 279, 15435, 30, 128009, 128006, 78191, 128007, 10267, 596, 1781, 3094, 555, 3094, 13, 763, 279, 7314, 11, 56111, 706, 1193, 220, 1041, 611, 220, 17, 284, 400, 2501, 1041, 14, 17, 28, 1135, 2511, 1135, 627, 57299, 1919, 596, 56435, 6688, 1077, 220, 868, 353, 220, 17, 284, 400, 2501, 868, 9, 17, 28, 966, 2511, 966, 627, 2028, 3445, 11, 56111, 3966, 220, 1041, 482, 220, 1135, 482, 220, 966, 482, 220, 868, 284, 400, 2501, 1041, 12, 1135, 12, 966, 12, 868, 28, 20, 2511, 20, 810, 627, 827, 220, 20, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 5618, 4320, 279, 2768, 3488, 25, 42287, 374, 5403, 264, 220, 4364, 15463, 2363, 13, 61133, 11, 1364, 574, 3025, 311, 1373, 220, 717, 6959, 323, 3432, 11, 1364, 1373, 11157, 439, 1690, 6959, 439, 13985, 13, 1442, 1364, 6944, 311, 1373, 4376, 315, 279, 9861, 6959, 16986, 11, 1268, 1690, 6959, 1288, 1364, 1373, 30, 128009, 128006, 78191, 128007, 10267, 596, 1781, 3094, 555, 3094, 13, 15219, 64, 1373, 220, 717, 865, 220, 17, 284, 1134, 717, 9, 17, 28, 1187, 2511, 1187, 6959, 3432, 627, 4516, 1364, 574, 3025, 311, 1373, 264, 2860, 315, 220, 717, 489, 220, 1187, 284, 1134, 717, 10, 1187, 28, 1927, 2511, 1927, 6959, 2533, 13985, 627, 3947, 527, 220, 4364, 482, 220, 1927, 284, 1134, 4364, 12, 1927, 28, 5833, 2511, 5833, 6959, 2163, 311, 387, 1373, 627, 12834, 1364, 6944, 311, 1373, 4376, 315, 279, 9861, 6959, 16986, 11, 1243, 1364, 1288, 1373, 220, 5833, 14, 17, 284, 1134, 5833, 14, 17, 28, 2983, 2511, 2983, 6959, 627, 827, 220, 2983, 128009], [128000, 128006, 9125, 128007, 128009, 128006, 882, 128007, 5618, 4320, 279, 2768, 3488, 25, 7957, 14238, 264, 220, 18, 15463, 6661, 311, 220, 17, 2204, 4885, 11157, 264, 2046, 13, 220, 2650, 1690, 6959, 1587, 568, 3350, 264, 1060, 30, 128009, 128006, 78191, 128007, 10267, 596, 1781, 3094, 555, 3094, 13, 1283, 14238, 1855, 4333, 220, 18, 9, 17, 28, 2501, 18, 9, 17, 28, 21, 2511, 21, 6959, 264, 2046, 198, 4516, 568, 14238, 220, 21, 9, 17, 28, 2501, 21, 9, 17, 28, 717, 2511, 717, 6959, 1475, 2046, 198, 4897, 3445, 568, 14238, 220, 717, 9, 4103, 28, 2501, 717, 9, 4103, 28, 23000, 2511, 23000, 6959, 264, 1060, 198, 827, 220, 23000, 128009]]}
2026-07-05 21:51:08 DEBUG: Saving preprocessed dataset: 8406fa9178c7b3f87b602489537089fc2ac20f1c66f229c91d578c1d869ce1e8
2026-07-05 21:51:08 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/8406fa9178c7b3f87b602489537089fc2ac20f1c66f229c91d578c1d869ce1e8/data-00000-of-00001.arrow
2026-07-05 21:51:08 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/8406fa9178c7b3f87b602489537089fc2ac20f1c66f229c91d578c1d869ce1e8/state.json
2026-07-05 21:51:08 DEBUG: open file: /content/text-to-lora/data/transformed_datasets/8406fa9178c7b3f87b602489537089fc2ac20f1c66f229c91d578c1d869ce1e8/dataset_info.json
2026-07-05 21:51:08 DEBUG: ds_descs[ds_name]=['Focus on comprehending the essence of textual details to validate or disprove statements arising from those details succinctly.', 'This task requires you to gauge the validity of various assertions in diverse fields, from geography to science, using supporting details found in the input.', 'This task asks you to validate or dismiss statements by connecting them back to facts described in the initial input. Delve into comprehension for correct evaluation.', 'Analyze input passages for underlying truths, engaging with binary fact-based questions that require close consideration of presented details.', 'This task requires careful reading of descriptive passages to check for factual correctness regarding specific inquiries about those passages.', 'You are required to digest textual content and critically evaluate claims made within it. Your task is to distinguish between truth and falsehood.', 'Analyze the statements and decide if the information supports a particular assertion, indicating whether it is true or false.', "The objective is to assess statements against background information. You will determine if what's being asked aligns with the facts given.", 'You are questioning specific claims related to known facts; your role is to verify these claims with informed reasoning.', 'The objective is to assess whether a specific claim is valid according to the details given. Analyzing the context is key to your judgment.', "Use your analytical skills to determine the accuracy of statements drawn from given readings. Each question asks whether information aligns with what's provided.", 'This activity focuses on evaluating factual statements against evidence or accepted knowledge in specific areas, from historical events to scientific principles.', 'As you engage with the text, your goal is to identify whether particular claims can be substantiated through careful analysis of the information given.', 'Here, you will investigate a series of declarations and ascertain their truthfulness based on provided excerpts. Focus on understanding details and forming judgments accordingly.', 'You will interpret information from different topics and make judgments about the validity of certain statements, using logical reasoning and recall skills.', 'Analyze assertions presented against detailed narratives and judge their accuracy based on your understanding of the material covered.']
2026-07-05 21:51:09 DEBUG: task_embs=tensor([[ 0.0735, -0.3417,  0.0218,  ...,  1.5430,  0.4091,  0.5049],
        [ 0.0973,  0.0473,  0.7050,  ...,  0.5092, -0.9191,  0.4517],
        [-0.0440,  0.0900, -0.1154,  ...,  0.9703, -0.3417,  0.7564],
        ...,
        [ 1.0226, -0.7043,  0.2465,  ...,  0.1624, -1.2365, -1.0591],
        [ 0.1059,  0.2497, -0.0286,  ...,  0.8890, -0.8472, -0.6798],
        [ 0.4907, -0.1960,  0.6102,  ...,  0.3116, -0.6387,  0.5193]],
       device='cuda:0')
2026-07-05 21:51:09 DEBUG: ds_descs[ds_name]=['This exercise hinges on recognizing implicit connections between ideas within sentences, requiring thoughtful decision-making regarding which option best completes them.', 'The objective here is to interpret situations involving two subjects and decide which one fits better into a given description. Apply your analytical thinking to understand their actions and behaviors.', 'In this task, you will review small narrative snippets to discern which character is most relevant to the situation being described.', 'This assignment focuses on deciphering meaning from context, allowing you to deduce what is most relevant or correct in a given statement.', 'You are tasked with discerning which individual or object is referenced through logical thinking about connections and interactions presented in short situational phrases.', 'Deduce the correct answer to fill in a blank in a narrative based on implied meaning and context.', 'Use your understanding of character roles in simple stories to determine who is being referenced in relation to specific actions or qualities presented in each scenario.', 'You must utilize your comprehension skills to determine which character or item fits logically into the situation described.', 'Task participants with evaluating statements for underlying meanings and selecting words that capture those meanings accurately.', "You'll be examining each situation presented and determining which option correctly reflects the implied meaning or intention behind the words used.", 'Explore brief contexts where two subjects are compared, identifying which one naturally aligns with the traits or actions described. It’s essential to analyze descriptions accurately.', 'Use your reasoning ability to navigate through short statements and select what most accurately corresponds to the narrative.', 'The challenge is to use logic and reasoning skills to sift through contextual information to highlight what is most appropriate.', 'Engage with concise narratives where your goal is to differentiate between two potential subjects based on contextual indications provided in the text.', 'You will examine scenarios that require pinpointing one character or object based on contextual hints given in short sentences, encouraging insightful interpretation.', 'You need to infer the most appropriate subject in a given situation based on the clues provided in the surrounding sentences. Close reading and critical thinking are key.']
2026-07-05 21:51:09 DEBUG: task_embs=tensor([[-0.3996,  0.1116,  0.0409,  ...,  0.2725, -0.0324, -1.2352],
        [-0.2441, -0.0928,  0.0591,  ...,  0.4102, -0.1337, -1.0333],
        [ 0.0339,  0.2046,  0.5889,  ...,  0.4039, -0.1661, -1.8762],
        ...,
        [-0.2449,  0.4745,  0.9797,  ...,  0.7027, -0.9694, -0.7386],
        [-0.5987,  0.5571,  0.2668,  ..., -0.2473, -0.7601, -0.7445],
        [-0.5412, -0.3304,  0.1730,  ...,  0.3031, -0.8274, -1.4571]],
       device='cuda:0')
2026-07-05 21:51:09 DEBUG: ds_descs[ds_name]=['Your responsibility is to compare different answer options and deduce which one more accurately addresses the question while being mindful of common practices.', 'By analyzing both choices, decide which represents a more suitable or everyday approach for addressing specific questions regarding functioning or usage.', 'Carefully consider the details provided in each option, recognizing how they apply to the question, so you can choose the most fitting and conventional approach.', 'The objective is to explore how different options correspond with typical needs or tasks and select those that offer greater practicality in a given context.', 'The focus here is on selecting the most efficient approach among several, using contextual understanding and everyday reasoning skills.', 'Use your practical knowledge to evaluate different solutions offered for everyday challenges, focusing on the one that makes the most sense.', 'The goal is to analyze question prompts that require practical advice and choose the best options based on convenience and logic.', 'You will need to differentiate between two strategies for completing tasks by interpreting their feasibility and alignment with ordinary methods employed in such cases.', 'Evaluate solutions provided for various tasks with attention to how each one fits typical needs and common scenarios faced in daily life.', 'In each instance, determine which action is most likely to lead to a satisfactory outcome based on your understanding of everyday situations.', 'Examine techniques for managing practical challenges at home, giving preference to those that are most commonly suggested or effective.', 'The focus here is to choose among various approaches presented in everyday questions. Apply logical reasoning to identify which solution is typically preferred.', "Assess two strategies for accomplishing a particular task, emphasizing traditional uses or prudent decisions based on similar examples you've encountered before.", 'Engage with everyday dilemmas and solutions. Identify which response aligns best with typical behavior or practical outcomes.', "In this task, you'll evaluate two different responses to a question, considering feasibility and usual practices, to select the option that best fits the scenario.", 'This task tests your ability to discern which answer provides a better solution or completes a requirement effectively, relying on your understanding of common practices.']
2026-07-05 21:51:09 DEBUG: task_embs=tensor([[-0.3607, -0.9566, -0.9200,  ...,  0.6744,  0.5097, -0.3764],
        [ 0.4872, -1.1107, -0.2122,  ...,  0.2214,  0.6601, -0.7597],
        [-0.4806, -1.1586, -0.1227,  ...,  0.6858,  0.4079, -0.7690],
        ...,
        [-0.3069,  0.1574, -0.4110,  ...,  0.0423, -0.5644, -0.8376],
        [-0.0777, -0.7386, -0.1391,  ...,  0.3563, -0.2978,  0.8374],
        [-0.1089, -0.3418, -0.4279,  ...,  1.2367,  0.6079, -0.5218]],
       device='cuda:0')
2026-07-05 21:51:09 DEBUG: ds_descs[ds_name]=["In this task, you focus on enriching a given passage with the correct concluding statement. It's essential to connect the ideas effectively to achieve a logical completion.", 'Process an incomplete narrative by selecting the best continuation. This will require attention to detail and appropriate interpretation of textual clues inherent in the passage.', 'The assignment requires you to evaluate different endings for a passage, discerning which one best complements the existing content while aligning with thematic elements.', 'Conclude a narrative by identifying which option connects seamlessly to the existing content. This requires you to analyze tone, content, and intended meaning.', 'The objective is to synthesize information from partial sentences to choose a concluding statement that maintains clarity and intent in communication.', 'Evaluate storytelling elements present in the provided text, discerning which option aligns well as a concluding thought or action to advance the narrative effectively.', 'The activity consists of reviewing a partial narrative or instructional piece and selecting an ending that complements it effectively. You’ll need strong analytical skills for effective evaluation.', 'This task centers around interpreting a partial passage and determining the most suitable continuation from several choices. Understanding context and logical flow is key.', 'Your job is to finish an incomplete sentence by picking the correct choice that aligns best with the initial information provided. Understanding context is crucial here.', 'Explore narrative threads within passages, analyzing choices that can successfully complete or enhance the existing context.', 'Work with snippets of text that require you to think critically about how they could be ended while keeping the message clear.', 'The objective is to read through a provided text and carefully select an ending that logically follows the context presented.', "You're given a text that requires closure, and your responsibility is to determine which given conclusion properly wraps up the narrative or topic introduced earlier.", 'You are tasked with completing a thought or narrative by evaluating various potential endings for their relevance and clarity.', 'This task challenges you to think critically about narrative structure, selecting options that best round out thoughts introduced in earlier parts of a passage.', 'You will be interpreting brief narratives and deciding which conclusion best aligns with the themes and ideas introduced.']
2026-07-05 21:51:10 DEBUG: task_embs=tensor([[-0.4500, -0.9832,  0.0845,  ...,  0.6554,  0.6502, -1.6022],
        [-0.0912, -1.1757,  0.4934,  ...,  1.3121,  0.6377, -0.7400],
        [ 0.4160, -0.6976,  1.0386,  ..., -0.8474,  0.7802, -1.3538],
        ...,
        [ 0.0075, -0.4881, -0.4258,  ..., -0.5297,  0.0704, -1.4852],
        [-0.3885, -0.1334,  0.7926,  ...,  0.6631,  0.3574, -1.5540],
        [ 1.2009, -0.2045,  0.9835,  ..., -0.4452, -0.3572, -1.2786]],
       device='cuda:0')
2026-07-05 21:51:10 DEBUG: ds_descs[ds_name]=['This task challenges you to align educational principles with question prompts, allowing you to showcase what you’ve learned across different fields.', 'Your task involves understanding scientific concepts and responding accurately based on your knowledge of astronomy, biology, and environmental science.', 'Identify key themes from each question and match them with relevant concepts you are familiar with. The selected answer should effectively summarize that awareness.', 'Investigate a range of questions encompassing societal practices, natural phenomena, or scientific trends while providing the most informed responses based on knowledge.', 'This task focuses on demonstrating knowledge about environmental science, food preservation techniques, and the physical properties influencing material choice.', 'This task requires applying your knowledge of plant products, biodiversity, and animal adaptations to select the correct answers from the options given.', 'This exercise tests your ability to integrate knowledge across multiple scientific domains and determine which explanation aligns with empirical observations and principles.', 'You will analyze scientific queries that necessitate a connection between theoretical concepts and practical tools in various situations.', 'You will look at various claims connected to observed events and select the one that is most accurately supported by established scientific principles and facts.', 'Use your understanding of science and real-world applications to address questions about sources of information, the role of light in nature, or the characteristics of objects.', 'The job requires you to tap into your knowledge about natural phenomena, aiming to pick responses that align with recognized facts in biology and chemistry.', 'Focus on examining questions related to living organisms, their environments, and physical science principles. Provide answers that showcase your grasp of essential academic concepts.', "Explore fundamental concepts within living systems as you respond accurately to diverse scientific inquiries based upon what you've learned or observed.", 'You will need to apply your understanding of scientific tools and concepts to identify the appropriate answers for questions concerning measurements and natural processes.', 'Your role here is to analyze different statements related to environmental issues, chemical reactions, or physical phenomena, using your reasoning skills to identify the correct one.', 'This activity assesses your knowledge across different fields, requiring you to identify the most accurate answers based on provided information about human biology, environmental cycles, and plant life.']
2026-07-05 21:51:10 DEBUG: task_embs=tensor([[-0.2120,  0.0930,  1.1448,  ...,  0.0135, -0.4735, -0.2068],
        [-0.2700, -0.0216,  0.3895,  ...,  0.1986, -0.2545, -0.1227],
        [-0.6797, -0.7163, -0.6222,  ..., -0.1817,  0.2405, -0.6902],
        ...,
        [-0.4079, -0.8158,  0.0856,  ...,  0.2536, -0.2824, -0.1634],
        [-0.0544, -0.6233,  0.4720,  ...,  2.0759, -0.1480, -0.2712],
        [ 0.5481,  0.3250,  0.9188,  ..., -0.4072, -0.8091,  1.2268]],
       device='cuda:0')
2026-07-05 21:51:10 DEBUG: ds_descs[ds_name]=['Your objective is to delve into questions that reflect principles of natural sciences or social studies, selecting the answer that aligns closest with established knowledge.', 'Essentially, this task is about applying your knowledge in science to select statements that accurately reflect natural occurrences, cellular capabilities, or energy classifications.', 'In each provided scenario, apply your educational background in science to decipher which statement provides the clearest explanation for what is being asked.', "Here, you'll delve into scientific queries, which ask for clarity on topics like energy transformation or ecological interactions that showcase how entities function naturally.", 'This task prompts you to recognize the patterns of metamorphosis in butterflies, assessing your grasp of life stages in insects.', 'Immerse yourself in inquiries regarding scientific facts or scenarios. Rely on logic and established theories to discern which option correlates correctly with the question posed.', 'The challenge involves identifying characteristics that indicate sexual reproduction in green algae, demanding comprehension of biological reproduction processes.', 'This task involves using your understanding of natural sciences to draw conclusions about the features and behaviors of celestial bodies, geological layers, ecological composition, and biological adaptations.', 'Assess multiple statements related to different fields and identify which one serves as the appropriate answer to each question based on logical reasoning.', 'Engage with the content by utilizing your expertise across various domains to derive the right answers from the given questions.', 'In this activity, you will explore concepts from various scientific fields, including cellular biology and environmental science, determining how different elements interact and change.', 'In this task, you explore key concepts from various scientific fields, working to articulate which statement most effectively explains a specific interaction or characteristic.', 'Dive into a variety of scientific questions that regard natural laws or experimental methods. Determine the most logical answer based on learned facts and concepts.', 'Your task is to analyze scientific concepts and determine the best answer to questions related to astronomy, geology, soil science, and biology.', 'You will be drawing on your scientific literacy and reasoning skills. Investigate the relationships among different concepts in science through the context provided in each question.', 'Navigate a range of questions, leveraging both analytical skills and existing knowledge bases relevant to individual inquiries for optimal response accuracy.']
2026-07-05 21:51:10 DEBUG: task_embs=tensor([[ 0.2303, -0.7013, -0.5076,  ...,  0.9525, -0.1550, -0.4684],
        [ 0.3531,  0.8893, -0.2746,  ...,  0.8003, -0.4002, -0.1216],
        [ 0.7859,  0.0852, -0.3591,  ..., -0.0693,  0.0924, -0.3565],
        ...,
        [ 0.9241,  0.1638,  0.2101,  ..., -0.4881, -0.2284, -0.0538],
        [-0.8366, -0.2693,  0.2732,  ...,  0.8053, -0.7791,  0.1085],
        [-0.5182, -0.9849, -1.0055,  ...,  1.0209,  0.5156, -0.7580]],
       device='cuda:0')
2026-07-05 21:51:10 DEBUG: ds_descs[ds_name]=['This task tests your understanding of general knowledge, as you decide which choice logically completes the statements provided.', 'For each statement presented, determine which option best complements or completes the thought being expressed. This involves drawing on general knowledge and critical thinking skills.', 'In these tasks, read each question carefully and choose the answer that best completes the thought, relying on your knowledge and reasoning abilities.', 'Explore topics ranging from ecology to human behavior in order to identify which description or statement resonates best with reality.', 'Gather your background knowledge on environmental science and wildlife behavior to appropriately fill in gaps in sentences provided in this task.', 'The essence of this task involves discerning information from statements provided, allowing you to select responses that make sense contextually and factually based on what you read.', 'You will be tasked with completing passages by identifying responses that align with the core idea presented, demonstrating comprehension and analytical skills.', 'The goal here is to analyze a specific question, using your knowledge to discern which answer choice best aligns with the provided information in the text.', 'The task involves selecting the most appropriate completion for a given sentence or question based on your knowledge of various subjects.', 'Examine the questions and apply your existing knowledge to determine which answer is correct, often involving basic principles from science, culture, or general wisdom.', 'Examine each context provided, and apply your understanding to select the most appropriate completion for the statement. This task relies on both analytical reasoning and knowledge retention.', 'You will explore different situations requiring factual discernment and make educated selections based on your ongoing learning experiences.', 'Engage with a passage and its related options by selecting the one that most appropriately fills in a blank or answers a question, showcasing your knowledge of relevant concepts.', 'Focus on understanding brief passages and evaluating corresponding answer choices based on content comprehension, which enables you to select fitting responses skillfully.', 'You will analyze different contexts or statements in order to find the best-fitting conclusion or solution, showcasing your critical thinking skills.', 'Your role is to discern key ideas from snippets of text, employing your understanding of various subjects to choose the right completion or answer.']
2026-07-05 21:51:10 DEBUG: task_embs=tensor([[-0.6084,  0.3443, -0.1993,  ...,  1.3047, -0.3443, -1.1184],
        [-0.7223,  0.4027, -1.1691,  ...,  1.1951,  0.3793, -0.8054],
        [-0.8231, -0.6885,  0.3572,  ...,  0.8542, -0.2498, -1.3253],
        ...,
        [-0.7454, -0.5989, -0.2044,  ..., -0.3059, -0.3779, -1.4189],
        [ 0.5183, -0.5366,  0.1732,  ...,  0.4610, -0.1153, -0.8960],
        [-0.3336, -0.0700, -0.7506,  ...,  0.1453,  0.2919, -1.1155]],
       device='cuda:0')
2026-07-05 21:51:10 DEBUG: ds_descs[ds_name]=['Your assignment involves interpreting real-life situations described in questions and using mathematical concepts to solve them. Carefully consider each scenario as you work towards the solution.', 'This task challenges you to translate narratives about quantities and costs into mathematical expressions for resolution.', 'This task focuses on fundamental math functions like addition, subtraction, multiplication, and percentage calculations in realistic situations.', 'You will be presented with various problem statements that require mathematical computations ranging from simple arithmetic to more complex reasoning based on the scenarios described.', 'Delve into word-based mathematical questions; extract essential information, make calculations, and reach conclusions using basic math skills.', 'Tackle a series of mathematical questions where your analytical skills will play a key role. You’ll often need to visualize or estimate based on provided details before calculating the final answer.', 'Your goal is to navigate through quantitative dilemmas by processing narrative details, allowing you to compute necessary results systematically.', 'The task involves solving math word problems, utilizing arithmetic operations to arrive at a final answer. You will need to analyze the details provided to form calculations step by step.', 'You are called to reason through a series of math-based inquiries that mimic real-life situations. Steps must be taken logically to work toward solving each question correctly.', 'Solve mathematical problems based on descriptions of events; identify key numbers and relationships, then calculate the final answer logically.', "Dive into applications of math in familiar contexts where you'll quantify aspects like time, money, or volume. Breaking down each problem clearly is essential for finding solutions.", 'This task tests your ability to understand relationships between numbers and how different variables influence outcomes in practical scenarios.', 'This task is focused on mathematical comprehension through word problems. You will examine given information and apply appropriate math techniques to derive answers clearly and accurately.', 'A step-by-step approach where evaluating each part of a scenario leads you closer to a final answer is crucial for successfully completing this type of task.', 'The task involves solving mathematical problems using basic arithmetic and logical reasoning to arrive at an answer based on given scenarios.', 'This task challenges you to use reasoning skills in a mathematical context, requiring you to connect pieces of information to find solutions in a stepwise manner.']
2026-07-05 21:51:10 DEBUG: task_embs=tensor([[ 0.2842,  0.8487, -0.1800,  ..., -0.8230, -0.7304,  1.2602],
        [-0.7731,  0.6391, -0.0221,  ...,  0.2010, -0.2719,  0.6700],
        [-1.0857,  0.1241, -0.6307,  ...,  0.8272, -0.7910,  1.1270],
        ...,
        [-0.2388,  0.3154, -0.1999,  ...,  0.4257, -0.0121, -0.0519],
        [-1.0030,  0.6507, -0.6173,  ...,  0.6507, -0.5067,  0.3061],
        [-0.5739,  0.6929, -0.3723,  ...,  1.0548, -0.1603,  0.0475]],
       device='cuda:0')
2026-07-05 21:51:10 INFO: split_name='val/seen', ds_names=[]
2026-07-05 21:51:10 INFO: split_name='val/unseen', ds_names=[]
2026-07-05 21:51:10 INFO: split_name='val/benchmark', ds_names=[]
2026-07-05 22:07:31 INFO: train/total_loss: 4.8848 || train/sft_loss: 4.8848 || train/generated_w_l2_loss: 0.0000 
2026-07-05 22:23:56 INFO: train/total_loss: 4.8953 || train/sft_loss: 4.8953 || train/generated_w_l2_loss: 0.0000 
2026-07-05 22:39:43 INFO: train/total_loss: 4.9269 || train/sft_loss: 4.9269 || train/generated_w_l2_loss: 0.0000 
2026-07-05 22:56:30 INFO: train/total_loss: 4.8730 || train/sft_loss: 4.8730 || train/generated_w_l2_loss: 0.0000 
2026-07-05 23:13:02 INFO: train/total_loss: 4.9231 || train/sft_loss: 4.9231 || train/generated_w_l2_loss: 0.0000 
2026-07-05 23:29:37 INFO: train/total_loss: 4.9095 || train/sft_loss: 4.9095 || train/generated_w_l2_loss: 0.0000 
2026-07-05 23:40:21 INFO: train/total_loss: 4.8803 || train/sft_loss: 4.8803 || train/generated_w_l2_loss: 0.0000 
2026-07-05 23:40:42 DEBUG: Model init kwargs: {'pretrained_model_name_or_path': 'Guilherme34/Firefly-V3', 'device_map': device(type='cuda'), 'torch_dtype': torch.bfloat16, 'trust_remote_code': True, 'output_hidden_states': True, 'output_attentions': False, 'attn_implementation': 'sdpa'}
2026-07-05 23:40:42 DEBUG: Resetting dropped connection: huggingface.co
2026-07-05 23:40:43 DEBUG: https://huggingface.co:443 "HEAD /Guilherme34/Firefly-V3/resolve/main/config.json HTTP/1.1" 307 0
2026-07-05 23:40:43 DEBUG: https://huggingface.co:443 "HEAD /api/resolve-cache/models/Guilherme34/Firefly-V3/b8a79e9e22bb888f872aef0f5c1475923f5edcf7/config.json HTTP/1.1" 200 0
2026-07-05 23:41:05 DEBUG: https://huggingface.co:443 "HEAD /Guilherme34/Firefly-V3/resolve/main/generation_config.json HTTP/1.1" 404 0