Upload Eval3 cotrain cycle 5 VLM LoRA

cycle_05_vlm_lora/README.md

@@ -0,0 +1,207 @@
+---
+base_model: HuggingFaceTB/SmolVLM2-2.2B-Instruct
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:HuggingFaceTB/SmolVLM2-2.2B-Instruct
+- lora
+- transformers
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1

cycle_05_vlm_lora/adapter_config.json

@@ -0,0 +1,45 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "HuggingFaceTB/SmolVLM2-2.2B-Instruct",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.19.1",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "v_proj",
+    "k_proj",
+    "q_proj",
+    "o_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

cycle_05_vlm_lora/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:60f043f22ac7d53eba64e15c1eccf65a11714c9e5eaa48c4fb76a71ab406aefb
+size 37162792

cycle_05_vlm_lora/chat_template.jinja

@@ -0,0 +1,2 @@
+<|im_start|>{% for message in messages %}{{message['role'] | capitalize}}{% if message['content'][0]['type'] == 'image' %}{{':'}}{% else %}{{': '}}{% endif %}{% for line in message['content'] %}{% if line['type'] == 'text' %}{{line['text']}}{% elif line['type'] == 'image' %}{{ '<image>' }}{% endif %}{% endfor %}<end_of_utterance>
+{% endfor %}{% if add_generation_prompt %}{{ 'Assistant:' }}{% endif %}

cycle_05_vlm_lora/cotrain_predictions.jsonl

@@ -0,0 +1,216 @@
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_000_start_frame_000.jpg", "episode_index": 0, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_000_middle_frame_045.jpg", "episode_index": 0, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_000_end_frame_089.jpg", "episode_index": 0, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_001_start_frame_000.jpg", "episode_index": 1, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_001_middle_frame_045.jpg", "episode_index": 1, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_001_end_frame_089.jpg", "episode_index": 1, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_002_start_frame_000.jpg", "episode_index": 2, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_002_middle_frame_045.jpg", "episode_index": 2, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_002_end_frame_089.jpg", "episode_index": 2, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_003_middle_frame_045.jpg", "episode_index": 3, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_003_end_frame_089.jpg", "episode_index": 3, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_004_start_frame_000.jpg", "episode_index": 4, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_004_middle_frame_045.jpg", "episode_index": 4, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_004_end_frame_089.jpg", "episode_index": 4, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_005_middle_frame_045.jpg", "episode_index": 5, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_005_end_frame_089.jpg", "episode_index": 5, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_006_start_frame_000.jpg", "episode_index": 6, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_006_middle_frame_045.jpg", "episode_index": 6, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_006_end_frame_089.jpg", "episode_index": 6, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_007_start_frame_000.jpg", "episode_index": 7, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_007_middle_frame_045.jpg", "episode_index": 7, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_008_start_frame_000.jpg", "episode_index": 8, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_008_middle_frame_045.jpg", "episode_index": 8, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_009_start_frame_000.jpg", "episode_index": 9, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "left", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_010_middle_frame_045.jpg", "episode_index": 10, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_011_middle_frame_045.jpg", "episode_index": 11, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_011_end_frame_089.jpg", "episode_index": 11, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_012_start_frame_000.jpg", "episode_index": 12, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_012_middle_frame_045.jpg", "episode_index": 12, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_012_end_frame_089.jpg", "episode_index": 12, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_013_start_frame_000.jpg", "episode_index": 13, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_013_middle_frame_045.jpg", "episode_index": 13, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_013_end_frame_089.jpg", "episode_index": 13, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_014_middle_frame_045.jpg", "episode_index": 14, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_014_end_frame_089.jpg", "episode_index": 14, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_015_start_frame_000.jpg", "episode_index": 15, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_015_middle_frame_045.jpg", "episode_index": 15, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_015_end_frame_089.jpg", "episode_index": 15, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_016_start_frame_000.jpg", "episode_index": 16, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_016_middle_frame_045.jpg", "episode_index": 16, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_017_start_frame_000.jpg", "episode_index": 17, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_017_middle_frame_045.jpg", "episode_index": 17, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_017_end_frame_089.jpg", "episode_index": 17, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_018_middle_frame_045.jpg", "episode_index": 18, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_018_end_frame_089.jpg", "episode_index": 18, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_019_start_frame_000.jpg", "episode_index": 19, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_019_middle_frame_045.jpg", "episode_index": 19, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_019_end_frame_089.jpg", "episode_index": 19, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "middle", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_020_middle_frame_045.jpg", "episode_index": 20, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_021_start_frame_000.jpg", "episode_index": 21, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_021_middle_frame_045.jpg", "episode_index": 21, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_022_start_frame_000.jpg", "episode_index": 22, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_022_middle_frame_045.jpg", "episode_index": 22, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_022_end_frame_089.jpg", "episode_index": 22, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_023_start_frame_000.jpg", "episode_index": 23, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_023_end_frame_089.jpg", "episode_index": 23, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_024_start_frame_000.jpg", "episode_index": 24, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_024_middle_frame_045.jpg", "episode_index": 24, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_024_end_frame_089.jpg", "episode_index": 24, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_025_start_frame_000.jpg", "episode_index": 25, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_025_middle_frame_045.jpg", "episode_index": 25, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_025_end_frame_089.jpg", "episode_index": 25, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_026_start_frame_000.jpg", "episode_index": 26, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_026_middle_frame_045.jpg", "episode_index": 26, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_027_start_frame_000.jpg", "episode_index": 27, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_027_middle_frame_045.jpg", "episode_index": 27, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_027_end_frame_089.jpg", "episode_index": 27, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_028_start_frame_000.jpg", "episode_index": 28, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_028_middle_frame_045.jpg", "episode_index": 28, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_028_end_frame_089.jpg", "episode_index": 28, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_029_start_frame_000.jpg", "episode_index": 29, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_029_end_frame_089.jpg", "episode_index": 29, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Taylor Swift", "ground_truth": "right", "prompt": "Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_030_start_frame_000.jpg", "episode_index": 30, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_030_middle_frame_045.jpg", "episode_index": 30, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_030_end_frame_089.jpg", "episode_index": 30, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_031_middle_frame_045.jpg", "episode_index": 31, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_031_end_frame_089.jpg", "episode_index": 31, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_032_middle_frame_045.jpg", "episode_index": 32, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_032_end_frame_089.jpg", "episode_index": 32, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_033_start_frame_000.jpg", "episode_index": 33, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_033_middle_frame_045.jpg", "episode_index": 33, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_033_end_frame_089.jpg", "episode_index": 33, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_034_middle_frame_045.jpg", "episode_index": 34, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_034_end_frame_089.jpg", "episode_index": 34, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_035_start_frame_000.jpg", "episode_index": 35, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_035_middle_frame_045.jpg", "episode_index": 35, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_035_end_frame_089.jpg", "episode_index": 35, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_036_middle_frame_045.jpg", "episode_index": 36, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_036_end_frame_089.jpg", "episode_index": 36, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_037_middle_frame_045.jpg", "episode_index": 37, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_038_start_frame_000.jpg", "episode_index": 38, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_038_middle_frame_045.jpg", "episode_index": 38, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_038_end_frame_089.jpg", "episode_index": 38, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_039_start_frame_000.jpg", "episode_index": 39, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_039_middle_frame_045.jpg", "episode_index": 39, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_039_end_frame_089.jpg", "episode_index": 39, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "left", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_040_start_frame_000.jpg", "episode_index": 40, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_040_middle_frame_045.jpg", "episode_index": 40, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_041_start_frame_000.jpg", "episode_index": 41, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_041_middle_frame_045.jpg", "episode_index": 41, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_041_end_frame_089.jpg", "episode_index": 41, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_042_start_frame_000.jpg", "episode_index": 42, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_042_end_frame_089.jpg", "episode_index": 42, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_043_start_frame_000.jpg", "episode_index": 43, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_043_middle_frame_045.jpg", "episode_index": 43, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_043_end_frame_089.jpg", "episode_index": 43, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_044_start_frame_000.jpg", "episode_index": 44, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_044_middle_frame_045.jpg", "episode_index": 44, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_044_end_frame_089.jpg", "episode_index": 44, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_045_start_frame_000.jpg", "episode_index": 45, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_045_middle_frame_045.jpg", "episode_index": 45, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_046_start_frame_000.jpg", "episode_index": 46, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_047_start_frame_000.jpg", "episode_index": 47, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_047_end_frame_089.jpg", "episode_index": 47, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_048_start_frame_000.jpg", "episode_index": 48, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_048_middle_frame_045.jpg", "episode_index": 48, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_048_end_frame_089.jpg", "episode_index": 48, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_049_start_frame_000.jpg", "episode_index": 49, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_049_middle_frame_045.jpg", "episode_index": 49, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_049_end_frame_089.jpg", "episode_index": 49, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "middle", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_050_start_frame_000.jpg", "episode_index": 50, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_050_middle_frame_045.jpg", "episode_index": 50, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_050_end_frame_089.jpg", "episode_index": 50, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_051_start_frame_000.jpg", "episode_index": 51, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_051_middle_frame_045.jpg", "episode_index": 51, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_051_end_frame_089.jpg", "episode_index": 51, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_052_middle_frame_045.jpg", "episode_index": 52, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_052_end_frame_089.jpg", "episode_index": 52, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_053_start_frame_000.jpg", "episode_index": 53, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_053_middle_frame_045.jpg", "episode_index": 53, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_053_end_frame_089.jpg", "episode_index": 53, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_054_start_frame_000.jpg", "episode_index": 54, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_054_middle_frame_045.jpg", "episode_index": 54, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_054_end_frame_089.jpg", "episode_index": 54, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_055_middle_frame_045.jpg", "episode_index": 55, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_055_end_frame_089.jpg", "episode_index": 55, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_056_start_frame_000.jpg", "episode_index": 56, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_057_start_frame_000.jpg", "episode_index": 57, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_057_middle_frame_045.jpg", "episode_index": 57, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_058_middle_frame_045.jpg", "episode_index": 58, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_058_end_frame_089.jpg", "episode_index": 58, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_059_start_frame_000.jpg", "episode_index": 59, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_059_middle_frame_045.jpg", "episode_index": 59, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_059_end_frame_089.jpg", "episode_index": 59, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Barack Obama", "ground_truth": "right", "prompt": "Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_060_start_frame_000.jpg", "episode_index": 60, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_060_middle_frame_045.jpg", "episode_index": 60, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_060_end_frame_089.jpg", "episode_index": 60, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_061_start_frame_000.jpg", "episode_index": 61, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_062_middle_frame_045.jpg", "episode_index": 62, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_062_end_frame_089.jpg", "episode_index": 62, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_063_start_frame_000.jpg", "episode_index": 63, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_063_middle_frame_045.jpg", "episode_index": 63, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_063_end_frame_089.jpg", "episode_index": 63, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_064_start_frame_000.jpg", "episode_index": 64, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_064_middle_frame_045.jpg", "episode_index": 64, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_064_end_frame_089.jpg", "episode_index": 64, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_065_start_frame_000.jpg", "episode_index": 65, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_065_middle_frame_045.jpg", "episode_index": 65, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_065_end_frame_089.jpg", "episode_index": 65, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_066_start_frame_000.jpg", "episode_index": 66, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_066_middle_frame_045.jpg", "episode_index": 66, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_066_end_frame_089.jpg", "episode_index": 66, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_067_start_frame_000.jpg", "episode_index": 67, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_068_start_frame_000.jpg", "episode_index": 68, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_068_end_frame_089.jpg", "episode_index": 68, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_069_start_frame_000.jpg", "episode_index": 69, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_069_middle_frame_045.jpg", "episode_index": 69, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_069_end_frame_089.jpg", "episode_index": 69, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "left", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "left", "prediction_raw": "left", "prediction": "left", "expected": "left", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_070_start_frame_000.jpg", "episode_index": 70, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_071_start_frame_000.jpg", "episode_index": 71, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_071_middle_frame_045.jpg", "episode_index": 71, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_071_end_frame_089.jpg", "episode_index": 71, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_072_middle_frame_045.jpg", "episode_index": 72, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_072_end_frame_089.jpg", "episode_index": 72, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_073_middle_frame_045.jpg", "episode_index": 73, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_073_end_frame_089.jpg", "episode_index": 73, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_074_middle_frame_045.jpg", "episode_index": 74, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_074_end_frame_089.jpg", "episode_index": 74, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_075_start_frame_000.jpg", "episode_index": 75, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_075_middle_frame_045.jpg", "episode_index": 75, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_075_end_frame_089.jpg", "episode_index": 75, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_076_start_frame_000.jpg", "episode_index": 76, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_076_middle_frame_045.jpg", "episode_index": 76, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_076_end_frame_089.jpg", "episode_index": 76, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_077_start_frame_000.jpg", "episode_index": 77, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_077_middle_frame_045.jpg", "episode_index": 77, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_078_start_frame_000.jpg", "episode_index": 78, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_078_middle_frame_045.jpg", "episode_index": 78, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_078_end_frame_089.jpg", "episode_index": 78, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_079_start_frame_000.jpg", "episode_index": 79, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_079_middle_frame_045.jpg", "episode_index": 79, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_079_end_frame_089.jpg", "episode_index": 79, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "middle", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "middle", "prediction_raw": "middle", "prediction": "middle", "expected": "middle", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_080_start_frame_000.jpg", "episode_index": 80, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_080_middle_frame_045.jpg", "episode_index": 80, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_080_end_frame_089.jpg", "episode_index": 80, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_081_start_frame_000.jpg", "episode_index": 81, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_081_middle_frame_045.jpg", "episode_index": 81, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_081_end_frame_089.jpg", "episode_index": 81, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_082_start_frame_000.jpg", "episode_index": 82, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_083_start_frame_000.jpg", "episode_index": 83, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_083_middle_frame_045.jpg", "episode_index": 83, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_083_end_frame_089.jpg", "episode_index": 83, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_084_start_frame_000.jpg", "episode_index": 84, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_084_middle_frame_045.jpg", "episode_index": 84, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_084_end_frame_089.jpg", "episode_index": 84, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_085_start_frame_000.jpg", "episode_index": 85, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_085_middle_frame_045.jpg", "episode_index": 85, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_086_start_frame_000.jpg", "episode_index": 86, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_086_end_frame_089.jpg", "episode_index": 86, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_087_start_frame_000.jpg", "episode_index": 87, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_087_end_frame_089.jpg", "episode_index": 87, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_088_start_frame_000.jpg", "episode_index": 88, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_088_end_frame_089.jpg", "episode_index": 88, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_089_start_frame_000.jpg", "episode_index": 89, "sample": "start", "frame_index": 0, "timestamp_s": 0.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_089_middle_frame_045.jpg", "episode_index": 89, "sample": "middle", "frame_index": 45, "timestamp_s": 3.0, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}
+{"image": "/home/shadeform/data/eval3_position_qa_3frames/images/episode_089_end_frame_089.jpg", "episode_index": 89, "sample": "end", "frame_index": 89, "timestamp_s": 5.933333, "target_person": "Yann LeCun", "ground_truth": "right", "prompt": "Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.", "answer": "right", "prediction_raw": "right", "prediction": "right", "expected": "right", "correct": true}

cycle_05_vlm_lora/epoch_01/README.md

@@ -0,0 +1,207 @@
+---
+base_model: HuggingFaceTB/SmolVLM2-2.2B-Instruct
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:HuggingFaceTB/SmolVLM2-2.2B-Instruct
+- lora
+- transformers
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1

cycle_05_vlm_lora/epoch_01/adapter_config.json

@@ -0,0 +1,45 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "HuggingFaceTB/SmolVLM2-2.2B-Instruct",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.19.1",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "v_proj",
+    "k_proj",
+    "q_proj",
+    "o_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

cycle_05_vlm_lora/epoch_01/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c28eaa297636f30f9e87bfc99912643a0e6d3972c5638e932fe86139e05234aa
+size 37162792

cycle_05_vlm_lora/epoch_01/chat_template.jinja

@@ -0,0 +1,2 @@
+<|im_start|>{% for message in messages %}{{message['role'] | capitalize}}{% if message['content'][0]['type'] == 'image' %}{{':'}}{% else %}{{': '}}{% endif %}{% for line in message['content'] %}{% if line['type'] == 'text' %}{{line['text']}}{% elif line['type'] == 'image' %}{{ '<image>' }}{% endif %}{% endfor %}<end_of_utterance>
+{% endfor %}{% if add_generation_prompt %}{{ 'Assistant:' }}{% endif %}

cycle_05_vlm_lora/epoch_01/processor_config.json

@@ -0,0 +1,79 @@
+{
+  "image_processor": {
+    "do_convert_rgb": true,
+    "do_image_splitting": true,
+    "do_normalize": true,
+    "do_pad": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_processor_type": "SmolVLMImageProcessor",
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "max_image_size": {
+      "longest_edge": 384
+    },
+    "resample": 1,
+    "rescale_factor": 0.00392156862745098,
+    "size": {
+      "longest_edge": 1536
+    },
+    "video_sampling": {
+      "fps": 1,
+      "max_frames": 64,
+      "video_size": {
+        "longest_edge": 384
+      }
+    }
+  },
+  "image_seq_len": 81,
+  "processor_class": "SmolVLMProcessor",
+  "video_processor": {
+    "data_format": "channels_first",
+    "default_to_square": true,
+    "do_convert_rgb": true,
+    "do_image_splitting": true,
+    "do_normalize": true,
+    "do_pad": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "do_sample_frames": false,
+    "fps": 1,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_processor_type": "SmolVLMImageProcessor",
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "max_image_size": {
+      "longest_edge": 384
+    },
+    "num_frames": 64,
+    "resample": 1,
+    "rescale_factor": 0.00392156862745098,
+    "return_metadata": false,
+    "size": {
+      "longest_edge": 1536
+    },
+    "video_processor_type": "SmolVLMVideoProcessor",
+    "video_sampling": {
+      "fps": 1,
+      "max_frames": 64,
+      "video_size": {
+        "longest_edge": 1536
+      }
+    }
+  }
+}

cycle_05_vlm_lora/epoch_01/tokenizer_config.json

@@ -0,0 +1,27 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": "<|im_start|>",
+  "clean_up_tokenization_spaces": false,
+  "end_of_utterance_token": "<end_of_utterance>",
+  "eos_token": "<end_of_utterance>",
+  "errors": "replace",
+  "fake_image_token": "<fake_token_around_image>",
+  "global_image_token": "<global-img>",
+  "image_token": "<image>",
+  "is_local": false,
+  "legacy": false,
+  "model_max_length": 16384,
+  "model_specific_special_tokens": {
+    "end_of_utterance_token": "<end_of_utterance>",
+    "fake_image_token": "<fake_token_around_image>",
+    "global_image_token": "<global-img>",
+    "image_token": "<image>"
+  },
+  "pad_token": "<|im_end|>",
+  "processor_class": "SmolVLMProcessor",
+  "tokenizer_class": "GPT2Tokenizer",
+  "truncation_side": "left",
+  "unk_token": "<|endoftext|>",
+  "vocab_size": 49152
+}

cycle_05_vlm_lora/epoch_02/README.md

@@ -0,0 +1,207 @@
+---
+base_model: HuggingFaceTB/SmolVLM2-2.2B-Instruct
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:HuggingFaceTB/SmolVLM2-2.2B-Instruct
+- lora
+- transformers
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1

cycle_05_vlm_lora/epoch_02/adapter_config.json

@@ -0,0 +1,45 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "HuggingFaceTB/SmolVLM2-2.2B-Instruct",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.19.1",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "v_proj",
+    "k_proj",
+    "q_proj",
+    "o_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

cycle_05_vlm_lora/epoch_02/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:60f043f22ac7d53eba64e15c1eccf65a11714c9e5eaa48c4fb76a71ab406aefb
+size 37162792

cycle_05_vlm_lora/epoch_02/chat_template.jinja

@@ -0,0 +1,2 @@
+<|im_start|>{% for message in messages %}{{message['role'] | capitalize}}{% if message['content'][0]['type'] == 'image' %}{{':'}}{% else %}{{': '}}{% endif %}{% for line in message['content'] %}{% if line['type'] == 'text' %}{{line['text']}}{% elif line['type'] == 'image' %}{{ '<image>' }}{% endif %}{% endfor %}<end_of_utterance>
+{% endfor %}{% if add_generation_prompt %}{{ 'Assistant:' }}{% endif %}

cycle_05_vlm_lora/epoch_02/processor_config.json

@@ -0,0 +1,79 @@
+{
+  "image_processor": {
+    "do_convert_rgb": true,
+    "do_image_splitting": true,
+    "do_normalize": true,
+    "do_pad": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_processor_type": "SmolVLMImageProcessor",
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "max_image_size": {
+      "longest_edge": 384
+    },
+    "resample": 1,
+    "rescale_factor": 0.00392156862745098,
+    "size": {
+      "longest_edge": 1536
+    },
+    "video_sampling": {
+      "fps": 1,
+      "max_frames": 64,
+      "video_size": {
+        "longest_edge": 384
+      }
+    }
+  },
+  "image_seq_len": 81,
+  "processor_class": "SmolVLMProcessor",
+  "video_processor": {
+    "data_format": "channels_first",
+    "default_to_square": true,
+    "do_convert_rgb": true,
+    "do_image_splitting": true,
+    "do_normalize": true,
+    "do_pad": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "do_sample_frames": false,
+    "fps": 1,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_processor_type": "SmolVLMImageProcessor",
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "max_image_size": {
+      "longest_edge": 384
+    },
+    "num_frames": 64,
+    "resample": 1,
+    "rescale_factor": 0.00392156862745098,
+    "return_metadata": false,
+    "size": {
+      "longest_edge": 1536
+    },
+    "video_processor_type": "SmolVLMVideoProcessor",
+    "video_sampling": {
+      "fps": 1,
+      "max_frames": 64,
+      "video_size": {
+        "longest_edge": 1536
+      }
+    }
+  }
+}

cycle_05_vlm_lora/epoch_02/tokenizer_config.json

@@ -0,0 +1,27 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": "<|im_start|>",
+  "clean_up_tokenization_spaces": false,
+  "end_of_utterance_token": "<end_of_utterance>",
+  "eos_token": "<end_of_utterance>",
+  "errors": "replace",
+  "fake_image_token": "<fake_token_around_image>",
+  "global_image_token": "<global-img>",
+  "image_token": "<image>",
+  "is_local": false,
+  "legacy": false,
+  "model_max_length": 16384,
+  "model_specific_special_tokens": {
+    "end_of_utterance_token": "<end_of_utterance>",
+    "fake_image_token": "<fake_token_around_image>",
+    "global_image_token": "<global-img>",
+    "image_token": "<image>"
+  },
+  "pad_token": "<|im_end|>",
+  "processor_class": "SmolVLMProcessor",
+  "tokenizer_class": "GPT2Tokenizer",
+  "truncation_side": "left",
+  "unk_token": "<|endoftext|>",
+  "vocab_size": 49152
+}

cycle_05_vlm_lora/eval_predictions.csv

@@ -0,0 +1,55 @@
+image,episode_index,sample,frame_index,timestamp_s,target_person,ground_truth,prompt,answer,prediction_raw,prediction,correct
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_003_start_frame_000.jpg,3,start,0,0.0,Taylor Swift,left,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_005_start_frame_000.jpg,5,start,0,0.0,Taylor Swift,left,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_007_end_frame_089.jpg,7,end,89,5.933333,Taylor Swift,left,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_008_end_frame_089.jpg,8,end,89,5.933333,Taylor Swift,left,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_009_middle_frame_045.jpg,9,middle,45,3.0,Taylor Swift,left,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_009_end_frame_089.jpg,9,end,89,5.933333,Taylor Swift,left,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_010_start_frame_000.jpg,10,start,0,0.0,Taylor Swift,middle,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_010_end_frame_089.jpg,10,end,89,5.933333,Taylor Swift,middle,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_011_start_frame_000.jpg,11,start,0,0.0,Taylor Swift,middle,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_014_start_frame_000.jpg,14,start,0,0.0,Taylor Swift,middle,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_016_end_frame_089.jpg,16,end,89,5.933333,Taylor Swift,middle,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_018_start_frame_000.jpg,18,start,0,0.0,Taylor Swift,middle,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_020_start_frame_000.jpg,20,start,0,0.0,Taylor Swift,right,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_020_end_frame_089.jpg,20,end,89,5.933333,Taylor Swift,right,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_021_end_frame_089.jpg,21,end,89,5.933333,Taylor Swift,right,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_023_middle_frame_045.jpg,23,middle,45,3.0,Taylor Swift,right,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_026_end_frame_089.jpg,26,end,89,5.933333,Taylor Swift,right,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_029_middle_frame_045.jpg,29,middle,45,3.0,Taylor Swift,right,"Is Taylor Swift on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_031_start_frame_000.jpg,31,start,0,0.0,Barack Obama,left,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_032_start_frame_000.jpg,32,start,0,0.0,Barack Obama,left,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_034_start_frame_000.jpg,34,start,0,0.0,Barack Obama,left,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_036_start_frame_000.jpg,36,start,0,0.0,Barack Obama,left,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_037_start_frame_000.jpg,37,start,0,0.0,Barack Obama,left,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_037_end_frame_089.jpg,37,end,89,5.933333,Barack Obama,left,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_040_end_frame_089.jpg,40,end,89,5.933333,Barack Obama,middle,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_042_middle_frame_045.jpg,42,middle,45,3.0,Barack Obama,middle,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_045_end_frame_089.jpg,45,end,89,5.933333,Barack Obama,middle,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_046_middle_frame_045.jpg,46,middle,45,3.0,Barack Obama,middle,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_046_end_frame_089.jpg,46,end,89,5.933333,Barack Obama,middle,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_047_middle_frame_045.jpg,47,middle,45,3.0,Barack Obama,middle,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_052_start_frame_000.jpg,52,start,0,0.0,Barack Obama,right,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_055_start_frame_000.jpg,55,start,0,0.0,Barack Obama,right,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_056_middle_frame_045.jpg,56,middle,45,3.0,Barack Obama,right,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_056_end_frame_089.jpg,56,end,89,5.933333,Barack Obama,right,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_057_end_frame_089.jpg,57,end,89,5.933333,Barack Obama,right,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_058_start_frame_000.jpg,58,start,0,0.0,Barack Obama,right,"Is Barack Obama on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_061_middle_frame_045.jpg,61,middle,45,3.0,Yann LeCun,left,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_061_end_frame_089.jpg,61,end,89,5.933333,Yann LeCun,left,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_062_start_frame_000.jpg,62,start,0,0.0,Yann LeCun,left,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_067_middle_frame_045.jpg,67,middle,45,3.0,Yann LeCun,left,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_067_end_frame_089.jpg,67,end,89,5.933333,Yann LeCun,left,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_068_middle_frame_045.jpg,68,middle,45,3.0,Yann LeCun,left,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",left,left,left,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_070_middle_frame_045.jpg,70,middle,45,3.0,Yann LeCun,middle,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_070_end_frame_089.jpg,70,end,89,5.933333,Yann LeCun,middle,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_072_start_frame_000.jpg,72,start,0,0.0,Yann LeCun,middle,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_073_start_frame_000.jpg,73,start,0,0.0,Yann LeCun,middle,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_074_start_frame_000.jpg,74,start,0,0.0,Yann LeCun,middle,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_077_end_frame_089.jpg,77,end,89,5.933333,Yann LeCun,middle,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",middle,middle,middle,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_082_middle_frame_045.jpg,82,middle,45,3.0,Yann LeCun,right,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_082_end_frame_089.jpg,82,end,89,5.933333,Yann LeCun,right,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_085_end_frame_089.jpg,85,end,89,5.933333,Yann LeCun,right,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_086_middle_frame_045.jpg,86,middle,45,3.0,Yann LeCun,right,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_087_middle_frame_045.jpg,87,middle,45,3.0,Yann LeCun,right,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True
+/home/shadeform/data/eval3_position_qa_3frames/images/episode_088_middle_frame_045.jpg,88,middle,45,3.0,Yann LeCun,right,"Is Yann LeCun on the left, middle, or right? Answer only one word: left, middle, or right.",right,right,right,True

cycle_05_vlm_lora/processor_config.json

@@ -0,0 +1,79 @@
+{
+  "image_processor": {
+    "do_convert_rgb": true,
+    "do_image_splitting": true,
+    "do_normalize": true,
+    "do_pad": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_processor_type": "SmolVLMImageProcessor",
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "max_image_size": {
+      "longest_edge": 384
+    },
+    "resample": 1,
+    "rescale_factor": 0.00392156862745098,
+    "size": {
+      "longest_edge": 1536
+    },
+    "video_sampling": {
+      "fps": 1,
+      "max_frames": 64,
+      "video_size": {
+        "longest_edge": 384
+      }
+    }
+  },
+  "image_seq_len": 81,
+  "processor_class": "SmolVLMProcessor",
+  "video_processor": {
+    "data_format": "channels_first",
+    "default_to_square": true,
+    "do_convert_rgb": true,
+    "do_image_splitting": true,
+    "do_normalize": true,
+    "do_pad": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "do_sample_frames": false,
+    "fps": 1,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_processor_type": "SmolVLMImageProcessor",
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "max_image_size": {
+      "longest_edge": 384
+    },
+    "num_frames": 64,
+    "resample": 1,
+    "rescale_factor": 0.00392156862745098,
+    "return_metadata": false,
+    "size": {
+      "longest_edge": 1536
+    },
+    "video_processor_type": "SmolVLMVideoProcessor",
+    "video_sampling": {
+      "fps": 1,
+      "max_frames": 64,
+      "video_size": {
+        "longest_edge": 1536
+      }
+    }
+  }
+}

cycle_05_vlm_lora/summary.json

@@ -0,0 +1,78 @@
+{
+  "checkpoint": "/home/shadeform/outputs/train/eval3_cotrain_action_lora_auxvlm_5k/cycle_04_vlm_lora",
+  "data_dir": "/home/shadeform/data/eval3_position_qa_3frames",
+  "output_dir": "/home/shadeform/outputs/train/eval3_cotrain_action_lora_auxvlm_5k/cycle_05_vlm_lora",
+  "train_examples": 216,
+  "eval_examples": 54,
+  "epochs": 20,
+  "batch_size": 1,
+  "grad_accum": 4,
+  "lr": 1e-05,
+  "global_step": 100,
+  "eval": {
+    "examples": 54,
+    "correct": 54,
+    "accuracy": 1.0,
+    "grouped": {
+      "target_person": {
+        "Barack Obama": {
+          "correct": 18,
+          "total": 18,
+          "accuracy": 1.0,
+          "prediction_counts": {
+            "left": 6,
+            "middle": 6,
+            "right": 6
+          }
+        },
+        "Taylor Swift": {
+          "correct": 18,
+          "total": 18,
+          "accuracy": 1.0,
+          "prediction_counts": {
+            "left": 6,
+            "middle": 6,
+            "right": 6
+          }
+        },
+        "Yann LeCun": {
+          "correct": 18,
+          "total": 18,
+          "accuracy": 1.0,
+          "prediction_counts": {
+            "left": 6,
+            "middle": 6,
+            "right": 6
+          }
+        }
+      },
+      "ground_truth": {
+        "left": {
+          "correct": 18,
+          "total": 18,
+          "accuracy": 1.0,
+          "prediction_counts": {
+            "left": 18
+          }
+        },
+        "middle": {
+          "correct": 18,
+          "total": 18,
+          "accuracy": 1.0,
+          "prediction_counts": {
+            "middle": 18
+          }
+        },
+        "right": {
+          "correct": 18,
+          "total": 18,
+          "accuracy": 1.0,
+          "prediction_counts": {
+            "right": 18
+          }
+        }
+      }
+    },
+    "output_csv": "/home/shadeform/outputs/train/eval3_cotrain_action_lora_auxvlm_5k/cycle_05_vlm_lora/eval_predictions.csv"
+  }
+}

cycle_05_vlm_lora/tokenizer_config.json

@@ -0,0 +1,27 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": "<|im_start|>",
+  "clean_up_tokenization_spaces": false,
+  "end_of_utterance_token": "<end_of_utterance>",
+  "eos_token": "<end_of_utterance>",
+  "errors": "replace",
+  "fake_image_token": "<fake_token_around_image>",
+  "global_image_token": "<global-img>",
+  "image_token": "<image>",
+  "is_local": false,
+  "legacy": false,
+  "model_max_length": 16384,
+  "model_specific_special_tokens": {
+    "end_of_utterance_token": "<end_of_utterance>",
+    "fake_image_token": "<fake_token_around_image>",
+    "global_image_token": "<global-img>",
+    "image_token": "<image>"
+  },
+  "pad_token": "<|im_end|>",
+  "processor_class": "SmolVLMProcessor",
+  "tokenizer_class": "GPT2Tokenizer",
+  "truncation_side": "left",
+  "unk_token": "<|endoftext|>",
+  "vocab_size": 49152
+}