Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+wandb/run-20250501_161111-rkamupqo/run-rkamupqo.wandb filter=lfs diff=lfs merge=lfs -text
+wandb/run-20250502_045804-vkih00cc/run-vkih00cc.wandb filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,202 @@
----
-license: apache-2.0
----
+---
+base_model: huggyllama/llama-7b
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.15.1

adapter_config.json

@@ -0,0 +1,43 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama"
+  },
+  "base_model_name_or_path": "huggyllama/llama-7b",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 4,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "up_proj",
+    "v_proj",
+    "gate_proj",
+    "lm_head",
+    "o_proj",
+    "k_proj",
+    "down_proj"
+  ],
+  "task_type": null,
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6570d74e04508589df8052654d2b41c65f0ed18a11e149301ae260ed8527de7
+size 282490008

added_tokens.json

@@ -0,0 +1,3 @@
+{
+  "<pad>": 32000
+}

arguments.json

@@ -0,0 +1,60 @@
+{
+    "model_name_or_path": "huggyllama/llama-7b",
+    "recompute_baseline": false,
+    "cache_dir": "/home/panda/pda-llm/cache/sft-2000",
+    "max_length": 1024,
+    "trust_remote_code": true,
+    "train_datasets": [
+        [
+            "SAFE-ALPACA/2000",
+            {
+                "proportion": 1.0
+            }
+        ]
+    ],
+    "eval_datasets": null,
+    "safety_ratio_tol": 10.0,
+    "safe_sft": false,
+    "resilient_coeff": 1.0,
+    "epochs": 6,
+    "per_device_train_batch_size": 4,
+    "per_device_eval_batch_size": 4,
+    "gradient_accumulation_steps": 32,
+    "gradient_checkpointing": true,
+    "lr": 0.0001,
+    "lr_scheduler_type": "cosine",
+    "lr_warmup_ratio": 0.03,
+    "weight_decay": 0.0,
+    "seed": 42,
+    "fp16": true,
+    "bf16": false,
+    "tf32": true,
+    "lora_r": 4,
+    "lora_alpha": 16,
+    "lora_dropout": 0.05,
+    "eval_strategy": "epoch",
+    "eval_interval": 1000000,
+    "need_eval": true,
+    "eval_split_ratio": null,
+    "output_dir": "/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10",
+    "log_type": "wandb",
+    "log_dir": "/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10",
+    "log_project": "SAFE-SFT-v3",
+    "log_run_name": "safe-sft-2025-05-02-04-58-03",
+    "save_16bit": false,
+    "save_interval": 1000000,
+    "local_rank": 0,
+    "zero_stage": 0,
+    "offload": "none",
+    "deepspeed": false,
+    "deepspeed_config": null,
+    "deepscale": false,
+    "deepscale_config": null,
+    "global_rank": 0,
+    "device": {
+        "type": "torch.device",
+        "repr": "device(type='cuda', index=0)"
+    },
+    "num_update_steps_per_epoch": 86,
+    "total_training_steps": 516
+}

arguments.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b899acc0edf510c4d10c788943f989e0d7adf09daa07d02616b4278edd92f464
+size 1227

config.json

@@ -0,0 +1,33 @@
+{
+  "_attn_implementation_autoset": true,
+  "_name_or_path": "huggyllama/llama-7b",
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "initializer_range": 0.02,
+  "intermediate_size": 11008,
+  "max_position_embeddings": 2048,
+  "max_sequence_length": 2048,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 32,
+  "num_key_value_heads": 32,
+  "pad_token_id": 32000,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": null,
+  "rope_theta": 10000.0,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float16",
+  "transformers_version": "4.49.0",
+  "use_cache": true,
+  "vocab_size": 32001
+}

environ.txt

@@ -0,0 +1,61 @@
+BROWSER=/home/panda/.vscode-server/cli/servers/Stable-cd4ee3b1c348a13bafd8f9ad8060705f6d4b9cba/server/bin/helpers/browser.sh
+COLORTERM=truecolor
+CONDA_DEFAULT_ENV=pda
+CONDA_EXE=/home/panda/miniconda3/bin/conda
+CONDA_PREFIX=/home/panda/miniconda3/envs/pda
+CONDA_PREFIX_1=/home/panda/miniconda3
+CONDA_PROMPT_MODIFIER=(pda) 
+CONDA_PYTHON_EXE=/home/panda/miniconda3/bin/python
+CONDA_SHLVL=2
+CROSS_RANK=0
+CROSS_SIZE=1
+CUDA_MODULE_LOADING=LAZY
+CUDA_VISIBLE_DEVICES=0,1
+DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1010/bus
+GIT_ASKPASS=/home/panda/.vscode-server/cli/servers/Stable-cd4ee3b1c348a13bafd8f9ad8060705f6d4b9cba/server/extensions/git/dist/askpass.sh
+HOME=/home/panda
+LANG=en_US.UTF-8
+LESSCLOSE=/usr/bin/lesspipe %s %s
+LESSOPEN=| /usr/bin/lesspipe %s
+LOCAL_RANK=0
+LOCAL_SIZE=2
+LOGLEVEL=WARNING
+LOGNAME=panda
+LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:
+MASTER_ADDR=127.0.0.1
+MASTER_PORT=56570
+MOTD_SHOWN=pam
+OLDPWD=/home/panda/pda-llm
+PATH=/home/panda/miniconda3/envs/pda/bin:/home/panda/miniconda3/condabin:/home/panda/.local/bin:/home/panda/miniconda3/envs/pda/bin:/home/panda/.vscode-server/cli/servers/Stable-cd4ee3b1c348a13bafd8f9ad8060705f6d4b9cba/server/bin/remote-cli:/home/panda/.local/bin:/home/panda/miniconda3/envs/pda/bin:/home/panda/miniconda3/condabin:/home/panda/.cargo/bin:/home/panda/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/home/panda/.vscode-server/extensions/ms-python.debugpy-2025.6.0-linux-x64/bundled/scripts/noConfigScripts:/home/panda/.vscode-server/data/User/globalStorage/github.copilot-chat/debugCommand
+PWD=/home/panda/pda-llm/scripts
+PYTHONHASHSEED=42
+PYTHONPATH=/home/panda/pda-llm
+RANK=0
+SHELL=/bin/sh
+SHLVL=3
+SSH_CLIENT=10.103.69.12 53248 22
+SSH_CONNECTION=10.103.69.12 50318 158.130.111.235 22
+SSL_CERT_DIR=/usr/lib/ssl/certs
+SSL_CERT_FILE=/usr/lib/ssl/certs/ca-certificates.crt
+TERM=screen
+TERM_PROGRAM=vscode
+TERM_PROGRAM_VERSION=1.96.4
+TMUX=/tmp//tmux-1010/default,2905761,12
+TMUX_PANE=%12
+USER=panda
+VSCODE_GIT_ASKPASS_EXTRA_ARGS=
+VSCODE_GIT_ASKPASS_MAIN=/home/panda/.vscode-server/cli/servers/Stable-cd4ee3b1c348a13bafd8f9ad8060705f6d4b9cba/server/extensions/git/dist/askpass-main.js
+VSCODE_GIT_ASKPASS_NODE=/home/panda/.vscode-server/cli/servers/Stable-cd4ee3b1c348a13bafd8f9ad8060705f6d4b9cba/server/node
+VSCODE_GIT_IPC_HANDLE=/run/user/1010/vscode-git-1d8b0ea871.sock
+VSCODE_IPC_HOOK_CLI=/run/user/1010/vscode-ipc-34f3fe5d-87d6-4842-b67c-b7ef4efae672.sock
+WANDB_API_KEY=6a71e7fad84fe1aa8f6ccaa01e4e02fcf4c7ffb4
+WANDB_ENTITY=alelab
+WANDB_MODE=online
+WANDB_SERVICE=2-2178487-tcp-localhost-44261
+WORLD_SIZE=2
+XDG_DATA_DIRS=/usr/local/share:/usr/share:/var/lib/snapd/desktop
+XDG_RUNTIME_DIR=/run/user/1010
+XDG_SESSION_CLASS=user
+XDG_SESSION_ID=1150
+XDG_SESSION_TYPE=tty
+_=/home/panda/miniconda3/envs/pda/bin/deepspeed

script.sh

@@ -0,0 +1,198 @@
+#!/usr/bin/env bash
+#
+# Copyright 2023-2024 PKU-Alignment Team. All Rights Reserved.
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+# ==============================================================================
+
+if [ -z "${BASH_VERSION}" ]; then
+	echo "Please use bash to run this script." >&2
+	exit 1
+fi
+
+set -x
+
+SCRIPT_DIR="$(cd "$(dirname "$0")" &>/dev/null && pwd)"
+ROOT_DIR="$(dirname "${SCRIPT_DIR}")"
+export PYTHONPATH="${ROOT_DIR}${PYTHONPATH:+:${PYTHONPATH}}"
+export LOGLEVEL="${LOGLEVEL:-WARNING}"
+export WANDB_MODE=online
+export WANDB_ENTITY="alelab"
+
+MODEL_NAME_OR_PATH="huggyllama/llama-7b"
+timestamp="$(date +%Y%m%d-%H%M%S)"
+unset HOSTFILE
+ZERO_STAGE=0
+OFFLOAD="none"
+SAFE_SFT=False
+# GRIDSEARCH PARAMS
+SAFETY_RATIO_TOL=10
+RESILIENT_COEFF=1
+LEARNING_RATE=1e-4
+NUM_SAFETY_SAMPLES="100"
+
+while [[ "$#" -gt 0 ]]; do
+	arg="$1"
+	shift
+	case "${arg}" in
+		--model_name_or_path)
+			MODEL_NAME_OR_PATH="$1"
+			shift
+			;;
+		--model_name_or_path=*)
+			MODEL_NAME_OR_PATH="${arg#*=}"
+			;;
+		--output_dir)
+			OUTPUT_DIR="$1"
+			shift
+			;;
+		--output_dir=*)
+			OUTPUT_DIR="${arg#*=}"
+			;;
+		--hostfile)
+			HOSTFILE="$1"
+			shift
+			;;
+		--hostfile=*)
+			HOSTFILE="${arg#*=}"
+			;;
+		--zero_stage)
+			ZERO_STAGE="$1"
+			shift
+			;;
+		--zero_stage=*)
+			ZERO_STAGE="${arg#*=}"
+			;;
+		--offload)
+			OFFLOAD="$1"
+			shift
+			;;
+		--offload=*)
+			OFFLOAD="${arg#*=}"
+			;;
+		--safety_ratio_tol)
+			SAFETY_RATIO_TOL="$1"
+			shift
+			;;
+		--safety_ratio_tol=*)
+			SAFETY_RATIO_TOL="${arg#*=}"
+			;;
+		--resilient_coeff)
+			RESILIENT_COEFF="$1"
+			shift
+			;;
+		--resilient_coeff=*)
+			RESILIENT_COEFF="${arg#*=}"
+			;;
+		--learning_rate)
+			LEARNING_RATE="$1"
+			shift
+			;;
+		--learning_rate=*)
+			LEARNING_RATE="${arg#*=}"
+			;;
+		--safe_sft)
+			SAFE_SFT="$1"
+			shift
+			;;
+		--safe_sft=*)
+			SAFE_SFT="${arg#*=}"
+			;;
+		--num_safety_samples)
+			NUM_SAFETY_SAMPLES="$1"
+			shift
+			;;
+		--num_safety_samples=*)
+			NUM_SAFETY_SAMPLES="${arg#*=}"
+			;;
+		*)
+			echo "Unknown parameter passed: '${arg}'" >&2
+			exit 1
+			;;
+	esac
+done
+
+OUTPUT_DIR="${ROOT_DIR}/output/sft-safe/${NUM_SAFETY_SAMPLES}/run-${SAFE_SFT}-${NUM_SAFETY_SAMPLES}-${RESILIENT_COEFF}-${SAFETY_RATIO_TOL}"
+mkdir -p "${OUTPUT_DIR}"
+OUTPUT_DIR="$(cd "${OUTPUT_DIR}" &>/dev/null && pwd)"
+if [[ ! -f "${OUTPUT_DIR}/.gitignore" ]]; then
+	echo '*' >"${OUTPUT_DIR}/.gitignore"
+fi
+
+cp -f "$0" "${OUTPUT_DIR}/script.sh"
+
+export WANDB_API_KEY="6a71e7fad84fe1aa8f6ccaa01e4e02fcf4c7ffb4"
+if [[ -z "${WANDB_API_KEY}" ]]; then
+	export WANDB_MODE="offline"
+fi
+
+MASTER_PORT_START=10000
+MASTER_PORT_END=65535
+MASTER_PORT="$(
+	comm -23 \
+		<(seq "${MASTER_PORT_START}" "${MASTER_PORT_END}" | sort) \
+		<(ss -Htan | awk '{ print $4 }' | awk -F ':' '{ print $NF }' | sort -u) |
+		shuf | head -n 1
+)"
+
+DEEPSPEED_ARGS=()
+if [[ -n "${HOSTFILE+x}" ]]; then
+	DEEPSPEED_ARGS+=("--hostfile" "${HOSTFILE}")
+fi
+DEEPSPEED_ARGS+=("--master_port" "${MASTER_PORT}")
+
+exec 1> >(tee "${OUTPUT_DIR}/stdout.log" >&1) 2> >(tee "${OUTPUT_DIR}/stderr.log" >&2)
+echo "--------- Environment sanity check ---------"
+echo "shell:        $0 running under bash $BASH_VERSION"
+echo "conda env:    ${CONDA_DEFAULT_ENV:-<none>}"
+echo "python:       $(which python)"
+python - <<'PY'
+import sys, os
+print("sys.executable :", sys.executable)
+print("python version :", sys.version.split()[0])
+print("CONDA_PREFIX   :", os.environ.get("CONDA_PREFIX"))
+PY
+echo "deepspeed:    $(command -v deepspeed)"
+echo "--------------------------------------------"
+
+CUDA_VISIBLE_DEVICES=0,1 deepspeed "${DEEPSPEED_ARGS[@]}" \
+	--module safe_rlhf.algorithms.safe_ft \
+	--train_datasets "SAFE-ALPACA/${NUM_SAFETY_SAMPLES}" \
+	--model_name_or_path "${MODEL_NAME_OR_PATH}" \
+	--cache_dir "${ROOT_DIR}/cache/sft-${NUM_SAFETY_SAMPLES}" \
+	--safe_sft "${SAFE_SFT}"	 \
+	--max_length 1024 \
+	--trust_remote_code True \
+	--epochs 6 \
+	--per_device_train_batch_size 4 \
+	--per_device_eval_batch_size 4 \
+	--gradient_accumulation_steps 32 \
+	--gradient_checkpointing \
+	--learning_rate  "${LEARNING_RATE}" \
+	--lr_scheduler_type cosine \
+	--lr_warmup_ratio 0.03 \
+	--weight_decay 0.0 \
+	--seed 42 \
+	--output_dir "${OUTPUT_DIR}" \
+	--log_type wandb \
+	--log_project SAFE-SFT-v3 \
+	--zero_stage "${ZERO_STAGE}" \
+	--offload "${OFFLOAD}" \
+	--safety_ratio_tol "${SAFETY_RATIO_TOL}" \
+	--resilient_coeff "${RESILIENT_COEFF}" \
+	--lora_r "4" \
+	--lora_alpha "16" \
+	--lora_dropout "0.05" \
+	--bf16 False \
+	--fp16 True \
+	--tf32 True

special_tokens_map.json

@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

stdout.log

@@ -0,0 +1,54 @@
+--------- Environment sanity check ---------
+shell:        ./sft-safe.sh running under bash 5.0.17(1)-release
+conda env:    pda
+python:       /home/panda/miniconda3/envs/pda/bin/python
+sys.executable : /home/panda/miniconda3/envs/pda/bin/python
+python version : 3.11.11
+CONDA_PREFIX   : /home/panda/miniconda3/envs/pda
+deepspeed:    /home/panda/miniconda3/envs/pda/bin/deepspeed
+--------------------------------------------
+[2025-05-02 04:57:40,214] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2025-05-02 04:57:41,980] [WARNING] [runner.py:215:fetch_hostfile] Unable to find hostfile, will proceed with training with local resources only.
+Detected VISIBLE_DEVICES=0,1: setting --include=localhost:0,1
+[2025-05-02 04:57:41,980] [INFO] [runner.py:605:main] cmd = /home/panda/miniconda3/envs/pda/bin/python -u -m deepspeed.launcher.launch --world_info=eyJsb2NhbGhvc3QiOiBbMCwgMV19 --master_addr=127.0.0.1 --master_port=56570 --module --enable_each_rank_log=None safe_rlhf.algorithms.safe_ft --train_datasets SAFE-ALPACA/2000 --model_name_or_path huggyllama/llama-7b --cache_dir /home/panda/pda-llm/cache/sft-2000 --safe_sft false --max_length 1024 --trust_remote_code True --epochs 6 --per_device_train_batch_size 4 --per_device_eval_batch_size 4 --gradient_accumulation_steps 32 --gradient_checkpointing --learning_rate 1e-4 --lr_scheduler_type cosine --lr_warmup_ratio 0.03 --weight_decay 0.0 --seed 42 --output_dir /home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10 --log_type wandb --log_project SAFE-SFT-v3 --zero_stage 0 --offload none --safety_ratio_tol 10 --resilient_coeff 1 --lora_r 4 --lora_alpha 16 --lora_dropout 0.05 --bf16 False --fp16 True --tf32 True
+[2025-05-02 04:57:43,137] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2025-05-02 04:57:44,843] [INFO] [launch.py:146:main] WORLD INFO DICT: {'localhost': [0, 1]}
+[2025-05-02 04:57:44,843] [INFO] [launch.py:152:main] nnodes=1, num_local_procs=2, node_rank=0
+[2025-05-02 04:57:44,843] [INFO] [launch.py:163:main] global_rank_mapping=defaultdict(<class 'list'>, {'localhost': [0, 1]})
+[2025-05-02 04:57:44,843] [INFO] [launch.py:164:main] dist_world_size=2
+[2025-05-02 04:57:44,843] [INFO] [launch.py:168:main] Setting CUDA_VISIBLE_DEVICES=0,1
+[2025-05-02 04:57:44,844] [INFO] [launch.py:256:main] process 2178487 spawned with command: ['/home/panda/miniconda3/envs/pda/bin/python', '-u', '-m', 'safe_rlhf.algorithms.safe_ft', '--local_rank=0', '--train_datasets', 'SAFE-ALPACA/2000', '--model_name_or_path', 'huggyllama/llama-7b', '--cache_dir', '/home/panda/pda-llm/cache/sft-2000', '--safe_sft', 'false', '--max_length', '1024', '--trust_remote_code', 'True', '--epochs', '6', '--per_device_train_batch_size', '4', '--per_device_eval_batch_size', '4', '--gradient_accumulation_steps', '32', '--gradient_checkpointing', '--learning_rate', '1e-4', '--lr_scheduler_type', 'cosine', '--lr_warmup_ratio', '0.03', '--weight_decay', '0.0', '--seed', '42', '--output_dir', '/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10', '--log_type', 'wandb', '--log_project', 'SAFE-SFT-v3', '--zero_stage', '0', '--offload', 'none', '--safety_ratio_tol', '10', '--resilient_coeff', '1', '--lora_r', '4', '--lora_alpha', '16', '--lora_dropout', '0.05', '--bf16', 'False', '--fp16', 'True', '--tf32', 'True']
+[2025-05-02 04:57:44,844] [INFO] [launch.py:256:main] process 2178488 spawned with command: ['/home/panda/miniconda3/envs/pda/bin/python', '-u', '-m', 'safe_rlhf.algorithms.safe_ft', '--local_rank=1', '--train_datasets', 'SAFE-ALPACA/2000', '--model_name_or_path', 'huggyllama/llama-7b', '--cache_dir', '/home/panda/pda-llm/cache/sft-2000', '--safe_sft', 'false', '--max_length', '1024', '--trust_remote_code', 'True', '--epochs', '6', '--per_device_train_batch_size', '4', '--per_device_eval_batch_size', '4', '--gradient_accumulation_steps', '32', '--gradient_checkpointing', '--learning_rate', '1e-4', '--lr_scheduler_type', 'cosine', '--lr_warmup_ratio', '0.03', '--weight_decay', '0.0', '--seed', '42', '--output_dir', '/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10', '--log_type', 'wandb', '--log_project', 'SAFE-SFT-v3', '--zero_stage', '0', '--offload', 'none', '--safety_ratio_tol', '10', '--resilient_coeff', '1', '--lora_r', '4', '--lora_alpha', '16', '--lora_dropout', '0.05', '--bf16', 'False', '--fp16', 'True', '--tf32', 'True']
+[2025-05-02 04:57:46,017] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2025-05-02 04:57:46,021] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2025-05-02 04:57:48,877] [INFO] [comm.py:658:init_distributed] cdb=None
+[2025-05-02 04:57:48,877] [INFO] [comm.py:689:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
+[2025-05-02 04:57:48,898] [INFO] [comm.py:658:init_distributed] cdb=None
+Set logger level to WARNING.
+calculating baseline ...calculating baseline ...
+
+Loading cached baseline logprobs from /home/panda/pda-llm/cache/sft-2000/cached_baseline_logprobs.pt
+Loaded cached baseline logprobs successfully
+ninja: no work to do.
+Time to load fused_adam op: 0.03387141227722168 seconds
+Time to load fused_adam op: 0.10104942321777344 seconds
+***** Running training *****
+
+***** Evaluating at the beginning *****
+
+***** Evaluating at epoch 1/6 *****
+
+***** Evaluating at epoch 2/6 *****
+
+***** Evaluating at epoch 3/6 *****
+
+***** Evaluating at epoch 4/6 *****
+
+***** Evaluating at epoch 5/6 *****
+
+***** Evaluating at epoch 6/6 *****
+Saving model to "/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10" ...
+Saving Hugging Face Checkpoints...
+Model saved!
+[2025-05-02 07:36:14,090] [INFO] [launch.py:351:main] Process 2178488 exits successfully.
+[2025-05-02 07:36:16,091] [INFO] [launch.py:351:main] Process 2178487 exits successfully.

tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
+size 499723

tokenizer_config.json

@@ -0,0 +1,52 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "add_prefix_space": null,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32000": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "chat_template": "{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% elif false == true and not '<<SYS>>' in messages[0]['content'] %}{% set loop_messages = messages %}{% set system_message = 'You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.\\n\\nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don\\'t know the answer to a question, please don\\'t share false information.' %}{% else %}{% set loop_messages = messages %}{% set system_message = false %}{% endif %}{% for message in loop_messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if loop.index0 == 0 and system_message != false %}{% set content = '<<SYS>>\\n' + system_message + '\\n<</SYS>>\\n\\n' + message['content'] %}{% else %}{% set content = message['content'] %}{% endif %}{% if message['role'] == 'user' %}{{ bos_token + '[INST] ' + content.strip() + ' [/INST]' }}{% elif message['role'] == 'system' %}{{ '<<SYS>>\\n' + content.strip() + '\\n<</SYS>>\\n\\n' }}{% elif message['role'] == 'assistant' %}{{ ' '  + content.strip() + ' ' + eos_token }}{% endif %}{% endfor %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "</s>",
+  "extra_special_tokens": {},
+  "legacy": true,
+  "model_max_length": 1024,
+  "pad_token": "<pad>",
+  "padding_side": "right",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}

wandb/debug-internal.log

@@ -0,0 +1,18 @@
+{"time":"2025-05-02T04:58:04.019119391-04:00","level":"INFO","msg":"stream: starting","core version":"0.19.9","symlink path":"/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10/wandb/run-20250502_045804-vkih00cc/logs/debug-core.log"}
+{"time":"2025-05-02T04:58:04.197136128-04:00","level":"INFO","msg":"created new stream","id":"vkih00cc"}
+{"time":"2025-05-02T04:58:04.197176589-04:00","level":"INFO","msg":"stream: started","id":"vkih00cc"}
+{"time":"2025-05-02T04:58:04.19719247-04:00","level":"INFO","msg":"writer: Do: started","stream_id":"vkih00cc"}
+{"time":"2025-05-02T04:58:04.197232281-04:00","level":"INFO","msg":"handler: started","stream_id":"vkih00cc"}
+{"time":"2025-05-02T04:58:04.197265422-04:00","level":"INFO","msg":"sender: started","stream_id":"vkih00cc"}
+{"time":"2025-05-02T04:58:04.358999441-04:00","level":"INFO","msg":"Starting system monitor"}
+{"time":"2025-05-02T04:58:04.359026392-04:00","level":"WARN","msg":"handleCodeSave: program relative path is empty"}
+{"time":"2025-05-02T04:58:04.359089224-04:00","level":"ERROR","msg":"git repo not found","error":"repository does not exist"}
+{"time":"2025-05-02T07:36:12.038523234-04:00","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2025-05-02T07:36:12.038620077-04:00","level":"INFO","msg":"Stopped system monitor"}
+{"time":"2025-05-02T07:36:12.460553289-04:00","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
+{"time":"2025-05-02T07:36:12.675372877-04:00","level":"INFO","msg":"handler: operation stats","stats":{}}
+{"time":"2025-05-02T07:36:12.683269813-04:00","level":"INFO","msg":"stream: closing","id":"vkih00cc"}
+{"time":"2025-05-02T07:36:12.683289333-04:00","level":"INFO","msg":"handler: closed","stream_id":"vkih00cc"}
+{"time":"2025-05-02T07:36:12.683301114-04:00","level":"INFO","msg":"writer: Close: closed","stream_id":"vkih00cc"}
+{"time":"2025-05-02T07:36:12.683364415-04:00","level":"INFO","msg":"sender: closed","stream_id":"vkih00cc"}
+{"time":"2025-05-02T07:36:12.683374416-04:00","level":"INFO","msg":"stream: closed","id":"vkih00cc"}

wandb/debug.log

@@ -0,0 +1,29 @@
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_setup.py:_flush():67] Current SDK version is 0.19.9
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_setup.py:_flush():67] Configure stats pid to 2178487
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_setup.py:_flush():67] Loading settings from /home/panda/.config/wandb/settings
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_setup.py:_flush():67] Loading settings from /home/panda/pda-llm/scripts/wandb/settings
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_setup.py:_flush():67] Loading settings from environment variables
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:setup_run_log_directory():662] Logging user logs to /home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10/wandb/run-20250502_045804-vkih00cc/logs/debug.log
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:setup_run_log_directory():663] Logging internal logs to /home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10/wandb/run-20250502_045804-vkih00cc/logs/debug-internal.log
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:init():781] calling init triggers
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:init():786] wandb.init called with sweep_config: {}
+config: {'model_name_or_path': 'huggyllama/llama-7b', 'recompute_baseline': False, 'cache_dir': '/home/panda/pda-llm/cache/sft-2000', 'max_length': 1024, 'trust_remote_code': True, 'train_datasets': [('SAFE-ALPACA/2000', {'proportion': 1.0})], 'eval_datasets': None, 'safety_ratio_tol': 10.0, 'safe_sft': False, 'resilient_coeff': 1.0, 'epochs': 6, 'per_device_train_batch_size': 4, 'per_device_eval_batch_size': 4, 'gradient_accumulation_steps': 32, 'gradient_checkpointing': True, 'lr': 0.0001, 'lr_scheduler_type': <SchedulerType.COSINE: 'cosine'>, 'lr_warmup_ratio': 0.03, 'weight_decay': 0.0, 'seed': 42, 'fp16': True, 'bf16': False, 'tf32': True, 'lora_r': 4, 'lora_alpha': 16, 'lora_dropout': 0.05, 'eval_strategy': 'epoch', 'eval_interval': 1000000, 'need_eval': True, 'eval_split_ratio': None, 'output_dir': '/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10', 'log_type': 'wandb', 'log_dir': '/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10', 'log_project': 'SAFE-SFT-v3', 'log_run_name': 'safe-sft-2025-05-02-04-58-03', 'save_16bit': False, 'save_interval': 1000000, 'local_rank': 0, 'zero_stage': 0, 'offload': 'none', 'deepspeed': False, 'deepspeed_config': None, 'deepscale': False, 'deepscale_config': None, 'global_rank': 0, 'device': device(type='cuda', index=0), 'num_update_steps_per_epoch': 86, 'total_training_steps': 516, '_wandb': {}}
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:init():809] starting backend
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:init():813] sending inform_init request
+2025-05-02 04:58:04,016 INFO    MainThread:2178487 [backend.py:_multiprocessing_setup():101] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2025-05-02 04:58:04,016 INFO    MainThread:2178487 [wandb_init.py:init():823] backend started and connected
+2025-05-02 04:58:04,018 INFO    MainThread:2178487 [wandb_init.py:init():915] updated telemetry
+2025-05-02 04:58:04,024 INFO    MainThread:2178487 [wandb_init.py:init():939] communicating run to backend with 90.0 second timeout
+2025-05-02 04:58:04,356 INFO    MainThread:2178487 [wandb_init.py:init():1014] starting run threads in backend
+2025-05-02 04:58:04,428 INFO    MainThread:2178487 [wandb_run.py:_console_start():2454] atexit reg
+2025-05-02 04:58:04,428 INFO    MainThread:2178487 [wandb_run.py:_redirect():2306] redirect: wrap_raw
+2025-05-02 04:58:04,428 INFO    MainThread:2178487 [wandb_run.py:_redirect():2371] Wrapping output streams.
+2025-05-02 04:58:04,428 INFO    MainThread:2178487 [wandb_run.py:_redirect():2394] Redirects installed.
+2025-05-02 04:58:04,430 INFO    MainThread:2178487 [wandb_init.py:init():1056] run started, returning control to user process
+2025-05-02 07:36:12,036 INFO    MainThread:2178487 [wandb_run.py:_finish():2189] finishing run alelab/SAFE-SFT-v3/vkih00cc
+2025-05-02 07:36:12,037 INFO    MainThread:2178487 [wandb_run.py:_atexit_cleanup():2419] got exitcode: 0
+2025-05-02 07:36:12,037 INFO    MainThread:2178487 [wandb_run.py:_restore():2401] restore
+2025-05-02 07:36:12,037 INFO    MainThread:2178487 [wandb_run.py:_restore():2407] restore done
+2025-05-02 07:36:12,678 INFO    MainThread:2178487 [wandb_run.py:_footer_history_summary_info():4064] rendering history
+2025-05-02 07:36:12,679 INFO    MainThread:2178487 [wandb_run.py:_footer_history_summary_info():4096] rendering summary
+2025-05-02 07:36:12,682 INFO    MainThread:2178487 [wandb_run.py:_footer_sync_info():4025] logging synced files

wandb/run-20250501_161111-rkamupqo/files/media/table/eval/table_0_d4da849d7b84c3e060a1.table.json

@@ -0,0 +1 @@
+{"columns": ["data_index", "value"], "data": [[22, 0.0], [86, 0.0], [101, 0.0], [105, 0.0], [110, -0.125], [121, 0.0], [124, 0.0], [135, 0.0], [136, 0.0], [138, 0.0], [160, 0.0], [166, 0.25], [177, -0.125], [180, 0.0], [196, 0.0], [208, 0.125], [226, 0.0], [245, 0.0], [258, 0.125], [259, 0.0], [266, 0.0], [273, 0.0], [275, 0.0], [277, 0.0], [288, -0.125], [324, 0.0], [327, -0.125], [339, 0.0], [340, 0.125], [369, 0.0], [400, 0.0], [402, 0.0], [432, 0.0], [438, 0.0], [440, 0.0], [446, 0.0], [458, 0.0], [461, 0.0], [494, 0.0], [500, 0.0], [503, -0.125], [507, 0.0], [511, -0.25], [525, 0.0], [534, 0.25], [538, 0.0], [543, 0.0], [563, 0.25], [567, 0.125], [569, 0.0], [575, -0.25], [591, -0.125], [594, 0.125], [602, 0.0], [609, 0.0], [620, 0.0], [625, -0.125], [679, 0.0], [687, 0.0], [700, 0.0], [716, 0.125], [725, 0.0], [736, 0.0], [740, 0.0], [757, 0.0], [758, 0.0], [769, 0.0], [795, 0.0], [804, 0.0], [806, 0.0], [816, -0.125], [821, 0.0], [831, 0.0], [842, -0.125], [849, 0.0], [862, 0.0], [889, 0.125], [896, -0.125], [903, -0.125], [930, 0.0], [937, 0.0], [940, -0.25], [945, 0.0], [993, 0.0], [999, 0.0], [1014, 0.0], [1043, 0.0], [1045, 0.0], [1062, 0.125], [1064, -0.25], [1066, 0.25], [1069, -0.25], [1077, -0.125], [1082, 0.0], [1099, 0.0], [1100, 0.0], [1108, 0.0], [1122, 0.0], [1136, 0.0], [1143, -0.125], [1147, 0.0], [1151, 0.0], [1166, 0.0], [1172, 0.125], [1185, 0.0], [1186, 0.0], [1195, 0.125], [1196, 0.0], [1225, 0.0], [1232, 0.0], [1233, 0.0], [1239, 0.0], [1247, 0.0], [1280, 0.0], [1285, 0.0], [1286, 0.0], [1289, 0.0], [1304, 0.0], [1313, 0.0], [1324, 0.0], [1327, 0.0], [1329, 0.0], [1340, 0.0], [1350, -0.125], [1357, 0.125], [1392, 0.0], [1394, 0.0], [1415, 0.0], [1421, 0.0], [1435, -0.25], [1450, 0.0], [1488, 0.0], [1489, 0.0], [1509, 0.0], [1526, 0.0], [1530, 0.0], [1551, 0.0], [1557, 0.0], [1558, 0.0], [1565, 0.0], [1580, 0.0], [1583, 0.0], [1588, 0.0], [1660, 0.0], [1675, 0.0], [1684, 0.0], [1694, 0.25], [1696, -0.125], [1703, 0.0], [1705, 0.0], [1755, -0.125], [1762, 0.0], [1764, 0.0], [1788, 0.0], [1796, 0.0], [1811, 0.0], [1814, 0.0], [1830, 0.0], [1834, 0.0], [1836, 0.0], [1851, -0.125], [1852, -0.125], [1870, 0.0], [1871, 0.0], [1889, 0.0], [1898, -0.125], [1907, 0.0], [1914, 0.0], [1915, 0.0], [1916, 0.0], [1918, 0.0], [1925, 0.125], [1927, 0.0], [1928, -0.125], [1970, -0.125], [1995, 0.0], [2002, 0.0], [2016, -0.125], [2019, 0.0], [2020, 0.0], [2083, 0.0], [2120, -0.125], [2135, 0.0], [2146, 0.0], [2153, 0.25], [2195, -0.125], [2203, -0.125], [2226, 0.0], [2231, 0.0], [2253, 0.0], [2254, 0.0], [2269, 0.125], [2275, 0.0], [2290, 0.0], [2303, 0.0], [2311, 0.0], [2312, 0.0], [2347, 0.0], [2357, -0.125], [2368, 0.0], [2369, 0.125], [2376, 0.0], [2380, 0.125], [2414, 0.0], [2425, 0.125], [2454, 0.0], [2462, 0.0], [2481, 0.0], [2483, 0.0], [2485, -0.125], [2490, 0.0625], [2492, 0.0], [2499, 0.0], [2508, 0.0], [2523, 0.0], [2533, 0.0], [2544, 0.0], [2584, 0.0], [2591, -0.125], [2628, 0.0], [2630, 0.125], [2634, 0.0], [2662, 0.0], [2669, 0.0], [2686, 0.125], [2688, 0.125], [2711, 0.125], [2725, -0.125], [2731, -0.125], [2734, 0.0], [2738, 0.0], [2745, 0.0], [2769, 0.0], [2778, 0.125], [2786, 0.0], [2808, 0.0], [2818, -0.125], [2820, 0.0], [2822, 0.0], [2834, 0.0], [2843, 0.0], [2851, 0.0], [2866, 0.0], [2892, 0.0], [2922, -0.125], [2926, 0.0], [2935, 0.0], [2950, 0.0], [2960, 0.0], [2965, 0.0], [2970, 0.0], [2984, 0.25], [2988, 0.0], [2994, 0.0], [3006, 0.125], [3017, 0.0], [3020, 0.0], [3058, 0.0], [3061, 0.0], [3064, 0.0], [3073, 0.0], [3092, 0.0], [3108, 0.0], [3118, 0.0], [3138, 0.0], [3144, 0.0], [3149, 0.25], [3153, 0.125], [3154, 0.0], [3157, 0.0], [3165, 0.125], [3166, 0.0], [3171, -0.125], [3181, 0.0], [3196, 0.0], [3230, 0.0], [3233, 0.25], [3244, 0.0], [3265, 0.0], [3268, -0.125], [3283, 0.0], [3296, 0.125], [3298, 0.0], [3307, 0.0], [3321, 0.125], [3353, 0.0], [3362, 0.0], [3368, 0.0], [3375, 0.0], [3393, 0.125], [3395, 0.0], [3400, 0.25], [3401, 0.0], [3423, 0.0], [3429, -0.125], [3434, -0.125], [3447, 0.0], [3456, -0.125], [3479, 0.0], [3484, -0.25], [3574, -0.125], [3581, 0.0], [3587, -0.125], [3604, 0.0], [3629, 0.0], [3643, 0.125], [3648, 0.0], [3657, 0.0], [3662, -0.125], [3695, 0.0], [3697, 0.0], [3699, 0.0], [3703, 0.0], [3721, 0.0], [3732, 0.0], [3738, 0.0], [3746, 0.125], [3748, 0.0], [3750, 0.0], [3779, 0.0], [3786, 0.0], [3796, 0.0], [3805, 0.0], [3816, 0.0], [3845, -0.125], [3846, 0.0], [3864, 0.0], [3880, 0.0], [3892, 0.0], [3895, 0.0], [3902, 0.0], [3933, 0.0], [3938, 0.0], [3940, 0.0], [3954, 0.0], [3961, 0.0], [3974, 0.0], [3976, 0.0], [3980, 0.0], [3990, 0.0], [3997, 0.25], [3998, 0.25], [3999, 0.0], [4001, 0.0], [4005, 0.0], [4012, 0.0], [4014, -0.125], [4015, 0.0], [4023, -0.125], [4042, 0.0], [4047, 0.0], [4048, 0.125], [4091, 0.0], [4097, 0.0], [4106, 0.125], [4120, 0.0], [4125, -0.125], [4151, 0.0], [4161, 0.0], [4162, 0.0], [4163, 0.0], [4164, 0.125], [4185, 0.0], [4193, 0.0], [4195, 0.0], [4197, 0.0], [4198, 0.0], [4201, 0.0], [4206, 0.125], [4227, 0.0], [4240, 0.0], [4244, 0.0], [4246, 0.0], [4252, 0.0], [4267, 0.0], [4271, 0.0], [4275, 0.0], [4297, 0.125], [4307, 0.0], [4337, 0.0], [4352, 0.0], [4365, 0.0], [4380, 0.0], [4382, 0.0], [4399, 0.0], [4405, 0.125], [4415, 0.0], [4417, 0.0], [4436, 0.0], [4441, 0.0], [4453, 0.0], [4469, 0.125], [4474, 0.0], [4491, 0.0], [4500, 0.0], [4503, -0.125], [4517, 0.0], [4538, 0.0], [4588, 0.0], [4589, 0.0], [4602, 0.0], [4606, 0.0], [4631, 0.0], [4640, 0.0], [4649, 0.0], [4651, 0.0], [4665, 0.0], [4690, 0.0], [4703, 0.0], [4706, 0.125], [4724, 0.0], [4750, 0.0], [4752, -0.25], [4763, -0.125], [4773, 0.0], [4778, -0.125], [4789, 0.125], [4804, 0.0], [4809, 0.0], [4813, -0.125], [4822, 0.0], [4839, 0.0], [4841, -0.125], [4858, -0.125], [4878, 0.0], [4899, 0.0], [4916, 0.0], [4923, 0.0], [4929, -0.125], [4954, 0.125], [4955, -0.125], [4971, 0.0], [4985, 0.0], [4999, 0.0], [5000, -0.125], [5003, 0.0], [5006, 0.0], [5017, 0.0], [5021, 0.0], [5043, 0.0], [5055, 0.0], [5062, 0.0], [5064, 0.0], [5074, 0.0], [5075, -0.25], [5081, 0.0], [5101, 0.0], [5103, 0.125], [5119, -0.25], [5137, 0.0], [5138, 0.0], [5142, 0.0], [5151, 0.0], [5152, 0.0], [5164, 0.0], [5207, 0.0], [5209, 0.0], [5226, 0.0], [5229, 0.0], [5235, 0.0], [5246, 0.0625], [5256, 0.0], [5265, 0.0], [5274, 0.0], [5279, 0.0], [5284, -0.125], [5303, -0.125], [5311, 0.0], [5319, 0.0], [5320, 0.0], [5322, 0.0], [5325, 0.0], [5357, -0.125], [5374, -0.125], [5375, 0.0], [5380, -0.125], [5384, 0.0], [5389, 0.0], [5390, 0.0], [5394, 0.125], [5409, -0.125], [5410, 0.0], [5420, 0.0], [5421, 0.0], [5428, 0.0], [5431, 0.0], [5450, 0.125], [5465, -0.125], [5472, 0.0], [5484, 0.0], [5486, 0.0], [5487, 0.0], [5489, 0.125], [5524, 0.0], [5541, 0.0], [5542, 0.0], [5568, 0.0], [5586, 0.0], [5589, 0.0], [5594, 0.0], [5598, 0.125], [5615, 0.0], [5617, 0.25], [5653, 0.0], [5655, 0.0], [5676, 0.0], [5704, 0.125], [5709, 0.125], [5711, -0.125], [5751, 0.0], [5767, 0.0], [5777, 0.0], [5783, 0.0], [5786, 0.0], [5825, 0.0], [5831, 0.0], [5841, 0.125], [5851, -0.125], [5853, 0.0], [5859, 0.0], [5865, 0.0], [5930, 0.0], [5983, 0.0], [6001, 0.0], [6010, 0.25], [6016, 0.0], [6017, 0.0], [6019, 0.0], [6025, 0.25], [6028, 0.0], [6029, -0.125], [6035, 0.0], [6037, 0.125], [6077, 0.0], [6083, 0.0], [6094, 0.0], [6107, 0.0], [6126, 0.125], [6136, -0.25], [6152, 0.0], [6194, 0.0], [6202, 0.0], [6203, 0.0], [6210, 0.0], [6211, 0.0], [6219, 0.0], [6296, 0.0], [6305, 0.0], [6326, -0.25], [6337, -0.125], [6349, 0.0], [6360, 0.0], [6375, 0.0], [6378, 0.0], [6400, 0.0], [6412, 0.0], [6434, 0.0], [6469, 0.0], [6471, 0.0], [6480, 0.0], [6490, -0.125], [6508, 0.0], [6543, 0.0], [6547, 0.0], [6561, -0.25], [6576, 0.0], [6589, 0.0], [6600, 0.0], [6604, 0.0], [6613, 0.0], [6621, 0.0], [6625, 0.0], [6626, 0.0], [6636, -0.125], [6645, -0.125], [6684, 0.0], [6688, 0.0], [6689, 0.0], [6705, 0.0], [6720, 0.0], [6736, 0.0], [6749, 0.0], [6752, 0.0], [6760, 0.125], [6769, 0.0], [6771, -0.125], [6778, 0.0], [6786, 0.0], [6789, 0.0], [6803, -0.125], [6861, -0.25], [6866, 0.0], [6869, 0.125], [6872, -0.125], [6877, -0.125], [6884, -0.125], [6888, 0.0], [6889, 0.0], [6898, 0.0], [6993, 0.0], [7011, 0.125], [7013, -0.125], [7016, 0.0], [7027, -0.125], [7035, -0.125], [7045, -0.125], [7046, 0.0], [7049, 0.0], [7068, 0.0], [7072, 0.0], [7085, 0.0], [7090, 0.0], [7097, 0.125], [7101, 0.0], [7102, 0.0], [7109, 0.0], [7132, -0.125], [7139, -0.125], [7141, 0.0], [7144, 0.0], [7152, 0.0], [7167, 0.0], [7170, 0.0], [7185, 0.0], [7186, -0.125], [7202, 0.125], [7207, 0.0], [7211, 0.0], [7227, 0.0], [7236, 0.0], [7250, -0.125], [7257, 0.125], [7274, 0.0], [7278, 0.0], [7280, 0.0], [7281, 0.0], [7290, 0.0], [7298, -0.125], [7299, -0.25], [7302, -0.125], [7306, 0.125], [7318, 0.125], [7321, 0.125], [7330, 0.0], [7334, -0.125], [7336, 0.0], [7341, 0.0], [7344, 0.0], [7347, -0.125], [7361, 0.0], [7369, 0.0], [7397, 0.0], [7408, 0.0], [7427, -0.125], [7430, 0.0], [7439, 0.0], [7453, 0.0], [7473, 0.25], [7478, -0.125], [7488, 0.0], [7503, 0.0], [7518, 0.0], [7544, 0.0], [7552, 0.125], [7576, -0.125], [7577, 0.0], [7597, 0.0], [7605, 0.0], [7616, 0.0], [7620, 0.0], [7656, 0.0], [7659, 0.0], [7681, 0.0], [7692, 0.0], [7710, 0.0], [7713, 0.0], [7722, 0.0], [7723, 0.125], [7742, -0.125], [7743, 0.0], [7750, 0.0], [7790, 0.0], [7801, 0.0], [7811, 0.0], [7815, 0.0], [7843, 0.0], [7844, 0.0], [7857, 0.0], [7868, 0.0], [7877, 0.0], [7887, 0.0], [7897, 0.0], [7902, 0.0], [7910, 0.0], [7912, 0.0], [7918, 0.0], [7933, -0.125], [7936, 0.0], [7951, 0.0], [7953, 0.0], [7957, 0.0], [7962, -0.125], [7971, 0.0], [7974, 0.0], [7991, 0.0], [8000, 0.0], [8008, 0.0], [8018, 0.0], [8024, 0.0], [8047, 0.0], [8060, -0.25], [8077, 0.0], [8086, 0.0], [8104, 0.0], [8118, 0.125], [8133, 0.0], [8138, 0.0], [8145, 0.0], [8150, 0.0], [8168, 0.0], [8170, 0.0], [8173, 0.0], [8175, 0.0], [8194, 0.0], [8211, 0.0], [8253, 0.0], [8262, 0.0], [8263, 0.0], [8265, 0.0], [8268, 0.0], [8271, 0.0], [8272, 0.0], [8273, 0.0], [8277, 0.0], [8292, 0.0], [8344, 0.125], [8346, 0.0], [8350, 0.0], [8364, 0.0], [8369, 0.0], [8370, -0.125], [8385, 0.0], [8389, 0.0], [8421, 0.0], [8442, 0.0], [8453, 0.0], [8458, 0.125], [8466, 0.0], [8478, 0.0], [8483, 0.0], [8487, 0.0], [8501, -0.125], [8505, -0.125], [8509, 0.125], [8534, 0.0], [8539, 0.125], [8556, 0.125], [8566, -0.125], [8577, -0.125], [8583, 0.0], [8600, 0.0], [8615, 0.0], [8624, 0.0], [8630, 0.0], [8645, 0.0], [8658, 0.125], [8660, 0.0], [8667, -0.125], [8672, 0.0], [8676, -0.125], [8687, 0.0], [8689, 0.0], [8692, 0.0], [8697, -0.125], [8699, 0.0], [8707, 0.0], [8722, 0.0], [8726, 0.0], [8727, 0.0], [8736, 0.0], [8737, -0.125], [8752, -0.125], [8760, 0.125], [8776, 0.0], [8793, 0.125], [8794, 0.0], [8797, 0.0], [8806, 0.0], [8812, 0.0], [8820, 0.0], [8830, 0.0], [8852, 0.0], [8877, -0.125], [8885, 0.0], [8891, 0.0], [8929, 0.0], [8936, 0.0], [8938, 0.0], [8954, -0.125], [8967, 0.0], [8975, 0.125], [8985, 0.0], [8989, 0.125], [8999, 0.0], [9002, 0.0], [9014, -0.25], [9025, 0.0], [9034, 0.0], [9052, 0.0], [9059, 0.0], [9063, 0.0], [9084, 0.0], [9086, -0.125], [9088, 0.0], [9123, 0.0], [9130, 0.0], [9144, 0.0], [9167, 0.0], [9182, 0.0], [9184, 0.0], [9198, 0.0], [9218, 0.0], [9231, 0.0], [9237, 0.0], [9239, 0.0], [9244, 0.0], [9256, 0.0], [9257, -0.125], [9261, 0.0], [9267, 0.0], [9269, 0.0], [9297, 0.0], [9300, -0.125], [9305, 0.0], [9327, 0.0], [9337, 0.0], [9340, 0.125], [9341, -0.125], [9355, 0.0], [9360, 0.125], [9366, 0.0], [9369, 0.0], [9377, 0.125], [9380, 0.0], [9381, -0.25], [9385, 0.0], [9403, 0.0], [9406, 0.0], [9409, 0.0], [9419, 0.125], [9420, 0.125], [9423, 0.0], [9447, 0.0], [9450, 0.0], [9467, 0.0], [9475, 0.0], [9485, 0.0], [9502, 0.0], [9504, 0.0], [9518, 0.0], [9523, 0.0], [9536, 0.0], [9559, 0.0], [9563, -0.125], [9576, 0.0], [9594, 0.0], [9611, 0.0], [9613, 0.0], [9621, 0.0], [9633, 0.0], [9655, 0.0], [9658, -0.125], [9667, 0.0], [9672, 0.0], [9681, 0.0], [9684, 0.0], [9687, -0.125], [9688, 0.0], [9693, 0.125], [9698, -0.125], [9702, -0.125], [9713, 0.0], [9716, 0.0], [9721, 0.0], [9726, 0.0], [9736, 0.0], [9762, 0.125], [9772, 0.0], [9776, 0.0], [9781, -0.125], [9783, -0.25], [9809, 0.0], [9833, 0.0], [9837, -0.125], [9853, 0.0], [9856, 0.125], [9857, -0.125], [9863, 0.0], [9872, 0.125], [9894, 0.0], [9899, 0.0], [9919, 0.0], [9936, 0.0], [9947, 0.0], [9949, 0.0], [9952, 0.0], [9958, 0.0], [9979, 0.0], [9998, 0.0], [10005, 0.0], [10015, 0.0], [10053, 0.0], [10096, 0.0], [10108, 0.0], [10114, 0.0], [10122, 0.0], [10126, 0.0], [10145, 0.0], [10159, 0.0], [10166, 0.0], [10181, 0.0], [10184, 0.0], [10190, 0.0], [10197, 0.0], [10217, 0.125], [10218, -0.25], [10219, -0.125], [10224, 0.0], [10234, -0.125], [10244, 0.0], [10258, 0.0], [10330, 0.0], [10340, 0.125], [10352, 0.0], [10367, 0.0], [10372, 0.0], [10376, -0.125], [10377, 0.0], [10390, 0.0], [10419, -0.125], [10422, -0.125], [10434, 0.125], [10439, 0.0], [10445, -0.125], [10448, 0.25], [10471, -0.125], [10493, 0.0], [10500, 0.0], [10517, 0.0], [10527, 0.0], [10561, 0.0], [10569, 0.0], [10576, 0.0], [10577, 0.0], [10598, 0.0], [10609, 0.0], [10635, 0.0], [10637, -0.125], [10640, -0.125], [10654, 0.0], [10660, 0.0], [10662, 0.0], [10664, -0.125], [10667, -0.25], [10668, 0.0], [10672, 0.0], [10679, 0.0], [10687, 0.0], [10690, -0.125], [10692, 0.0], [10693, 0.25], [10699, 0.0], [10710, 0.0], [10715, 0.0], [10719, 0.0], [10730, 0.0], [10735, 0.0], [10742, 0.0], [10746, 0.0], [10750, 0.0], [10753, 0.0], [10754, 0.0], [10758, 0.0], [10766, -0.125], [10768, -0.125], [10773, 0.0], [10780, 0.0], [10785, 0.0], [10789, 0.125], [10798, -0.125], [10817, 0.0], [10821, 0.0], [10822, 0.0], [10862, 0.0], [10863, 0.125], [10866, -0.125], [10889, 0.0], [10924, 0.0], [10944, 0.0], [10955, 0.0], [10966, 0.0], [10969, 0.0], [10978, 0.0], [10979, -0.25], [10987, 0.125], [10999, 0.0], [11025, 0.0], [11026, 0.25], [11031, -0.125], [11034, 0.0], [11048, 0.0], [11050, -0.125], [11053, 0.0], [11055, 0.0], [11056, 0.0], [11057, -0.125], [11067, 0.0], [11069, 0.0], [11072, 0.0], [11074, 0.0], [11085, 0.25], [11111, 0.0], [11112, 0.0], [11123, -0.125], [11149, -0.125], [11185, -0.125], [11221, 0.0], [11250, -0.125], [11266, 0.0], [11279, 0.0], [11280, 0.0], [11312, 0.0], [11320, 0.0], [11327, 0.0], [11331, -0.125], [11351, 0.0], [11359, 0.0], [11360, 0.0], [11362, 0.0], [11386, 0.0], [11391, 0.0], [11393, 0.0], [11428, -0.125], [11436, 0.0], [11446, 0.0], [11460, 0.0], [11462, -0.125], [11465, 0.0], [11478, 0.0], [11495, 0.0], [11497, 0.0], [11500, 0.125], [11522, 0.0], [11523, 0.0], [11526, 0.0], [11533, 0.0], [11539, 0.125], [11540, -0.25], [11543, 0.0], [11548, 0.0], [11570, 0.0], [11572, 0.0], [11584, 0.0], [11597, 0.0], [11605, -0.125], [11622, 0.0], [11637, 0.0], [11650, 0.0], [11657, 0.0], [11665, -0.25], [11668, 0.0], [11686, -0.125], [11720, 0.0], [11721, -0.125], [11741, 0.0], [11755, 0.0], [11756, 0.0], [11764, 0.0], [11819, 0.0], [11828, -0.125], [11842, 0.0], [11861, 0.0], [11871, 0.0], [11880, 0.0], [11903, 0.0], [11905, 0.0], [11939, 0.0], [11940, 0.0], [11941, 0.0], [11963, 0.0], [11964, -0.25], [11970, 0.0], [11983, 0.0], [11992, 0.0], [12020, -0.25], [12042, 0.0], [12051, -0.125], [12069, -0.125], [12075, 0.0], [12102, 0.0], [12106, 0.125], [12150, -0.125], [12158, 0.0], [12161, 0.0], [12164, -0.125], [12165, 0.0], [12172, 0.0], [12181, 0.0], [12192, 0.0], [12193, 0.0], [12205, 0.0], [12207, -0.125], [12214, 0.0], [12219, 0.125], [12224, 0.0], [12225, 0.0], [12229, 0.0], [12237, 0.125], [12238, 0.125], [12253, -0.125], [12257, 0.0], [12259, 0.0], [12262, 0.0], [12266, 0.0], [12300, 0.125], [12309, 0.0], [12344, -0.125], [12351, 0.125], [12352, -0.125], [12354, 0.0], [12357, 0.0], [12359, -0.125], [12361, 0.0], [12362, 0.0], [12370, 0.0625], [12384, 0.0], [12397, 0.0], [12411, 0.0], [12428, 0.0], [12436, 0.0], [12455, 0.0], [12467, 0.0], [12481, 0.0], [12482, 0.0], [12499, 0.0], [12505, 0.0], [12527, 0.0], [12546, -0.125], [12559, 0.0], [12578, -0.25], [12583, 0.25], [12584, 0.125], [12601, -0.125], [12609, 0.0], [12610, 0.0], [12614, 0.0], [12620, 0.0], [12626, 0.0], [12647, -0.125], [12669, 0.0], [12676, -0.125], [12700, -0.125], [12703, -0.125], [12706, 0.0], [12711, 0.0], [12716, 0.0], [12739, 0.0], [12766, -0.125], [12779, 0.0], [12812, 0.0], [12820, 0.0], [12823, 0.0], [12826, 0.0], [12857, 0.125], [12866, 0.0], [12893, 0.0], [12907, 0.0], [12940, 0.0], [12944, 0.0], [12946, 0.0], [12954, 0.0], [12958, 0.0], [12960, 0.0], [12972, 0.0], [13005, 0.0], [13008, 0.0], [13019, -0.125], [13022, 0.0], [13041, 0.0], [13044, 0.0], [13048, 0.0], [13060, 0.0], [13066, 0.0], [13069, 0.0], [13081, 0.125], [13086, 0.0], [13091, 0.0], [13098, 0.0], [13100, 0.0], [13104, 0.0], [13112, 0.0], [13127, 0.0], [13136, 0.0], [13154, 0.0], [13162, 0.0], [13195, 0.0], [13214, 0.0], [13225, 0.0], [13233, 0.25], [13244, 0.0], [13253, 0.0], [13259, 0.0], [13268, -0.125], [13270, 0.0], [13273, 0.0], [13290, 0.0], [13300, 0.0], [13305, 0.0], [13312, 0.0], [13353, -0.25], [13357, -0.125], [13359, 0.0], [13386, 0.0], [13390, 0.0], [13425, 0.0], [13426, -0.125], [13437, 0.0], [13449, 0.0], [13455, 0.0], [13468, 0.0], [13471, 0.0], [13494, 0.0], [13495, 0.0], [13496, 0.0], [13515, 0.125], [13517, 0.0], [13526, 0.0], [13546, 0.0625], [13567, 0.0], [13575, 0.0], [13583, 0.0], [13586, -0.125], [13594, 0.0], [13596, -0.125], [13598, 0.0], [13613, 0.0], [13616, 0.25], [13633, 0.0], [13639, -0.125], [13654, 0.0], [13671, 0.0], [13693, 0.0], [13697, 0.0], [13706, 0.0], [13723, 0.0], [13730, 0.0], [13735, 0.125], [13751, -0.125], [13765, 0.125], [13775, -0.125], [13789, 0.0], [13790, 0.0], [13792, -0.25], [13814, 0.0], [13821, 0.0], [13823, 0.0], [13838, 0.0], [13843, 0.0], [13866, 0.0], [13868, 0.0], [13870, 0.0], [13874, 0.0], [13887, 0.0], [13891, 0.0], [13895, 0.0], [13901, -0.125], [13931, 0.0], [13950, 0.0], [13952, 0.0], [13957, -0.125], [13964, 0.0], [13968, 0.0], [13970, 0.0], [13974, 0.0], [13976, 0.125], [13978, -0.125], [14000, -0.125], [14004, -0.125], [14005, 0.0], [14006, 0.0], [14017, 0.0], [14030, 0.0], [14037, 0.0], [14054, 0.0], [14068, -0.125], [14080, 0.0], [14083, -0.125], [14084, 0.0], [14092, 0.0], [14103, 0.0], [14109, 0.0], [14132, 0.0], [14157, 0.0], [14165, 0.0], [14172, 0.0], [14180, 0.0], [14203, 0.0], [14207, 0.0], [14210, 0.0], [14248, 0.0], [14260, 0.0], [14273, 0.125], [14279, 0.0], [14282, 0.0], [14283, 0.0], [14285, 0.0], [14291, 0.0], [14294, 0.0], [14304, 0.25], [14312, 0.0], [14319, -0.125], [14326, 0.0], [14358, -0.125], [14373, -0.125], [14380, 0.0], [14385, 0.0], [14417, 0.125], [14421, 0.0], [14424, 0.0], [14429, -0.125], [14433, 0.0], [14441, 0.0], [14456, 0.0], [14458, 0.0], [14475, 0.0], [14524, 0.0], [14531, 0.0], [14532, -0.125], [14551, 0.0], [14556, 0.0], [14566, 0.0], [14567, 0.0], [14574, -0.25], [14576, 0.0], [14597, 0.0], [14603, 0.0], [14622, 0.0], [14664, -0.25], [14665, 0.0], [14668, -0.125], [14670, 0.0], [14671, 0.0], [14676, 0.0], [14682, 0.0], [14686, 0.0], [14688, 0.125], [14694, 0.0], [14701, 0.0], [14717, 0.0], [14743, 0.125], [14744, 0.0], [14750, 0.0], [14764, 0.125], [14770, 0.125], [14779, 0.0], [14784, 0.0], [14787, -0.125], [14803, 0.0], [14805, 0.125], [14808, 0.0], [14821, 0.0], [14823, 0.0], [14825, 0.0], [14831, 0.0], [14833, 0.0], [14851, 0.0], [14866, 0.0], [14899, 0.125], [14901, 0.0], [14911, 0.125], [14914, -0.125], [14921, 0.0], [14944, 0.0], [14947, 0.0], [14949, -0.25], [14951, 0.25], [14953, 0.0], [14959, -0.25], [14962, 0.0], [14970, 0.0], [14974, 0.0], [14997, 0.0], [15000, 0.0], [15001, 0.0], [15003, 0.0], [15006, 0.125], [15019, 0.0], [15024, 0.0], [15028, 0.0], [15032, -0.125], [15045, 0.0], [15054, 0.0], [15069, 0.0], [15070, 0.0], [15095, 0.125], [15118, 0.0], [15133, 0.0], [15142, 0.0], [15143, 0.0], [15164, 0.0], [15172, 0.5], [15182, 0.0], [15185, -0.125], [15197, 0.125], [15204, 0.0], [15214, 0.0], [15236, 0.0], [15242, 0.0], [15247, 0.0], [15251, 0.0], [15257, 0.0], [15316, 0.0], [15334, 0.0], [15336, 0.0], [15344, 0.0], [15366, 0.0], [15373, 0.0], [15380, 0.0], [15382, 0.0], [15412, 0.0], [15416, 0.0], [15434, 0.0], [15436, 0.0], [15441, -0.125], [15444, 0.0], [15457, 0.0], [15465, 0.0], [15475, 0.0], [15496, 0.125], [15500, 0.0], [15522, -0.125], [15529, 0.0], [15531, 0.0], [15562, 0.0], [15565, 0.0], [15569, 0.0], [15576, 0.0], [15594, -0.125], [15597, 0.0], [15614, 0.25], [15627, 0.0], [15640, 0.125], [15664, 0.0], [15667, 0.0], [15679, 0.0], [15680, -0.125], [15698, 0.0], [15730, 0.0], [15731, 0.125], [15745, 0.0], [15759, 0.0], [15766, 0.0], [15791, 0.0], [15801, 0.0], [15808, 0.0], [15822, 0.0], [15834, -0.25], [15838, -0.125], [15844, 0.0], [15850, 0.0], [15862, 0.0], [15872, -0.125], [15887, -0.25], [15931, 0.0], [15942, 0.125], [15945, 0.125], [15955, 0.0], [16000, 0.0], [16042, 0.0], [16043, 0.0], [16060, -0.125], [16063, 0.0], [16073, 0.0], [16076, 0.0], [16078, 0.0], [16140, 0.0], [16164, 0.0], [16165, 0.0], [16169, 0.0], [16210, 0.0], [16225, -0.125], [16262, 0.0], [16269, 0.0], [16277, 0.0], [16282, 0.0], [16295, 0.0], [16312, 0.125], [16316, 0.125], [16328, 0.0], [16346, 0.0], [16389, 0.0], [16434, 0.0], [16472, -0.25], [16474, 0.0], [16489, 0.0], [16502, -0.25], [16531, 0.0], [16532, 0.0], [16539, 0.0], [16541, 0.0], [16571, 0.0], [16572, 0.0], [16580, 0.0], [16582, 0.0], [16598, 0.0], [16605, -0.125], [16606, 0.0], [16619, 0.0], [16643, 0.0], [16657, 0.0], [16659, 0.0], [16671, 0.0], [16737, 0.0], [16743, 0.0], [16759, 0.0], [16765, -0.125], [16768, -0.25], [16769, 0.0], [16773, -0.125], [16777, 0.125], [16790, 0.0], [16804, 0.0], [16831, -0.125], [16851, 0.0], [16854, 0.0], [16868, 0.125], [16882, 0.0], [16891, 0.0], [16919, -0.125], [16937, 0.0], [16938, -0.125], [16941, 0.0], [16965, 0.0], [16977, 0.0], [16982, 0.0], [16987, -0.125], [17002, 0.0], [17018, 0.0], [17020, 0.0], [17030, 0.0], [17044, -0.125], [17049, 0.0], [17077, 0.0], [17101, 0.0], [17115, 0.0], [17135, 0.125], [17154, 0.0], [17160, 0.0], [17171, 0.0], [17172, -0.125], [17193, 0.0], [17216, 0.0], [17229, 0.0], [17251, 0.0], [17278, 0.0], [17279, 0.125], [17322, -0.25], [17325, 0.0], [17346, 0.25], [17364, 0.0], [17392, 0.25], [17394, 0.0], [17395, 0.0], [17397, -0.125], [17403, 0.0], [17405, 0.0], [17408, 0.0], [17420, -0.125], [17431, 0.0], [17443, 0.0], [17447, 0.0], [17463, 0.0], [17482, 0.125], [17509, 0.125], [17527, 0.0], [17536, 0.0], [17540, 0.0], [17551, 0.0], [17552, 0.0], [17553, 0.125], [17554, 0.0], [17563, 0.0], [17564, 0.125], [17574, 0.0], [17577, 0.0], [17589, -0.125], [17610, 0.0], [17618, 0.125], [17637, 0.0], [17650, 0.0], [17661, 0.0], [17664, -0.125], [17668, 0.0], [17687, -0.25], [17723, 0.0], [17745, 0.0], [17755, 0.0], [17756, 0.25], [17757, 0.0], [17766, 0.0], [17777, -0.125], [17780, 0.125], [17794, 0.0], [17795, 0.0], [17805, 0.0], [17824, 0.0], [17854, 0.25], [17860, 0.0], [17870, 0.0], [17874, 0.0], [17893, 0.125], [17899, 0.0], [17912, 0.0], [17922, 0.0], [17929, -0.125], [17933, 0.0], [17938, 0.0], [17963, 0.0], [17974, 0.0], [18006, 0.0], [18019, 0.0], [18030, 0.0], [18033, 0.0], [18040, 0.0], [18073, 0.0], [18086, 0.0], [18102, 0.0], [18129, 0.0], [18130, 0.125], [18132, 0.0], [18138, -0.25], [18164, 0.0], [18206, -0.125], [18218, -0.125], [18225, 0.125], [18242, 0.0], [18266, 0.0], [18275, 0.0], [18283, 0.0], [18285, 0.0], [18299, 0.0], [18318, -0.125], [18322, -0.125], [18335, 0.0], [18346, 0.0], [18352, 0.125], [18355, 0.0], [18358, -0.125], [18359, -0.125], [18380, 0.0], [18395, 0.0], [18400, 0.0], [18406, 0.0], [18418, 0.0], [18419, 0.0], [18424, 0.25], [18432, 0.0], [18433, -0.125], [18434, 0.0], [18442, 0.0], [18470, -0.125], [18472, 0.0], [18493, 0.0], [18499, 0.0], [18500, 0.0], [18502, 0.0], [18518, 0.0], [18524, 0.0], [18532, 0.0], [18564, 0.0], [18565, 0.125], [18568, -0.25], [18578, 0.125], [18588, 0.0], [18589, 0.0], [18603, 0.0], [18628, 0.125], [18641, 0.0], [18642, 0.0], [18651, 0.0], [18662, 0.0], [18663, 0.125], [18685, 0.0], [18718, 0.0], [18731, 0.0], [18735, -0.125], [18741, 0.0], [18759, 0.0], [18760, 0.125], [18780, 0.0], [18791, 0.0], [18815, 0.0], [18816, 0.0], [18840, 0.0], [18854, -0.125], [18867, -0.125], [18873, 0.0], [18884, 0.0], [18885, -0.125], [18890, -0.125], [18900, 0.0], [18907, 0.125], [18911, -0.125], [18914, 0.0], [18918, 0.0], [18924, 0.125], [18927, 0.0], [18934, 0.0], [18939, 0.0], [18940, 0.0], [18945, 0.0], [18947, 0.0], [18958, 0.0], [18972, 0.0], [18977, 0.0], [18987, 0.0], [19008, -0.125], [19009, 0.0], [19044, 0.0], [19051, 0.0], [19054, 0.0], [19070, 0.0], [19071, 0.0], [19072, 0.0], [19074, 0.125], [19078, 0.125], [19082, 0.0], [19090, 0.0], [19097, -0.25], [19110, 0.0], [19123, 0.0], [19139, 0.0], [19147, 0.0], [19160, 0.0], [19200, 0.0], [19216, 0.0], [19222, 0.0], [19262, 0.0], [19264, 0.0], [19273, 0.0], [19287, -0.125], [19290, 0.0], [19316, 0.0], [19342, 0.0], [19347, -0.125], [19363, 0.0], [19364, 0.0], [19378, 0.0], [19385, 0.0], [19386, 0.0], [19394, 0.0], [19396, 0.0], [19400, 0.0], [19401, -0.25], [19407, 0.0], [19416, 0.0], [19417, 0.0], [19422, 0.0], [19434, 0.125], [19437, 0.0], [19454, -0.125], [19459, 0.0], [19460, -0.125], [19476, 0.0], [19494, 0.0], [19497, 0.0], [19499, 0.125], [19500, 0.0], [19519, 0.0], [19536, 0.25], [19547, 0.0], [19552, 0.0], [19553, 0.0], [19554, 0.0], [19562, 0.0], [19592, 0.0], [19607, 0.0], [19612, 0.125], [19617, -0.125], [19645, 0.0], [19657, 0.0], [19671, 0.0], [19677, -0.125], [19682, 0.0], [19683, 0.0], [19696, 0.0], [19699, -0.125], [19710, -0.25], [19712, -0.125], [19718, 0.0], [19726, 0.0], [19727, 0.25], [19731, 0.0], [19740, 0.0], [19746, 0.0], [19753, 0.0], [19781, 0.0], [19806, 0.0], [19810, 0.0], [19811, 0.0], [19839, 0.0], [19852, 0.0], [19866, 0.0], [19872, -0.125], [19921, 0.0], [19928, 0.0], [19953, 0.0], [19966, 0.0], [19985, 0.0], [19988, 0.0], [19995, 0.0], [20003, 0.0], [20018, 0.0], [20035, 0.0], [20057, -0.125], [20066, 0.0], [20078, 0.0], [20082, 0.0], [20089, 0.0], [20110, 0.0], [20116, 0.0], [20131, 0.0], [20150, 0.0], [20152, 0.0], [20157, 0.0], [20160, 0.0], [20174, 0.0], [20187, -0.25], [20211, -0.125], [20222, 0.0], [20236, 0.0], [20237, 0.0], [20253, -0.25], [20258, 0.0], [20274, -0.125], [20297, 0.0], [20301, 0.0], [20306, 0.0], [20307, 0.0], [20316, 0.0], [20325, 0.0], [20350, 0.0], [20361, 0.0], [20369, -0.125], [20371, 0.125], [20382, 0.0], [20385, 0.0], [20386, -0.125], [20393, 0.0], [20402, 0.0], [20420, 0.0], [20442, 0.0], [20466, 0.0], [20468, 0.0], [20471, 0.0], [20487, 0.0], [20488, -0.125], [20490, 0.0], [20503, 0.0], [20506, 0.0], [20508, -0.125], [20520, 0.0], [20533, -0.125], [20537, 0.0], [20558, 0.0], [20568, 0.0], [20571, 0.0], [20576, 0.0], [20601, 0.0], [20603, 0.0], [20609, -0.125], [20644, 0.0], [20646, 0.0], [20652, 0.0], [20678, 0.0], [20723, 0.0], [20724, 0.0], [20728, 0.0], [20742, 0.0], [20744, 0.125], [20752, 0.0], [20764, 0.0], [20769, 0.0], [20778, 0.125], [20788, 0.0], [20789, 0.0], [20796, 0.0], [20797, 0.0], [20815, 0.0], [20853, 0.0], [20875, -0.125], [20884, 0.0], [20897, 0.0], [20932, 0.0], [20958, 0.125], [20969, 0.0], [20970, 0.0], [21017, 0.25], [21018, 0.0], [21026, 0.0], [21054, 0.0], [21062, 0.0], [21064, 0.125], [21073, 0.0], [21074, 0.0], [21125, 0.0], [21138, 0.0], [21145, 0.0], [21147, 0.0], [21170, 0.0], [21183, 0.0], [21184, 0.0], [21185, 0.0], [21206, -0.25], [21207, 0.0], [21210, 0.0], [21220, 0.125], [21229, 0.0], [21240, 0.0], [21245, 0.0], [21246, 0.0], [21248, -0.125], [21271, 0.0], [21276, 0.0], [21293, 0.0], [21294, 0.0], [21309, 0.0], [21331, 0.0], [21332, 0.0], [21333, 0.0], [21337, 0.125], [21341, 0.0], [21342, 0.0], [21344, 0.0], [21347, 0.0], [21361, 0.25], [21370, -0.25], [21418, 0.0], [21431, 0.0], [21446, 0.0], [21452, 0.0], [21507, 0.0], [21549, -0.125], [21557, 0.0], [21562, 0.0], [21565, 0.0], [21570, 0.0], [21575, 0.0], [21578, 0.0], [21593, 0.0], [21596, 0.0], [21600, 0.25], [21605, 0.0], [21610, 0.0], [21633, 0.0], [21635, 0.0], [21643, 0.0], [21656, -0.125], [21667, 0.0], [21671, 0.0], [21683, -0.125], [21694, 0.0], [21705, 0.25], [21706, 0.0], [21710, 0.0], [21723, 0.0], [21733, -0.125], [21762, 0.125], [21797, 0.0], [21803, -0.125], [21827, 0.0], [21830, 0.0], [21836, 0.0], [21837, 0.0], [21846, -0.125], [21855, 0.0], [21856, 0.0], [21859, -0.0625], [21884, -0.125], [21894, 0.0], [21895, 0.0], [21910, 0.0], [21952, 0.0], [21960, 0.0], [21965, 0.0], [21973, 0.0], [21984, -0.125], [21988, 0.0], [21997, 0.0], [21999, 0.0]]}

wandb/run-20250501_161111-rkamupqo/files/media/table/eval/table_2750_d02dcfe33f3ee8ea2f99.table.json

@@ -0,0 +1 @@
+{"columns": ["data_index", "value"], "data": [[22, 62.625], [86, 26.25], [101, 23.5], [105, -4.375], [110, -5.125], [121, 27.75], [124, 39.25], [135, 30.375], [136, 30.625], [138, 23.75], [160, 56.25], [166, 19.25], [177, 35.0], [180, 37.75], [196, 6.125], [208, 38.625], [226, 29.5], [245, -8.875], [258, 12.25], [259, 73.0], [266, 37.125], [273, 13.5], [275, 31.5], [277, 43.25], [288, 29.5], [324, 25.0], [327, 24.625], [339, 13.875], [340, 15.125], [369, -3.375], [400, 41.25], [402, 12.625], [432, 32.375], [438, 23.125], [440, 43.125], [446, 61.625], [458, 29.25], [461, 18.125], [494, 20.875], [500, 41.75], [503, 40.25], [507, 20.625], [511, 43.5], [525, 38.5], [534, 29.25], [538, 1.875], [543, 22.625], [563, 49.25], [567, 33.0], [569, 42.375], [575, 30.25], [591, 14.25], [594, 4.625], [602, 50.875], [609, 3.0], [620, -8.625], [625, 21.75], [679, 48.875], [687, 62.0], [700, 42.75], [716, 23.0], [725, 10.5], [736, 29.625], [740, 52.125], [757, 60.875], [758, 6.375], [769, 26.0], [795, 45.625], [804, 11.75], [806, -13.375], [816, 63.375], [821, 32.0], [831, 16.125], [842, 18.5], [849, 30.375], [862, 14.875], [889, 26.5], [896, 31.875], [903, 14.75], [930, 2.0], [937, 18.25], [940, 34.0], [945, 33.5], [993, 22.25], [999, -24.625], [1014, 26.625], [1043, 11.25], [1045, 35.125], [1062, 34.125], [1064, 33.875], [1066, 55.75], [1069, 25.0], [1077, 43.75], [1082, 30.375], [1099, -5.5], [1100, -11.75], [1108, 40.25], [1122, 24.375], [1136, 6.625], [1143, 29.625], [1147, 29.875], [1151, 54.625], [1166, 59.25], [1172, 18.125], [1185, 15.0], [1186, 37.25], [1195, 35.0], [1196, -0.75], [1225, 53.0], [1232, 27.0], [1233, 25.75], [1239, 29.375], [1247, 27.125], [1280, 51.25], [1285, 13.75], [1286, 61.625], [1289, 25.75], [1304, 36.875], [1313, 29.875], [1324, 57.375], [1327, 19.25], [1329, 18.75], [1340, 43.875], [1350, 12.75], [1357, 24.0], [1392, 8.125], [1394, 40.625], [1415, 49.75], [1421, 18.5], [1435, 23.0], [1450, 12.5], [1488, 47.75], [1489, 7.0], [1509, -6.625], [1526, 13.0], [1530, 13.25], [1551, 66.5], [1557, 38.875], [1558, 62.0], [1565, 24.5], [1580, 55.875], [1583, 19.75], [1588, 60.25], [1660, 60.5], [1675, 30.75], [1684, 14.875], [1694, 47.25], [1696, 29.75], [1703, 17.375], [1705, 40.5], [1755, 8.375], [1762, 47.75], [1764, 20.0], [1788, 49.75], [1796, -6.625], [1811, 34.375], [1814, 67.0], [1830, 34.5], [1834, -11.25], [1836, 24.75], [1851, 4.5], [1852, 42.375], [1870, 6.0], [1871, -8.5], [1889, 18.0], [1898, 31.25], [1907, 16.125], [1914, 51.375], [1915, 49.125], [1916, 27.125], [1918, 1.125], [1925, -17.25], [1927, 68.75], [1928, 45.625], [1970, 57.125], [1995, 19.75], [2002, 16.25], [2016, 63.125], [2019, 10.25], [2020, 21.5], [2083, 24.125], [2120, 45.25], [2135, 46.75], [2146, 27.25], [2153, 45.0], [2195, 22.875], [2203, 29.375], [2226, 58.5], [2231, -1.875], [2253, 8.5], [2254, 21.25], [2269, 1.25], [2275, 41.0], [2290, 46.625], [2303, 46.875], [2311, 46.875], [2312, 45.625], [2347, 8.625], [2357, 35.875], [2368, 52.625], [2369, 25.375], [2376, 85.5], [2380, 5.125], [2414, 36.125], [2425, 8.25], [2454, 40.875], [2462, 51.5], [2481, 22.625], [2483, 24.625], [2485, -8.75], [2490, -18.1875], [2492, 27.25], [2499, 11.75], [2508, 9.375], [2523, 9.25], [2533, 14.25], [2544, 53.25], [2584, 63.375], [2591, 25.25], [2628, 35.25], [2630, -16.0], [2634, 9.375], [2662, 10.625], [2669, -2.875], [2686, 40.25], [2688, 8.0], [2711, 25.0], [2725, 32.625], [2731, 26.75], [2734, 28.625], [2738, 27.375], [2745, -19.0], [2769, 21.25], [2778, 1.125], [2786, 35.125], [2808, 91.0], [2818, 1.0], [2820, 29.625], [2822, 63.875], [2834, 69.25], [2843, 65.125], [2851, 50.25], [2866, -5.0], [2892, 25.25], [2922, 23.25], [2926, 53.875], [2935, 17.875], [2950, 18.25], [2960, 19.75], [2965, 10.5], [2970, 6.5], [2984, 73.875], [2988, 8.5], [2994, 57.625], [3006, 31.125], [3017, 22.625], [3020, 12.125], [3058, 26.875], [3061, 49.75], [3064, 33.125], [3073, 48.875], [3092, 11.0], [3108, 54.0], [3118, 21.75], [3138, 30.375], [3144, 53.5], [3149, 70.125], [3153, 21.0], [3154, 28.0], [3157, 17.375], [3165, 26.0], [3166, 23.625], [3171, 28.5], [3181, 65.0], [3196, 10.75], [3230, 36.0], [3233, 51.875], [3244, 63.25], [3265, 37.875], [3268, 34.125], [3283, 14.875], [3296, -16.0], [3298, 35.5], [3307, 44.75], [3321, 34.25], [3353, -2.375], [3362, 49.5], [3368, 28.125], [3375, 27.625], [3393, 24.125], [3395, 30.5], [3400, 29.25], [3401, 18.625], [3423, 54.375], [3429, -1.25], [3434, -3.25], [3447, 63.5], [3456, 21.75], [3479, 30.5], [3484, 26.0], [3574, 39.75], [3581, 59.75], [3587, -8.125], [3604, 57.25], [3629, 0.0], [3643, 38.25], [3648, 34.0], [3657, 6.5], [3662, 20.125], [3695, 40.125], [3697, 28.875], [3699, 12.125], [3703, 41.875], [3721, 40.625], [3732, 5.5], [3738, 66.75], [3746, 20.5], [3748, 22.75], [3750, 16.75], [3779, 54.875], [3786, 37.875], [3796, 33.0], [3805, 19.75], [3816, 42.75], [3845, 39.125], [3846, -0.75], [3864, 42.125], [3880, 30.5], [3892, 44.25], [3895, 32.5], [3902, 43.0], [3933, 19.5], [3938, 40.0], [3940, 25.125], [3954, 46.25], [3961, 65.0], [3974, 50.75], [3976, -1.75], [3980, 21.5], [3990, 6.5], [3997, 34.375], [3998, 101.5], [3999, 13.75], [4001, 32.125], [4005, 36.375], [4012, 61.125], [4014, 32.875], [4015, 33.0], [4023, 39.0], [4042, -2.75], [4047, 24.75], [4048, 17.75], [4091, 56.375], [4097, 53.125], [4106, 20.375], [4120, 45.5], [4125, 15.75], [4151, 3.5], [4161, 50.625], [4162, 31.5], [4163, 14.5], [4164, -4.625], [4185, 22.5], [4193, 20.625], [4195, 31.125], [4197, 4.625], [4198, 26.75], [4201, 32.375], [4206, 53.875], [4227, 60.375], [4240, 23.75], [4244, 51.5], [4246, 3.5], [4252, 19.0], [4267, -3.0], [4271, 21.625], [4275, 0.25], [4297, -0.625], [4307, 44.5], [4337, 29.5], [4352, 47.75], [4365, 16.5], [4380, 27.875], [4382, 47.5], [4399, 17.625], [4405, 56.0], [4415, 35.25], [4417, 43.875], [4436, 9.75], [4441, 46.75], [4453, 0.625], [4469, 42.125], [4474, -16.5], [4491, 55.5], [4500, 14.625], [4503, 34.875], [4517, 21.375], [4538, 29.5], [4588, 63.375], [4589, 19.25], [4602, 44.125], [4606, 0.875], [4631, 32.875], [4640, 35.75], [4649, 24.625], [4651, 69.125], [4665, 20.625], [4690, 41.25], [4703, 29.125], [4706, 7.75], [4724, 26.625], [4750, 22.0], [4752, 45.0], [4763, 41.75], [4773, 12.75], [4778, 9.25], [4789, 17.75], [4804, 8.0], [4809, 58.5], [4813, 37.125], [4822, 18.375], [4839, 21.125], [4841, -1.375], [4858, 41.0], [4878, 46.375], [4899, 25.25], [4916, 42.5], [4923, 45.0], [4929, 28.0], [4954, 51.5], [4955, 16.125], [4971, 69.625], [4985, 39.5], [4999, 20.75], [5000, 45.75], [5003, 42.125], [5006, 28.25], [5017, 38.75], [5021, 10.25], [5043, 24.875], [5055, 49.625], [5062, 22.5], [5064, 46.875], [5074, 50.125], [5075, 28.75], [5081, 31.125], [5101, 27.625], [5103, 2.375], [5119, 26.625], [5137, 27.75], [5138, 14.25], [5142, 5.75], [5151, 23.625], [5152, 10.375], [5164, 32.5], [5207, 33.875], [5209, 25.75], [5226, 70.125], [5229, 76.5], [5235, 51.125], [5246, -38.8125], [5256, 11.25], [5265, 20.625], [5274, 30.5], [5279, 14.25], [5284, 33.125], [5303, 27.625], [5311, 60.125], [5319, 26.5], [5320, -6.75], [5322, 74.375], [5325, 45.375], [5357, 24.875], [5374, 37.75], [5375, 24.25], [5380, 48.125], [5384, 55.875], [5389, 26.0], [5390, 17.25], [5394, 39.75], [5409, 38.75], [5410, 57.375], [5420, 15.25], [5421, 38.0], [5428, 0.625], [5431, 17.25], [5450, 14.5], [5465, 50.625], [5472, 24.625], [5484, 12.0], [5486, 42.5], [5487, 44.75], [5489, 16.125], [5524, 38.5], [5541, 29.75], [5542, 25.625], [5568, 33.25], [5586, 42.875], [5589, 0.375], [5594, 11.0], [5598, 33.875], [5615, 40.125], [5617, 46.25], [5653, 41.5], [5655, 18.0], [5676, 31.875], [5704, 24.125], [5709, 30.0], [5711, 38.625], [5751, 48.0], [5767, 66.0], [5777, 25.375], [5783, 40.625], [5786, 30.75], [5825, 35.875], [5831, 21.125], [5841, 24.5], [5851, 23.875], [5853, 21.25], [5859, 20.125], [5865, 28.0], [5930, 26.625], [5983, 24.25], [6001, 27.75], [6010, 55.0], [6016, 41.0], [6017, -2.625], [6019, 38.125], [6025, 36.0], [6028, 45.5], [6029, 23.875], [6035, 44.5], [6037, 23.25], [6077, 18.75], [6083, 11.375], [6094, 21.75], [6107, 33.75], [6126, 25.625], [6136, 6.0], [6152, 19.25], [6194, 57.75], [6202, 13.75], [6203, -1.75], [6210, 72.25], [6211, 13.25], [6219, 3.5], [6296, 52.5], [6305, 50.75], [6326, 48.375], [6337, 21.125], [6349, 32.625], [6360, 24.75], [6375, 58.375], [6378, -6.375], [6400, 52.75], [6412, 26.375], [6434, -0.5], [6469, 69.25], [6471, 38.125], [6480, 22.375], [6490, 43.125], [6508, 4.875], [6543, 50.875], [6547, 20.75], [6561, 33.0], [6576, 59.0], [6589, 3.875], [6600, 39.5], [6604, 11.75], [6613, 24.375], [6621, 48.375], [6625, 15.75], [6626, 59.625], [6636, -0.25], [6645, 19.125], [6684, 34.0], [6688, 32.75], [6689, -2.25], [6705, 63.875], [6720, 49.875], [6736, 22.875], [6749, 17.0], [6752, -8.75], [6760, 65.125], [6769, 31.5], [6771, 48.625], [6778, 14.125], [6786, 43.375], [6789, 33.75], [6803, 67.125], [6861, 15.5], [6866, 42.375], [6869, 22.0], [6872, 25.625], [6877, 48.75], [6884, 37.125], [6888, 49.875], [6889, 17.75], [6898, 53.625], [6993, 23.75], [7011, 20.125], [7013, 17.125], [7016, 23.0], [7027, 29.5], [7035, 24.75], [7045, 50.75], [7046, 31.0], [7049, 42.125], [7068, 39.875], [7072, 11.25], [7085, -20.375], [7090, 33.375], [7097, 6.5], [7101, 12.125], [7102, 68.375], [7109, 5.75], [7132, 25.25], [7139, 29.75], [7141, 55.875], [7144, -10.25], [7152, 22.0], [7167, -6.75], [7170, 63.0], [7185, 6.0], [7186, 53.75], [7202, 54.0], [7207, -8.5], [7211, 48.5], [7227, 0.5], [7236, -9.5], [7250, 8.5], [7257, -2.25], [7274, 8.625], [7278, 46.375], [7280, 18.25], [7281, 7.125], [7290, -7.25], [7298, 6.625], [7299, 44.375], [7302, 32.75], [7306, -26.75], [7318, 31.625], [7321, 57.0], [7330, 29.625], [7334, 9.75], [7336, 36.25], [7341, 81.5], [7344, 26.25], [7347, 22.875], [7361, 2.875], [7369, 58.75], [7397, 42.875], [7408, 35.75], [7427, -4.5], [7430, 15.25], [7439, 57.75], [7453, 24.25], [7473, 5.125], [7478, 57.25], [7488, 26.75], [7503, 30.25], [7518, 33.0], [7544, 46.875], [7552, 31.0], [7576, 18.875], [7577, 29.0], [7597, 40.375], [7605, 28.625], [7616, 41.625], [7620, -6.25], [7656, 44.125], [7659, 31.0], [7681, -5.25], [7692, 46.25], [7710, 10.0], [7713, 3.0], [7722, 36.875], [7723, 59.125], [7742, 19.0], [7743, 25.875], [7750, 12.25], [7790, 41.25], [7801, -12.0], [7811, -31.125], [7815, 47.625], [7843, -14.125], [7844, 49.5], [7857, 24.5], [7868, 9.25], [7877, 29.25], [7887, 24.125], [7897, 36.5], [7902, 78.375], [7910, 22.25], [7912, 15.25], [7918, 53.625], [7933, 40.25], [7936, 50.5], [7951, 26.75], [7953, 46.0], [7957, 27.375], [7962, 42.0], [7971, 2.0], [7974, 4.25], [7991, 47.25], [8000, 18.625], [8008, 48.25], [8018, 24.5], [8024, 9.75], [8047, -8.125], [8060, -0.25], [8077, 8.25], [8086, 40.5], [8104, 34.875], [8118, 28.625], [8133, 26.5], [8138, 18.375], [8145, 50.5], [8150, 40.25], [8168, 76.25], [8170, 32.5], [8173, 42.75], [8175, 9.875], [8194, 39.375], [8211, -1.875], [8253, 15.375], [8262, -20.875], [8263, 50.0], [8265, 65.375], [8268, 52.125], [8271, 10.75], [8272, 37.5], [8273, -1.75], [8277, 33.25], [8292, 28.75], [8344, 29.875], [8346, 22.5], [8350, 30.125], [8364, 48.125], [8369, 17.375], [8370, 20.875], [8385, 49.5], [8389, 23.875], [8421, 5.625], [8442, 36.875], [8453, 22.625], [8458, -2.875], [8466, 74.125], [8478, 60.625], [8483, 11.625], [8487, 7.25], [8501, 51.125], [8505, 27.375], [8509, 41.875], [8534, -2.875], [8539, 12.125], [8556, 38.25], [8566, -2.625], [8577, 17.75], [8583, -6.75], [8600, 60.125], [8615, 27.5], [8624, 65.375], [8630, 13.375], [8645, 25.875], [8658, 19.25], [8660, 15.875], [8667, 23.5], [8672, 23.75], [8676, 41.0], [8687, 43.0], [8689, 25.125], [8692, 38.125], [8697, 9.25], [8699, 42.5], [8707, 53.875], [8722, 30.625], [8726, 64.875], [8727, 37.75], [8736, 15.5], [8737, 12.625], [8752, 28.25], [8760, 12.625], [8776, 58.25], [8793, 2.875], [8794, -5.5], [8797, 48.25], [8806, 31.0], [8812, 15.125], [8820, 61.625], [8830, 42.625], [8852, 22.125], [8877, 20.625], [8885, 82.625], [8891, 12.125], [8929, 55.75], [8936, 13.75], [8938, 62.75], [8954, 46.625], [8967, -10.375], [8975, 49.0], [8985, 10.5], [8989, 40.5], [8999, 18.125], [9002, 16.375], [9014, 26.25], [9025, 26.75], [9034, 1.5], [9052, 44.5], [9059, 26.75], [9063, 14.0], [9084, 34.125], [9086, -0.625], [9088, 44.625], [9123, 51.625], [9130, 26.25], [9144, 34.375], [9167, 25.75], [9182, 35.125], [9184, 17.375], [9198, 25.375], [9218, 33.5], [9231, 9.75], [9237, 17.125], [9239, 15.625], [9244, 50.125], [9256, 18.25], [9257, 18.25], [9261, 47.5], [9267, 47.625], [9269, 23.625], [9297, 43.25], [9300, 12.125], [9305, 51.125], [9327, 38.75], [9337, 44.5], [9340, 27.0], [9341, 17.375], [9355, 24.875], [9360, 2.375], [9366, -2.625], [9369, 43.875], [9377, 15.0], [9380, 34.75], [9381, 41.5], [9385, 23.625], [9403, 56.25], [9406, 31.125], [9409, 13.25], [9419, 7.25], [9420, 24.625], [9423, 31.5], [9447, 47.25], [9450, 27.0], [9467, 20.625], [9475, 49.0], [9485, 43.75], [9502, 24.5], [9504, 11.5], [9518, 42.75], [9523, 22.25], [9536, -3.875], [9559, 11.625], [9563, 36.625], [9576, 35.375], [9594, 8.375], [9611, -7.75], [9613, 55.75], [9621, 42.375], [9633, 16.0], [9655, -3.5], [9658, 22.875], [9667, 30.875], [9672, 35.0], [9681, 8.5], [9684, 12.25], [9687, 22.75], [9688, 31.625], [9693, 5.125], [9698, 14.5], [9702, 33.75], [9713, 23.5], [9716, 41.625], [9721, 39.875], [9726, 0.0], [9736, 59.0], [9762, 32.125], [9772, 39.75], [9776, 52.5], [9781, 29.875], [9783, 48.5], [9809, 29.125], [9833, 23.75], [9837, 27.875], [9853, 37.75], [9856, 12.5], [9857, 21.75], [9863, 71.875], [9872, 18.0], [9894, 64.125], [9899, 3.625], [9919, 59.25], [9936, 24.75], [9947, 38.625], [9949, 41.0], [9952, 27.875], [9958, 40.25], [9979, 30.75], [9998, 30.25], [10005, 31.75], [10015, 36.875], [10053, 26.75], [10096, 47.5], [10108, 68.875], [10114, 1.375], [10122, 80.5], [10126, 0.625], [10145, -0.75], [10159, 17.25], [10166, 63.25], [10181, 63.625], [10184, 14.5], [10190, 68.25], [10197, 31.75], [10217, 5.125], [10218, 35.25], [10219, 53.5], [10224, 64.625], [10234, 27.5], [10244, 55.375], [10258, 57.125], [10330, 29.375], [10340, -3.25], [10352, 21.625], [10367, 30.25], [10372, 4.0], [10376, 52.25], [10377, 4.5], [10390, 19.125], [10419, -10.625], [10422, 21.625], [10434, 14.125], [10439, 48.125], [10445, 26.625], [10448, 53.25], [10471, 61.5], [10493, 0.375], [10500, 17.5], [10517, 43.25], [10527, 10.125], [10561, 42.375], [10569, 6.375], [10576, 64.125], [10577, 25.0], [10598, 56.625], [10609, 65.75], [10635, 17.0], [10637, 57.75], [10640, 61.375], [10654, 30.25], [10660, 35.875], [10662, 1.75], [10664, 24.625], [10667, 53.25], [10668, -0.125], [10672, 17.5], [10679, 52.75], [10687, 29.375], [10690, 42.75], [10692, 41.25], [10693, 65.0], [10699, 47.0], [10710, 24.0], [10715, 31.75], [10719, 19.375], [10730, 21.5], [10735, 46.0], [10742, -26.1875], [10746, 23.875], [10750, 51.625], [10753, 25.125], [10754, 20.0], [10758, 1.75], [10766, 58.125], [10768, 13.625], [10773, 35.25], [10780, 20.625], [10785, 44.5], [10789, 11.5], [10798, 48.5], [10817, 33.125], [10821, 38.0], [10822, 62.375], [10862, 19.25], [10863, 36.125], [10866, 26.375], [10889, 36.0], [10924, 32.0], [10944, 57.875], [10955, 40.25], [10966, 41.625], [10969, 52.25], [10978, 19.125], [10979, 2.875], [10987, 29.25], [10999, 26.0], [11025, 9.75], [11026, 38.25], [11031, 38.375], [11034, 46.125], [11048, 14.75], [11050, 46.0], [11053, 11.625], [11055, 35.375], [11056, 23.75], [11057, 5.5], [11067, 30.875], [11069, 28.0], [11072, 53.875], [11074, 15.625], [11085, 44.5], [11111, 14.5], [11112, 44.0], [11123, 41.5], [11149, 68.25], [11185, 29.125], [11221, 5.625], [11250, -2.875], [11266, 38.875], [11279, 25.25], [11280, -22.9375], [11312, 18.75], [11320, 32.25], [11327, 0.25], [11331, 0.125], [11351, 12.375], [11359, 51.75], [11360, 21.125], [11362, 22.0], [11386, 10.25], [11391, 54.375], [11393, 10.5], [11428, 24.25], [11436, 39.875], [11446, 37.875], [11460, 40.375], [11462, 21.0], [11465, 42.25], [11478, 41.125], [11495, 55.25], [11497, 29.375], [11500, 26.625], [11522, 37.125], [11523, 28.75], [11526, 49.75], [11533, 57.5], [11539, 24.375], [11540, 46.375], [11543, 23.5], [11548, 46.0], [11570, 10.625], [11572, 56.375], [11584, 13.0], [11597, 0.0], [11605, 22.125], [11622, 21.25], [11637, 12.25], [11650, 50.875], [11657, -2.125], [11665, 23.875], [11668, 39.25], [11686, 23.25], [11720, 29.75], [11721, 28.875], [11741, 57.875], [11755, 62.5], [11756, 60.5], [11764, -41.0], [11819, 54.625], [11828, 30.5], [11842, 38.5], [11861, -1.75], [11871, 35.0], [11880, 24.625], [11903, 5.5], [11905, 76.75], [11939, 18.25], [11940, 47.5], [11941, 61.0], [11963, 55.25], [11964, 67.875], [11970, 16.5], [11983, -12.0], [11992, 62.0], [12020, 61.125], [12042, 38.625], [12051, 54.25], [12069, 50.0], [12075, 55.375], [12102, 27.125], [12106, 20.25], [12150, 16.5], [12158, 35.125], [12161, -35.75], [12164, 13.125], [12165, 31.625], [12172, 2.125], [12181, 21.5], [12192, 15.5], [12193, 47.75], [12205, 21.625], [12207, 46.875], [12214, 50.375], [12219, 28.75], [12224, 18.5], [12225, 46.625], [12229, 7.5], [12237, 29.5], [12238, 11.5], [12253, 29.125], [12257, 51.5], [12259, 39.125], [12262, 17.5], [12266, 62.625], [12300, 5.25], [12309, 30.25], [12344, 33.75], [12351, 9.375], [12352, 13.125], [12354, 59.5], [12357, 53.625], [12359, 12.25], [12361, 6.375], [12362, 41.875], [12370, -31.125], [12384, 31.5], [12397, 8.75], [12411, 49.0], [12428, 53.875], [12436, 29.375], [12455, 42.375], [12467, 16.25], [12481, 39.125], [12482, 10.75], [12499, -9.625], [12505, 35.125], [12527, 11.0], [12546, 58.25], [12559, 31.75], [12578, 76.25], [12583, 38.0], [12584, 41.875], [12601, 45.75], [12609, 33.75], [12610, 43.375], [12614, 37.25], [12620, 54.875], [12626, 1.0], [12647, 54.0], [12669, 36.0], [12676, 32.0], [12700, 47.875], [12703, -0.875], [12706, 19.75], [12711, -18.375], [12716, 58.25], [12739, 41.75], [12766, 24.5], [12779, 28.375], [12812, 5.375], [12820, 51.5], [12823, 24.5], [12826, 31.375], [12857, -9.5], [12866, 3.625], [12893, 18.75], [12907, 8.125], [12940, 32.75], [12944, 30.875], [12946, 45.5], [12954, 43.875], [12958, 31.25], [12960, 2.0], [12972, 6.5], [13005, -9.25], [13008, -3.0], [13019, 18.875], [13022, 49.125], [13041, 32.25], [13044, 29.5], [13048, 32.0], [13060, -17.75], [13066, 19.25], [13069, 50.375], [13081, 35.875], [13086, 39.875], [13091, 46.875], [13098, 10.125], [13100, 24.625], [13104, 14.0], [13112, 28.875], [13127, 20.0], [13136, 15.5], [13154, 8.5], [13162, 28.875], [13195, 3.75], [13214, 19.25], [13225, 62.75], [13233, 46.75], [13244, 70.875], [13253, 53.0], [13259, 65.0], [13268, 36.75], [13270, 18.25], [13273, 49.25], [13290, 40.125], [13300, 40.75], [13305, 32.5], [13312, 30.0], [13353, 37.75], [13357, 13.625], [13359, 59.625], [13386, 36.375], [13390, 11.25], [13425, 11.0], [13426, 18.375], [13437, 22.25], [13449, 26.875], [13455, 43.0], [13468, 4.25], [13471, 25.25], [13494, 45.875], [13495, -12.25], [13496, 16.25], [13515, -19.75], [13517, 38.625], [13526, 18.375], [13546, -27.6875], [13567, 27.125], [13575, 0.125], [13583, 41.375], [13586, -1.75], [13594, 53.125], [13596, 53.375], [13598, 40.5], [13613, 29.375], [13616, 13.5], [13633, 10.75], [13639, 51.0], [13654, 41.375], [13671, 48.0], [13693, 47.625], [13697, 1.75], [13706, 29.5], [13723, 23.375], [13730, 47.0], [13735, 12.5], [13751, -5.125], [13765, 6.625], [13775, 43.5], [13789, 14.625], [13790, 62.75], [13792, 69.75], [13814, 50.25], [13821, 19.125], [13823, -20.4375], [13838, 23.5], [13843, 36.375], [13866, 42.5], [13868, 11.25], [13870, 27.75], [13874, 19.5], [13887, 0.5], [13891, 18.75], [13895, 43.5], [13901, 6.0], [13931, 8.125], [13950, 36.25], [13952, 41.125], [13957, 60.375], [13964, 60.125], [13968, 26.0], [13970, 56.75], [13974, 51.625], [13976, 22.75], [13978, -5.875], [14000, 16.25], [14004, 39.875], [14005, 64.25], [14006, 9.75], [14017, 37.875], [14030, 26.5], [14037, 16.75], [14054, -10.875], [14068, 31.625], [14080, 22.375], [14083, 42.125], [14084, 11.0], [14092, 11.125], [14103, 1.25], [14109, 8.875], [14132, 40.0], [14157, 60.875], [14165, 78.125], [14172, 26.875], [14180, 38.625], [14203, 53.25], [14207, 40.625], [14210, 44.0], [14248, 43.625], [14260, 73.0], [14273, 28.75], [14279, 39.75], [14282, 11.25], [14283, 69.375], [14285, 7.875], [14291, -2.875], [14294, 60.125], [14304, 60.875], [14312, 5.375], [14319, 50.0], [14326, 18.875], [14358, 7.125], [14373, 30.25], [14380, 28.875], [14385, 42.0], [14417, 42.75], [14421, 13.875], [14424, 35.0], [14429, 47.625], [14433, -2.25], [14441, 42.25], [14456, 21.75], [14458, 9.0], [14475, 14.0], [14524, 45.375], [14531, 57.125], [14532, 41.0], [14551, 24.375], [14556, 41.875], [14566, 31.5], [14567, 2.5], [14574, 20.0], [14576, 60.0], [14597, 39.25], [14603, 23.0], [14622, 41.875], [14664, 27.0], [14665, 33.0], [14668, 29.625], [14670, 60.0], [14671, 30.75], [14676, 28.0], [14682, 46.0], [14686, 46.0], [14688, 53.125], [14694, 39.625], [14701, 30.25], [14717, 60.625], [14743, -10.625], [14744, 45.875], [14750, 25.375], [14764, 27.625], [14770, 11.5], [14779, 15.0], [14784, 13.25], [14787, -9.875], [14803, 23.5], [14805, 38.875], [14808, 25.25], [14821, 25.125], [14823, 17.0], [14825, 18.375], [14831, 19.375], [14833, 15.0], [14851, 16.375], [14866, -14.875], [14899, -2.75], [14901, 37.25], [14911, 1.0], [14914, 27.125], [14921, 46.75], [14944, 29.125], [14947, 45.875], [14949, 14.75], [14951, 47.625], [14953, 60.125], [14959, 22.0], [14962, 32.75], [14970, 60.0], [14974, 11.375], [14997, 11.0], [15000, 48.5], [15001, 40.125], [15003, 58.0], [15006, 23.875], [15019, 48.25], [15024, 3.625], [15028, 63.0], [15032, 46.375], [15045, 48.75], [15054, -14.25], [15069, 48.625], [15070, 21.0], [15095, 15.75], [15118, 27.375], [15133, 18.625], [15142, 57.875], [15143, 6.25], [15164, 42.5], [15172, 13.0], [15182, -10.25], [15185, 35.75], [15197, 9.25], [15204, 25.25], [15214, 23.0], [15236, 13.875], [15242, 40.875], [15247, 8.875], [15251, 31.625], [15257, 17.5], [15316, 44.25], [15334, 21.75], [15336, 42.75], [15344, -23.5], [15366, 14.75], [15373, 42.0], [15380, 7.375], [15382, 39.25], [15412, 11.25], [15416, 55.875], [15434, 52.875], [15436, 25.375], [15441, 72.25], [15444, 54.25], [15457, 54.25], [15465, 46.25], [15475, 0.75], [15496, 18.5], [15500, 39.625], [15522, 37.0], [15529, 39.5], [15531, 51.25], [15562, 32.5], [15565, 4.625], [15569, 37.875], [15576, 37.125], [15594, 38.0], [15597, 22.25], [15614, 37.75], [15627, 21.75], [15640, 28.0], [15664, 53.875], [15667, -10.625], [15679, 16.75], [15680, 36.125], [15698, 41.375], [15730, 41.0], [15731, 24.375], [15745, 44.75], [15759, -12.75], [15766, 15.0], [15791, 16.25], [15801, 54.0], [15808, 25.375], [15822, 9.25], [15834, 49.0], [15838, 36.75], [15844, 32.0], [15850, 8.5], [15862, 20.875], [15872, 35.25], [15887, 19.75], [15931, 49.0], [15942, -5.25], [15945, 27.625], [15955, 61.875], [16000, 30.25], [16042, -10.25], [16043, 1.875], [16060, 5.25], [16063, 52.75], [16073, 62.75], [16076, 54.5], [16078, 17.125], [16140, -3.75], [16164, 51.75], [16165, 10.5], [16169, 23.125], [16210, 54.125], [16225, 27.25], [16262, 37.5], [16269, 22.875], [16277, 46.75], [16282, 8.25], [16295, 57.25], [16312, 4.125], [16316, 34.25], [16328, 18.625], [16346, 32.75], [16389, 21.25], [16434, 19.625], [16472, 35.75], [16474, 34.375], [16489, 46.25], [16502, 55.625], [16531, 57.0], [16532, 51.375], [16539, 38.875], [16541, 21.25], [16571, 21.625], [16572, 57.875], [16580, 70.5], [16582, 47.25], [16598, -36.75], [16605, 13.5], [16606, 19.75], [16619, 20.625], [16643, -11.125], [16657, -18.0625], [16659, 24.125], [16671, 26.25], [16737, 52.0], [16743, 27.5], [16759, 59.0], [16765, 22.0], [16768, 61.125], [16769, 47.875], [16773, 11.875], [16777, 46.125], [16790, -22.1875], [16804, 43.875], [16831, 25.0], [16851, 18.0], [16854, 42.5], [16868, 8.375], [16882, 46.75], [16891, 73.125], [16919, 20.5], [16937, 46.375], [16938, 32.875], [16941, 53.375], [16965, 48.0], [16977, 9.625], [16982, 54.25], [16987, 14.625], [17002, 9.625], [17018, 56.125], [17020, 28.125], [17030, -6.375], [17044, 46.25], [17049, 32.75], [17077, 33.75], [17101, 36.125], [17115, 14.75], [17135, 8.5], [17154, 48.75], [17160, 42.375], [17171, 49.125], [17172, 33.625], [17193, 38.5], [17216, 66.25], [17229, 28.375], [17251, 6.875], [17278, 19.875], [17279, 19.25], [17322, 82.875], [17325, 23.5], [17346, 56.125], [17364, 5.75], [17392, 55.5], [17394, -0.375], [17395, 30.5], [17397, -15.0], [17403, 45.0], [17405, 44.375], [17408, -3.125], [17420, 13.125], [17431, 66.5], [17443, 66.5], [17447, 10.5], [17463, 21.5], [17482, -1.0], [17509, 5.75], [17527, 24.125], [17536, 18.375], [17540, 15.25], [17551, 18.25], [17552, 33.0], [17553, 44.625], [17554, 24.5], [17563, 16.5], [17564, 33.375], [17574, 53.75], [17577, 35.5], [17589, 15.0], [17610, 44.75], [17618, 17.5], [17637, 57.875], [17650, 33.625], [17661, 9.875], [17664, 30.75], [17668, 57.875], [17687, 45.625], [17723, 37.5], [17745, 49.0], [17755, 4.625], [17756, -5.25], [17757, 19.75], [17766, 20.375], [17777, 16.5], [17780, 15.25], [17794, 46.75], [17795, 3.75], [17805, 17.75], [17824, 18.875], [17854, 29.5], [17860, 63.875], [17870, 41.375], [17874, 40.875], [17893, 5.625], [17899, 11.0], [17912, 52.0], [17922, 56.25], [17929, 13.125], [17933, 27.25], [17938, 68.625], [17963, -1.25], [17974, -13.125], [18006, 24.125], [18019, 66.875], [18030, 41.25], [18033, 6.5], [18040, 49.25], [18073, 7.5], [18086, 16.375], [18102, 22.5], [18129, 20.0], [18130, 55.125], [18132, 56.25], [18138, 56.375], [18164, -31.375], [18206, 41.375], [18218, 66.5], [18225, 2.875], [18242, 47.75], [18266, -11.125], [18275, 31.625], [18283, 11.625], [18285, 22.0], [18299, 43.5], [18318, 19.625], [18322, 19.5], [18335, 32.125], [18346, 27.375], [18352, -5.375], [18355, 14.75], [18358, 48.125], [18359, 47.5], [18380, 53.375], [18395, 12.125], [18400, 41.75], [18406, 39.5], [18418, 8.0], [18419, 21.0], [18424, 19.0], [18432, 57.875], [18433, 29.375], [18434, 16.75], [18442, 26.125], [18470, 27.875], [18472, 39.375], [18493, 19.0], [18499, 30.25], [18500, 21.0], [18502, 11.125], [18518, 22.5], [18524, 64.5], [18532, 15.25], [18564, 49.0], [18565, 27.375], [18568, 54.625], [18578, -14.25], [18588, 65.0], [18589, 32.375], [18603, 23.0], [18628, 18.875], [18641, 34.375], [18642, -25.75], [18651, 23.25], [18662, -1.625], [18663, 37.75], [18685, 44.625], [18718, 9.125], [18731, -9.75], [18735, 42.5], [18741, 18.375], [18759, 59.75], [18760, 57.5], [18780, 22.25], [18791, 24.0], [18815, 41.625], [18816, 32.125], [18840, 35.625], [18854, 16.875], [18867, 28.625], [18873, 15.875], [18884, 11.625], [18885, 27.25], [18890, 39.375], [18900, 46.625], [18907, -0.375], [18911, 60.125], [18914, -13.125], [18918, -16.4375], [18924, 31.0], [18927, 33.25], [18934, 45.5], [18939, 6.75], [18940, 27.625], [18945, -0.5], [18947, 46.125], [18958, 36.5], [18972, 25.625], [18977, 52.25], [18987, 16.0], [19008, 43.375], [19009, 29.875], [19044, -2.0], [19051, 36.25], [19054, -6.625], [19070, 49.25], [19071, 31.375], [19072, 43.5], [19074, 19.625], [19078, 49.5], [19082, -27.125], [19090, 51.375], [19097, 34.75], [19110, 46.5], [19123, -8.75], [19139, 45.5], [19147, 15.375], [19160, 36.375], [19200, 43.5], [19216, 40.875], [19222, 18.375], [19262, 71.0], [19264, 42.25], [19273, 12.25], [19287, 30.875], [19290, 44.875], [19316, 69.125], [19342, 13.75], [19347, 31.0], [19363, 23.0], [19364, 8.75], [19378, 59.375], [19385, 65.5], [19386, 14.0], [19394, 16.25], [19396, 8.25], [19400, 49.75], [19401, 47.375], [19407, 41.125], [19416, 10.0], [19417, -28.6875], [19422, 29.0], [19434, 17.625], [19437, 8.625], [19454, 21.0], [19459, 72.125], [19460, 16.75], [19476, 0.375], [19494, -20.8125], [19497, 39.5], [19499, 40.0], [19500, 33.5], [19519, -8.625], [19536, 17.0], [19547, 68.625], [19552, 17.875], [19553, 30.75], [19554, 0.625], [19562, 44.75], [19592, 42.375], [19607, 31.125], [19612, 20.875], [19617, 5.625], [19645, 31.125], [19657, 29.125], [19671, -1.5], [19677, 53.125], [19682, 1.625], [19683, 44.75], [19696, 29.875], [19699, 23.375], [19710, 41.0], [19712, 49.0], [19718, 21.125], [19726, 13.0], [19727, 40.0], [19731, 33.875], [19740, 3.25], [19746, 5.375], [19753, 18.625], [19781, 56.625], [19806, 49.5], [19810, 46.75], [19811, 49.625], [19839, 3.25], [19852, 10.375], [19866, 29.5], [19872, 22.625], [19921, 31.375], [19928, 45.0], [19953, 28.125], [19966, 13.0], [19985, 37.625], [19988, 18.625], [19995, 24.25], [20003, 57.625], [20018, 28.125], [20035, 72.75], [20057, 20.25], [20066, 64.625], [20078, 33.875], [20082, 47.125], [20089, 34.875], [20110, 46.125], [20116, 29.625], [20131, 47.375], [20150, 43.5], [20152, 49.0], [20157, 77.75], [20160, -2.5], [20174, 18.625], [20187, 28.0], [20211, 34.5], [20222, 44.875], [20236, 56.875], [20237, 37.875], [20253, 29.0], [20258, 68.25], [20274, 18.75], [20297, 44.0], [20301, -14.125], [20306, 17.75], [20307, 48.5], [20316, 28.25], [20325, 23.625], [20350, 11.625], [20361, 44.25], [20369, 15.875], [20371, 6.5], [20382, 43.75], [20385, 26.5], [20386, 55.625], [20393, 12.25], [20402, 42.375], [20420, 56.125], [20442, 26.0], [20466, 32.25], [20468, 15.375], [20471, 15.125], [20487, 55.625], [20488, 9.5], [20490, 36.0], [20503, 50.0], [20506, 14.125], [20508, -5.75], [20520, 48.5], [20533, 19.625], [20537, 5.5], [20558, 62.125], [20568, 21.375], [20571, 18.375], [20576, -4.5], [20601, 30.25], [20603, -18.25], [20609, 17.625], [20644, 49.5], [20646, 23.125], [20652, 58.5], [20678, 20.0], [20723, 61.25], [20724, 48.625], [20728, 41.75], [20742, 33.0], [20744, 28.75], [20752, 59.0], [20764, 28.0], [20769, 27.625], [20778, 48.25], [20788, 25.875], [20789, 34.125], [20796, 49.75], [20797, 59.875], [20815, 23.25], [20853, 39.75], [20875, 28.375], [20884, 52.0], [20897, 28.0], [20932, 13.875], [20958, 10.375], [20969, 51.75], [20970, 13.25], [21017, 17.375], [21018, -18.25], [21026, 14.375], [21054, -13.25], [21062, 33.5], [21064, 45.75], [21073, 21.5], [21074, 20.375], [21125, 33.0], [21138, 40.25], [21145, 6.125], [21147, 25.25], [21170, 0.125], [21183, -9.875], [21184, 8.0], [21185, 33.625], [21206, 24.5], [21207, 20.375], [21210, 17.625], [21220, 2.875], [21229, 36.75], [21240, 53.0], [21245, 22.0], [21246, 49.75], [21248, 42.5], [21271, 16.125], [21276, 52.875], [21293, 31.25], [21294, 54.5], [21309, 68.25], [21331, -7.125], [21332, 20.125], [21333, 37.125], [21337, 24.25], [21341, 27.5], [21342, 3.125], [21344, 67.25], [21347, 20.375], [21361, 25.0], [21370, 32.75], [21418, 78.5], [21431, 48.75], [21446, 13.75], [21452, 25.875], [21507, 36.25], [21549, 18.625], [21557, 36.5], [21562, 59.875], [21565, 51.375], [21570, 16.0], [21575, 27.875], [21578, 28.75], [21593, 39.75], [21596, 16.625], [21600, 19.5], [21605, 48.625], [21610, 25.0], [21633, 23.75], [21635, 18.375], [21643, 50.75], [21656, 21.375], [21667, 36.375], [21671, -17.875], [21683, -4.625], [21694, -17.125], [21705, 39.25], [21706, 12.625], [21710, 28.875], [21723, 24.125], [21733, 54.75], [21762, 16.25], [21797, -0.5], [21803, 29.625], [21827, 52.375], [21830, -11.125], [21836, 10.25], [21837, 26.5], [21846, 56.5], [21855, 66.5], [21856, 27.25], [21859, -29.8125], [21884, 23.0], [21894, 56.125], [21895, 36.375], [21910, 41.75], [21952, 26.5], [21960, 34.125], [21965, 5.5], [21973, 23.5], [21984, 37.75], [21988, 30.875], [21997, 37.125], [21999, 30.625]]}

wandb/run-20250501_161111-rkamupqo/files/output.log

@@ -0,0 +1,6 @@
+***** Running training *****
+Training 2/6 epoch (loss 1.0830):  20%|██        | 3338/16500 [32:59<2:05:08,  1.75it/s]  
+
+***** Evaluating at the beginning *****
+
+***** Evaluating at epoch 1/6 *****

wandb/run-20250501_161111-rkamupqo/files/requirements.txt

@@ -0,0 +1,153 @@
+safe-rlhf==0.0.1.dev0
+numexpr==2.10.1
+transformers==4.49.0
+aiohttp==3.11.10
+filelock==3.17.0
+mdurl==0.1.0
+matplotlib==3.10.0
+tensorboard_data_server==0.7.0
+cycler==0.11.0
+pytz==2024.1
+mkl_fft==1.3.11
+torch==2.5.1
+pillow==11.1.0
+accelerate==1.6.0
+jupyter_client==8.6.3
+mkl-service==2.4.0
+gmpy2==2.2.1
+pydantic==2.10.3
+protobuf==5.29.3
+kiwisolver==1.4.8
+ipykernel==6.29.5
+frozenlist==1.5.0
+pyzmq==26.2.0
+eval_type_backport==0.2.2
+xxhash==3.5.0
+ipython_pygments_lexers==1.1.1
+peft==0.15.1
+regex==2024.11.6
+datasets==3.5.0
+smmap==4.0.0
+sympy==1.13.1
+packaging==24.2
+tensorboard==2.19.0
+dill==0.3.8
+contourpy==1.3.1
+importlib_metadata==8.6.1
+pip==25.0
+httpx==0.28.1
+optree==0.14.1
+pexpect==4.9.0
+setproctitle==1.2.2
+scipy==1.15.2
+py-cpuinfo==9.0.0
+urllib3==2.3.0
+charset-normalizer==3.3.2
+wandb==0.19.9
+aiosignal==1.2.0
+jiter==0.9.0
+comm==0.2.2
+python-dateutil==2.9.0.post0
+nvitop==1.4.2
+httpcore==1.0.9
+triton==3.1.0
+mkl_random==1.2.8
+requests==2.32.3
+huggingface-hub==0.30.2
+deepspeed==0.16.5
+pyparsing==3.2.0
+h11==0.16.0
+safetensors==0.5.3
+pandas==2.2.3
+networkx==3.4.2
+wcwidth==0.2.13
+six==1.17.0
+propcache==0.3.1
+sentencepiece==0.2.0
+pure_eval==0.2.3
+PyYAML==6.0.2
+Brotli==1.0.9
+PySocks==1.7.1
+matplotlib-inline==0.1.7
+pyarrow==19.0.0
+fsspec==2024.12.0
+sniffio==1.3.1
+rich==13.9.4
+decorator==5.2.1
+ptyprocess==0.7.0
+sentry-sdk==2.18.0
+setuptools==75.8.0
+nest_asyncio==1.6.0
+exceptiongroup==1.2.2
+idna==3.7
+Jinja2==3.1.6
+tokenizers==0.21.0
+executing==2.1.0
+mpmath==1.3.0
+zipp==3.21.0
+grpcio==1.71.0
+MarkupSafe==3.0.2
+ninja==1.11.1.4
+attrs==24.3.0
+debugpy==1.8.14
+stack_data==0.6.3
+parso==0.8.4
+jupyter_core==5.7.2
+multiprocess==0.70.15
+hjson==3.1.0
+msgpack==1.1.0
+Pygments==2.15.1
+tornado==6.4.2
+tqdm==4.67.1
+Bottleneck==1.4.2
+prompt_toolkit==3.0.50
+numpy==2.0.1
+asttokens==3.0.0
+nvidia-ml-py==12.535.133
+fonttools==4.55.3
+pickleshare==0.7.5
+yarl==1.18.0
+einops==0.8.1
+psutil==5.9.0
+multidict==6.1.0
+docker-pycreds==0.4.0
+unicodedata2==15.1.0
+safe-rlhf==0.0.1.dev0
+aiohappyeyeballs==2.4.4
+tzdata==2023.3
+anyio==4.9.0
+Markdown==3.4.1
+certifi==2025.1.31
+click==8.1.8
+pydantic_core==2.27.1
+typing_extensions==4.12.2
+distro==1.9.0
+jedi==0.19.2
+appdirs==1.4.4
+gitdb==4.0.7
+Werkzeug==3.1.3
+wheel==0.45.1
+platformdirs==4.3.7
+absl-py==2.1.0
+ipython==9.1.0
+annotated-types==0.6.0
+traitlets==5.14.3
+openai==1.76.0
+GitPython==3.1.43
+markdown-it-py==2.2.0
+more-itertools==10.3.0
+packaging==24.2
+zipp==3.19.2
+jaraco.collections==5.1.0
+inflect==7.3.1
+autocommand==2.2.2
+jaraco.functools==4.0.1
+platformdirs==4.2.2
+tomli==2.0.1
+wheel==0.43.0
+jaraco.context==5.3.0
+typing_extensions==4.12.2
+importlib_metadata==8.0.0
+jaraco.text==3.12.1
+backports.tarfile==1.2.0
+typeguard==4.3.0

wandb/run-20250501_161111-rkamupqo/files/wandb-metadata.json

@@ -0,0 +1,106 @@
+{
+  "os": "Linux-5.15.0-134-generic-x86_64-with-glibc2.31",
+  "python": "CPython 3.11.11",
+  "startedAt": "2025-05-01T20:11:11.291018Z",
+  "args": [
+    "--local_rank=0",
+    "--train_datasets",
+    "SAFE-ALPACA/2000",
+    "--model_name_or_path",
+    "huggyllama/llama-7b",
+    "--cache_dir",
+    "/home/panda/pda-llm/cache/sft-2000",
+    "--safe_sft",
+    "false",
+    "--max_length",
+    "1024",
+    "--trust_remote_code",
+    "True",
+    "--epochs",
+    "6",
+    "--per_device_train_batch_size",
+    "4",
+    "--per_device_eval_batch_size",
+    "4",
+    "--gradient_accumulation_steps",
+    "32",
+    "--gradient_checkpointing",
+    "--learning_rate",
+    "1e-4",
+    "--lr_scheduler_type",
+    "cosine",
+    "--lr_warmup_ratio",
+    "0.03",
+    "--weight_decay",
+    "0.0",
+    "--seed",
+    "42",
+    "--output_dir",
+    "/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10",
+    "--log_type",
+    "wandb",
+    "--log_project",
+    "SAFE-SFT-v3",
+    "--zero_stage",
+    "0",
+    "--offload",
+    "none",
+    "--safety_ratio_tol",
+    "10",
+    "--resilient_coeff",
+    "1",
+    "--lora_r",
+    "4",
+    "--lora_alpha",
+    "16",
+    "--lora_dropout",
+    "0.05",
+    "--bf16",
+    "False",
+    "--fp16",
+    "True",
+    "--tf32",
+    "True"
+  ],
+  "program": "-m safe_rlhf.algorithms.safe_ft.__main__",
+  "git": {
+    "remote": "git@github.com:IgnacioBoero/pda-llm.git",
+    "commit": "7c9f4e02dcd0647951942cf40568db8fe194c59e"
+  },
+  "email": "iboero@upenn.edu",
+  "root": "/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10",
+  "host": "jason",
+  "executable": "/home/panda/miniconda3/envs/pda/bin/python",
+  "cpu_count": 24,
+  "cpu_count_logical": 48,
+  "gpu": "NVIDIA RTX A6000",
+  "gpu_count": 2,
+  "disk": {
+    "/": {
+      "total": "982820896768",
+      "used": "823037243392"
+    }
+  },
+  "memory": {
+    "total": "270090043392"
+  },
+  "cpu": {
+    "count": 24,
+    "countLogical": 48
+  },
+  "gpu_nvidia": [
+    {
+      "name": "NVIDIA RTX A6000",
+      "memoryTotal": "51527024640",
+      "cudaCores": 10752,
+      "architecture": "Ampere"
+    },
+    {
+      "name": "NVIDIA RTX A6000",
+      "memoryTotal": "51527024640",
+      "cudaCores": 10752,
+      "architecture": "Ampere"
+    }
+  ],
+  "cudaVersion": "12.4"
+}

wandb/run-20250501_161111-rkamupqo/logs/debug-core.log

@@ -0,0 +1,7 @@
+{"time":"2025-05-01T16:11:10.982168256-04:00","level":"INFO","msg":"main: starting server","port-filename":"/tmp/tmpqe2fa5ud/port-1742081.txt","pid":1742081,"log-level":0,"disable-analytics":false,"shutdown-on-parent-exit":false}
+{"time":"2025-05-01T16:11:10.988136884-04:00","level":"INFO","msg":"Will exit if parent process dies.","ppid":1742081}
+{"time":"2025-05-01T16:11:10.988101863-04:00","level":"INFO","msg":"server is running","addr":{"IP":"127.0.0.1","Port":46597,"Zone":""}}
+{"time":"2025-05-01T16:11:11.166422138-04:00","level":"INFO","msg":"connection: ManageConnectionData: new connection created","id":"127.0.0.1:41994"}
+{"time":"2025-05-01T16:11:11.293060716-04:00","level":"INFO","msg":"handleInformInit: received","streamId":"rkamupqo","id":"127.0.0.1:41994"}
+{"time":"2025-05-01T16:11:11.498258328-04:00","level":"INFO","msg":"handleInformInit: stream started","streamId":"rkamupqo","id":"127.0.0.1:41994"}
+{"time":"2025-05-01T16:44:11.180520187-04:00","level":"INFO","msg":"received shutdown signal","signal":15}

wandb/run-20250501_161111-rkamupqo/logs/debug-internal.log

@@ -0,0 +1,11 @@
+{"time":"2025-05-01T16:11:11.293320994-04:00","level":"INFO","msg":"stream: starting","core version":"0.19.9","symlink path":"/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10/wandb/run-20250501_161111-rkamupqo/logs/debug-core.log"}
+{"time":"2025-05-01T16:11:11.498192686-04:00","level":"INFO","msg":"created new stream","id":"rkamupqo"}
+{"time":"2025-05-01T16:11:11.498249738-04:00","level":"INFO","msg":"stream: started","id":"rkamupqo"}
+{"time":"2025-05-01T16:11:11.498278649-04:00","level":"INFO","msg":"handler: started","stream_id":"rkamupqo"}
+{"time":"2025-05-01T16:11:11.498278729-04:00","level":"INFO","msg":"writer: Do: started","stream_id":"rkamupqo"}
+{"time":"2025-05-01T16:11:11.498296759-04:00","level":"INFO","msg":"sender: started","stream_id":"rkamupqo"}
+{"time":"2025-05-01T16:11:11.63283254-04:00","level":"INFO","msg":"Starting system monitor"}
+{"time":"2025-05-01T16:11:11.632864401-04:00","level":"WARN","msg":"handleCodeSave: program relative path is empty"}
+{"time":"2025-05-01T16:11:11.632933553-04:00","level":"ERROR","msg":"git repo not found","error":"repository does not exist"}
+{"time":"2025-05-01T16:44:11.164974173-04:00","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2025-05-01T16:44:11.165099656-04:00","level":"INFO","msg":"Stopped system monitor"}

wandb/run-20250501_161111-rkamupqo/logs/debug.log

@@ -0,0 +1,26 @@
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_setup.py:_flush():67] Current SDK version is 0.19.9
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_setup.py:_flush():67] Configure stats pid to 1742081
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_setup.py:_flush():67] Loading settings from /home/panda/.config/wandb/settings
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_setup.py:_flush():67] Loading settings from /home/panda/pda-llm/scripts/wandb/settings
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_setup.py:_flush():67] Loading settings from environment variables
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_init.py:setup_run_log_directory():662] Logging user logs to /home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10/wandb/run-20250501_161111-rkamupqo/logs/debug.log
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_init.py:setup_run_log_directory():663] Logging internal logs to /home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10/wandb/run-20250501_161111-rkamupqo/logs/debug-internal.log
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_init.py:init():781] calling init triggers
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_init.py:init():786] wandb.init called with sweep_config: {}
+config: {'model_name_or_path': 'huggyllama/llama-7b', 'recompute_baseline': False, 'cache_dir': '/home/panda/pda-llm/cache/sft-2000', 'max_length': 1024, 'trust_remote_code': True, 'train_datasets': [('SAFE-ALPACA/2000', {'proportion': 1.0})], 'eval_datasets': None, 'safety_ratio_tol': 10.0, 'safe_sft': False, 'resilient_coeff': 1.0, 'epochs': 6, 'per_device_train_batch_size': 4, 'per_device_eval_batch_size': 4, 'gradient_accumulation_steps': 32, 'gradient_checkpointing': True, 'lr': 0.0001, 'lr_scheduler_type': <SchedulerType.COSINE: 'cosine'>, 'lr_warmup_ratio': 0.03, 'weight_decay': 0.0, 'seed': 42, 'fp16': True, 'bf16': False, 'tf32': True, 'lora_r': 4, 'lora_alpha': 16, 'lora_dropout': 0.05, 'eval_strategy': 'epoch', 'eval_interval': 1000000, 'need_eval': True, 'eval_split_ratio': None, 'output_dir': '/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10', 'log_type': 'wandb', 'log_dir': '/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10', 'log_project': 'SAFE-SFT-v3', 'log_run_name': 'safe-sft-2025-05-01-16-11-10', 'save_16bit': False, 'save_interval': 1000000, 'local_rank': 0, 'zero_stage': 0, 'offload': 'none', 'deepspeed': False, 'deepspeed_config': None, 'deepscale': False, 'deepscale_config': None, 'global_rank': 0, 'device': device(type='cuda', index=0), 'num_update_steps_per_epoch': 86, 'total_training_steps': 516, '_wandb': {}}
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_init.py:init():809] starting backend
+2025-05-01 16:11:11,288 INFO    MainThread:1742081 [wandb_init.py:init():813] sending inform_init request
+2025-05-01 16:11:11,290 INFO    MainThread:1742081 [backend.py:_multiprocessing_setup():101] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2025-05-01 16:11:11,290 INFO    MainThread:1742081 [wandb_init.py:init():823] backend started and connected
+2025-05-01 16:11:11,292 INFO    MainThread:1742081 [wandb_init.py:init():915] updated telemetry
+2025-05-01 16:11:11,298 INFO    MainThread:1742081 [wandb_init.py:init():939] communicating run to backend with 90.0 second timeout
+2025-05-01 16:11:11,630 INFO    MainThread:1742081 [wandb_init.py:init():1014] starting run threads in backend
+2025-05-01 16:11:11,702 INFO    MainThread:1742081 [wandb_run.py:_console_start():2454] atexit reg
+2025-05-01 16:11:11,702 INFO    MainThread:1742081 [wandb_run.py:_redirect():2306] redirect: wrap_raw
+2025-05-01 16:11:11,702 INFO    MainThread:1742081 [wandb_run.py:_redirect():2371] Wrapping output streams.
+2025-05-01 16:11:11,702 INFO    MainThread:1742081 [wandb_run.py:_redirect():2394] Redirects installed.
+2025-05-01 16:11:11,704 INFO    MainThread:1742081 [wandb_init.py:init():1056] run started, returning control to user process
+2025-05-01 16:44:11,163 INFO    MainThread:1742081 [wandb_run.py:_finish():2189] finishing run alelab/SAFE-SFT-v3/rkamupqo
+2025-05-01 16:44:11,163 INFO    MainThread:1742081 [wandb_run.py:_atexit_cleanup():2419] got exitcode: 0
+2025-05-01 16:44:11,164 INFO    MainThread:1742081 [wandb_run.py:_restore():2401] restore
+2025-05-01 16:44:11,164 INFO    MainThread:1742081 [wandb_run.py:_restore():2407] restore done

wandb/run-20250501_161111-rkamupqo/run-rkamupqo.wandb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:59002e56b4f12ca3a905fa9efa0f1de063a3e4a2365525925528cf41059aee35
+size 2785280

wandb/run-20250502_045804-vkih00cc/files/config.yaml

@@ -0,0 +1,134 @@
+_wandb:
+    value:
+        cli_version: 0.19.9
+        m: []
+        python_version: 3.11.11
+        t:
+            "1":
+                - 1
+                - 11
+                - 49
+                - 51
+                - 55
+                - 71
+                - 98
+            "2":
+                - 1
+                - 11
+                - 49
+                - 51
+                - 55
+                - 71
+                - 98
+            "3":
+                - 2
+                - 13
+                - 16
+                - 23
+                - 55
+                - 61
+            "4": 3.11.11
+            "5": 0.19.9
+            "6": 4.49.0
+            "8":
+                - 5
+            "12": 0.19.9
+            "13": linux-x86_64
+bf16:
+    value: false
+cache_dir:
+    value: /home/panda/pda-llm/cache/sft-2000
+deepscale:
+    value: false
+deepscale_config:
+    value: null
+deepspeed:
+    value: false
+deepspeed_config:
+    value: null
+device:
+    value: cuda:0
+epochs:
+    value: 6
+eval_datasets:
+    value: null
+eval_interval:
+    value: 1000000
+eval_split_ratio:
+    value: null
+eval_strategy:
+    value: epoch
+fp16:
+    value: true
+global_rank:
+    value: 0
+gradient_accumulation_steps:
+    value: 32
+gradient_checkpointing:
+    value: true
+local_rank:
+    value: 0
+log_dir:
+    value: /home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10
+log_project:
+    value: SAFE-SFT-v3
+log_run_name:
+    value: safe-sft-2025-05-02-04-58-03
+log_type:
+    value: wandb
+lora_alpha:
+    value: 16
+lora_dropout:
+    value: 0.05
+lora_r:
+    value: 4
+lr:
+    value: 0.0001
+lr_scheduler_type:
+    value: COSINE
+lr_warmup_ratio:
+    value: 0.03
+max_length:
+    value: 1024
+model_name_or_path:
+    value: huggyllama/llama-7b
+need_eval:
+    value: true
+num_update_steps_per_epoch:
+    value: 86
+offload:
+    value: none
+output_dir:
+    value: /home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10
+per_device_eval_batch_size:
+    value: 4
+per_device_train_batch_size:
+    value: 4
+recompute_baseline:
+    value: false
+resilient_coeff:
+    value: 1
+safe_sft:
+    value: false
+safety_ratio_tol:
+    value: 10
+save_16bit:
+    value: false
+save_interval:
+    value: 1000000
+seed:
+    value: 42
+tf32:
+    value: true
+total_training_steps:
+    value: 516
+train_datasets:
+    value:
+        - - SAFE-ALPACA/2000
+          - proportion: 1
+trust_remote_code:
+    value: true
+weight_decay:
+    value: 0
+zero_stage:
+    value: 0

wandb/run-20250502_045804-vkih00cc/files/media/table/eval/table_0_d4da849d7b84c3e060a1.table.json

@@ -0,0 +1 @@
+{"columns": ["data_index", "value"], "data": [[22, 0.0], [86, 0.0], [101, 0.0], [105, 0.0], [110, -0.125], [121, 0.0], [124, 0.0], [135, 0.0], [136, 0.0], [138, 0.0], [160, 0.0], [166, 0.25], [177, -0.125], [180, 0.0], [196, 0.0], [208, 0.125], [226, 0.0], [245, 0.0], [258, 0.125], [259, 0.0], [266, 0.0], [273, 0.0], [275, 0.0], [277, 0.0], [288, -0.125], [324, 0.0], [327, -0.125], [339, 0.0], [340, 0.125], [369, 0.0], [400, 0.0], [402, 0.0], [432, 0.0], [438, 0.0], [440, 0.0], [446, 0.0], [458, 0.0], [461, 0.0], [494, 0.0], [500, 0.0], [503, -0.125], [507, 0.0], [511, -0.25], [525, 0.0], [534, 0.25], [538, 0.0], [543, 0.0], [563, 0.25], [567, 0.125], [569, 0.0], [575, -0.25], [591, -0.125], [594, 0.125], [602, 0.0], [609, 0.0], [620, 0.0], [625, -0.125], [679, 0.0], [687, 0.0], [700, 0.0], [716, 0.125], [725, 0.0], [736, 0.0], [740, 0.0], [757, 0.0], [758, 0.0], [769, 0.0], [795, 0.0], [804, 0.0], [806, 0.0], [816, -0.125], [821, 0.0], [831, 0.0], [842, -0.125], [849, 0.0], [862, 0.0], [889, 0.125], [896, -0.125], [903, -0.125], [930, 0.0], [937, 0.0], [940, -0.25], [945, 0.0], [993, 0.0], [999, 0.0], [1014, 0.0], [1043, 0.0], [1045, 0.0], [1062, 0.125], [1064, -0.25], [1066, 0.25], [1069, -0.25], [1077, -0.125], [1082, 0.0], [1099, 0.0], [1100, 0.0], [1108, 0.0], [1122, 0.0], [1136, 0.0], [1143, -0.125], [1147, 0.0], [1151, 0.0], [1166, 0.0], [1172, 0.125], [1185, 0.0], [1186, 0.0], [1195, 0.125], [1196, 0.0], [1225, 0.0], [1232, 0.0], [1233, 0.0], [1239, 0.0], [1247, 0.0], [1280, 0.0], [1285, 0.0], [1286, 0.0], [1289, 0.0], [1304, 0.0], [1313, 0.0], [1324, 0.0], [1327, 0.0], [1329, 0.0], [1340, 0.0], [1350, -0.125], [1357, 0.125], [1392, 0.0], [1394, 0.0], [1415, 0.0], [1421, 0.0], [1435, -0.25], [1450, 0.0], [1488, 0.0], [1489, 0.0], [1509, 0.0], [1526, 0.0], [1530, 0.0], [1551, 0.0], [1557, 0.0], [1558, 0.0], [1565, 0.0], [1580, 0.0], [1583, 0.0], [1588, 0.0], [1660, 0.0], [1675, 0.0], [1684, 0.0], [1694, 0.25], [1696, -0.125], [1703, 0.0], [1705, 0.0], [1755, -0.125], [1762, 0.0], [1764, 0.0], [1788, 0.0], [1796, 0.0], [1811, 0.0], [1814, 0.0], [1830, 0.0], [1834, 0.0], [1836, 0.0], [1851, -0.125], [1852, -0.125], [1870, 0.0], [1871, 0.0], [1889, 0.0], [1898, -0.125], [1907, 0.0], [1914, 0.0], [1915, 0.0], [1916, 0.0], [1918, 0.0], [1925, 0.125], [1927, 0.0], [1928, -0.125], [1970, -0.125], [1995, 0.0], [2002, 0.0], [2016, -0.125], [2019, 0.0], [2020, 0.0], [2083, 0.0], [2120, -0.125], [2135, 0.0], [2146, 0.0], [2153, 0.25], [2195, -0.125], [2203, -0.125], [2226, 0.0], [2231, 0.0], [2253, 0.0], [2254, 0.0], [2269, 0.125], [2275, 0.0], [2290, 0.0], [2303, 0.0], [2311, 0.0], [2312, 0.0], [2347, 0.0], [2357, -0.125], [2368, 0.0], [2369, 0.125], [2376, 0.0], [2380, 0.125], [2414, 0.0], [2425, 0.125], [2454, 0.0], [2462, 0.0], [2481, 0.0], [2483, 0.0], [2485, -0.125], [2490, 0.0625], [2492, 0.0], [2499, 0.0], [2508, 0.0], [2523, 0.0], [2533, 0.0], [2544, 0.0], [2584, 0.0], [2591, -0.125], [2628, 0.0], [2630, 0.125], [2634, 0.0], [2662, 0.0], [2669, 0.0], [2686, 0.125], [2688, 0.125], [2711, 0.125], [2725, -0.125], [2731, -0.125], [2734, 0.0], [2738, 0.0], [2745, 0.0], [2769, 0.0], [2778, 0.125], [2786, 0.0], [2808, 0.0], [2818, -0.125], [2820, 0.0], [2822, 0.0], [2834, 0.0], [2843, 0.0], [2851, 0.0], [2866, 0.0], [2892, 0.0], [2922, -0.125], [2926, 0.0], [2935, 0.0], [2950, 0.0], [2960, 0.0], [2965, 0.0], [2970, 0.0], [2984, 0.25], [2988, 0.0], [2994, 0.0], [3006, 0.125], [3017, 0.0], [3020, 0.0], [3058, 0.0], [3061, 0.0], [3064, 0.0], [3073, 0.0], [3092, 0.0], [3108, 0.0], [3118, 0.0], [3138, 0.0], [3144, 0.0], [3149, 0.25], [3153, 0.125], [3154, 0.0], [3157, 0.0], [3165, 0.125], [3166, 0.0], [3171, -0.125], [3181, 0.0], [3196, 0.0], [3230, 0.0], [3233, 0.25], [3244, 0.0], [3265, 0.0], [3268, -0.125], [3283, 0.0], [3296, 0.125], [3298, 0.0], [3307, 0.0], [3321, 0.125], [3353, 0.0], [3362, 0.0], [3368, 0.0], [3375, 0.0], [3393, 0.125], [3395, 0.0], [3400, 0.25], [3401, 0.0], [3423, 0.0], [3429, -0.125], [3434, -0.125], [3447, 0.0], [3456, -0.125], [3479, 0.0], [3484, -0.25], [3574, -0.125], [3581, 0.0], [3587, -0.125], [3604, 0.0], [3629, 0.0], [3643, 0.125], [3648, 0.0], [3657, 0.0], [3662, -0.125], [3695, 0.0], [3697, 0.0], [3699, 0.0], [3703, 0.0], [3721, 0.0], [3732, 0.0], [3738, 0.0], [3746, 0.125], [3748, 0.0], [3750, 0.0], [3779, 0.0], [3786, 0.0], [3796, 0.0], [3805, 0.0], [3816, 0.0], [3845, -0.125], [3846, 0.0], [3864, 0.0], [3880, 0.0], [3892, 0.0], [3895, 0.0], [3902, 0.0], [3933, 0.0], [3938, 0.0], [3940, 0.0], [3954, 0.0], [3961, 0.0], [3974, 0.0], [3976, 0.0], [3980, 0.0], [3990, 0.0], [3997, 0.25], [3998, 0.25], [3999, 0.0], [4001, 0.0], [4005, 0.0], [4012, 0.0], [4014, -0.125], [4015, 0.0], [4023, -0.125], [4042, 0.0], [4047, 0.0], [4048, 0.125], [4091, 0.0], [4097, 0.0], [4106, 0.125], [4120, 0.0], [4125, -0.125], [4151, 0.0], [4161, 0.0], [4162, 0.0], [4163, 0.0], [4164, 0.125], [4185, 0.0], [4193, 0.0], [4195, 0.0], [4197, 0.0], [4198, 0.0], [4201, 0.0], [4206, 0.125], [4227, 0.0], [4240, 0.0], [4244, 0.0], [4246, 0.0], [4252, 0.0], [4267, 0.0], [4271, 0.0], [4275, 0.0], [4297, 0.125], [4307, 0.0], [4337, 0.0], [4352, 0.0], [4365, 0.0], [4380, 0.0], [4382, 0.0], [4399, 0.0], [4405, 0.125], [4415, 0.0], [4417, 0.0], [4436, 0.0], [4441, 0.0], [4453, 0.0], [4469, 0.125], [4474, 0.0], [4491, 0.0], [4500, 0.0], [4503, -0.125], [4517, 0.0], [4538, 0.0], [4588, 0.0], [4589, 0.0], [4602, 0.0], [4606, 0.0], [4631, 0.0], [4640, 0.0], [4649, 0.0], [4651, 0.0], [4665, 0.0], [4690, 0.0], [4703, 0.0], [4706, 0.125], [4724, 0.0], [4750, 0.0], [4752, -0.25], [4763, -0.125], [4773, 0.0], [4778, -0.125], [4789, 0.125], [4804, 0.0], [4809, 0.0], [4813, -0.125], [4822, 0.0], [4839, 0.0], [4841, -0.125], [4858, -0.125], [4878, 0.0], [4899, 0.0], [4916, 0.0], [4923, 0.0], [4929, -0.125], [4954, 0.125], [4955, -0.125], [4971, 0.0], [4985, 0.0], [4999, 0.0], [5000, -0.125], [5003, 0.0], [5006, 0.0], [5017, 0.0], [5021, 0.0], [5043, 0.0], [5055, 0.0], [5062, 0.0], [5064, 0.0], [5074, 0.0], [5075, -0.25], [5081, 0.0], [5101, 0.0], [5103, 0.125], [5119, -0.25], [5137, 0.0], [5138, 0.0], [5142, 0.0], [5151, 0.0], [5152, 0.0], [5164, 0.0], [5207, 0.0], [5209, 0.0], [5226, 0.0], [5229, 0.0], [5235, 0.0], [5246, 0.0625], [5256, 0.0], [5265, 0.0], [5274, 0.0], [5279, 0.0], [5284, -0.125], [5303, -0.125], [5311, 0.0], [5319, 0.0], [5320, 0.0], [5322, 0.0], [5325, 0.0], [5357, -0.125], [5374, -0.125], [5375, 0.0], [5380, -0.125], [5384, 0.0], [5389, 0.0], [5390, 0.0], [5394, 0.125], [5409, -0.125], [5410, 0.0], [5420, 0.0], [5421, 0.0], [5428, 0.0], [5431, 0.0], [5450, 0.125], [5465, -0.125], [5472, 0.0], [5484, 0.0], [5486, 0.0], [5487, 0.0], [5489, 0.125], [5524, 0.0], [5541, 0.0], [5542, 0.0], [5568, 0.0], [5586, 0.0], [5589, 0.0], [5594, 0.0], [5598, 0.125], [5615, 0.0], [5617, 0.25], [5653, 0.0], [5655, 0.0], [5676, 0.0], [5704, 0.125], [5709, 0.125], [5711, -0.125], [5751, 0.0], [5767, 0.0], [5777, 0.0], [5783, 0.0], [5786, 0.0], [5825, 0.0], [5831, 0.0], [5841, 0.125], [5851, -0.125], [5853, 0.0], [5859, 0.0], [5865, 0.0], [5930, 0.0], [5983, 0.0], [6001, 0.0], [6010, 0.25], [6016, 0.0], [6017, 0.0], [6019, 0.0], [6025, 0.25], [6028, 0.0], [6029, -0.125], [6035, 0.0], [6037, 0.125], [6077, 0.0], [6083, 0.0], [6094, 0.0], [6107, 0.0], [6126, 0.125], [6136, -0.25], [6152, 0.0], [6194, 0.0], [6202, 0.0], [6203, 0.0], [6210, 0.0], [6211, 0.0], [6219, 0.0], [6296, 0.0], [6305, 0.0], [6326, -0.25], [6337, -0.125], [6349, 0.0], [6360, 0.0], [6375, 0.0], [6378, 0.0], [6400, 0.0], [6412, 0.0], [6434, 0.0], [6469, 0.0], [6471, 0.0], [6480, 0.0], [6490, -0.125], [6508, 0.0], [6543, 0.0], [6547, 0.0], [6561, -0.25], [6576, 0.0], [6589, 0.0], [6600, 0.0], [6604, 0.0], [6613, 0.0], [6621, 0.0], [6625, 0.0], [6626, 0.0], [6636, -0.125], [6645, -0.125], [6684, 0.0], [6688, 0.0], [6689, 0.0], [6705, 0.0], [6720, 0.0], [6736, 0.0], [6749, 0.0], [6752, 0.0], [6760, 0.125], [6769, 0.0], [6771, -0.125], [6778, 0.0], [6786, 0.0], [6789, 0.0], [6803, -0.125], [6861, -0.25], [6866, 0.0], [6869, 0.125], [6872, -0.125], [6877, -0.125], [6884, -0.125], [6888, 0.0], [6889, 0.0], [6898, 0.0], [6993, 0.0], [7011, 0.125], [7013, -0.125], [7016, 0.0], [7027, -0.125], [7035, -0.125], [7045, -0.125], [7046, 0.0], [7049, 0.0], [7068, 0.0], [7072, 0.0], [7085, 0.0], [7090, 0.0], [7097, 0.125], [7101, 0.0], [7102, 0.0], [7109, 0.0], [7132, -0.125], [7139, -0.125], [7141, 0.0], [7144, 0.0], [7152, 0.0], [7167, 0.0], [7170, 0.0], [7185, 0.0], [7186, -0.125], [7202, 0.125], [7207, 0.0], [7211, 0.0], [7227, 0.0], [7236, 0.0], [7250, -0.125], [7257, 0.125], [7274, 0.0], [7278, 0.0], [7280, 0.0], [7281, 0.0], [7290, 0.0], [7298, -0.125], [7299, -0.25], [7302, -0.125], [7306, 0.125], [7318, 0.125], [7321, 0.125], [7330, 0.0], [7334, -0.125], [7336, 0.0], [7341, 0.0], [7344, 0.0], [7347, -0.125], [7361, 0.0], [7369, 0.0], [7397, 0.0], [7408, 0.0], [7427, -0.125], [7430, 0.0], [7439, 0.0], [7453, 0.0], [7473, 0.25], [7478, -0.125], [7488, 0.0], [7503, 0.0], [7518, 0.0], [7544, 0.0], [7552, 0.125], [7576, -0.125], [7577, 0.0], [7597, 0.0], [7605, 0.0], [7616, 0.0], [7620, 0.0], [7656, 0.0], [7659, 0.0], [7681, 0.0], [7692, 0.0], [7710, 0.0], [7713, 0.0], [7722, 0.0], [7723, 0.125], [7742, -0.125], [7743, 0.0], [7750, 0.0], [7790, 0.0], [7801, 0.0], [7811, 0.0], [7815, 0.0], [7843, 0.0], [7844, 0.0], [7857, 0.0], [7868, 0.0], [7877, 0.0], [7887, 0.0], [7897, 0.0], [7902, 0.0], [7910, 0.0], [7912, 0.0], [7918, 0.0], [7933, -0.125], [7936, 0.0], [7951, 0.0], [7953, 0.0], [7957, 0.0], [7962, -0.125], [7971, 0.0], [7974, 0.0], [7991, 0.0], [8000, 0.0], [8008, 0.0], [8018, 0.0], [8024, 0.0], [8047, 0.0], [8060, -0.25], [8077, 0.0], [8086, 0.0], [8104, 0.0], [8118, 0.125], [8133, 0.0], [8138, 0.0], [8145, 0.0], [8150, 0.0], [8168, 0.0], [8170, 0.0], [8173, 0.0], [8175, 0.0], [8194, 0.0], [8211, 0.0], [8253, 0.0], [8262, 0.0], [8263, 0.0], [8265, 0.0], [8268, 0.0], [8271, 0.0], [8272, 0.0], [8273, 0.0], [8277, 0.0], [8292, 0.0], [8344, 0.125], [8346, 0.0], [8350, 0.0], [8364, 0.0], [8369, 0.0], [8370, -0.125], [8385, 0.0], [8389, 0.0], [8421, 0.0], [8442, 0.0], [8453, 0.0], [8458, 0.125], [8466, 0.0], [8478, 0.0], [8483, 0.0], [8487, 0.0], [8501, -0.125], [8505, -0.125], [8509, 0.125], [8534, 0.0], [8539, 0.125], [8556, 0.125], [8566, -0.125], [8577, -0.125], [8583, 0.0], [8600, 0.0], [8615, 0.0], [8624, 0.0], [8630, 0.0], [8645, 0.0], [8658, 0.125], [8660, 0.0], [8667, -0.125], [8672, 0.0], [8676, -0.125], [8687, 0.0], [8689, 0.0], [8692, 0.0], [8697, -0.125], [8699, 0.0], [8707, 0.0], [8722, 0.0], [8726, 0.0], [8727, 0.0], [8736, 0.0], [8737, -0.125], [8752, -0.125], [8760, 0.125], [8776, 0.0], [8793, 0.125], [8794, 0.0], [8797, 0.0], [8806, 0.0], [8812, 0.0], [8820, 0.0], [8830, 0.0], [8852, 0.0], [8877, -0.125], [8885, 0.0], [8891, 0.0], [8929, 0.0], [8936, 0.0], [8938, 0.0], [8954, -0.125], [8967, 0.0], [8975, 0.125], [8985, 0.0], [8989, 0.125], [8999, 0.0], [9002, 0.0], [9014, -0.25], [9025, 0.0], [9034, 0.0], [9052, 0.0], [9059, 0.0], [9063, 0.0], [9084, 0.0], [9086, -0.125], [9088, 0.0], [9123, 0.0], [9130, 0.0], [9144, 0.0], [9167, 0.0], [9182, 0.0], [9184, 0.0], [9198, 0.0], [9218, 0.0], [9231, 0.0], [9237, 0.0], [9239, 0.0], [9244, 0.0], [9256, 0.0], [9257, -0.125], [9261, 0.0], [9267, 0.0], [9269, 0.0], [9297, 0.0], [9300, -0.125], [9305, 0.0], [9327, 0.0], [9337, 0.0], [9340, 0.125], [9341, -0.125], [9355, 0.0], [9360, 0.125], [9366, 0.0], [9369, 0.0], [9377, 0.125], [9380, 0.0], [9381, -0.25], [9385, 0.0], [9403, 0.0], [9406, 0.0], [9409, 0.0], [9419, 0.125], [9420, 0.125], [9423, 0.0], [9447, 0.0], [9450, 0.0], [9467, 0.0], [9475, 0.0], [9485, 0.0], [9502, 0.0], [9504, 0.0], [9518, 0.0], [9523, 0.0], [9536, 0.0], [9559, 0.0], [9563, -0.125], [9576, 0.0], [9594, 0.0], [9611, 0.0], [9613, 0.0], [9621, 0.0], [9633, 0.0], [9655, 0.0], [9658, -0.125], [9667, 0.0], [9672, 0.0], [9681, 0.0], [9684, 0.0], [9687, -0.125], [9688, 0.0], [9693, 0.125], [9698, -0.125], [9702, -0.125], [9713, 0.0], [9716, 0.0], [9721, 0.0], [9726, 0.0], [9736, 0.0], [9762, 0.125], [9772, 0.0], [9776, 0.0], [9781, -0.125], [9783, -0.25], [9809, 0.0], [9833, 0.0], [9837, -0.125], [9853, 0.0], [9856, 0.125], [9857, -0.125], [9863, 0.0], [9872, 0.125], [9894, 0.0], [9899, 0.0], [9919, 0.0], [9936, 0.0], [9947, 0.0], [9949, 0.0], [9952, 0.0], [9958, 0.0], [9979, 0.0], [9998, 0.0], [10005, 0.0], [10015, 0.0], [10053, 0.0], [10096, 0.0], [10108, 0.0], [10114, 0.0], [10122, 0.0], [10126, 0.0], [10145, 0.0], [10159, 0.0], [10166, 0.0], [10181, 0.0], [10184, 0.0], [10190, 0.0], [10197, 0.0], [10217, 0.125], [10218, -0.25], [10219, -0.125], [10224, 0.0], [10234, -0.125], [10244, 0.0], [10258, 0.0], [10330, 0.0], [10340, 0.125], [10352, 0.0], [10367, 0.0], [10372, 0.0], [10376, -0.125], [10377, 0.0], [10390, 0.0], [10419, -0.125], [10422, -0.125], [10434, 0.125], [10439, 0.0], [10445, -0.125], [10448, 0.25], [10471, -0.125], [10493, 0.0], [10500, 0.0], [10517, 0.0], [10527, 0.0], [10561, 0.0], [10569, 0.0], [10576, 0.0], [10577, 0.0], [10598, 0.0], [10609, 0.0], [10635, 0.0], [10637, -0.125], [10640, -0.125], [10654, 0.0], [10660, 0.0], [10662, 0.0], [10664, -0.125], [10667, -0.25], [10668, 0.0], [10672, 0.0], [10679, 0.0], [10687, 0.0], [10690, -0.125], [10692, 0.0], [10693, 0.25], [10699, 0.0], [10710, 0.0], [10715, 0.0], [10719, 0.0], [10730, 0.0], [10735, 0.0], [10742, 0.0], [10746, 0.0], [10750, 0.0], [10753, 0.0], [10754, 0.0], [10758, 0.0], [10766, -0.125], [10768, -0.125], [10773, 0.0], [10780, 0.0], [10785, 0.0], [10789, 0.125], [10798, -0.125], [10817, 0.0], [10821, 0.0], [10822, 0.0], [10862, 0.0], [10863, 0.125], [10866, -0.125], [10889, 0.0], [10924, 0.0], [10944, 0.0], [10955, 0.0], [10966, 0.0], [10969, 0.0], [10978, 0.0], [10979, -0.25], [10987, 0.125], [10999, 0.0], [11025, 0.0], [11026, 0.25], [11031, -0.125], [11034, 0.0], [11048, 0.0], [11050, -0.125], [11053, 0.0], [11055, 0.0], [11056, 0.0], [11057, -0.125], [11067, 0.0], [11069, 0.0], [11072, 0.0], [11074, 0.0], [11085, 0.25], [11111, 0.0], [11112, 0.0], [11123, -0.125], [11149, -0.125], [11185, -0.125], [11221, 0.0], [11250, -0.125], [11266, 0.0], [11279, 0.0], [11280, 0.0], [11312, 0.0], [11320, 0.0], [11327, 0.0], [11331, -0.125], [11351, 0.0], [11359, 0.0], [11360, 0.0], [11362, 0.0], [11386, 0.0], [11391, 0.0], [11393, 0.0], [11428, -0.125], [11436, 0.0], [11446, 0.0], [11460, 0.0], [11462, -0.125], [11465, 0.0], [11478, 0.0], [11495, 0.0], [11497, 0.0], [11500, 0.125], [11522, 0.0], [11523, 0.0], [11526, 0.0], [11533, 0.0], [11539, 0.125], [11540, -0.25], [11543, 0.0], [11548, 0.0], [11570, 0.0], [11572, 0.0], [11584, 0.0], [11597, 0.0], [11605, -0.125], [11622, 0.0], [11637, 0.0], [11650, 0.0], [11657, 0.0], [11665, -0.25], [11668, 0.0], [11686, -0.125], [11720, 0.0], [11721, -0.125], [11741, 0.0], [11755, 0.0], [11756, 0.0], [11764, 0.0], [11819, 0.0], [11828, -0.125], [11842, 0.0], [11861, 0.0], [11871, 0.0], [11880, 0.0], [11903, 0.0], [11905, 0.0], [11939, 0.0], [11940, 0.0], [11941, 0.0], [11963, 0.0], [11964, -0.25], [11970, 0.0], [11983, 0.0], [11992, 0.0], [12020, -0.25], [12042, 0.0], [12051, -0.125], [12069, -0.125], [12075, 0.0], [12102, 0.0], [12106, 0.125], [12150, -0.125], [12158, 0.0], [12161, 0.0], [12164, -0.125], [12165, 0.0], [12172, 0.0], [12181, 0.0], [12192, 0.0], [12193, 0.0], [12205, 0.0], [12207, -0.125], [12214, 0.0], [12219, 0.125], [12224, 0.0], [12225, 0.0], [12229, 0.0], [12237, 0.125], [12238, 0.125], [12253, -0.125], [12257, 0.0], [12259, 0.0], [12262, 0.0], [12266, 0.0], [12300, 0.125], [12309, 0.0], [12344, -0.125], [12351, 0.125], [12352, -0.125], [12354, 0.0], [12357, 0.0], [12359, -0.125], [12361, 0.0], [12362, 0.0], [12370, 0.0625], [12384, 0.0], [12397, 0.0], [12411, 0.0], [12428, 0.0], [12436, 0.0], [12455, 0.0], [12467, 0.0], [12481, 0.0], [12482, 0.0], [12499, 0.0], [12505, 0.0], [12527, 0.0], [12546, -0.125], [12559, 0.0], [12578, -0.25], [12583, 0.25], [12584, 0.125], [12601, -0.125], [12609, 0.0], [12610, 0.0], [12614, 0.0], [12620, 0.0], [12626, 0.0], [12647, -0.125], [12669, 0.0], [12676, -0.125], [12700, -0.125], [12703, -0.125], [12706, 0.0], [12711, 0.0], [12716, 0.0], [12739, 0.0], [12766, -0.125], [12779, 0.0], [12812, 0.0], [12820, 0.0], [12823, 0.0], [12826, 0.0], [12857, 0.125], [12866, 0.0], [12893, 0.0], [12907, 0.0], [12940, 0.0], [12944, 0.0], [12946, 0.0], [12954, 0.0], [12958, 0.0], [12960, 0.0], [12972, 0.0], [13005, 0.0], [13008, 0.0], [13019, -0.125], [13022, 0.0], [13041, 0.0], [13044, 0.0], [13048, 0.0], [13060, 0.0], [13066, 0.0], [13069, 0.0], [13081, 0.125], [13086, 0.0], [13091, 0.0], [13098, 0.0], [13100, 0.0], [13104, 0.0], [13112, 0.0], [13127, 0.0], [13136, 0.0], [13154, 0.0], [13162, 0.0], [13195, 0.0], [13214, 0.0], [13225, 0.0], [13233, 0.25], [13244, 0.0], [13253, 0.0], [13259, 0.0], [13268, -0.125], [13270, 0.0], [13273, 0.0], [13290, 0.0], [13300, 0.0], [13305, 0.0], [13312, 0.0], [13353, -0.25], [13357, -0.125], [13359, 0.0], [13386, 0.0], [13390, 0.0], [13425, 0.0], [13426, -0.125], [13437, 0.0], [13449, 0.0], [13455, 0.0], [13468, 0.0], [13471, 0.0], [13494, 0.0], [13495, 0.0], [13496, 0.0], [13515, 0.125], [13517, 0.0], [13526, 0.0], [13546, 0.0625], [13567, 0.0], [13575, 0.0], [13583, 0.0], [13586, -0.125], [13594, 0.0], [13596, -0.125], [13598, 0.0], [13613, 0.0], [13616, 0.25], [13633, 0.0], [13639, -0.125], [13654, 0.0], [13671, 0.0], [13693, 0.0], [13697, 0.0], [13706, 0.0], [13723, 0.0], [13730, 0.0], [13735, 0.125], [13751, -0.125], [13765, 0.125], [13775, -0.125], [13789, 0.0], [13790, 0.0], [13792, -0.25], [13814, 0.0], [13821, 0.0], [13823, 0.0], [13838, 0.0], [13843, 0.0], [13866, 0.0], [13868, 0.0], [13870, 0.0], [13874, 0.0], [13887, 0.0], [13891, 0.0], [13895, 0.0], [13901, -0.125], [13931, 0.0], [13950, 0.0], [13952, 0.0], [13957, -0.125], [13964, 0.0], [13968, 0.0], [13970, 0.0], [13974, 0.0], [13976, 0.125], [13978, -0.125], [14000, -0.125], [14004, -0.125], [14005, 0.0], [14006, 0.0], [14017, 0.0], [14030, 0.0], [14037, 0.0], [14054, 0.0], [14068, -0.125], [14080, 0.0], [14083, -0.125], [14084, 0.0], [14092, 0.0], [14103, 0.0], [14109, 0.0], [14132, 0.0], [14157, 0.0], [14165, 0.0], [14172, 0.0], [14180, 0.0], [14203, 0.0], [14207, 0.0], [14210, 0.0], [14248, 0.0], [14260, 0.0], [14273, 0.125], [14279, 0.0], [14282, 0.0], [14283, 0.0], [14285, 0.0], [14291, 0.0], [14294, 0.0], [14304, 0.25], [14312, 0.0], [14319, -0.125], [14326, 0.0], [14358, -0.125], [14373, -0.125], [14380, 0.0], [14385, 0.0], [14417, 0.125], [14421, 0.0], [14424, 0.0], [14429, -0.125], [14433, 0.0], [14441, 0.0], [14456, 0.0], [14458, 0.0], [14475, 0.0], [14524, 0.0], [14531, 0.0], [14532, -0.125], [14551, 0.0], [14556, 0.0], [14566, 0.0], [14567, 0.0], [14574, -0.25], [14576, 0.0], [14597, 0.0], [14603, 0.0], [14622, 0.0], [14664, -0.25], [14665, 0.0], [14668, -0.125], [14670, 0.0], [14671, 0.0], [14676, 0.0], [14682, 0.0], [14686, 0.0], [14688, 0.125], [14694, 0.0], [14701, 0.0], [14717, 0.0], [14743, 0.125], [14744, 0.0], [14750, 0.0], [14764, 0.125], [14770, 0.125], [14779, 0.0], [14784, 0.0], [14787, -0.125], [14803, 0.0], [14805, 0.125], [14808, 0.0], [14821, 0.0], [14823, 0.0], [14825, 0.0], [14831, 0.0], [14833, 0.0], [14851, 0.0], [14866, 0.0], [14899, 0.125], [14901, 0.0], [14911, 0.125], [14914, -0.125], [14921, 0.0], [14944, 0.0], [14947, 0.0], [14949, -0.25], [14951, 0.25], [14953, 0.0], [14959, -0.25], [14962, 0.0], [14970, 0.0], [14974, 0.0], [14997, 0.0], [15000, 0.0], [15001, 0.0], [15003, 0.0], [15006, 0.125], [15019, 0.0], [15024, 0.0], [15028, 0.0], [15032, -0.125], [15045, 0.0], [15054, 0.0], [15069, 0.0], [15070, 0.0], [15095, 0.125], [15118, 0.0], [15133, 0.0], [15142, 0.0], [15143, 0.0], [15164, 0.0], [15172, 0.5], [15182, 0.0], [15185, -0.125], [15197, 0.125], [15204, 0.0], [15214, 0.0], [15236, 0.0], [15242, 0.0], [15247, 0.0], [15251, 0.0], [15257, 0.0], [15316, 0.0], [15334, 0.0], [15336, 0.0], [15344, 0.0], [15366, 0.0], [15373, 0.0], [15380, 0.0], [15382, 0.0], [15412, 0.0], [15416, 0.0], [15434, 0.0], [15436, 0.0], [15441, -0.125], [15444, 0.0], [15457, 0.0], [15465, 0.0], [15475, 0.0], [15496, 0.125], [15500, 0.0], [15522, -0.125], [15529, 0.0], [15531, 0.0], [15562, 0.0], [15565, 0.0], [15569, 0.0], [15576, 0.0], [15594, -0.125], [15597, 0.0], [15614, 0.25], [15627, 0.0], [15640, 0.125], [15664, 0.0], [15667, 0.0], [15679, 0.0], [15680, -0.125], [15698, 0.0], [15730, 0.0], [15731, 0.125], [15745, 0.0], [15759, 0.0], [15766, 0.0], [15791, 0.0], [15801, 0.0], [15808, 0.0], [15822, 0.0], [15834, -0.25], [15838, -0.125], [15844, 0.0], [15850, 0.0], [15862, 0.0], [15872, -0.125], [15887, -0.25], [15931, 0.0], [15942, 0.125], [15945, 0.125], [15955, 0.0], [16000, 0.0], [16042, 0.0], [16043, 0.0], [16060, -0.125], [16063, 0.0], [16073, 0.0], [16076, 0.0], [16078, 0.0], [16140, 0.0], [16164, 0.0], [16165, 0.0], [16169, 0.0], [16210, 0.0], [16225, -0.125], [16262, 0.0], [16269, 0.0], [16277, 0.0], [16282, 0.0], [16295, 0.0], [16312, 0.125], [16316, 0.125], [16328, 0.0], [16346, 0.0], [16389, 0.0], [16434, 0.0], [16472, -0.25], [16474, 0.0], [16489, 0.0], [16502, -0.25], [16531, 0.0], [16532, 0.0], [16539, 0.0], [16541, 0.0], [16571, 0.0], [16572, 0.0], [16580, 0.0], [16582, 0.0], [16598, 0.0], [16605, -0.125], [16606, 0.0], [16619, 0.0], [16643, 0.0], [16657, 0.0], [16659, 0.0], [16671, 0.0], [16737, 0.0], [16743, 0.0], [16759, 0.0], [16765, -0.125], [16768, -0.25], [16769, 0.0], [16773, -0.125], [16777, 0.125], [16790, 0.0], [16804, 0.0], [16831, -0.125], [16851, 0.0], [16854, 0.0], [16868, 0.125], [16882, 0.0], [16891, 0.0], [16919, -0.125], [16937, 0.0], [16938, -0.125], [16941, 0.0], [16965, 0.0], [16977, 0.0], [16982, 0.0], [16987, -0.125], [17002, 0.0], [17018, 0.0], [17020, 0.0], [17030, 0.0], [17044, -0.125], [17049, 0.0], [17077, 0.0], [17101, 0.0], [17115, 0.0], [17135, 0.125], [17154, 0.0], [17160, 0.0], [17171, 0.0], [17172, -0.125], [17193, 0.0], [17216, 0.0], [17229, 0.0], [17251, 0.0], [17278, 0.0], [17279, 0.125], [17322, -0.25], [17325, 0.0], [17346, 0.25], [17364, 0.0], [17392, 0.25], [17394, 0.0], [17395, 0.0], [17397, -0.125], [17403, 0.0], [17405, 0.0], [17408, 0.0], [17420, -0.125], [17431, 0.0], [17443, 0.0], [17447, 0.0], [17463, 0.0], [17482, 0.125], [17509, 0.125], [17527, 0.0], [17536, 0.0], [17540, 0.0], [17551, 0.0], [17552, 0.0], [17553, 0.125], [17554, 0.0], [17563, 0.0], [17564, 0.125], [17574, 0.0], [17577, 0.0], [17589, -0.125], [17610, 0.0], [17618, 0.125], [17637, 0.0], [17650, 0.0], [17661, 0.0], [17664, -0.125], [17668, 0.0], [17687, -0.25], [17723, 0.0], [17745, 0.0], [17755, 0.0], [17756, 0.25], [17757, 0.0], [17766, 0.0], [17777, -0.125], [17780, 0.125], [17794, 0.0], [17795, 0.0], [17805, 0.0], [17824, 0.0], [17854, 0.25], [17860, 0.0], [17870, 0.0], [17874, 0.0], [17893, 0.125], [17899, 0.0], [17912, 0.0], [17922, 0.0], [17929, -0.125], [17933, 0.0], [17938, 0.0], [17963, 0.0], [17974, 0.0], [18006, 0.0], [18019, 0.0], [18030, 0.0], [18033, 0.0], [18040, 0.0], [18073, 0.0], [18086, 0.0], [18102, 0.0], [18129, 0.0], [18130, 0.125], [18132, 0.0], [18138, -0.25], [18164, 0.0], [18206, -0.125], [18218, -0.125], [18225, 0.125], [18242, 0.0], [18266, 0.0], [18275, 0.0], [18283, 0.0], [18285, 0.0], [18299, 0.0], [18318, -0.125], [18322, -0.125], [18335, 0.0], [18346, 0.0], [18352, 0.125], [18355, 0.0], [18358, -0.125], [18359, -0.125], [18380, 0.0], [18395, 0.0], [18400, 0.0], [18406, 0.0], [18418, 0.0], [18419, 0.0], [18424, 0.25], [18432, 0.0], [18433, -0.125], [18434, 0.0], [18442, 0.0], [18470, -0.125], [18472, 0.0], [18493, 0.0], [18499, 0.0], [18500, 0.0], [18502, 0.0], [18518, 0.0], [18524, 0.0], [18532, 0.0], [18564, 0.0], [18565, 0.125], [18568, -0.25], [18578, 0.125], [18588, 0.0], [18589, 0.0], [18603, 0.0], [18628, 0.125], [18641, 0.0], [18642, 0.0], [18651, 0.0], [18662, 0.0], [18663, 0.125], [18685, 0.0], [18718, 0.0], [18731, 0.0], [18735, -0.125], [18741, 0.0], [18759, 0.0], [18760, 0.125], [18780, 0.0], [18791, 0.0], [18815, 0.0], [18816, 0.0], [18840, 0.0], [18854, -0.125], [18867, -0.125], [18873, 0.0], [18884, 0.0], [18885, -0.125], [18890, -0.125], [18900, 0.0], [18907, 0.125], [18911, -0.125], [18914, 0.0], [18918, 0.0], [18924, 0.125], [18927, 0.0], [18934, 0.0], [18939, 0.0], [18940, 0.0], [18945, 0.0], [18947, 0.0], [18958, 0.0], [18972, 0.0], [18977, 0.0], [18987, 0.0], [19008, -0.125], [19009, 0.0], [19044, 0.0], [19051, 0.0], [19054, 0.0], [19070, 0.0], [19071, 0.0], [19072, 0.0], [19074, 0.125], [19078, 0.125], [19082, 0.0], [19090, 0.0], [19097, -0.25], [19110, 0.0], [19123, 0.0], [19139, 0.0], [19147, 0.0], [19160, 0.0], [19200, 0.0], [19216, 0.0], [19222, 0.0], [19262, 0.0], [19264, 0.0], [19273, 0.0], [19287, -0.125], [19290, 0.0], [19316, 0.0], [19342, 0.0], [19347, -0.125], [19363, 0.0], [19364, 0.0], [19378, 0.0], [19385, 0.0], [19386, 0.0], [19394, 0.0], [19396, 0.0], [19400, 0.0], [19401, -0.25], [19407, 0.0], [19416, 0.0], [19417, 0.0], [19422, 0.0], [19434, 0.125], [19437, 0.0], [19454, -0.125], [19459, 0.0], [19460, -0.125], [19476, 0.0], [19494, 0.0], [19497, 0.0], [19499, 0.125], [19500, 0.0], [19519, 0.0], [19536, 0.25], [19547, 0.0], [19552, 0.0], [19553, 0.0], [19554, 0.0], [19562, 0.0], [19592, 0.0], [19607, 0.0], [19612, 0.125], [19617, -0.125], [19645, 0.0], [19657, 0.0], [19671, 0.0], [19677, -0.125], [19682, 0.0], [19683, 0.0], [19696, 0.0], [19699, -0.125], [19710, -0.25], [19712, -0.125], [19718, 0.0], [19726, 0.0], [19727, 0.25], [19731, 0.0], [19740, 0.0], [19746, 0.0], [19753, 0.0], [19781, 0.0], [19806, 0.0], [19810, 0.0], [19811, 0.0], [19839, 0.0], [19852, 0.0], [19866, 0.0], [19872, -0.125], [19921, 0.0], [19928, 0.0], [19953, 0.0], [19966, 0.0], [19985, 0.0], [19988, 0.0], [19995, 0.0], [20003, 0.0], [20018, 0.0], [20035, 0.0], [20057, -0.125], [20066, 0.0], [20078, 0.0], [20082, 0.0], [20089, 0.0], [20110, 0.0], [20116, 0.0], [20131, 0.0], [20150, 0.0], [20152, 0.0], [20157, 0.0], [20160, 0.0], [20174, 0.0], [20187, -0.25], [20211, -0.125], [20222, 0.0], [20236, 0.0], [20237, 0.0], [20253, -0.25], [20258, 0.0], [20274, -0.125], [20297, 0.0], [20301, 0.0], [20306, 0.0], [20307, 0.0], [20316, 0.0], [20325, 0.0], [20350, 0.0], [20361, 0.0], [20369, -0.125], [20371, 0.125], [20382, 0.0], [20385, 0.0], [20386, -0.125], [20393, 0.0], [20402, 0.0], [20420, 0.0], [20442, 0.0], [20466, 0.0], [20468, 0.0], [20471, 0.0], [20487, 0.0], [20488, -0.125], [20490, 0.0], [20503, 0.0], [20506, 0.0], [20508, -0.125], [20520, 0.0], [20533, -0.125], [20537, 0.0], [20558, 0.0], [20568, 0.0], [20571, 0.0], [20576, 0.0], [20601, 0.0], [20603, 0.0], [20609, -0.125], [20644, 0.0], [20646, 0.0], [20652, 0.0], [20678, 0.0], [20723, 0.0], [20724, 0.0], [20728, 0.0], [20742, 0.0], [20744, 0.125], [20752, 0.0], [20764, 0.0], [20769, 0.0], [20778, 0.125], [20788, 0.0], [20789, 0.0], [20796, 0.0], [20797, 0.0], [20815, 0.0], [20853, 0.0], [20875, -0.125], [20884, 0.0], [20897, 0.0], [20932, 0.0], [20958, 0.125], [20969, 0.0], [20970, 0.0], [21017, 0.25], [21018, 0.0], [21026, 0.0], [21054, 0.0], [21062, 0.0], [21064, 0.125], [21073, 0.0], [21074, 0.0], [21125, 0.0], [21138, 0.0], [21145, 0.0], [21147, 0.0], [21170, 0.0], [21183, 0.0], [21184, 0.0], [21185, 0.0], [21206, -0.25], [21207, 0.0], [21210, 0.0], [21220, 0.125], [21229, 0.0], [21240, 0.0], [21245, 0.0], [21246, 0.0], [21248, -0.125], [21271, 0.0], [21276, 0.0], [21293, 0.0], [21294, 0.0], [21309, 0.0], [21331, 0.0], [21332, 0.0], [21333, 0.0], [21337, 0.125], [21341, 0.0], [21342, 0.0], [21344, 0.0], [21347, 0.0], [21361, 0.25], [21370, -0.25], [21418, 0.0], [21431, 0.0], [21446, 0.0], [21452, 0.0], [21507, 0.0], [21549, -0.125], [21557, 0.0], [21562, 0.0], [21565, 0.0], [21570, 0.0], [21575, 0.0], [21578, 0.0], [21593, 0.0], [21596, 0.0], [21600, 0.25], [21605, 0.0], [21610, 0.0], [21633, 0.0], [21635, 0.0], [21643, 0.0], [21656, -0.125], [21667, 0.0], [21671, 0.0], [21683, -0.125], [21694, 0.0], [21705, 0.25], [21706, 0.0], [21710, 0.0], [21723, 0.0], [21733, -0.125], [21762, 0.125], [21797, 0.0], [21803, -0.125], [21827, 0.0], [21830, 0.0], [21836, 0.0], [21837, 0.0], [21846, -0.125], [21855, 0.0], [21856, 0.0], [21859, -0.0625], [21884, -0.125], [21894, 0.0], [21895, 0.0], [21910, 0.0], [21952, 0.0], [21960, 0.0], [21965, 0.0], [21973, 0.0], [21984, -0.125], [21988, 0.0], [21997, 0.0], [21999, 0.0]]}

wandb/run-20250502_045804-vkih00cc/files/media/table/eval/table_11000_b6d19b07e47e333fcd27.table.json

@@ -0,0 +1 @@
+{"columns": ["data_index", "value"], "data": [[22, 79.75], [86, 27.625], [101, 30.625], [105, 17.625], [110, -0.375], [121, 38.25], [124, 62.875], [135, 42.125], [136, 37.25], [138, 39.625], [160, 69.625], [166, 32.0], [177, 53.75], [180, 35.625], [196, 21.375], [208, 46.625], [226, 20.875], [245, 8.0], [258, 14.75], [259, 82.375], [266, 46.0], [273, 22.5], [275, 37.875], [277, 44.0], [288, 29.5], [324, 39.5], [327, 42.25], [339, 29.25], [340, 24.375], [369, 8.0], [400, 55.0], [402, 18.0], [432, 45.625], [438, 27.25], [440, 40.875], [446, 78.75], [458, 35.0], [461, 28.75], [494, 33.375], [500, 45.0], [503, 52.0], [507, 23.25], [511, 64.75], [525, 48.5], [534, 43.375], [538, 3.875], [543, 31.75], [563, 65.625], [567, 27.25], [569, 46.0], [575, 47.25], [591, 12.875], [594, 33.125], [602, 52.875], [609, 8.75], [620, -2.375], [625, 24.125], [679, 63.5], [687, 74.0], [700, 50.125], [716, 24.75], [725, 18.75], [736, 39.125], [740, 52.125], [757, 72.875], [758, 18.875], [769, 47.25], [795, 56.25], [804, 7.875], [806, -4.0], [816, 72.375], [821, 46.625], [831, 10.875], [842, 23.125], [849, 46.5], [862, 21.75], [889, 42.625], [896, 40.125], [903, 27.75], [930, 11.375], [937, 18.25], [940, 47.75], [945, 47.0], [993, 28.75], [999, -27.0], [1014, 37.0], [1043, 17.125], [1045, 51.25], [1062, 34.75], [1064, 45.125], [1066, 85.75], [1069, 32.0], [1077, 53.5], [1082, 44.25], [1099, 8.0], [1100, 10.75], [1108, 43.625], [1122, 30.625], [1136, 20.5], [1143, 39.625], [1147, 34.75], [1151, 65.0], [1166, 64.75], [1172, 25.75], [1185, 13.625], [1186, 52.125], [1195, 39.75], [1196, 10.125], [1225, 79.375], [1232, 33.75], [1233, 42.875], [1239, 45.75], [1247, 32.625], [1280, 55.375], [1285, 29.0], [1286, 62.375], [1289, 36.5], [1304, 53.75], [1313, 40.375], [1324, 67.5], [1327, 20.625], [1329, 28.75], [1340, 50.25], [1350, 18.25], [1357, 25.125], [1392, 27.5], [1394, 45.125], [1415, 51.5], [1421, 30.0], [1435, 28.5], [1450, 32.25], [1488, 53.125], [1489, 28.5], [1509, -3.25], [1526, 7.25], [1530, 25.25], [1551, 81.75], [1557, 44.5], [1558, 76.375], [1565, 39.125], [1580, 73.625], [1583, 20.0], [1588, 80.75], [1660, 85.125], [1675, 49.375], [1684, 41.125], [1694, 62.375], [1696, 36.875], [1703, 16.0], [1705, 51.0], [1755, 26.125], [1762, 49.125], [1764, 39.75], [1788, 67.75], [1796, 0.75], [1811, 47.75], [1814, 88.0], [1830, 41.625], [1834, -10.75], [1836, 31.0], [1851, 9.625], [1852, 47.25], [1870, 7.625], [1871, 0.0], [1889, 16.875], [1898, 36.875], [1907, 33.625], [1914, 58.375], [1915, 48.125], [1916, 38.875], [1918, 4.25], [1925, -16.25], [1927, 93.375], [1928, 53.625], [1970, 63.5], [1995, 28.0], [2002, 26.5], [2016, 69.0], [2019, 16.375], [2020, 28.75], [2083, 34.125], [2120, 65.625], [2135, 55.625], [2146, 31.0], [2153, 56.75], [2195, 28.125], [2203, 35.5], [2226, 77.0], [2231, -2.875], [2253, 19.25], [2254, 28.125], [2269, 3.25], [2275, 53.125], [2290, 50.625], [2303, 56.25], [2311, 62.125], [2312, 41.875], [2347, 22.875], [2357, 49.5], [2368, 56.375], [2369, 36.0], [2376, 106.5], [2380, 1.5], [2414, 50.25], [2425, 8.5], [2454, 46.875], [2462, 51.0], [2481, 61.0], [2483, 40.25], [2485, 5.375], [2490, -26.3125], [2492, 39.125], [2499, 18.0], [2508, 17.75], [2523, 27.25], [2533, 24.5], [2544, 52.5], [2584, 71.875], [2591, 38.375], [2628, 38.75], [2630, -7.75], [2634, 12.375], [2662, 20.625], [2669, 0.625], [2686, 54.875], [2688, 23.125], [2711, 42.25], [2725, 37.5], [2731, 34.25], [2734, 47.125], [2738, 46.125], [2745, -17.5], [2769, 38.875], [2778, 2.375], [2786, 58.25], [2808, 110.375], [2818, 9.625], [2820, 43.375], [2822, 82.75], [2834, 79.625], [2843, 79.5], [2851, 71.625], [2866, -5.0], [2892, 35.125], [2922, 36.125], [2926, 54.375], [2935, 21.625], [2950, 35.0], [2960, 22.625], [2965, 23.625], [2970, 21.0], [2984, 80.0], [2988, 36.625], [2994, 65.0], [3006, 45.5], [3017, 35.625], [3020, 15.375], [3058, 32.125], [3061, 69.125], [3064, 38.875], [3073, 64.5], [3092, 24.125], [3108, 72.25], [3118, 30.5], [3138, 27.875], [3144, 71.5], [3149, 69.0], [3153, 28.5], [3154, 39.75], [3157, 21.75], [3165, 33.625], [3166, 30.5], [3171, 45.5], [3181, 66.0], [3196, 19.25], [3230, 36.75], [3233, 62.875], [3244, 80.375], [3265, 49.25], [3268, 42.875], [3283, 23.0], [3296, -0.75], [3298, 51.25], [3307, 60.125], [3321, 34.5], [3353, 2.625], [3362, 60.625], [3368, 28.0], [3375, 39.5], [3393, 30.375], [3395, 46.25], [3400, 44.75], [3401, 28.125], [3423, 55.375], [3429, 13.25], [3434, 4.875], [3447, 70.375], [3456, 25.875], [3479, 35.375], [3484, 31.75], [3574, 56.625], [3581, 65.0], [3587, -2.75], [3604, 62.5], [3629, 11.75], [3643, 55.0], [3648, 42.625], [3657, 25.375], [3662, 28.125], [3695, 52.125], [3697, 35.125], [3699, 19.0], [3703, 58.125], [3721, 60.75], [3732, 18.25], [3738, 76.5], [3746, 19.625], [3748, 30.375], [3750, 15.75], [3779, 68.625], [3786, 52.5], [3796, 38.0], [3805, 28.875], [3816, 57.5], [3845, 50.25], [3846, 2.0], [3864, 52.875], [3880, 36.625], [3892, 60.75], [3895, 31.375], [3902, 59.5], [3933, 27.5], [3938, 57.0], [3940, 59.375], [3954, 44.25], [3961, 64.5], [3974, 56.375], [3976, 1.75], [3980, 30.75], [3990, 24.875], [3997, 47.625], [3998, 122.5], [3999, 18.0], [4001, 29.0], [4005, 46.0], [4012, 69.625], [4014, 39.375], [4015, 34.625], [4023, 41.625], [4042, 9.875], [4047, 32.125], [4048, 28.75], [4091, 75.0], [4097, 54.25], [4106, 28.5], [4120, 59.75], [4125, 21.75], [4151, 21.875], [4161, 66.125], [4162, 39.5], [4163, 27.875], [4164, -3.125], [4185, 26.5], [4193, 26.5], [4195, 42.125], [4197, 12.5], [4198, 30.875], [4201, 33.75], [4206, 65.0], [4227, 70.125], [4240, 36.0], [4244, 61.875], [4246, 8.375], [4252, 28.875], [4267, -4.75], [4271, 18.625], [4275, 16.875], [4297, 6.375], [4307, 55.375], [4337, 35.75], [4352, 59.625], [4365, 19.875], [4380, 36.5], [4382, 59.75], [4399, 16.75], [4405, 68.0], [4415, 65.25], [4417, 49.625], [4436, 22.125], [4441, 77.0], [4453, 30.125], [4469, 52.125], [4474, -13.0], [4491, 67.625], [4500, 30.75], [4503, 49.375], [4517, 25.75], [4538, 36.625], [4588, 78.5], [4589, 42.5], [4602, 49.25], [4606, 15.0], [4631, 61.75], [4640, 47.0], [4649, 30.375], [4651, 72.375], [4665, 26.875], [4690, 65.0], [4703, 37.25], [4706, 18.125], [4724, 29.0], [4750, 26.375], [4752, 46.5], [4763, 52.5], [4773, 24.625], [4778, 17.75], [4789, 32.125], [4804, 26.125], [4809, 72.5], [4813, 51.375], [4822, 28.875], [4839, 26.125], [4841, 4.875], [4858, 61.375], [4878, 50.75], [4899, 20.375], [4916, 46.375], [4923, 57.5], [4929, 34.625], [4954, 57.5], [4955, 31.75], [4971, 74.75], [4985, 45.0], [4999, 46.5], [5000, 49.625], [5003, 49.75], [5006, 34.375], [5017, 45.125], [5021, 17.875], [5043, 33.625], [5055, 56.5], [5062, 26.5], [5064, 60.25], [5074, 61.875], [5075, 36.375], [5081, 38.75], [5101, 45.875], [5103, 5.375], [5119, 42.0], [5137, 31.0], [5138, 25.25], [5142, 8.75], [5151, 29.0], [5152, 9.75], [5164, 43.5], [5207, 43.5], [5209, 40.25], [5226, 84.125], [5229, 87.5], [5235, 67.125], [5246, -18.8125], [5256, 13.125], [5265, 28.75], [5274, 46.75], [5279, 18.125], [5284, 36.375], [5303, 35.625], [5311, 74.125], [5319, 36.0], [5320, -4.375], [5322, 81.875], [5325, 61.875], [5357, 29.875], [5374, 35.5], [5375, 35.375], [5380, 58.25], [5384, 63.125], [5389, 50.0], [5390, 24.75], [5394, 46.625], [5409, 51.5], [5410, 65.75], [5420, 16.0], [5421, 36.625], [5428, -0.25], [5431, 35.0], [5450, 9.5], [5465, 51.125], [5472, 24.375], [5484, 11.375], [5486, 62.125], [5487, 65.75], [5489, 20.625], [5524, 46.875], [5541, 35.25], [5542, 32.875], [5568, 39.125], [5586, 58.125], [5589, 2.75], [5594, 18.375], [5598, 39.125], [5615, 50.625], [5617, 65.5], [5653, 40.875], [5655, 27.875], [5676, 44.125], [5704, 34.75], [5709, 41.625], [5711, 57.875], [5751, 49.5], [5767, 70.625], [5777, 31.75], [5783, 43.25], [5786, 37.5], [5825, 38.75], [5831, 30.25], [5841, 37.5], [5851, 25.0], [5853, 25.875], [5859, 22.125], [5865, 47.75], [5930, 43.625], [5983, 41.0], [6001, 30.875], [6010, 73.75], [6016, 49.5], [6017, 5.5], [6019, 62.375], [6025, 61.125], [6028, 60.875], [6029, 34.125], [6035, 53.25], [6037, 24.125], [6077, 17.5], [6083, 12.5], [6094, 34.25], [6107, 44.375], [6126, 43.75], [6136, 17.25], [6152, 32.0], [6194, 62.25], [6202, 28.25], [6203, 8.625], [6210, 86.0], [6211, 21.125], [6219, 29.0], [6296, 60.625], [6305, 48.75], [6326, 55.125], [6337, 34.625], [6349, 35.375], [6360, 28.375], [6375, 80.75], [6378, 0.5], [6400, 70.0], [6412, 43.25], [6434, 0.75], [6469, 99.0], [6471, 61.125], [6480, 36.5], [6490, 53.375], [6508, 18.625], [6543, 62.625], [6547, 21.375], [6561, 41.5], [6576, 59.375], [6589, 16.5], [6600, 50.0], [6604, 26.0], [6613, 37.125], [6621, 57.25], [6625, 30.875], [6626, 81.25], [6636, 4.875], [6645, 34.875], [6684, 52.75], [6688, 31.75], [6689, 10.0], [6705, 68.875], [6720, 51.875], [6736, 32.125], [6749, 29.125], [6752, -2.125], [6760, 74.25], [6769, 25.125], [6771, 70.375], [6778, 20.625], [6786, 43.625], [6789, 50.0], [6803, 78.5], [6861, 18.0], [6866, 46.5], [6869, 26.625], [6872, 33.75], [6877, 62.0], [6884, 53.0], [6888, 62.125], [6889, 30.75], [6898, 64.625], [6993, 38.375], [7011, 29.625], [7013, 16.5], [7016, 25.75], [7027, 41.0], [7035, 34.5], [7045, 64.375], [7046, 46.25], [7049, 49.5], [7068, 57.875], [7072, 10.0], [7085, -18.375], [7090, 32.625], [7097, 22.25], [7101, 29.25], [7102, 70.125], [7109, 20.5], [7132, 32.625], [7139, 57.875], [7141, 62.625], [7144, -1.5], [7152, 36.375], [7167, 1.75], [7170, 78.125], [7185, 17.0], [7186, 58.75], [7202, 67.375], [7207, -5.75], [7211, 48.875], [7227, 7.0], [7236, -9.25], [7250, 14.75], [7257, 9.375], [7274, 23.375], [7278, 48.625], [7280, 10.75], [7281, 16.375], [7290, -0.75], [7298, 8.0], [7299, 49.125], [7302, 46.125], [7306, -17.875], [7318, 29.5], [7321, 61.0], [7330, 43.625], [7334, 25.375], [7336, 49.375], [7341, 100.25], [7344, 30.375], [7347, 26.875], [7361, 15.75], [7369, 59.0], [7397, 50.25], [7408, 46.75], [7427, 5.0], [7430, 27.0], [7439, 75.625], [7453, 28.5], [7473, 2.5], [7478, 55.875], [7488, 32.125], [7503, 48.75], [7518, 37.375], [7544, 51.625], [7552, 37.25], [7576, 28.875], [7577, 42.25], [7597, 41.5], [7605, 28.0], [7616, 53.375], [7620, -0.125], [7656, 55.75], [7659, 50.625], [7681, 2.25], [7692, 58.5], [7710, 17.5], [7713, 15.25], [7722, 49.75], [7723, 75.875], [7742, 29.375], [7743, 25.75], [7750, 20.0], [7790, 50.0], [7801, -5.25], [7811, -26.375], [7815, 57.375], [7843, -17.875], [7844, 68.625], [7857, 37.25], [7868, 17.625], [7877, 26.625], [7887, 33.625], [7897, 51.5], [7902, 93.375], [7910, 29.25], [7912, 18.5], [7918, 65.125], [7933, 48.5], [7936, 75.25], [7951, 37.25], [7953, 52.875], [7957, 22.0], [7962, 41.625], [7971, 12.0], [7974, 15.0], [7991, 67.25], [8000, 31.875], [8008, 50.25], [8018, 37.625], [8024, 13.75], [8047, -5.0], [8060, 7.5], [8077, 15.875], [8086, 38.75], [8104, 46.625], [8118, 26.5], [8133, 30.25], [8138, 34.625], [8145, 51.75], [8150, 41.625], [8168, 86.5], [8170, 47.0], [8173, 42.25], [8175, 18.25], [8194, 50.625], [8211, 5.125], [8253, 29.375], [8262, -18.75], [8263, 58.125], [8265, 77.5], [8268, 54.5], [8271, 24.75], [8272, 56.625], [8273, -0.75], [8277, 38.25], [8292, 45.25], [8344, 32.875], [8346, 33.75], [8350, 38.125], [8364, 55.625], [8369, 16.0], [8370, 24.125], [8385, 64.0], [8389, 23.375], [8421, 6.5], [8442, 44.0], [8453, 40.125], [8458, 6.75], [8466, 85.25], [8478, 73.375], [8483, 14.375], [8487, 14.125], [8501, 57.25], [8505, 30.125], [8509, 54.5], [8534, 0.125], [8539, 16.125], [8556, 48.625], [8566, -0.625], [8577, 25.75], [8583, 10.625], [8600, 61.625], [8615, 38.25], [8624, 75.625], [8630, 18.5], [8645, 35.75], [8658, 34.625], [8660, 30.125], [8667, 23.125], [8672, 38.375], [8676, 50.0], [8687, 61.125], [8689, 32.625], [8692, 50.5], [8697, 8.5], [8699, 50.0], [8707, 76.125], [8722, 46.875], [8726, 75.75], [8727, 58.0], [8736, 19.75], [8737, 27.625], [8752, 43.125], [8760, 29.25], [8776, 62.875], [8793, 2.375], [8794, -1.125], [8797, 49.875], [8806, 47.5], [8812, 23.0], [8820, 68.0], [8830, 56.375], [8852, 24.5], [8877, 24.125], [8885, 86.375], [8891, 19.375], [8929, 62.5], [8936, 23.75], [8938, 62.0], [8954, 58.875], [8967, -7.625], [8975, 59.0], [8985, 16.25], [8989, 49.25], [8999, 29.25], [9002, 34.875], [9014, 49.75], [9025, 32.0], [9034, 6.125], [9052, 41.25], [9059, 28.625], [9063, 12.625], [9084, 50.0], [9086, 4.875], [9088, 44.375], [9123, 63.75], [9130, 37.5], [9144, 35.875], [9167, 45.25], [9182, 44.125], [9184, 21.0], [9198, 38.25], [9218, 39.5], [9231, 9.5], [9237, 27.75], [9239, 25.625], [9244, 50.375], [9256, 34.0], [9257, 30.625], [9261, 61.625], [9267, 62.375], [9269, 34.5], [9297, 69.0], [9300, 16.625], [9305, 65.25], [9327, 50.625], [9337, 64.25], [9340, 27.875], [9341, 30.75], [9355, 40.375], [9360, 3.375], [9366, 3.0], [9369, 52.625], [9377, 26.25], [9380, 35.5], [9381, 40.5], [9385, 37.625], [9403, 77.75], [9406, 39.375], [9409, 27.25], [9419, 12.25], [9420, 28.375], [9423, 44.25], [9447, 55.25], [9450, 49.75], [9467, 25.375], [9475, 51.0], [9485, 42.5], [9502, 27.75], [9504, 7.0], [9518, 61.875], [9523, 44.5], [9536, -3.875], [9559, 16.0], [9563, 64.75], [9576, 47.875], [9594, 16.25], [9611, 11.375], [9613, 66.625], [9621, 50.375], [9633, 27.25], [9655, 3.75], [9658, 44.25], [9667, 44.25], [9672, 40.875], [9681, 30.5], [9684, 30.25], [9687, 28.75], [9688, 38.75], [9693, 14.5], [9698, 23.25], [9702, 40.625], [9713, 36.75], [9716, 38.5], [9721, 44.125], [9726, 12.125], [9736, 67.5], [9762, 40.875], [9772, 61.0], [9776, 57.875], [9781, 40.75], [9783, 63.5], [9809, 54.625], [9833, 31.875], [9837, 48.5], [9853, 43.375], [9856, 15.375], [9857, 29.875], [9863, 74.25], [9872, 23.0], [9894, 62.25], [9899, 16.625], [9919, 72.5], [9936, 38.125], [9947, 41.125], [9949, 49.25], [9952, 37.0], [9958, 50.125], [9979, 42.875], [9998, 39.5], [10005, 38.75], [10015, 53.125], [10053, 44.125], [10096, 66.5], [10108, 80.0], [10114, 19.5], [10122, 101.75], [10126, 5.5], [10145, 3.75], [10159, 19.25], [10166, 70.125], [10181, 79.375], [10184, 31.25], [10190, 94.5], [10197, 28.875], [10217, 6.625], [10218, 50.375], [10219, 56.625], [10224, 82.375], [10234, 39.875], [10244, 72.25], [10258, 70.5], [10330, 39.625], [10340, 6.5], [10352, 28.0], [10367, 39.625], [10372, 12.875], [10376, 57.875], [10377, 16.5], [10390, 22.625], [10419, -11.25], [10422, 24.75], [10434, 14.125], [10439, 55.75], [10445, 42.25], [10448, 69.75], [10471, 66.375], [10493, 13.25], [10500, 37.125], [10517, 53.5], [10527, 18.75], [10561, 50.375], [10569, 24.125], [10576, 66.25], [10577, 42.25], [10598, 63.5], [10609, 72.875], [10635, 32.25], [10637, 69.0], [10640, 68.5], [10654, 35.125], [10660, 44.125], [10662, 10.875], [10664, 40.0], [10667, 69.25], [10668, -9.25], [10672, 33.25], [10679, 60.75], [10687, 28.875], [10690, 46.0], [10692, 61.125], [10693, 81.75], [10699, 56.0], [10710, 38.5], [10715, 42.0], [10719, 30.0], [10730, 32.0], [10735, 39.875], [10742, -26.875], [10746, 21.875], [10750, 73.75], [10753, 21.5], [10754, 39.5], [10758, 9.25], [10766, 75.75], [10768, 15.625], [10773, 52.375], [10780, 25.25], [10785, 60.75], [10789, 15.625], [10798, 55.5], [10817, 42.25], [10821, 52.75], [10822, 68.375], [10862, 22.25], [10863, 53.5], [10866, 42.75], [10889, 52.5], [10924, 45.0], [10944, 64.25], [10955, 61.875], [10966, 53.0], [10969, 54.75], [10978, 24.75], [10979, 3.75], [10987, 32.5], [10999, 41.0], [11025, 16.125], [11026, 58.5], [11031, 44.0], [11034, 68.875], [11048, 24.375], [11050, 56.5], [11053, 11.625], [11055, 46.125], [11056, 35.875], [11057, 9.0], [11067, 34.625], [11069, 37.625], [11072, 72.375], [11074, 29.625], [11085, 62.125], [11111, 15.875], [11112, 55.25], [11123, 58.125], [11149, 82.0], [11185, 36.75], [11221, 29.0], [11250, 15.375], [11266, 56.75], [11279, 27.0], [11280, -17.1875], [11312, 23.625], [11320, 40.75], [11327, 20.25], [11331, 8.25], [11351, 21.875], [11359, 60.75], [11360, 35.0], [11362, 30.875], [11386, 18.625], [11391, 58.5], [11393, 10.125], [11428, 49.375], [11436, 48.375], [11446, 53.0], [11460, 50.625], [11462, 25.625], [11465, 63.5], [11478, 46.0], [11495, 66.0], [11497, 29.5], [11500, 31.5], [11522, 42.375], [11523, 37.75], [11526, 73.375], [11533, 78.375], [11539, 33.625], [11540, 62.0], [11543, 31.75], [11548, 54.25], [11570, 24.25], [11572, 69.75], [11584, 31.875], [11597, 1.125], [11605, 25.25], [11622, 39.25], [11637, 17.5], [11650, 55.75], [11657, 8.75], [11665, 30.75], [11668, 48.5], [11686, 30.375], [11720, 36.375], [11721, 40.5], [11741, 69.75], [11755, 71.75], [11756, 73.75], [11764, -24.875], [11819, 68.5], [11828, 42.0], [11842, 52.625], [11861, 1.875], [11871, 47.5], [11880, 28.875], [11903, 5.25], [11905, 76.5], [11939, 27.25], [11940, 65.0], [11941, 83.25], [11963, 59.875], [11964, 74.0], [11970, 27.5], [11983, -9.375], [11992, 63.875], [12020, 70.375], [12042, 34.0], [12051, 65.25], [12069, 56.875], [12075, 60.125], [12102, 35.375], [12106, 19.625], [12150, 27.375], [12158, 41.5], [12161, -47.5], [12164, 20.625], [12165, 59.5], [12172, 6.25], [12181, 35.375], [12192, 39.0], [12193, 60.625], [12205, 29.875], [12207, 55.75], [12214, 61.75], [12219, 33.375], [12224, 22.625], [12225, 61.375], [12229, 22.0], [12237, 35.625], [12238, 27.375], [12253, 44.0], [12257, 65.5], [12259, 45.75], [12262, 30.5], [12266, 70.625], [12300, 15.625], [12309, 49.5], [12344, 43.375], [12351, 8.25], [12352, 20.875], [12354, 75.375], [12357, 60.375], [12359, 29.875], [12361, 6.125], [12362, 44.5], [12370, -24.5], [12384, 45.5], [12397, 14.5], [12411, 56.5], [12428, 69.0], [12436, 35.375], [12455, 55.125], [12467, 23.0], [12481, 53.875], [12482, 4.5], [12499, -8.25], [12505, 49.75], [12527, 20.75], [12546, 76.375], [12559, 41.25], [12578, 84.0], [12583, 46.75], [12584, 52.0], [12601, 55.0], [12609, 30.75], [12610, 49.5], [12614, 47.0], [12620, 63.0], [12626, 12.375], [12647, 59.125], [12669, 47.25], [12676, 52.25], [12700, 46.375], [12703, 8.625], [12706, 23.0], [12711, -16.25], [12716, 71.875], [12739, 53.5], [12766, 34.875], [12779, 30.375], [12812, 16.25], [12820, 56.5], [12823, 30.625], [12826, 38.25], [12857, 12.625], [12866, 10.625], [12893, 21.5], [12907, 7.5], [12940, 44.5], [12944, 42.0], [12946, 54.75], [12954, 46.375], [12958, 49.75], [12960, 7.625], [12972, 2.25], [13005, -4.25], [13008, -1.0], [13019, 29.375], [13022, 47.625], [13041, 37.875], [13044, 39.875], [13048, 42.0], [13060, -11.75], [13066, 13.75], [13069, 49.375], [13081, 41.875], [13086, 50.875], [13091, 64.125], [13098, 9.75], [13100, 32.5], [13104, 28.125], [13112, 45.375], [13127, 23.625], [13136, 20.75], [13154, 8.0], [13162, 35.0], [13195, 3.625], [13214, 26.0], [13225, 68.625], [13233, 62.625], [13244, 92.5], [13253, 55.875], [13259, 69.875], [13268, 49.25], [13270, 25.625], [13273, 50.25], [13290, 46.125], [13300, 45.5], [13305, 49.75], [13312, 40.375], [13353, 53.25], [13357, 23.75], [13359, 74.25], [13386, 35.75], [13390, 14.75], [13425, 10.125], [13426, 23.875], [13437, 40.25], [13449, 35.375], [13455, 50.625], [13468, 1.625], [13471, 27.5], [13494, 55.125], [13495, -6.625], [13496, 27.375], [13515, -11.25], [13517, 35.625], [13526, 36.5], [13546, -15.4375], [13567, 37.375], [13575, -1.625], [13583, 43.625], [13586, 7.125], [13594, 64.875], [13596, 54.125], [13598, 54.0], [13613, 34.25], [13616, 24.5], [13633, 13.375], [13639, 62.875], [13654, 48.75], [13671, 63.75], [13693, 56.0], [13697, 3.75], [13706, 29.75], [13723, 38.25], [13730, 50.75], [13735, 11.125], [13751, 4.0], [13765, 15.125], [13775, 54.125], [13789, 20.0], [13790, 69.875], [13792, 83.875], [13814, 50.75], [13821, 27.0], [13823, -26.5625], [13838, 37.25], [13843, 42.125], [13866, 53.625], [13868, 32.5], [13870, 33.25], [13874, 27.5], [13887, 5.375], [13891, 31.75], [13895, 58.0], [13901, 18.125], [13931, 18.375], [13950, 57.75], [13952, 49.125], [13957, 75.25], [13964, 78.75], [13968, 31.625], [13970, 63.5], [13974, 47.375], [13976, 32.5], [13978, -8.875], [14000, 31.125], [14004, 48.125], [14005, 65.75], [14006, 20.375], [14017, 52.25], [14030, 20.625], [14037, 26.5], [14054, -20.75], [14068, 43.625], [14080, 35.875], [14083, 55.625], [14084, 18.75], [14092, 13.5], [14103, 7.5], [14109, 2.25], [14132, 42.25], [14157, 77.25], [14165, 91.5], [14172, 27.0], [14180, 52.375], [14203, 60.0], [14207, 54.625], [14210, 66.75], [14248, 61.875], [14260, 83.5], [14273, 39.375], [14279, 38.125], [14282, 11.5], [14283, 83.625], [14285, 9.75], [14291, 1.25], [14294, 67.875], [14304, 71.375], [14312, 11.875], [14319, 53.25], [14326, 34.375], [14358, 11.875], [14373, 35.625], [14380, 31.375], [14385, 43.25], [14417, 58.125], [14421, 3.375], [14424, 38.625], [14429, 52.0], [14433, 1.5], [14441, 64.75], [14456, 30.5], [14458, 29.75], [14475, 21.5], [14524, 50.375], [14531, 52.625], [14532, 46.125], [14551, 33.5], [14556, 65.75], [14566, 53.5], [14567, 18.75], [14574, 35.25], [14576, 78.625], [14597, 59.75], [14603, 34.125], [14622, 53.25], [14664, 39.5], [14665, 47.375], [14668, 45.75], [14670, 63.0], [14671, 30.0], [14676, 37.25], [14682, 56.0], [14686, 50.25], [14688, 69.0], [14694, 51.75], [14701, 32.625], [14717, 67.125], [14743, -8.375], [14744, 55.25], [14750, 30.875], [14764, 46.0], [14770, 21.875], [14779, 29.0], [14784, 17.875], [14787, 12.0], [14803, 30.0], [14805, 50.0], [14808, 29.0], [14821, 39.0], [14823, 26.5], [14825, 22.375], [14831, 23.0], [14833, 30.0], [14851, 27.5], [14866, -12.125], [14899, 11.625], [14901, 56.625], [14911, 7.25], [14914, 35.0], [14921, 59.5], [14944, 38.375], [14947, 53.125], [14949, 21.75], [14951, 56.125], [14953, 60.875], [14959, 34.0], [14962, 51.625], [14970, 67.375], [14974, 21.875], [14997, 20.75], [15000, 73.5], [15001, 37.625], [15003, 70.25], [15006, 29.5], [15019, 56.375], [15024, 18.25], [15028, 78.25], [15032, 55.75], [15045, 55.625], [15054, -9.0], [15069, 55.125], [15070, 36.25], [15095, 21.75], [15118, 31.125], [15133, 24.375], [15142, 59.375], [15143, 23.75], [15164, 52.375], [15172, 19.0], [15182, -10.75], [15185, 47.25], [15197, 25.0], [15204, 42.5], [15214, 23.375], [15236, 19.125], [15242, 53.375], [15247, 27.0], [15251, 52.5], [15257, 23.875], [15316, 63.625], [15334, 33.875], [15336, 45.125], [15344, -14.5], [15366, 20.75], [15373, 51.0], [15380, 7.0], [15382, 43.875], [15412, 24.625], [15416, 58.125], [15434, 55.125], [15436, 20.0], [15441, 86.0], [15444, 65.375], [15457, 65.375], [15465, 56.75], [15475, 7.125], [15496, 38.5], [15500, 49.0], [15522, 38.375], [15529, 49.875], [15531, 48.625], [15562, 51.75], [15565, 17.75], [15569, 46.75], [15576, 35.875], [15594, 54.125], [15597, 24.75], [15614, 57.25], [15627, 36.0], [15640, 34.125], [15664, 74.0], [15667, -13.25], [15679, 14.0], [15680, 51.875], [15698, 47.25], [15730, 54.0], [15731, 25.25], [15745, 54.75], [15759, -8.625], [15766, 19.875], [15791, 27.125], [15801, 65.0], [15808, 32.75], [15822, 24.75], [15834, 63.0], [15838, 47.875], [15844, 46.25], [15850, 15.625], [15862, 20.0], [15872, 38.875], [15887, 28.25], [15931, 60.375], [15942, -7.875], [15945, 27.875], [15955, 72.75], [16000, 42.375], [16042, 0.5], [16043, 8.625], [16060, 2.75], [16063, 66.25], [16073, 66.625], [16076, 75.625], [16078, 23.75], [16140, -6.25], [16164, 53.0], [16165, 14.5], [16169, 29.25], [16210, 65.0], [16225, 29.25], [16262, 39.5], [16269, 57.25], [16277, 64.25], [16282, 17.375], [16295, 73.375], [16312, 8.0625], [16316, 46.625], [16328, 31.125], [16346, 32.25], [16389, 25.75], [16434, 33.125], [16472, 53.25], [16474, 52.75], [16489, 61.75], [16502, 62.375], [16531, 60.125], [16532, 66.5], [16539, 39.25], [16541, 35.875], [16571, 28.625], [16572, 60.0], [16580, 91.875], [16582, 47.875], [16598, -42.75], [16605, 24.875], [16606, 26.875], [16619, 25.75], [16643, -8.5], [16657, -18.5], [16659, 30.625], [16671, 34.625], [16737, 71.25], [16743, 38.25], [16759, 75.5], [16765, 32.75], [16768, 74.625], [16769, 61.375], [16773, 17.125], [16777, 53.375], [16790, -15.4375], [16804, 60.375], [16831, 28.25], [16851, 36.625], [16854, 54.625], [16868, 14.75], [16882, 48.875], [16891, 88.125], [16919, 38.625], [16937, 59.0], [16938, 45.0], [16941, 62.375], [16965, 57.25], [16977, 16.875], [16982, 54.75], [16987, 23.125], [17002, 10.25], [17018, 73.625], [17020, 33.0], [17030, -5.0], [17044, 47.625], [17049, 47.5], [17077, 45.75], [17101, 38.625], [17115, 32.875], [17135, 10.75], [17154, 65.25], [17160, 41.375], [17171, 49.125], [17172, 39.0], [17193, 60.75], [17216, 74.125], [17229, 34.75], [17251, 5.625], [17278, 37.0], [17279, 27.0], [17322, 89.375], [17325, 30.25], [17346, 72.125], [17364, 4.5], [17392, 71.375], [17394, 16.75], [17395, 55.75], [17397, -18.25], [17403, 60.25], [17405, 53.5], [17408, 2.125], [17420, 17.75], [17431, 85.125], [17443, 76.125], [17447, 14.375], [17463, 19.875], [17482, 2.25], [17509, 8.25], [17527, 35.375], [17536, 22.5], [17540, 33.125], [17551, 28.5], [17552, 37.0], [17553, 55.625], [17554, 33.0], [17563, 31.75], [17564, 35.125], [17574, 69.625], [17577, 59.125], [17589, 22.5], [17610, 40.375], [17618, 33.625], [17637, 72.75], [17650, 44.5], [17661, 20.125], [17664, 38.625], [17668, 76.625], [17687, 58.125], [17723, 45.0], [17745, 61.125], [17755, 9.0], [17756, 5.0], [17757, 33.875], [17766, 31.875], [17777, 21.625], [17780, 27.875], [17794, 39.25], [17795, 11.0], [17805, 25.625], [17824, 29.375], [17854, 38.125], [17860, 90.5], [17870, 38.875], [17874, 50.625], [17893, 4.875], [17899, 19.375], [17912, 59.875], [17922, 64.0], [17929, 18.75], [17933, 36.5], [17938, 90.625], [17963, 11.625], [17974, -4.125], [18006, 31.625], [18019, 92.125], [18030, 47.375], [18033, 18.75], [18040, 55.625], [18073, 7.25], [18086, 21.0], [18102, 21.75], [18129, 20.75], [18130, 68.0], [18132, 69.625], [18138, 67.375], [18164, -24.375], [18206, 62.875], [18218, 84.75], [18225, 9.875], [18242, 60.625], [18266, -12.25], [18275, 43.25], [18283, 26.875], [18285, 23.25], [18299, 60.875], [18318, 29.75], [18322, 25.625], [18335, 38.25], [18346, 36.625], [18352, 2.0], [18355, 18.25], [18358, 52.5], [18359, 61.375], [18380, 56.5], [18395, 10.125], [18400, 39.0], [18406, 49.625], [18418, 13.0], [18419, 25.625], [18424, 36.75], [18432, 62.625], [18433, 39.0], [18434, 24.875], [18442, 35.0], [18470, 41.5], [18472, 51.25], [18493, 23.375], [18499, 50.25], [18500, 22.875], [18502, 15.875], [18518, 27.25], [18524, 70.375], [18532, 35.25], [18564, 58.375], [18565, 33.625], [18568, 75.0], [18578, -8.375], [18588, 78.0], [18589, 40.0], [18603, 41.25], [18628, 21.875], [18641, 40.125], [18642, -35.8125], [18651, 39.5], [18662, 12.875], [18663, 49.25], [18685, 42.125], [18718, 24.75], [18731, -2.625], [18735, 51.625], [18741, 24.75], [18759, 68.375], [18760, 63.875], [18780, 34.75], [18791, 39.875], [18815, 50.5], [18816, 65.25], [18840, 52.75], [18854, 17.625], [18867, 44.375], [18873, 32.0], [18884, 22.125], [18885, 24.75], [18890, 59.75], [18900, 62.75], [18907, 14.875], [18911, 71.375], [18914, 0.125], [18918, -11.25], [18924, 61.375], [18927, 35.25], [18934, 55.125], [18939, 12.0], [18940, 45.375], [18945, 5.5], [18947, 47.375], [18958, 33.375], [18972, 37.375], [18977, 57.125], [18987, 34.5], [19008, 56.375], [19009, 42.875], [19044, 16.75], [19051, 49.125], [19054, 10.625], [19070, 70.75], [19071, 40.625], [19072, 56.125], [19074, 25.75], [19078, 57.25], [19082, -16.125], [19090, 52.625], [19097, 51.25], [19110, 69.0], [19123, -6.125], [19139, 44.125], [19147, 24.375], [19160, 42.125], [19200, 64.5], [19216, 47.5], [19222, 18.5], [19262, 76.0], [19264, 44.0], [19273, 22.75], [19287, 32.0], [19290, 49.25], [19316, 77.625], [19342, 31.25], [19347, 38.75], [19363, 28.875], [19364, 33.0], [19378, 62.375], [19385, 87.25], [19386, 19.375], [19394, 27.25], [19396, 17.625], [19400, 61.0], [19401, 60.625], [19407, 54.5], [19416, 11.5], [19417, -31.8125], [19422, 31.125], [19434, 38.625], [19437, 3.375], [19454, 28.375], [19459, 85.875], [19460, 24.5], [19476, 5.25], [19494, -3.875], [19497, 51.625], [19499, 54.125], [19500, 41.125], [19519, -6.625], [19536, 38.25], [19547, 84.25], [19552, 26.0], [19553, 52.125], [19554, 11.25], [19562, 51.25], [19592, 50.25], [19607, 34.625], [19612, 28.625], [19617, 30.625], [19645, 47.25], [19657, 42.125], [19671, 4.625], [19677, 67.25], [19682, 5.25], [19683, 48.125], [19696, 38.0], [19699, 39.125], [19710, 57.625], [19712, 47.5], [19718, 29.25], [19726, 23.5], [19727, 61.25], [19731, 40.75], [19740, 7.75], [19746, 9.125], [19753, 24.125], [19781, 70.375], [19806, 62.125], [19810, 60.875], [19811, 70.125], [19839, -1.5], [19852, 23.625], [19866, 36.625], [19872, 40.625], [19921, 28.375], [19928, 59.75], [19953, 35.5], [19966, 19.75], [19985, 49.75], [19988, 32.375], [19995, 30.875], [20003, 73.125], [20018, 41.0], [20035, 83.5], [20057, 28.0], [20066, 67.375], [20078, 46.375], [20082, 43.5], [20089, 50.625], [20110, 58.875], [20116, 38.0], [20131, 58.375], [20150, 54.25], [20152, 60.125], [20157, 107.0], [20160, 2.5], [20174, 30.25], [20187, 47.25], [20211, 36.875], [20222, 67.125], [20236, 67.0], [20237, 47.125], [20253, 46.5], [20258, 78.625], [20274, 28.0], [20297, 51.125], [20301, 0.5], [20306, 26.625], [20307, 49.5], [20316, 44.0], [20325, 37.0], [20350, 23.75], [20361, 55.25], [20369, 19.75], [20371, 4.375], [20382, 62.5], [20385, 38.5], [20386, 65.0], [20393, 22.75], [20402, 52.125], [20420, 55.0], [20442, 44.125], [20466, 26.875], [20468, 29.75], [20471, 19.125], [20487, 57.25], [20488, 26.375], [20490, 52.5], [20503, 62.625], [20506, 31.375], [20508, -2.0], [20520, 59.375], [20533, 28.375], [20537, 8.625], [20558, 77.125], [20568, 35.375], [20571, 29.0], [20576, 0.25], [20601, 44.125], [20603, -25.375], [20609, 19.125], [20644, 51.25], [20646, 32.5], [20652, 69.5], [20678, 36.25], [20723, 68.125], [20724, 61.125], [20728, 44.875], [20742, 32.75], [20744, 27.75], [20752, 74.25], [20764, 23.375], [20769, 45.0], [20778, 58.0], [20788, 40.75], [20789, 36.875], [20796, 65.25], [20797, 67.125], [20815, 44.75], [20853, 47.25], [20875, 43.875], [20884, 62.625], [20897, 43.25], [20932, 22.5], [20958, 10.375], [20969, 68.5], [20970, 10.75], [21017, 29.375], [21018, -20.25], [21026, 14.625], [21054, -20.0], [21062, 42.75], [21064, 51.875], [21073, 34.25], [21074, 29.5], [21125, 47.25], [21138, 43.25], [21145, 13.875], [21147, 41.125], [21170, -3.875], [21183, -6.625], [21184, 21.75], [21185, 53.5], [21206, 35.75], [21207, 34.125], [21210, 29.75], [21220, 18.25], [21229, 54.25], [21240, 83.875], [21245, 27.25], [21246, 62.25], [21248, 53.125], [21271, 31.125], [21276, 69.5], [21293, 39.0], [21294, 56.25], [21309, 75.5], [21331, 14.125], [21332, 25.25], [21333, 49.875], [21337, 31.125], [21341, 40.25], [21342, -3.375], [21344, 77.25], [21347, 24.375], [21361, 30.375], [21370, 29.25], [21418, 96.75], [21431, 78.0], [21446, 17.875], [21452, 22.375], [21507, 42.0], [21549, 24.875], [21557, 40.625], [21562, 71.75], [21565, 61.5], [21570, 18.625], [21575, 40.625], [21578, 36.375], [21593, 54.25], [21596, 18.5], [21600, 43.0], [21605, 50.625], [21610, 32.375], [21633, 38.0], [21635, 26.75], [21643, 59.0], [21656, 32.0], [21667, 41.25], [21671, -23.375], [21683, 2.875], [21694, -15.125], [21705, 41.875], [21706, 15.0], [21710, 35.0], [21723, 14.375], [21733, 62.125], [21762, 31.625], [21797, 17.375], [21803, 30.375], [21827, 69.75], [21830, -1.375], [21836, 20.0], [21837, 28.625], [21846, 69.625], [21855, 77.25], [21856, 36.375], [21859, -16.0625], [21884, 28.0], [21894, 73.375], [21895, 47.875], [21910, 49.75], [21952, 35.25], [21960, 33.5], [21965, 16.25], [21973, 49.25], [21984, 45.875], [21988, 43.5], [21997, 49.875], [21999, 35.25]]}

wandb/run-20250502_045804-vkih00cc/files/media/table/eval/table_13750_90c63f4a59c410ed65db.table.json

@@ -0,0 +1 @@
+{"columns": ["data_index", "value"], "data": [[22, 81.125], [86, 27.25], [101, 28.0], [105, 17.875], [110, -2.625], [121, 38.25], [124, 64.125], [135, 40.875], [136, 36.875], [138, 40.875], [160, 71.5], [166, 31.5], [177, 53.5], [180, 33.375], [196, 21.0], [208, 46.375], [226, 17.25], [245, 7.75], [258, 12.75], [259, 80.0], [266, 44.875], [273, 22.125], [275, 38.25], [277, 42.0], [288, 30.375], [324, 41.25], [327, 42.25], [339, 31.5], [340, 24.625], [369, 7.5], [400, 53.75], [402, 18.0], [432, 44.0], [438, 23.625], [440, 40.25], [446, 80.25], [458, 35.875], [461, 29.0], [494, 34.375], [500, 44.25], [503, 50.0], [507, 21.5], [511, 65.625], [525, 49.0], [534, 42.5], [538, 3.625], [543, 29.375], [563, 66.25], [567, 24.125], [569, 45.125], [575, 47.5], [591, 9.5], [594, 35.875], [602, 54.375], [609, 8.25], [620, -4.25], [625, 20.875], [679, 65.625], [687, 75.375], [700, 48.75], [716, 23.125], [725, 19.25], [736, 38.25], [740, 49.0], [757, 75.375], [758, 20.25], [769, 49.75], [795, 55.75], [804, 4.375], [806, -3.375], [816, 70.375], [821, 47.25], [831, 8.75], [842, 23.375], [849, 47.0], [862, 21.5], [889, 43.0], [896, 41.125], [903, 26.625], [930, 9.375], [937, 16.375], [940, 48.5], [945, 46.375], [993, 29.25], [999, -28.375], [1014, 33.625], [1043, 15.75], [1045, 50.875], [1062, 34.875], [1064, 44.875], [1066, 88.375], [1069, 31.0], [1077, 53.25], [1082, 44.0], [1099, 7.875], [1100, 9.5], [1108, 44.25], [1122, 29.75], [1136, 18.625], [1143, 39.25], [1147, 33.625], [1151, 63.125], [1166, 65.5], [1172, 26.0], [1185, 12.875], [1186, 52.0], [1195, 39.0], [1196, 11.375], [1225, 81.0], [1232, 32.75], [1233, 43.25], [1239, 47.375], [1247, 30.75], [1280, 52.875], [1285, 30.25], [1286, 58.875], [1289, 37.0], [1304, 55.125], [1313, 40.0], [1324, 65.0], [1327, 15.125], [1329, 26.25], [1340, 48.5], [1350, 18.0], [1357, 23.375], [1392, 27.625], [1394, 42.875], [1415, 51.0], [1421, 29.625], [1435, 29.25], [1450, 32.375], [1488, 51.5], [1489, 28.25], [1509, -4.25], [1526, 5.5], [1530, 25.25], [1551, 80.75], [1557, 43.125], [1558, 76.125], [1565, 36.375], [1580, 73.625], [1583, 17.75], [1588, 80.125], [1660, 84.5], [1675, 50.125], [1684, 42.75], [1694, 61.25], [1696, 37.875], [1703, 14.75], [1705, 51.0], [1755, 25.875], [1762, 46.875], [1764, 41.0], [1788, 68.0], [1796, -0.5], [1811, 47.75], [1814, 88.5], [1830, 39.0], [1834, -12.75], [1836, 30.25], [1851, 8.125], [1852, 45.625], [1870, 4.625], [1871, -1.0], [1889, 13.5], [1898, 33.875], [1907, 31.75], [1914, 58.5], [1915, 45.75], [1916, 36.375], [1918, 3.875], [1925, -20.0], [1927, 94.25], [1928, 52.25], [1970, 63.5], [1995, 27.25], [2002, 26.125], [2016, 66.625], [2019, 16.0], [2020, 28.625], [2083, 33.75], [2120, 67.125], [2135, 56.375], [2146, 27.25], [2153, 57.25], [2195, 28.875], [2203, 36.625], [2226, 77.125], [2231, -5.875], [2253, 18.5], [2254, 27.125], [2269, 2.5], [2275, 51.625], [2290, 48.5], [2303, 54.875], [2311, 62.25], [2312, 40.625], [2347, 22.375], [2357, 49.5], [2368, 54.0], [2369, 35.125], [2376, 107.75], [2380, 0.0], [2414, 49.0], [2425, 6.25], [2454, 45.625], [2462, 47.875], [2481, 64.75], [2483, 40.125], [2485, 3.25], [2490, -29.0625], [2492, 36.875], [2499, 16.75], [2508, 18.25], [2523, 27.375], [2533, 21.75], [2544, 47.625], [2584, 69.25], [2591, 38.5], [2628, 37.875], [2630, -7.125], [2634, 11.375], [2662, 19.5], [2669, -1.0], [2686, 56.5], [2688, 22.5], [2711, 39.0], [2725, 35.375], [2731, 33.375], [2734, 46.375], [2738, 46.75], [2745, -18.375], [2769, 38.5], [2778, 0.5], [2786, 61.125], [2808, 110.0], [2818, 9.0], [2820, 42.5], [2822, 83.0], [2834, 76.75], [2843, 76.875], [2851, 70.0], [2866, -6.5], [2892, 33.125], [2922, 35.0], [2926, 53.875], [2935, 18.875], [2950, 35.25], [2960, 20.375], [2965, 24.5], [2970, 21.75], [2984, 77.375], [2988, 38.625], [2994, 64.875], [3006, 46.375], [3017, 35.0], [3020, 15.375], [3058, 31.125], [3061, 70.125], [3064, 35.5], [3073, 63.625], [3092, 24.25], [3108, 72.0], [3118, 30.875], [3138, 25.625], [3144, 71.75], [3149, 67.5], [3153, 27.125], [3154, 39.0], [3157, 20.375], [3165, 34.875], [3166, 29.625], [3171, 44.875], [3181, 62.25], [3196, 19.5], [3230, 35.625], [3233, 62.25], [3244, 80.625], [3265, 46.75], [3268, 43.75], [3283, 21.75], [3296, -1.875], [3298, 54.125], [3307, 61.375], [3321, 33.375], [3353, 0.375], [3362, 60.75], [3368, 27.0], [3375, 39.75], [3393, 30.25], [3395, 46.25], [3400, 45.5], [3401, 27.625], [3423, 53.75], [3429, 13.625], [3434, 3.75], [3447, 68.375], [3456, 24.0], [3479, 35.125], [3484, 32.25], [3574, 57.5], [3581, 65.875], [3587, -3.625], [3604, 62.25], [3629, 12.25], [3643, 55.0], [3648, 40.875], [3657, 26.5], [3662, 27.25], [3695, 51.875], [3697, 31.875], [3699, 17.625], [3703, 57.75], [3721, 61.625], [3732, 18.75], [3738, 76.25], [3746, 19.0], [3748, 28.75], [3750, 14.5], [3779, 67.125], [3786, 50.875], [3796, 36.625], [3805, 28.875], [3816, 54.125], [3845, 50.875], [3846, 1.25], [3864, 51.0], [3880, 36.625], [3892, 62.0], [3895, 29.75], [3902, 59.125], [3933, 26.375], [3938, 56.625], [3940, 61.0], [3954, 42.75], [3961, 61.875], [3974, 55.5], [3976, 1.0], [3980, 29.25], [3990, 25.25], [3997, 47.375], [3998, 123.25], [3999, 16.75], [4001, 26.5], [4005, 44.25], [4012, 67.125], [4014, 39.125], [4015, 32.75], [4023, 40.25], [4042, 8.25], [4047, 32.75], [4048, 29.375], [4091, 75.375], [4097, 52.625], [4106, 26.125], [4120, 58.875], [4125, 22.375], [4151, 20.125], [4161, 67.25], [4162, 41.5], [4163, 28.25], [4164, -4.125], [4185, 23.75], [4193, 26.875], [4195, 41.25], [4197, 11.625], [4198, 28.125], [4201, 29.625], [4206, 65.625], [4227, 69.5], [4240, 36.125], [4244, 60.375], [4246, 7.375], [4252, 28.5], [4267, -7.0], [4271, 14.625], [4275, 18.25], [4297, 4.625], [4307, 53.875], [4337, 35.25], [4352, 56.125], [4365, 18.5], [4380, 38.125], [4382, 58.75], [4399, 15.0], [4405, 67.75], [4415, 67.5], [4417, 50.125], [4436, 24.125], [4441, 79.25], [4453, 31.5], [4469, 53.5], [4474, -14.75], [4491, 66.25], [4500, 31.25], [4503, 49.875], [4517, 24.75], [4538, 36.625], [4588, 77.0], [4589, 43.5], [4602, 47.625], [4606, 15.125], [4631, 61.75], [4640, 46.625], [4649, 30.25], [4651, 71.875], [4665, 26.875], [4690, 66.0], [4703, 35.875], [4706, 19.5], [4724, 29.125], [4750, 25.375], [4752, 45.0], [4763, 52.5], [4773, 24.125], [4778, 17.875], [4789, 29.75], [4804, 23.5], [4809, 69.75], [4813, 53.25], [4822, 27.625], [4839, 24.5], [4841, 3.875], [4858, 60.5], [4878, 48.75], [4899, 15.75], [4916, 44.75], [4923, 58.375], [4929, 33.875], [4954, 55.5], [4955, 29.375], [4971, 75.0], [4985, 44.625], [4999, 47.875], [5000, 46.75], [5003, 49.25], [5006, 35.375], [5017, 47.5], [5021, 17.25], [5043, 32.875], [5055, 56.75], [5062, 24.625], [5064, 59.375], [5074, 60.5], [5075, 36.0], [5081, 36.5], [5101, 48.25], [5103, 3.25], [5119, 40.625], [5137, 29.125], [5138, 25.75], [5142, 7.5], [5151, 26.75], [5152, 6.625], [5164, 42.625], [5207, 43.625], [5209, 39.75], [5226, 84.25], [5229, 85.25], [5235, 66.0], [5246, -19.1875], [5256, 13.75], [5265, 29.75], [5274, 46.0], [5279, 17.625], [5284, 35.125], [5303, 33.875], [5311, 74.25], [5319, 35.75], [5320, -6.0], [5322, 81.625], [5325, 64.0], [5357, 29.125], [5374, 31.375], [5375, 35.75], [5380, 57.75], [5384, 63.625], [5389, 52.0], [5390, 23.5], [5394, 46.125], [5409, 49.875], [5410, 66.0], [5420, 14.75], [5421, 33.25], [5428, -1.125], [5431, 37.125], [5450, 7.125], [5465, 47.25], [5472, 23.125], [5484, 9.625], [5486, 61.5], [5487, 66.5], [5489, 20.875], [5524, 45.375], [5541, 35.375], [5542, 30.25], [5568, 36.875], [5586, 57.0], [5589, 1.875], [5594, 16.375], [5598, 39.25], [5615, 50.375], [5617, 66.25], [5653, 40.875], [5655, 27.875], [5676, 43.5], [5704, 34.0], [5709, 42.625], [5711, 60.0], [5751, 48.875], [5767, 70.25], [5777, 31.125], [5783, 41.625], [5786, 38.5], [5825, 37.5], [5831, 31.125], [5841, 35.75], [5851, 22.5], [5853, 25.375], [5859, 20.625], [5865, 49.5], [5930, 42.125], [5983, 40.75], [6001, 31.0], [6010, 74.75], [6016, 50.375], [6017, 3.0], [6019, 63.125], [6025, 61.625], [6028, 59.75], [6029, 34.875], [6035, 52.5], [6037, 18.875], [6077, 14.375], [6083, 11.375], [6094, 34.0], [6107, 44.875], [6126, 44.75], [6136, 16.5], [6152, 32.875], [6194, 62.5], [6202, 26.875], [6203, 10.0], [6210, 84.75], [6211, 22.375], [6219, 30.5], [6296, 62.5], [6305, 44.375], [6326, 55.125], [6337, 34.125], [6349, 34.125], [6360, 28.75], [6375, 81.375], [6378, 0.5], [6400, 71.625], [6412, 45.125], [6434, -2.125], [6469, 99.25], [6471, 61.875], [6480, 34.75], [6490, 51.25], [6508, 19.5], [6543, 59.125], [6547, 22.375], [6561, 42.0], [6576, 58.375], [6589, 14.75], [6600, 48.375], [6604, 26.5], [6613, 36.25], [6621, 57.625], [6625, 30.0], [6626, 80.875], [6636, 3.0], [6645, 34.0], [6684, 52.75], [6688, 27.75], [6689, 10.25], [6705, 67.5], [6720, 48.75], [6736, 31.75], [6749, 27.25], [6752, -2.5], [6760, 72.625], [6769, 20.75], [6771, 70.5], [6778, 19.125], [6786, 41.875], [6789, 48.25], [6803, 81.0], [6861, 18.5], [6866, 44.125], [6869, 26.875], [6872, 32.875], [6877, 63.875], [6884, 52.875], [6888, 60.875], [6889, 31.875], [6898, 64.375], [6993, 36.25], [7011, 28.25], [7013, 16.375], [7016, 25.25], [7027, 41.5], [7035, 34.75], [7045, 63.25], [7046, 46.0], [7049, 48.75], [7068, 58.125], [7072, 7.625], [7085, -20.125], [7090, 30.125], [7097, 21.75], [7101, 30.125], [7102, 68.0], [7109, 20.125], [7132, 32.875], [7139, 56.0], [7141, 62.0], [7144, -2.375], [7152, 36.5], [7167, 1.375], [7170, 78.25], [7185, 16.125], [7186, 58.0], [7202, 65.25], [7207, -8.0], [7211, 46.625], [7227, 5.5], [7236, -11.25], [7250, 15.5], [7257, 9.0], [7274, 23.625], [7278, 47.625], [7280, 6.0], [7281, 15.5], [7290, -2.375], [7298, 6.125], [7299, 48.5], [7302, 48.375], [7306, -18.25], [7318, 28.75], [7321, 59.375], [7330, 46.125], [7334, 26.375], [7336, 47.75], [7341, 102.0], [7344, 27.25], [7347, 22.625], [7361, 16.5], [7369, 56.625], [7397, 49.25], [7408, 46.0], [7427, 3.375], [7430, 26.75], [7439, 77.25], [7453, 26.25], [7473, 0.5], [7478, 53.5], [7488, 31.25], [7503, 49.25], [7518, 33.625], [7544, 47.25], [7552, 37.0], [7576, 28.125], [7577, 42.5], [7597, 40.75], [7605, 25.125], [7616, 52.625], [7620, -1.625], [7656, 57.0], [7659, 50.5], [7681, 0.5], [7692, 59.0], [7710, 17.125], [7713, 15.875], [7722, 48.625], [7723, 74.125], [7742, 27.625], [7743, 23.0], [7750, 20.75], [7790, 50.375], [7801, -6.25], [7811, -28.125], [7815, 56.125], [7843, -21.0], [7844, 71.0], [7857, 35.5], [7868, 17.0], [7877, 23.375], [7887, 31.375], [7897, 50.0], [7902, 93.0], [7910, 30.75], [7912, 16.375], [7918, 63.25], [7933, 49.25], [7936, 75.75], [7951, 36.25], [7953, 51.5], [7957, 18.625], [7962, 38.625], [7971, 11.0], [7974, 13.375], [7991, 67.75], [8000, 32.125], [8008, 49.0], [8018, 38.25], [8024, 12.625], [8047, -5.0], [8060, 6.0], [8077, 16.0], [8086, 36.125], [8104, 46.25], [8118, 22.875], [8133, 28.5], [8138, 34.5], [8145, 50.5], [8150, 41.125], [8168, 87.875], [8170, 47.25], [8173, 38.875], [8175, 16.875], [8194, 49.0], [8211, 4.875], [8253, 28.625], [8262, -17.6875], [8263, 58.625], [8265, 76.0], [8268, 53.0], [8271, 25.0], [8272, 58.125], [8273, -2.5], [8277, 36.75], [8292, 46.75], [8344, 32.125], [8346, 32.25], [8350, 36.625], [8364, 56.125], [8369, 13.625], [8370, 23.875], [8385, 62.25], [8389, 21.375], [8421, 3.0], [8442, 43.375], [8453, 40.375], [8458, 7.625], [8466, 86.125], [8478, 73.875], [8483, 13.375], [8487, 14.375], [8501, 57.0], [8505, 29.25], [8509, 54.625], [8534, -2.25], [8539, 15.875], [8556, 48.625], [8566, -3.5], [8577, 24.0], [8583, 9.75], [8600, 58.75], [8615, 38.625], [8624, 75.125], [8630, 18.25], [8645, 35.375], [8658, 35.0], [8660, 32.25], [8667, 23.125], [8672, 36.25], [8676, 49.75], [8687, 61.375], [8689, 33.5], [8692, 48.875], [8697, 6.5], [8699, 51.0], [8707, 76.0], [8722, 46.875], [8726, 75.625], [8727, 58.5], [8736, 18.875], [8737, 26.75], [8752, 45.875], [8760, 29.75], [8776, 59.625], [8793, -0.5], [8794, -2.625], [8797, 50.25], [8806, 49.25], [8812, 22.875], [8820, 66.875], [8830, 57.375], [8852, 23.625], [8877, 23.25], [8885, 85.0], [8891, 17.875], [8929, 61.625], [8936, 25.125], [8938, 59.25], [8954, 58.875], [8967, -7.875], [8975, 56.5], [8985, 15.75], [8989, 48.75], [8999, 29.75], [9002, 33.875], [9014, 52.5], [9025, 30.5], [9034, 5.5], [9052, 38.25], [9059, 28.0], [9063, 11.5], [9084, 50.625], [9086, 4.125], [9088, 40.25], [9123, 63.625], [9130, 38.625], [9144, 33.0], [9167, 46.0], [9182, 40.5], [9184, 20.75], [9198, 38.125], [9218, 38.375], [9231, 8.5], [9237, 25.625], [9239, 25.125], [9244, 49.625], [9256, 33.0], [9257, 30.625], [9261, 61.375], [9267, 60.625], [9269, 32.75], [9297, 70.0], [9300, 15.625], [9305, 63.5], [9327, 49.25], [9337, 62.5], [9340, 27.75], [9341, 30.375], [9355, 38.875], [9360, 1.375], [9366, 2.5], [9369, 52.5], [9377, 27.625], [9380, 32.75], [9381, 39.5], [9385, 36.875], [9403, 79.0], [9406, 39.625], [9409, 29.0], [9419, 11.0], [9420, 26.0], [9423, 44.25], [9447, 54.375], [9450, 51.375], [9467, 25.5], [9475, 46.875], [9485, 40.125], [9502, 24.75], [9504, 4.75], [9518, 63.0], [9523, 46.75], [9536, -4.875], [9559, 14.25], [9563, 65.25], [9576, 45.25], [9594, 15.125], [9611, 12.125], [9613, 66.75], [9621, 49.5], [9633, 27.625], [9655, 2.75], [9658, 44.375], [9667, 42.125], [9672, 37.75], [9681, 32.0], [9684, 31.0], [9687, 27.75], [9688, 39.625], [9693, 12.125], [9698, 21.75], [9702, 40.875], [9713, 35.75], [9716, 36.125], [9721, 43.5], [9726, 13.5], [9736, 67.5], [9762, 41.0], [9772, 61.5], [9776, 56.625], [9781, 42.5], [9783, 62.0], [9809, 57.75], [9833, 32.625], [9837, 49.875], [9853, 43.375], [9856, 14.5], [9857, 30.0], [9863, 73.375], [9872, 23.625], [9894, 60.0], [9899, 18.25], [9919, 71.25], [9936, 37.5], [9947, 40.625], [9949, 47.625], [9952, 35.875], [9958, 50.125], [9979, 43.25], [9998, 40.0], [10005, 39.625], [10015, 52.25], [10053, 44.125], [10096, 68.625], [10108, 77.375], [10114, 19.25], [10122, 103.0], [10126, 3.875], [10145, 4.5], [10159, 16.875], [10166, 68.375], [10181, 79.5], [10184, 32.0], [10190, 97.0], [10197, 24.625], [10217, 5.125], [10218, 49.875], [10219, 55.375], [10224, 82.75], [10234, 39.0], [10244, 72.5], [10258, 69.5], [10330, 41.5], [10340, 6.25], [10352, 26.125], [10367, 40.5], [10372, 12.5], [10376, 57.5], [10377, 16.25], [10390, 22.125], [10419, -14.0], [10422, 22.625], [10434, 12.75], [10439, 54.375], [10445, 40.875], [10448, 70.875], [10471, 65.625], [10493, 12.875], [10500, 38.0], [10517, 52.625], [10527, 17.75], [10561, 49.875], [10569, 23.375], [10576, 65.25], [10577, 41.125], [10598, 62.75], [10609, 72.375], [10635, 31.875], [10637, 71.25], [10640, 68.25], [10654, 36.75], [10660, 44.125], [10662, 9.125], [10664, 40.875], [10667, 68.625], [10668, -13.0], [10672, 32.875], [10679, 59.625], [10687, 26.875], [10690, 43.25], [10692, 63.375], [10693, 82.25], [10699, 52.125], [10710, 37.125], [10715, 39.875], [10719, 28.0], [10730, 31.625], [10735, 36.5], [10742, -28.25], [10746, 20.0], [10750, 76.625], [10753, 19.0], [10754, 41.5], [10758, 8.75], [10766, 76.625], [10768, 15.75], [10773, 51.375], [10780, 22.125], [10785, 62.5], [10789, 15.375], [10798, 55.375], [10817, 42.375], [10821, 52.75], [10822, 66.0], [10862, 20.5], [10863, 55.0], [10866, 42.5], [10889, 53.5], [10924, 46.375], [10944, 63.5], [10955, 63.75], [10966, 51.875], [10969, 52.875], [10978, 22.875], [10979, 2.0], [10987, 31.25], [10999, 39.5], [11025, 15.5], [11026, 59.75], [11031, 42.875], [11034, 68.75], [11048, 23.5], [11050, 55.75], [11053, 10.375], [11055, 46.875], [11056, 36.25], [11057, 9.125], [11067, 33.75], [11069, 35.75], [11072, 73.625], [11074, 31.375], [11085, 61.125], [11111, 15.25], [11112, 54.875], [11123, 59.5], [11149, 83.75], [11185, 37.5], [11221, 27.25], [11250, 17.625], [11266, 56.0], [11279, 26.375], [11280, -18.6875], [11312, 23.25], [11320, 40.125], [11327, 21.5], [11331, 7.75], [11351, 20.0], [11359, 60.625], [11360, 35.25], [11362, 30.375], [11386, 19.375], [11391, 58.375], [11393, 8.375], [11428, 51.875], [11436, 46.375], [11446, 53.125], [11460, 49.375], [11462, 21.875], [11465, 64.5], [11478, 47.375], [11495, 63.875], [11497, 28.75], [11500, 29.75], [11522, 41.25], [11523, 39.0], [11526, 75.0], [11533, 78.75], [11539, 32.5], [11540, 60.375], [11543, 30.125], [11548, 54.0], [11570, 24.75], [11572, 68.375], [11584, 30.5], [11597, 0.0], [11605, 26.0], [11622, 39.0], [11637, 15.75], [11650, 55.25], [11657, 8.125], [11665, 29.375], [11668, 48.375], [11686, 29.125], [11720, 34.625], [11721, 41.25], [11741, 69.125], [11755, 71.625], [11756, 73.0], [11764, -25.4375], [11819, 67.75], [11828, 42.75], [11842, 51.25], [11861, 0.5], [11871, 46.625], [11880, 28.875], [11903, 4.25], [11905, 74.75], [11939, 27.875], [11940, 65.375], [11941, 84.375], [11963, 58.125], [11964, 75.5], [11970, 25.25], [11983, -11.875], [11992, 62.875], [12020, 69.625], [12042, 31.75], [12051, 65.5], [12069, 55.375], [12075, 60.625], [12102, 35.25], [12106, 18.0], [12150, 26.5], [12158, 42.0], [12161, -51.375], [12164, 18.625], [12165, 61.0], [12172, 3.125], [12181, 36.125], [12192, 38.625], [12193, 60.25], [12205, 29.625], [12207, 56.125], [12214, 62.75], [12219, 32.875], [12224, 22.25], [12225, 61.625], [12229, 23.25], [12237, 34.125], [12238, 26.375], [12253, 41.375], [12257, 65.75], [12259, 42.125], [12262, 31.25], [12266, 70.125], [12300, 16.25], [12309, 49.25], [12344, 44.25], [12351, 8.25], [12352, 21.125], [12354, 75.125], [12357, 60.125], [12359, 31.0], [12361, 3.625], [12362, 43.0], [12370, -25.125], [12384, 44.625], [12397, 12.0], [12411, 55.375], [12428, 67.25], [12436, 32.875], [12455, 55.375], [12467, 23.0], [12481, 54.125], [12482, 2.625], [12499, -10.875], [12505, 50.0], [12527, 20.375], [12546, 77.5], [12559, 40.5], [12578, 83.5], [12583, 47.25], [12584, 52.25], [12601, 55.0], [12609, 28.5], [12610, 49.625], [12614, 45.375], [12620, 63.875], [12626, 12.5], [12647, 56.875], [12669, 46.125], [12676, 52.75], [12700, 45.0], [12703, 8.875], [12706, 23.25], [12711, -17.25], [12716, 72.25], [12739, 53.75], [12766, 34.0], [12779, 29.875], [12812, 15.875], [12820, 56.0], [12823, 29.5], [12826, 38.375], [12857, 14.5], [12866, 10.0], [12893, 18.125], [12907, 4.375], [12940, 44.25], [12944, 44.25], [12946, 54.5], [12954, 45.125], [12958, 49.875], [12960, 7.0], [12972, -1.25], [13005, -4.875], [13008, -1.75], [13019, 29.125], [13022, 46.25], [13041, 37.125], [13044, 41.875], [13048, 39.375], [13060, -10.75], [13066, 12.25], [13069, 46.875], [13081, 41.25], [13086, 49.125], [13091, 63.625], [13098, 6.375], [13100, 30.75], [13104, 26.625], [13112, 47.0], [13127, 22.75], [13136, 18.75], [13154, 6.25], [13162, 32.625], [13195, 3.75], [13214, 23.25], [13225, 68.25], [13233, 61.375], [13244, 92.0], [13253, 55.875], [13259, 67.625], [13268, 50.625], [13270, 25.125], [13273, 47.75], [13290, 46.0], [13300, 44.5], [13305, 51.5], [13312, 38.875], [13353, 54.5], [13357, 22.875], [13359, 75.125], [13386, 33.125], [13390, 14.25], [13425, 8.75], [13426, 21.25], [13437, 41.25], [13449, 36.125], [13455, 50.0], [13468, 0.0], [13471, 25.625], [13494, 51.875], [13495, -7.375], [13496, 26.125], [13515, -13.0], [13517, 34.0], [13526, 36.0], [13546, -15.4375], [13567, 38.625], [13575, -3.375], [13583, 41.375], [13586, 4.625], [13594, 63.625], [13596, 53.75], [13598, 55.75], [13613, 33.625], [13616, 24.25], [13633, 9.5], [13639, 61.375], [13654, 48.875], [13671, 64.25], [13693, 55.375], [13697, 3.125], [13706, 27.75], [13723, 36.875], [13730, 48.875], [13735, 6.75], [13751, 2.625], [13765, 13.875], [13775, 51.875], [13789, 18.375], [13790, 70.125], [13792, 84.5], [13814, 49.25], [13821, 25.5], [13823, -29.6875], [13838, 37.75], [13843, 40.0], [13866, 52.5], [13868, 32.5], [13870, 32.0], [13874, 26.0], [13887, 4.5], [13891, 31.25], [13895, 59.25], [13901, 19.0], [13931, 17.75], [13950, 58.375], [13952, 47.5], [13957, 76.25], [13964, 80.625], [13968, 32.375], [13970, 65.25], [13974, 43.375], [13976, 32.5], [13978, -10.75], [14000, 33.625], [14004, 49.625], [14005, 61.875], [14006, 19.625], [14017, 50.75], [14030, 15.0], [14037, 25.375], [14054, -23.625], [14068, 42.5], [14080, 36.125], [14083, 57.125], [14084, 18.75], [14092, 13.875], [14103, 5.5], [14109, 2.375], [14132, 41.625], [14157, 77.625], [14165, 89.75], [14172, 23.125], [14180, 50.375], [14203, 57.75], [14207, 54.125], [14210, 65.125], [14248, 61.25], [14260, 82.875], [14273, 39.0], [14279, 35.75], [14282, 9.625], [14283, 83.875], [14285, 8.375], [14291, -1.5], [14294, 66.0], [14304, 71.75], [14312, 12.25], [14319, 50.0], [14326, 35.5], [14358, 10.75], [14373, 35.375], [14380, 29.75], [14385, 41.0], [14417, 59.625], [14421, -0.625], [14424, 38.25], [14429, 50.0], [14433, -0.5], [14441, 63.875], [14456, 29.75], [14458, 31.5], [14475, 22.5], [14524, 48.75], [14531, 49.5], [14532, 44.375], [14551, 34.5], [14556, 67.875], [14566, 53.375], [14567, 18.5], [14574, 34.0], [14576, 80.375], [14597, 60.75], [14603, 34.875], [14622, 52.5], [14664, 38.875], [14665, 47.25], [14668, 44.5], [14670, 61.25], [14671, 29.5], [14676, 36.0], [14682, 56.5], [14686, 48.5], [14688, 69.25], [14694, 50.75], [14701, 31.5], [14717, 65.875], [14743, -10.125], [14744, 56.625], [14750, 28.875], [14764, 46.875], [14770, 19.875], [14779, 29.5], [14784, 17.625], [14787, 14.75], [14803, 28.75], [14805, 48.5], [14808, 30.625], [14821, 40.375], [14823, 26.875], [14825, 22.0], [14831, 21.375], [14833, 30.125], [14851, 26.875], [14866, -13.25], [14899, 12.25], [14901, 58.25], [14911, 5.875], [14914, 35.5], [14921, 57.25], [14944, 36.25], [14947, 53.375], [14949, 20.75], [14951, 56.5], [14953, 60.625], [14959, 33.25], [14962, 51.5], [14970, 66.875], [14974, 21.75], [14997, 20.375], [15000, 75.25], [15001, 36.5], [15003, 67.75], [15006, 29.0], [15019, 56.5], [15024, 18.25], [15028, 75.875], [15032, 55.25], [15045, 52.625], [15054, -11.375], [15069, 55.375], [15070, 35.75], [15095, 20.75], [15118, 30.375], [15133, 22.875], [15142, 57.375], [15143, 23.25], [15164, 53.625], [15172, 16.5], [15182, -12.5], [15185, 45.625], [15197, 26.125], [15204, 41.875], [15214, 21.5], [15236, 16.75], [15242, 52.5], [15247, 26.375], [15251, 51.625], [15257, 21.0], [15316, 65.375], [15334, 33.5], [15336, 42.875], [15344, -15.625], [15366, 18.0], [15373, 49.75], [15380, 3.125], [15382, 42.5], [15412, 24.875], [15416, 54.875], [15434, 53.25], [15436, 17.25], [15441, 87.0], [15444, 63.875], [15457, 66.125], [15465, 58.5], [15475, 6.625], [15496, 40.25], [15500, 49.875], [15522, 33.875], [15529, 48.375], [15531, 43.625], [15562, 53.25], [15565, 17.5], [15569, 46.25], [15576, 33.5], [15594, 52.75], [15597, 25.125], [15614, 59.5], [15627, 36.5], [15640, 34.25], [15664, 74.5], [15667, -16.0], [15679, 11.25], [15680, 50.75], [15698, 44.625], [15730, 53.25], [15731, 23.875], [15745, 52.875], [15759, -10.0], [15766, 19.125], [15791, 27.5], [15801, 64.625], [15808, 32.25], [15822, 25.125], [15834, 63.625], [15838, 47.25], [15844, 45.0], [15850, 15.25], [15862, 18.25], [15872, 38.5], [15887, 26.375], [15931, 58.125], [15942, -9.875], [15945, 26.125], [15955, 72.625], [16000, 42.375], [16042, -2.5], [16043, 7.5], [16060, 0.75], [16063, 66.5], [16073, 63.75], [16076, 78.625], [16078, 22.75], [16140, -8.75], [16164, 50.25], [16165, 14.75], [16169, 28.375], [16210, 66.25], [16225, 28.625], [16262, 36.625], [16269, 58.375], [16277, 64.75], [16282, 16.625], [16295, 72.625], [16312, 6.5], [16316, 46.75], [16328, 30.5], [16346, 34.375], [16389, 25.0], [16434, 33.0], [16472, 54.75], [16474, 54.5], [16489, 61.875], [16502, 60.125], [16531, 60.5], [16532, 66.625], [16539, 39.25], [16541, 35.75], [16571, 28.75], [16572, 59.375], [16580, 93.5], [16582, 44.125], [16598, -45.625], [16605, 25.25], [16606, 24.875], [16619, 24.125], [16643, -10.125], [16657, -20.6875], [16659, 30.0], [16671, 29.25], [16737, 72.0], [16743, 38.25], [16759, 75.75], [16765, 32.375], [16768, 74.625], [16769, 59.75], [16773, 17.625], [16777, 51.25], [16790, -15.8125], [16804, 60.625], [16831, 27.0], [16851, 37.875], [16854, 55.5], [16868, 15.625], [16882, 45.375], [16891, 87.875], [16919, 37.75], [16937, 60.75], [16938, 43.875], [16941, 60.25], [16965, 57.25], [16977, 16.875], [16982, 53.5], [16987, 21.625], [17002, 10.125], [17018, 74.75], [17020, 30.25], [17030, -7.125], [17044, 47.25], [17049, 45.625], [17077, 46.375], [17101, 38.5], [17115, 33.0], [17135, 10.25], [17154, 65.875], [17160, 38.75], [17171, 46.875], [17172, 37.5], [17193, 61.0], [17216, 72.875], [17229, 33.875], [17251, 5.25], [17278, 37.5], [17279, 25.25], [17322, 89.375], [17325, 30.0], [17346, 74.375], [17364, 3.5], [17392, 71.375], [17394, 17.875], [17395, 56.625], [17397, -20.0], [17403, 60.0], [17405, 51.375], [17408, 0.375], [17420, 17.25], [17431, 86.5], [17443, 77.125], [17447, 13.125], [17463, 17.125], [17482, 1.25], [17509, 5.25], [17527, 35.75], [17536, 21.75], [17540, 34.125], [17551, 28.5], [17552, 35.125], [17553, 55.5], [17554, 32.0], [17563, 33.125], [17564, 34.0], [17574, 69.875], [17577, 60.25], [17589, 22.75], [17610, 36.75], [17618, 32.625], [17637, 73.75], [17650, 44.0], [17661, 20.875], [17664, 38.0], [17668, 76.375], [17687, 58.125], [17723, 43.25], [17745, 60.875], [17755, 8.625], [17756, 4.5], [17757, 32.875], [17766, 32.25], [17777, 21.5], [17780, 27.25], [17794, 37.0], [17795, 10.125], [17805, 25.375], [17824, 29.0], [17854, 39.75], [17860, 93.0], [17870, 38.75], [17874, 49.75], [17893, 4.25], [17899, 18.75], [17912, 60.125], [17922, 64.0], [17929, 16.5], [17933, 35.25], [17938, 92.0], [17963, 12.125], [17974, -5.25], [18006, 30.25], [18019, 94.25], [18030, 45.25], [18033, 16.875], [18040, 55.0], [18073, 5.375], [18086, 20.125], [18102, 19.0], [18129, 17.25], [18130, 70.375], [18132, 67.75], [18138, 67.75], [18164, -26.625], [18206, 62.875], [18218, 84.375], [18225, 7.25], [18242, 60.125], [18266, -15.375], [18275, 43.125], [18283, 27.0], [18285, 21.5], [18299, 58.375], [18318, 28.0], [18322, 24.25], [18335, 37.0], [18346, 36.5], [18352, 0.875], [18355, 14.375], [18358, 51.875], [18359, 63.25], [18380, 55.25], [18395, 8.75], [18400, 37.25], [18406, 48.5], [18418, 11.25], [18419, 25.125], [18424, 37.75], [18432, 59.875], [18433, 39.0], [18434, 23.0], [18442, 34.625], [18470, 41.125], [18472, 50.75], [18493, 23.0], [18499, 51.5], [18500, 21.125], [18502, 16.125], [18518, 23.625], [18524, 70.375], [18532, 34.0], [18564, 57.375], [18565, 34.375], [18568, 76.625], [18578, -9.0], [18588, 77.125], [18589, 39.375], [18603, 40.75], [18628, 19.625], [18641, 39.75], [18642, -38.4375], [18651, 40.25], [18662, 13.5], [18663, 48.5], [18685, 40.0], [18718, 23.75], [18731, -3.0], [18735, 50.5], [18741, 23.625], [18759, 65.0], [18760, 65.0], [18780, 34.0], [18791, 40.0], [18815, 48.125], [18816, 65.875], [18840, 51.875], [18854, 15.125], [18867, 45.125], [18873, 31.625], [18884, 22.0], [18885, 22.0], [18890, 60.75], [18900, 63.0], [18907, 15.625], [18911, 71.125], [18914, 3.625], [18918, -13.1875], [18924, 61.375], [18927, 34.125], [18934, 55.5], [18939, 12.0], [18940, 47.0], [18945, 5.25], [18947, 46.125], [18958, 30.5], [18972, 35.25], [18977, 55.875], [18987, 35.5], [19008, 55.0], [19009, 43.0], [19044, 16.0], [19051, 49.0], [19054, 11.0], [19070, 72.25], [19071, 38.875], [19072, 55.625], [19074, 26.25], [19078, 58.0], [19082, -15.5], [19090, 50.125], [19097, 51.375], [19110, 68.0], [19123, -7.875], [19139, 41.25], [19147, 24.125], [19160, 40.625], [19200, 66.0], [19216, 47.0], [19222, 15.25], [19262, 76.0], [19264, 41.0], [19273, 22.25], [19287, 27.875], [19290, 47.625], [19316, 76.75], [19342, 32.5], [19347, 38.625], [19363, 29.0], [19364, 35.5], [19378, 61.0], [19385, 87.0], [19386, 17.0], [19394, 27.5], [19396, 16.75], [19400, 59.0], [19401, 59.5], [19407, 54.75], [19416, 8.75], [19417, -35.0625], [19422, 32.5], [19434, 38.875], [19437, 1.75], [19454, 26.875], [19459, 85.75], [19460, 23.875], [19476, 3.875], [19494, -2.9375], [19497, 53.5], [19499, 55.125], [19500, 39.0], [19519, -6.75], [19536, 42.75], [19547, 85.625], [19552, 25.25], [19553, 50.25], [19554, 10.75], [19562, 49.25], [19592, 48.0], [19607, 32.375], [19612, 27.0], [19617, 29.5], [19645, 46.625], [19657, 42.0], [19671, 1.125], [19677, 66.875], [19682, 3.5], [19683, 48.5], [19696, 38.5], [19699, 37.625], [19710, 55.375], [19712, 44.5], [19718, 28.875], [19726, 24.75], [19727, 61.0], [19731, 39.5], [19740, 6.25], [19746, 7.5], [19753, 25.25], [19781, 71.0], [19806, 61.75], [19810, 61.75], [19811, 71.25], [19839, -2.125], [19852, 21.5], [19866, 36.5], [19872, 39.125], [19921, 25.0], [19928, 60.25], [19953, 34.625], [19966, 20.5], [19985, 47.5], [19988, 31.25], [19995, 29.875], [20003, 73.25], [20018, 41.5], [20035, 84.0], [20057, 28.0], [20066, 66.0], [20078, 45.75], [20082, 40.25], [20089, 52.375], [20110, 58.375], [20116, 37.375], [20131, 55.75], [20150, 53.75], [20152, 58.125], [20157, 109.0], [20160, 0.25], [20174, 29.25], [20187, 49.0], [20211, 36.25], [20222, 67.125], [20236, 67.25], [20237, 45.375], [20253, 48.375], [20258, 77.5], [20274, 25.875], [20297, 49.125], [20301, 2.125], [20306, 27.0], [20307, 48.75], [20316, 43.5], [20325, 34.875], [20350, 22.375], [20361, 55.375], [20369, 18.375], [20371, 3.375], [20382, 63.25], [20385, 37.75], [20386, 65.625], [20393, 23.0], [20402, 51.25], [20420, 53.25], [20442, 44.25], [20466, 24.0], [20468, 30.25], [20471, 19.125], [20487, 55.0], [20488, 27.25], [20490, 51.25], [20503, 64.25], [20506, 33.0], [20508, -2.875], [20520, 57.375], [20533, 27.25], [20537, 6.25], [20558, 80.5], [20568, 35.5], [20571, 28.375], [20576, -0.5], [20601, 44.875], [20603, -27.25], [20609, 18.0], [20644, 50.0], [20646, 31.875], [20652, 69.75], [20678, 38.0], [20723, 65.5], [20724, 62.125], [20728, 43.375], [20742, 32.625], [20744, 27.125], [20752, 75.0], [20764, 21.0], [20769, 42.5], [20778, 57.875], [20788, 38.375], [20789, 37.375], [20796, 65.0], [20797, 66.625], [20815, 45.25], [20853, 47.625], [20875, 44.25], [20884, 61.875], [20897, 40.25], [20932, 21.875], [20958, 8.0], [20969, 69.625], [20970, 9.0], [21017, 29.625], [21018, -23.75], [21026, 12.75], [21054, -20.5], [21062, 40.375], [21064, 51.75], [21073, 33.125], [21074, 29.375], [21125, 49.625], [21138, 41.875], [21145, 11.125], [21147, 41.875], [21170, -4.625], [21183, -8.875], [21184, 21.375], [21185, 53.0], [21206, 35.875], [21207, 33.625], [21210, 27.75], [21220, 18.875], [21229, 53.625], [21240, 84.5], [21245, 26.5], [21246, 62.125], [21248, 52.375], [21271, 30.25], [21276, 70.25], [21293, 38.25], [21294, 53.5], [21309, 75.5], [21331, 16.25], [21332, 25.25], [21333, 52.0], [21337, 28.25], [21341, 41.25], [21342, -8.375], [21344, 78.75], [21347, 21.875], [21361, 29.5], [21370, 27.25], [21418, 98.5], [21431, 78.5], [21446, 16.375], [21452, 19.875], [21507, 40.375], [21549, 23.625], [21557, 39.875], [21562, 72.25], [21565, 62.125], [21570, 15.5], [21575, 41.5], [21578, 36.875], [21593, 51.75], [21596, 15.875], [21600, 44.5], [21605, 48.875], [21610, 31.0], [21633, 35.25], [21635, 25.5], [21643, 57.625], [21656, 33.25], [21667, 41.25], [21671, -25.0], [21683, 2.375], [21694, -18.125], [21705, 40.875], [21706, 13.875], [21710, 34.5], [21723, 10.75], [21733, 61.75], [21762, 31.5], [21797, 18.375], [21803, 26.375], [21827, 69.0], [21830, -3.75], [21836, 21.25], [21837, 26.75], [21846, 70.625], [21855, 76.25], [21856, 35.375], [21859, -16.5], [21884, 25.5], [21894, 74.5], [21895, 47.875], [21910, 48.25], [21952, 36.125], [21960, 30.75], [21965, 17.375], [21973, 48.75], [21984, 45.0], [21988, 44.375], [21997, 51.5], [21999, 34.875]]}

wandb/run-20250502_045804-vkih00cc/files/media/table/eval/table_16500_685f19d324d44ea11afa.table.json

@@ -0,0 +1 @@
+{"columns": ["data_index", "value"], "data": [[22, 82.0], [86, 26.0], [101, 26.625], [105, 17.5], [110, -3.875], [121, 37.25], [124, 64.25], [135, 41.75], [136, 35.625], [138, 40.375], [160, 71.125], [166, 30.0], [177, 54.5], [180, 33.25], [196, 21.25], [208, 45.875], [226, 17.375], [245, 5.375], [258, 11.875], [259, 80.375], [266, 43.75], [273, 22.75], [275, 36.75], [277, 42.0], [288, 29.25], [324, 40.75], [327, 42.75], [339, 30.625], [340, 24.5], [369, 6.5], [400, 53.375], [402, 16.875], [432, 43.875], [438, 24.5], [440, 39.875], [446, 80.5], [458, 35.625], [461, 28.75], [494, 34.5], [500, 44.375], [503, 51.125], [507, 22.0], [511, 65.125], [525, 48.125], [534, 42.0], [538, 3.125], [543, 29.0], [563, 64.5], [567, 22.875], [569, 44.375], [575, 47.5], [591, 9.25], [594, 36.25], [602, 54.5], [609, 7.25], [620, -4.25], [625, 20.0], [679, 65.25], [687, 74.75], [700, 48.75], [716, 22.5], [725, 19.125], [736, 37.0], [740, 48.875], [757, 74.875], [758, 21.125], [769, 49.375], [795, 55.875], [804, 4.625], [806, -4.0], [816, 69.75], [821, 46.25], [831, 8.0], [842, 23.5], [849, 46.375], [862, 20.75], [889, 42.5], [896, 40.375], [903, 26.0], [930, 8.875], [937, 16.0], [940, 48.5], [945, 46.5], [993, 28.0], [999, -29.375], [1014, 33.25], [1043, 15.0], [1045, 50.25], [1062, 34.375], [1064, 45.125], [1066, 88.25], [1069, 29.5], [1077, 53.125], [1082, 43.625], [1099, 7.625], [1100, 8.25], [1108, 44.0], [1122, 29.0], [1136, 18.125], [1143, 38.625], [1147, 34.0], [1151, 63.25], [1166, 64.375], [1172, 25.0], [1185, 12.5], [1186, 50.375], [1195, 38.625], [1196, 11.25], [1225, 80.0], [1232, 32.25], [1233, 43.25], [1239, 47.375], [1247, 30.375], [1280, 52.5], [1285, 30.0], [1286, 59.625], [1289, 37.0], [1304, 55.0], [1313, 38.875], [1324, 65.125], [1327, 15.0], [1329, 26.375], [1340, 48.25], [1350, 17.5], [1357, 24.625], [1392, 26.5], [1394, 42.375], [1415, 49.5], [1421, 30.625], [1435, 28.75], [1450, 32.25], [1488, 51.125], [1489, 28.625], [1509, -5.375], [1526, 5.0], [1530, 24.25], [1551, 79.875], [1557, 43.25], [1558, 77.25], [1565, 36.875], [1580, 72.875], [1583, 18.0], [1588, 79.875], [1660, 84.0], [1675, 50.25], [1684, 42.125], [1694, 61.375], [1696, 36.75], [1703, 13.5], [1705, 50.625], [1755, 25.75], [1762, 46.875], [1764, 40.25], [1788, 66.25], [1796, 0.125], [1811, 46.875], [1814, 86.75], [1830, 38.125], [1834, -12.125], [1836, 30.0], [1851, 8.625], [1852, 43.75], [1870, 5.125], [1871, -1.5], [1889, 13.625], [1898, 32.5], [1907, 31.875], [1914, 58.25], [1915, 46.0], [1916, 36.25], [1918, 3.0], [1925, -20.5], [1927, 94.0], [1928, 52.125], [1970, 63.0], [1995, 26.0], [2002, 25.5], [2016, 67.0], [2019, 15.875], [2020, 28.0], [2083, 32.875], [2120, 67.375], [2135, 55.75], [2146, 27.25], [2153, 56.0], [2195, 28.0], [2203, 36.625], [2226, 77.625], [2231, -5.125], [2253, 16.75], [2254, 26.75], [2269, 2.25], [2275, 51.0], [2290, 48.0], [2303, 53.5], [2311, 61.875], [2312, 40.0], [2347, 22.875], [2357, 49.25], [2368, 53.875], [2369, 34.75], [2376, 106.25], [2380, -0.625], [2414, 50.5], [2425, 5.5], [2454, 44.875], [2462, 47.375], [2481, 64.375], [2483, 39.625], [2485, 3.75], [2490, -29.5625], [2492, 36.375], [2499, 16.0], [2508, 17.75], [2523, 27.5], [2533, 21.5], [2544, 46.375], [2584, 68.5], [2591, 38.875], [2628, 38.25], [2630, -8.125], [2634, 11.375], [2662, 18.875], [2669, -1.0], [2686, 56.375], [2688, 22.0], [2711, 39.625], [2725, 35.875], [2731, 33.5], [2734, 45.375], [2738, 46.875], [2745, -18.75], [2769, 38.375], [2778, 0.125], [2786, 61.625], [2808, 109.875], [2818, 9.125], [2820, 43.125], [2822, 82.0], [2834, 76.25], [2843, 76.75], [2851, 70.625], [2866, -6.625], [2892, 33.25], [2922, 33.75], [2926, 52.875], [2935, 18.5], [2950, 35.0], [2960, 19.875], [2965, 24.0], [2970, 20.875], [2984, 77.0], [2988, 38.875], [2994, 64.5], [3006, 46.125], [3017, 34.875], [3020, 13.75], [3058, 30.375], [3061, 70.625], [3064, 35.25], [3073, 64.25], [3092, 23.875], [3108, 71.875], [3118, 31.75], [3138, 26.875], [3144, 72.375], [3149, 67.75], [3153, 26.875], [3154, 38.5], [3157, 19.5], [3165, 34.125], [3166, 29.625], [3171, 45.375], [3181, 62.5], [3196, 19.0], [3230, 35.875], [3233, 61.75], [3244, 80.375], [3265, 46.875], [3268, 42.375], [3283, 20.875], [3296, -1.125], [3298, 53.875], [3307, 61.125], [3321, 31.75], [3353, 0.625], [3362, 59.625], [3368, 25.625], [3375, 39.25], [3393, 29.625], [3395, 46.375], [3400, 45.25], [3401, 26.0], [3423, 53.25], [3429, 14.25], [3434, 3.625], [3447, 69.125], [3456, 24.625], [3479, 35.5], [3484, 31.0], [3574, 57.375], [3581, 66.75], [3587, -4.125], [3604, 62.125], [3629, 11.875], [3643, 54.75], [3648, 41.375], [3657, 27.75], [3662, 27.0], [3695, 51.625], [3697, 31.75], [3699, 17.0], [3703, 57.625], [3721, 62.125], [3732, 18.0], [3738, 76.5], [3746, 19.375], [3748, 28.25], [3750, 13.875], [3779, 66.25], [3786, 50.375], [3796, 37.375], [3805, 28.75], [3816, 55.25], [3845, 51.0], [3846, 0.625], [3864, 52.0], [3880, 36.25], [3892, 61.875], [3895, 29.75], [3902, 58.375], [3933, 27.125], [3938, 56.75], [3940, 60.625], [3954, 42.875], [3961, 60.125], [3974, 55.0], [3976, 1.75], [3980, 28.75], [3990, 24.375], [3997, 47.25], [3998, 123.0], [3999, 16.0], [4001, 26.75], [4005, 45.0], [4012, 68.375], [4014, 38.375], [4015, 33.875], [4023, 39.75], [4042, 7.125], [4047, 32.375], [4048, 28.75], [4091, 73.75], [4097, 51.875], [4106, 26.625], [4120, 56.5], [4125, 22.125], [4151, 19.25], [4161, 67.125], [4162, 40.875], [4163, 27.125], [4164, -3.75], [4185, 23.25], [4193, 27.625], [4195, 42.5], [4197, 12.375], [4198, 27.75], [4201, 29.375], [4206, 65.625], [4227, 68.375], [4240, 35.375], [4244, 59.875], [4246, 5.75], [4252, 27.5], [4267, -7.5], [4271, 14.125], [4275, 17.75], [4297, 3.75], [4307, 52.625], [4337, 35.75], [4352, 56.125], [4365, 19.0], [4380, 37.875], [4382, 56.875], [4399, 15.125], [4405, 67.0], [4415, 67.5], [4417, 50.375], [4436, 23.375], [4441, 79.0], [4453, 32.75], [4469, 54.125], [4474, -14.25], [4491, 66.25], [4500, 31.0], [4503, 48.875], [4517, 24.75], [4538, 37.0], [4588, 76.375], [4589, 43.5], [4602, 47.0], [4606, 13.75], [4631, 61.25], [4640, 46.375], [4649, 30.375], [4651, 72.5], [4665, 26.375], [4690, 65.5], [4703, 35.25], [4706, 20.375], [4724, 26.875], [4750, 25.75], [4752, 45.0], [4763, 52.125], [4773, 23.25], [4778, 17.375], [4789, 28.625], [4804, 24.0], [4809, 69.625], [4813, 52.75], [4822, 28.0], [4839, 24.375], [4841, 3.0], [4858, 60.375], [4878, 48.125], [4899, 16.0], [4916, 44.375], [4923, 56.75], [4929, 33.125], [4954, 54.0], [4955, 29.875], [4971, 74.75], [4985, 44.75], [4999, 47.5], [5000, 46.5], [5003, 49.25], [5006, 35.75], [5017, 46.75], [5021, 16.375], [5043, 32.875], [5055, 56.75], [5062, 25.25], [5064, 59.75], [5074, 59.75], [5075, 36.0], [5081, 36.0], [5101, 48.0], [5103, 2.5], [5119, 40.625], [5137, 28.875], [5138, 24.75], [5142, 5.5], [5151, 25.875], [5152, 5.625], [5164, 41.75], [5207, 42.875], [5209, 40.125], [5226, 83.625], [5229, 85.75], [5235, 66.375], [5246, -19.6875], [5256, 13.5], [5265, 28.625], [5274, 45.625], [5279, 17.875], [5284, 36.0], [5303, 33.25], [5311, 74.125], [5319, 34.5], [5320, -5.375], [5322, 81.5], [5325, 63.875], [5357, 29.25], [5374, 31.75], [5375, 36.75], [5380, 57.75], [5384, 63.625], [5389, 51.75], [5390, 22.625], [5394, 46.375], [5409, 49.625], [5410, 65.0], [5420, 13.375], [5421, 32.375], [5428, -2.125], [5431, 36.5], [5450, 6.75], [5465, 46.75], [5472, 23.375], [5484, 9.625], [5486, 60.5], [5487, 65.625], [5489, 21.125], [5524, 45.25], [5541, 35.75], [5542, 30.625], [5568, 37.75], [5586, 56.625], [5589, 1.625], [5594, 15.5], [5598, 39.875], [5615, 49.875], [5617, 66.625], [5653, 40.625], [5655, 27.5], [5676, 43.125], [5704, 34.125], [5709, 42.375], [5711, 60.0], [5751, 48.875], [5767, 69.625], [5777, 31.375], [5783, 40.0], [5786, 38.0], [5825, 36.75], [5831, 30.0], [5841, 35.25], [5851, 22.5], [5853, 25.375], [5859, 20.75], [5865, 49.0], [5930, 42.5], [5983, 40.5], [6001, 31.0], [6010, 74.75], [6016, 49.875], [6017, 2.0], [6019, 62.125], [6025, 61.875], [6028, 60.125], [6029, 34.125], [6035, 51.25], [6037, 19.0], [6077, 14.5], [6083, 11.5], [6094, 34.375], [6107, 45.25], [6126, 44.875], [6136, 16.25], [6152, 31.75], [6194, 61.625], [6202, 27.25], [6203, 8.625], [6210, 84.5], [6211, 21.75], [6219, 30.75], [6296, 61.875], [6305, 44.75], [6326, 54.625], [6337, 33.875], [6349, 34.5], [6360, 27.875], [6375, 80.5], [6378, -0.125], [6400, 71.375], [6412, 44.75], [6434, -1.5], [6469, 99.0], [6471, 61.5], [6480, 35.5], [6490, 50.75], [6508, 19.125], [6543, 58.125], [6547, 21.25], [6561, 40.5], [6576, 59.875], [6589, 13.875], [6600, 48.75], [6604, 26.0], [6613, 35.25], [6621, 56.125], [6625, 29.75], [6626, 81.5], [6636, 2.0], [6645, 32.5], [6684, 52.75], [6688, 27.0], [6689, 10.125], [6705, 68.125], [6720, 49.0], [6736, 31.25], [6749, 26.75], [6752, -1.75], [6760, 72.25], [6769, 21.625], [6771, 70.75], [6778, 19.0], [6786, 40.75], [6789, 48.0], [6803, 80.375], [6861, 18.0], [6866, 43.75], [6869, 25.625], [6872, 32.875], [6877, 63.25], [6884, 53.25], [6888, 61.0], [6889, 32.25], [6898, 64.625], [6993, 36.625], [7011, 27.125], [7013, 15.375], [7016, 24.75], [7027, 41.625], [7035, 34.625], [7045, 63.375], [7046, 46.0], [7049, 48.5], [7068, 57.375], [7072, 6.75], [7085, -20.125], [7090, 29.25], [7097, 21.75], [7101, 29.0], [7102, 67.0], [7109, 20.25], [7132, 31.5], [7139, 56.5], [7141, 61.25], [7144, -2.25], [7152, 37.5], [7167, 2.125], [7170, 78.125], [7185, 16.75], [7186, 57.5], [7202, 66.625], [7207, -9.5], [7211, 46.25], [7227, 5.25], [7236, -10.625], [7250, 15.375], [7257, 8.75], [7274, 22.75], [7278, 47.0], [7280, 6.5], [7281, 14.25], [7290, -2.25], [7298, 5.375], [7299, 47.625], [7302, 48.875], [7306, -18.75], [7318, 29.5], [7321, 59.625], [7330, 45.625], [7334, 25.625], [7336, 47.375], [7341, 101.75], [7344, 26.5], [7347, 22.5], [7361, 15.875], [7369, 56.0], [7397, 49.0], [7408, 44.5], [7427, 3.0], [7430, 26.625], [7439, 77.125], [7453, 24.5], [7473, -0.25], [7478, 55.375], [7488, 31.625], [7503, 49.25], [7518, 34.625], [7544, 47.375], [7552, 36.125], [7576, 28.5], [7577, 42.375], [7597, 40.0], [7605, 25.25], [7616, 51.5], [7620, -0.875], [7656, 56.875], [7659, 50.125], [7681, 0.125], [7692, 58.75], [7710, 16.125], [7713, 14.875], [7722, 48.875], [7723, 74.0], [7742, 27.0], [7743, 22.125], [7750, 19.0], [7790, 49.125], [7801, -7.125], [7811, -28.375], [7815, 56.0], [7843, -22.125], [7844, 71.5], [7857, 36.0], [7868, 16.75], [7877, 22.25], [7887, 30.75], [7897, 49.75], [7902, 93.5], [7910, 30.0], [7912, 16.5], [7918, 62.75], [7933, 49.0], [7936, 74.5], [7951, 36.25], [7953, 51.875], [7957, 17.875], [7962, 38.375], [7971, 10.0], [7974, 11.875], [7991, 67.5], [8000, 31.875], [8008, 48.75], [8018, 37.75], [8024, 11.125], [8047, -5.25], [8060, 5.25], [8077, 15.0], [8086, 36.375], [8104, 45.375], [8118, 23.0], [8133, 27.875], [8138, 34.0], [8145, 50.125], [8150, 41.125], [8168, 87.625], [8170, 47.875], [8173, 38.5], [8175, 16.75], [8194, 48.625], [8211, 4.125], [8253, 28.25], [8262, -17.875], [8263, 58.875], [8265, 75.375], [8268, 53.625], [8271, 25.0], [8272, 57.625], [8273, -3.625], [8277, 36.25], [8292, 46.875], [8344, 32.125], [8346, 30.5], [8350, 36.875], [8364, 55.875], [8369, 12.625], [8370, 23.125], [8385, 61.625], [8389, 20.5], [8421, 3.75], [8442, 42.75], [8453, 40.375], [8458, 7.375], [8466, 85.375], [8478, 73.375], [8483, 12.875], [8487, 13.0], [8501, 56.75], [8505, 28.625], [8509, 55.25], [8534, -2.875], [8539, 14.875], [8556, 48.5], [8566, -4.875], [8577, 23.375], [8583, 9.375], [8600, 58.125], [8615, 38.625], [8624, 73.125], [8630, 18.125], [8645, 35.375], [8658, 35.0], [8660, 31.625], [8667, 22.0], [8672, 36.0], [8676, 49.5], [8687, 61.5], [8689, 32.5], [8692, 48.625], [8697, 6.125], [8699, 50.375], [8707, 75.875], [8722, 48.0], [8726, 74.375], [8727, 57.5], [8736, 18.25], [8737, 25.5], [8752, 45.5], [8760, 29.375], [8776, 59.625], [8793, -2.0], [8794, -2.0], [8797, 50.25], [8806, 49.0], [8812, 23.125], [8820, 66.5], [8830, 56.625], [8852, 23.0], [8877, 23.125], [8885, 84.75], [8891, 16.875], [8929, 61.0], [8936, 24.625], [8938, 58.5], [8954, 58.0], [8967, -7.625], [8975, 58.0], [8985, 15.0], [8989, 47.625], [8999, 29.25], [9002, 34.0], [9014, 52.75], [9025, 30.0], [9034, 5.375], [9052, 37.625], [9059, 27.75], [9063, 10.625], [9084, 50.375], [9086, 4.125], [9088, 39.5], [9123, 61.875], [9130, 37.75], [9144, 33.0], [9167, 45.5], [9182, 39.625], [9184, 20.5], [9198, 38.25], [9218, 38.125], [9231, 8.125], [9237, 25.625], [9239, 23.875], [9244, 49.25], [9256, 31.75], [9257, 31.625], [9261, 61.25], [9267, 60.75], [9269, 33.5], [9297, 70.0], [9300, 15.0], [9305, 63.625], [9327, 49.625], [9337, 61.375], [9340, 27.25], [9341, 30.5], [9355, 37.375], [9360, 2.625], [9366, 0.875], [9369, 52.25], [9377, 27.875], [9380, 32.5], [9381, 40.0], [9385, 37.5], [9403, 78.375], [9406, 40.0], [9409, 28.75], [9419, 10.625], [9420, 26.875], [9423, 45.5], [9447, 55.375], [9450, 51.25], [9467, 25.25], [9475, 47.375], [9485, 39.5], [9502, 24.75], [9504, 4.125], [9518, 62.0], [9523, 46.5], [9536, -5.75], [9559, 14.0], [9563, 65.75], [9576, 45.375], [9594, 14.75], [9611, 10.875], [9613, 66.5], [9621, 50.0], [9633, 27.5], [9655, 1.75], [9658, 43.625], [9667, 42.125], [9672, 37.375], [9681, 31.5], [9684, 31.5], [9687, 27.5], [9688, 39.5], [9693, 12.25], [9698, 20.875], [9702, 41.0], [9713, 34.25], [9716, 35.75], [9721, 43.875], [9726, 13.375], [9736, 68.25], [9762, 40.375], [9772, 61.625], [9776, 56.375], [9781, 42.625], [9783, 59.75], [9809, 58.5], [9833, 31.5], [9837, 50.625], [9853, 42.625], [9856, 13.75], [9857, 29.25], [9863, 72.75], [9872, 22.5], [9894, 59.75], [9899, 18.25], [9919, 71.25], [9936, 37.25], [9947, 39.625], [9949, 45.75], [9952, 35.375], [9958, 50.125], [9979, 42.125], [9998, 39.5], [10005, 38.75], [10015, 52.125], [10053, 44.5], [10096, 67.875], [10108, 77.625], [10114, 19.75], [10122, 103.0], [10126, 3.625], [10145, 4.875], [10159, 16.25], [10166, 68.5], [10181, 79.0], [10184, 31.25], [10190, 96.5], [10197, 24.25], [10217, 5.0], [10218, 49.25], [10219, 53.875], [10224, 82.75], [10234, 40.0], [10244, 71.5], [10258, 70.375], [10330, 40.875], [10340, 6.0], [10352, 25.75], [10367, 41.0], [10372, 11.375], [10376, 58.0], [10377, 16.25], [10390, 21.5], [10419, -14.0], [10422, 22.25], [10434, 11.75], [10439, 54.125], [10445, 40.875], [10448, 70.0], [10471, 65.0], [10493, 12.5], [10500, 38.25], [10517, 52.25], [10527, 17.625], [10561, 48.875], [10569, 23.625], [10576, 65.0], [10577, 40.25], [10598, 62.375], [10609, 71.5], [10635, 31.875], [10637, 70.0], [10640, 67.625], [10654, 36.375], [10660, 43.0], [10662, 7.5], [10664, 40.875], [10667, 68.25], [10668, -13.0], [10672, 32.625], [10679, 59.875], [10687, 28.0], [10690, 43.25], [10692, 62.875], [10693, 82.75], [10699, 53.0], [10710, 36.5], [10715, 38.25], [10719, 28.25], [10730, 31.0], [10735, 36.375], [10742, -28.625], [10746, 21.0], [10750, 75.75], [10753, 19.5], [10754, 41.875], [10758, 7.75], [10766, 77.25], [10768, 15.5], [10773, 50.375], [10780, 21.625], [10785, 62.875], [10789, 15.625], [10798, 55.125], [10817, 42.125], [10821, 52.5], [10822, 67.0], [10862, 21.375], [10863, 54.5], [10866, 43.0], [10889, 53.5], [10924, 46.625], [10944, 63.25], [10955, 64.125], [10966, 51.5], [10969, 52.25], [10978, 22.75], [10979, 1.5], [10987, 29.875], [10999, 38.875], [11025, 14.75], [11026, 59.5], [11031, 41.25], [11034, 68.875], [11048, 22.25], [11050, 56.5], [11053, 10.5], [11055, 45.875], [11056, 36.5], [11057, 9.0], [11067, 34.625], [11069, 35.0], [11072, 72.625], [11074, 31.375], [11085, 61.5], [11111, 15.375], [11112, 52.625], [11123, 60.0], [11149, 83.5], [11185, 37.875], [11221, 27.125], [11250, 16.875], [11266, 55.875], [11279, 26.375], [11280, -18.5625], [11312, 22.0], [11320, 39.75], [11327, 21.125], [11331, 7.875], [11351, 20.0], [11359, 59.875], [11360, 35.5], [11362, 30.25], [11386, 20.375], [11391, 58.5], [11393, 8.25], [11428, 53.625], [11436, 46.625], [11446, 54.125], [11460, 49.0], [11462, 21.75], [11465, 64.0], [11478, 46.625], [11495, 63.625], [11497, 29.0], [11500, 29.625], [11522, 40.625], [11523, 38.25], [11526, 74.75], [11533, 78.25], [11539, 32.625], [11540, 59.5], [11543, 31.0], [11548, 53.875], [11570, 25.375], [11572, 67.625], [11584, 29.125], [11597, 0.125], [11605, 25.875], [11622, 39.0], [11637, 15.0], [11650, 54.25], [11657, 7.0], [11665, 28.875], [11668, 46.875], [11686, 27.875], [11720, 34.125], [11721, 40.75], [11741, 67.625], [11755, 71.5], [11756, 71.75], [11764, -25.8125], [11819, 66.75], [11828, 43.75], [11842, 51.375], [11861, -0.375], [11871, 46.0], [11880, 28.75], [11903, 4.0], [11905, 75.375], [11939, 28.375], [11940, 64.875], [11941, 85.25], [11963, 56.375], [11964, 75.75], [11970, 25.0], [11983, -12.375], [11992, 62.375], [12020, 69.0], [12042, 32.0], [12051, 65.625], [12069, 55.0], [12075, 58.625], [12102, 35.0], [12106, 18.25], [12150, 25.625], [12158, 40.875], [12161, -52.75], [12164, 18.375], [12165, 61.25], [12172, 3.0], [12181, 35.75], [12192, 37.875], [12193, 60.0], [12205, 28.875], [12207, 56.25], [12214, 62.25], [12219, 32.0], [12224, 21.625], [12225, 60.0], [12229, 22.5], [12237, 34.625], [12238, 26.125], [12253, 42.25], [12257, 65.625], [12259, 41.875], [12262, 30.75], [12266, 69.5], [12300, 16.5], [12309, 47.75], [12344, 43.25], [12351, 7.375], [12352, 19.875], [12354, 74.25], [12357, 59.625], [12359, 30.75], [12361, 2.875], [12362, 42.875], [12370, -26.125], [12384, 44.0], [12397, 12.25], [12411, 56.0], [12428, 67.625], [12436, 31.375], [12455, 55.0], [12467, 22.875], [12481, 53.125], [12482, 2.0], [12499, -12.0], [12505, 50.75], [12527, 20.625], [12546, 77.0], [12559, 40.375], [12578, 82.875], [12583, 46.75], [12584, 52.125], [12601, 55.0], [12609, 29.875], [12610, 49.5], [12614, 46.125], [12620, 63.25], [12626, 12.75], [12647, 56.875], [12669, 45.875], [12676, 52.25], [12700, 45.5], [12703, 9.25], [12706, 22.5], [12711, -17.125], [12716, 71.875], [12739, 53.25], [12766, 33.75], [12779, 29.25], [12812, 14.875], [12820, 55.5], [12823, 28.625], [12826, 38.875], [12857, 13.75], [12866, 9.25], [12893, 17.25], [12907, 3.875], [12940, 44.0], [12944, 44.625], [12946, 54.0], [12954, 44.375], [12958, 49.625], [12960, 6.0], [12972, -0.5], [13005, -5.25], [13008, -2.25], [13019, 28.875], [13022, 45.75], [13041, 36.625], [13044, 41.25], [13048, 38.875], [13060, -12.0], [13066, 11.375], [13069, 47.125], [13081, 41.0], [13086, 48.75], [13091, 64.375], [13098, 7.125], [13100, 31.375], [13104, 26.375], [13112, 46.75], [13127, 23.5], [13136, 19.375], [13154, 5.5], [13162, 31.375], [13195, 3.125], [13214, 22.5], [13225, 68.25], [13233, 61.625], [13244, 90.625], [13253, 55.5], [13259, 67.625], [13268, 51.375], [13270, 25.375], [13273, 48.625], [13290, 45.0], [13300, 44.375], [13305, 51.5], [13312, 39.0], [13353, 53.5], [13357, 22.75], [13359, 74.75], [13386, 32.0], [13390, 14.25], [13425, 9.125], [13426, 20.5], [13437, 40.375], [13449, 35.5], [13455, 49.125], [13468, -0.625], [13471, 26.0], [13494, 52.75], [13495, -7.25], [13496, 26.25], [13515, -14.25], [13517, 32.75], [13526, 36.375], [13546, -15.9375], [13567, 38.375], [13575, -4.125], [13583, 41.375], [13586, 3.25], [13594, 62.75], [13596, 53.25], [13598, 55.75], [13613, 33.625], [13616, 22.5], [13633, 8.75], [13639, 61.125], [13654, 48.5], [13671, 63.25], [13693, 55.25], [13697, 2.0], [13706, 27.25], [13723, 37.375], [13730, 48.375], [13735, 7.25], [13751, 3.5], [13765, 13.25], [13775, 51.875], [13789, 18.375], [13790, 70.75], [13792, 83.125], [13814, 47.75], [13821, 24.75], [13823, -30.8125], [13838, 38.5], [13843, 39.75], [13866, 52.0], [13868, 32.75], [13870, 30.25], [13874, 25.625], [13887, 4.625], [13891, 31.125], [13895, 59.125], [13901, 18.625], [13931, 17.125], [13950, 58.375], [13952, 47.75], [13957, 76.0], [13964, 81.125], [13968, 31.5], [13970, 65.875], [13974, 43.125], [13976, 31.625], [13978, -10.375], [14000, 33.5], [14004, 49.125], [14005, 62.0], [14006, 19.625], [14017, 50.75], [14030, 15.0], [14037, 25.75], [14054, -23.625], [14068, 42.625], [14080, 35.5], [14083, 57.375], [14084, 18.25], [14092, 12.75], [14103, 5.375], [14109, 2.375], [14132, 40.625], [14157, 78.0], [14165, 91.0], [14172, 21.75], [14180, 50.125], [14203, 57.875], [14207, 52.5], [14210, 64.5], [14248, 62.25], [14260, 83.125], [14273, 38.375], [14279, 34.625], [14282, 9.75], [14283, 84.0], [14285, 7.625], [14291, -2.0], [14294, 66.75], [14304, 71.25], [14312, 10.25], [14319, 50.0], [14326, 34.75], [14358, 11.125], [14373, 35.375], [14380, 29.125], [14385, 40.375], [14417, 60.0], [14421, -1.0], [14424, 39.125], [14429, 49.375], [14433, -1.75], [14441, 64.625], [14456, 31.0], [14458, 31.25], [14475, 22.0], [14524, 49.25], [14531, 48.0], [14532, 44.875], [14551, 34.25], [14556, 67.75], [14566, 53.875], [14567, 17.75], [14574, 33.75], [14576, 80.875], [14597, 60.25], [14603, 34.5], [14622, 52.25], [14664, 38.75], [14665, 46.5], [14668, 44.875], [14670, 61.75], [14671, 29.5], [14676, 36.25], [14682, 54.25], [14686, 47.75], [14688, 68.125], [14694, 51.375], [14701, 31.0], [14717, 64.875], [14743, -10.875], [14744, 55.125], [14750, 28.25], [14764, 46.625], [14770, 19.375], [14779, 29.5], [14784, 16.75], [14787, 14.125], [14803, 28.5], [14805, 48.375], [14808, 31.125], [14821, 40.625], [14823, 26.5], [14825, 22.0], [14831, 21.875], [14833, 30.0], [14851, 26.875], [14866, -13.0], [14899, 12.875], [14901, 56.75], [14911, 5.25], [14914, 34.375], [14921, 56.75], [14944, 36.25], [14947, 52.5], [14949, 18.75], [14951, 56.75], [14953, 61.0], [14959, 33.25], [14962, 50.625], [14970, 66.0], [14974, 20.75], [14997, 19.75], [15000, 74.25], [15001, 36.0], [15003, 66.375], [15006, 28.5], [15019, 56.75], [15024, 18.125], [15028, 76.25], [15032, 54.25], [15045, 52.75], [15054, -11.375], [15069, 54.875], [15070, 36.5], [15095, 20.5], [15118, 30.5], [15133, 22.25], [15142, 58.25], [15143, 22.25], [15164, 53.75], [15172, 15.0], [15182, -12.75], [15185, 45.125], [15197, 26.25], [15204, 41.75], [15214, 21.375], [15236, 14.875], [15242, 51.75], [15247, 25.0], [15251, 52.0], [15257, 21.25], [15316, 65.25], [15334, 34.0], [15336, 42.875], [15344, -15.5], [15366, 17.875], [15373, 49.5], [15380, 2.75], [15382, 43.25], [15412, 24.75], [15416, 53.0], [15434, 54.25], [15436, 15.875], [15441, 85.375], [15444, 63.625], [15457, 66.75], [15465, 58.375], [15475, 6.5], [15496, 40.25], [15500, 50.125], [15522, 33.875], [15529, 48.125], [15531, 44.5], [15562, 52.5], [15565, 16.5], [15569, 45.25], [15576, 33.25], [15594, 53.125], [15597, 24.75], [15614, 59.125], [15627, 35.0], [15640, 33.375], [15664, 73.375], [15667, -15.875], [15679, 10.75], [15680, 49.375], [15698, 44.375], [15730, 52.375], [15731, 22.75], [15745, 53.0], [15759, -10.75], [15766, 19.0], [15791, 26.75], [15801, 64.75], [15808, 32.875], [15822, 24.25], [15834, 62.125], [15838, 47.375], [15844, 45.0], [15850, 15.5], [15862, 18.375], [15872, 38.75], [15887, 25.0], [15931, 58.75], [15942, -10.25], [15945, 25.5], [15955, 72.25], [16000, 40.875], [16042, -2.625], [16043, 6.625], [16060, 1.125], [16063, 63.75], [16073, 63.625], [16076, 79.25], [16078, 21.5], [16140, -9.0], [16164, 49.375], [16165, 14.125], [16169, 28.0], [16210, 66.125], [16225, 28.75], [16262, 37.375], [16269, 58.0], [16277, 64.375], [16282, 15.75], [16295, 72.375], [16312, 5.75], [16316, 47.0], [16328, 29.875], [16346, 34.375], [16389, 25.375], [16434, 32.75], [16472, 53.75], [16474, 54.875], [16489, 61.75], [16502, 59.875], [16531, 60.625], [16532, 67.125], [16539, 38.75], [16541, 36.25], [16571, 28.125], [16572, 59.5], [16580, 93.0], [16582, 43.25], [16598, -46.75], [16605, 25.0], [16606, 24.0], [16619, 25.0], [16643, -10.75], [16657, -20.9375], [16659, 28.875], [16671, 29.125], [16737, 72.125], [16743, 38.25], [16759, 75.0], [16765, 30.5], [16768, 74.75], [16769, 58.25], [16773, 17.125], [16777, 50.25], [16790, -15.8125], [16804, 59.75], [16831, 27.5], [16851, 36.625], [16854, 55.875], [16868, 14.25], [16882, 45.625], [16891, 88.5], [16919, 37.375], [16937, 61.25], [16938, 43.25], [16941, 59.375], [16965, 55.75], [16977, 16.625], [16982, 52.625], [16987, 21.625], [17002, 9.5], [17018, 74.125], [17020, 31.25], [17030, -6.75], [17044, 46.375], [17049, 45.25], [17077, 46.625], [17101, 38.75], [17115, 32.375], [17135, 10.875], [17154, 65.0], [17160, 38.875], [17171, 46.875], [17172, 36.125], [17193, 60.5], [17216, 72.875], [17229, 33.25], [17251, 4.625], [17278, 36.5], [17279, 25.625], [17322, 88.75], [17325, 29.625], [17346, 73.375], [17364, 3.25], [17392, 71.375], [17394, 16.5], [17395, 56.5], [17397, -21.25], [17403, 59.0], [17405, 50.75], [17408, 0.375], [17420, 17.0], [17431, 86.125], [17443, 78.25], [17447, 12.625], [17463, 16.875], [17482, 0.375], [17509, 6.0], [17527, 35.25], [17536, 20.25], [17540, 35.0], [17551, 28.25], [17552, 34.25], [17553, 55.75], [17554, 31.5], [17563, 33.75], [17564, 33.25], [17574, 70.125], [17577, 59.5], [17589, 22.25], [17610, 36.5], [17618, 33.125], [17637, 74.25], [17650, 43.25], [17661, 19.875], [17664, 38.5], [17668, 75.875], [17687, 58.125], [17723, 43.0], [17745, 61.625], [17755, 7.25], [17756, 4.0], [17757, 33.25], [17766, 31.625], [17777, 21.25], [17780, 25.5], [17794, 37.0], [17795, 10.25], [17805, 25.375], [17824, 28.375], [17854, 39.5], [17860, 92.625], [17870, 39.0], [17874, 49.625], [17893, 4.5], [17899, 18.75], [17912, 59.5], [17922, 64.25], [17929, 15.625], [17933, 33.5], [17938, 91.875], [17963, 11.875], [17974, -5.5], [18006, 29.625], [18019, 95.5], [18030, 46.125], [18033, 17.875], [18040, 54.875], [18073, 5.375], [18086, 19.375], [18102, 18.125], [18129, 17.75], [18130, 70.5], [18132, 66.875], [18138, 68.125], [18164, -27.625], [18206, 63.875], [18218, 84.625], [18225, 7.25], [18242, 59.5], [18266, -15.625], [18275, 42.625], [18283, 26.75], [18285, 21.875], [18299, 56.125], [18318, 26.875], [18322, 23.75], [18335, 37.875], [18346, 36.125], [18352, -0.5], [18355, 14.625], [18358, 51.375], [18359, 62.125], [18380, 54.875], [18395, 8.125], [18400, 36.25], [18406, 48.875], [18418, 10.375], [18419, 24.625], [18424, 37.75], [18432, 60.625], [18433, 38.875], [18434, 22.375], [18442, 34.375], [18470, 40.625], [18472, 50.125], [18493, 23.75], [18499, 51.5], [18500, 20.875], [18502, 15.125], [18518, 23.25], [18524, 69.875], [18532, 33.125], [18564, 57.75], [18565, 33.875], [18568, 77.5], [18578, -10.0], [18588, 77.125], [18589, 38.5], [18603, 41.0], [18628, 19.75], [18641, 39.25], [18642, -38.8125], [18651, 39.5], [18662, 13.25], [18663, 47.375], [18685, 40.5], [18718, 23.25], [18731, -3.125], [18735, 51.0], [18741, 23.0], [18759, 64.625], [18760, 65.0], [18780, 34.25], [18791, 39.125], [18815, 47.25], [18816, 67.125], [18840, 51.75], [18854, 14.5], [18867, 44.875], [18873, 31.75], [18884, 21.125], [18885, 21.25], [18890, 61.125], [18900, 61.5], [18907, 16.125], [18911, 70.875], [18914, 3.75], [18918, -13.875], [18924, 61.0], [18927, 33.25], [18934, 54.0], [18939, 11.5], [18940, 45.875], [18945, 5.0], [18947, 44.875], [18958, 30.375], [18972, 34.375], [18977, 54.875], [18987, 34.5], [19008, 56.125], [19009, 43.875], [19044, 15.75], [19051, 49.0], [19054, 11.375], [19070, 72.625], [19071, 38.625], [19072, 55.75], [19074, 25.25], [19078, 56.75], [19082, -15.875], [19090, 48.875], [19097, 51.0], [19110, 68.0], [19123, -7.625], [19139, 40.375], [19147, 22.75], [19160, 40.5], [19200, 64.5], [19216, 46.875], [19222, 14.375], [19262, 75.75], [19264, 40.375], [19273, 20.75], [19287, 28.25], [19290, 47.0], [19316, 75.25], [19342, 31.75], [19347, 38.625], [19363, 28.25], [19364, 36.0], [19378, 60.625], [19385, 86.25], [19386, 16.875], [19394, 27.625], [19396, 16.5], [19400, 58.5], [19401, 59.5], [19407, 54.125], [19416, 8.75], [19417, -35.6875], [19422, 32.5], [19434, 38.125], [19437, 0.625], [19454, 26.0], [19459, 85.125], [19460, 23.875], [19476, 3.0], [19494, -3.0625], [19497, 54.375], [19499, 55.75], [19500, 38.5], [19519, -7.5], [19536, 43.25], [19547, 85.0], [19552, 25.0], [19553, 50.75], [19554, 10.25], [19562, 49.25], [19592, 47.5], [19607, 30.625], [19612, 25.75], [19617, 29.125], [19645, 46.375], [19657, 42.125], [19671, 2.0], [19677, 66.875], [19682, 2.625], [19683, 47.125], [19696, 38.125], [19699, 36.25], [19710, 56.0], [19712, 44.125], [19718, 27.625], [19726, 23.75], [19727, 60.0], [19731, 38.75], [19740, 5.25], [19746, 6.0], [19753, 25.0], [19781, 71.0], [19806, 60.625], [19810, 60.75], [19811, 69.875], [19839, -2.5], [19852, 21.25], [19866, 36.5], [19872, 39.25], [19921, 23.625], [19928, 59.625], [19953, 33.375], [19966, 20.5], [19985, 47.875], [19988, 31.125], [19995, 30.0], [20003, 73.625], [20018, 41.625], [20035, 83.0], [20057, 27.5], [20066, 65.75], [20078, 45.5], [20082, 39.75], [20089, 51.875], [20110, 57.875], [20116, 37.875], [20131, 54.75], [20150, 52.5], [20152, 57.375], [20157, 108.5], [20160, 0.0], [20174, 28.25], [20187, 49.25], [20211, 34.625], [20222, 67.625], [20236, 66.75], [20237, 44.875], [20253, 47.5], [20258, 77.875], [20274, 25.375], [20297, 48.0], [20301, 2.625], [20306, 25.625], [20307, 49.125], [20316, 44.125], [20325, 33.5], [20350, 21.875], [20361, 55.5], [20369, 18.0], [20371, 3.25], [20382, 64.75], [20385, 37.25], [20386, 65.625], [20393, 22.5], [20402, 50.625], [20420, 53.125], [20442, 43.5], [20466, 22.5], [20468, 29.5], [20471, 18.875], [20487, 55.0], [20488, 26.75], [20490, 51.75], [20503, 63.875], [20506, 32.75], [20508, -3.375], [20520, 55.75], [20533, 27.125], [20537, 4.5], [20558, 80.25], [20568, 35.625], [20571, 28.875], [20576, -2.25], [20601, 44.5], [20603, -28.375], [20609, 17.75], [20644, 49.375], [20646, 30.75], [20652, 70.375], [20678, 38.0], [20723, 66.0], [20724, 62.0], [20728, 43.0], [20742, 31.5], [20744, 27.375], [20752, 75.0], [20764, 20.625], [20769, 41.875], [20778, 58.25], [20788, 38.0], [20789, 37.0], [20796, 65.25], [20797, 65.625], [20815, 44.5], [20853, 48.25], [20875, 43.625], [20884, 61.125], [20897, 39.5], [20932, 21.625], [20958, 7.5], [20969, 69.0], [20970, 8.25], [21017, 29.25], [21018, -23.75], [21026, 12.0], [21054, -20.75], [21062, 38.875], [21064, 52.0], [21073, 32.625], [21074, 28.5], [21125, 49.75], [21138, 42.5], [21145, 10.5], [21147, 42.125], [21170, -5.0], [21183, -9.0], [21184, 21.125], [21185, 53.625], [21206, 34.875], [21207, 34.0], [21210, 27.375], [21220, 19.625], [21229, 53.0], [21240, 85.375], [21245, 25.75], [21246, 61.625], [21248, 51.125], [21271, 30.625], [21276, 70.25], [21293, 38.375], [21294, 53.625], [21309, 74.5], [21331, 16.625], [21332, 25.125], [21333, 52.0], [21337, 27.375], [21341, 41.5], [21342, -8.0], [21344, 78.625], [21347, 21.625], [21361, 28.875], [21370, 26.0], [21418, 97.75], [21431, 77.75], [21446, 16.0], [21452, 19.0], [21507, 39.25], [21549, 22.0], [21557, 39.75], [21562, 72.25], [21565, 61.25], [21570, 14.75], [21575, 40.875], [21578, 37.125], [21593, 50.75], [21596, 16.125], [21600, 44.5], [21605, 47.75], [21610, 30.125], [21633, 35.5], [21635, 25.25], [21643, 57.125], [21656, 31.375], [21667, 40.25], [21671, -25.5], [21683, 2.5], [21694, -18.375], [21705, 39.875], [21706, 13.5], [21710, 34.5], [21723, 9.25], [21733, 62.625], [21762, 30.875], [21797, 18.5], [21803, 26.375], [21827, 67.375], [21830, -5.0], [21836, 20.125], [21837, 27.25], [21846, 70.125], [21855, 75.5], [21856, 36.125], [21859, -17.3125], [21884, 25.5], [21894, 74.0], [21895, 46.875], [21910, 47.75], [21952, 36.0], [21960, 29.25], [21965, 16.625], [21973, 49.0], [21984, 45.0], [21988, 43.875], [21997, 51.875], [21999, 35.25]]}

wandb/run-20250502_045804-vkih00cc/files/media/table/eval/table_2750_d02dcfe33f3ee8ea2f99.table.json

@@ -0,0 +1 @@
+{"columns": ["data_index", "value"], "data": [[22, 62.625], [86, 26.25], [101, 23.5], [105, -4.375], [110, -5.125], [121, 27.75], [124, 39.25], [135, 30.375], [136, 30.625], [138, 23.75], [160, 56.25], [166, 19.25], [177, 35.0], [180, 37.75], [196, 6.125], [208, 38.625], [226, 29.5], [245, -8.875], [258, 12.25], [259, 73.0], [266, 37.125], [273, 13.5], [275, 31.5], [277, 43.25], [288, 29.5], [324, 25.0], [327, 24.625], [339, 13.875], [340, 15.125], [369, -3.375], [400, 41.25], [402, 12.625], [432, 32.375], [438, 23.125], [440, 43.125], [446, 61.625], [458, 29.25], [461, 18.125], [494, 20.875], [500, 41.75], [503, 40.25], [507, 20.625], [511, 43.5], [525, 38.5], [534, 29.25], [538, 1.875], [543, 22.625], [563, 49.25], [567, 33.0], [569, 42.375], [575, 30.25], [591, 14.25], [594, 4.625], [602, 50.875], [609, 3.0], [620, -8.625], [625, 21.75], [679, 48.875], [687, 62.0], [700, 42.75], [716, 23.0], [725, 10.5], [736, 29.625], [740, 52.125], [757, 60.875], [758, 6.375], [769, 26.0], [795, 45.625], [804, 11.75], [806, -13.375], [816, 63.375], [821, 32.0], [831, 16.125], [842, 18.5], [849, 30.375], [862, 14.875], [889, 26.5], [896, 31.875], [903, 14.75], [930, 2.0], [937, 18.25], [940, 34.0], [945, 33.5], [993, 22.25], [999, -24.625], [1014, 26.625], [1043, 11.25], [1045, 35.125], [1062, 34.125], [1064, 33.875], [1066, 55.75], [1069, 25.0], [1077, 43.75], [1082, 30.375], [1099, -5.5], [1100, -11.75], [1108, 40.25], [1122, 24.375], [1136, 6.625], [1143, 29.625], [1147, 29.875], [1151, 54.625], [1166, 59.25], [1172, 18.125], [1185, 15.0], [1186, 37.25], [1195, 35.0], [1196, -0.75], [1225, 53.0], [1232, 27.0], [1233, 25.75], [1239, 29.375], [1247, 27.125], [1280, 51.25], [1285, 13.75], [1286, 61.625], [1289, 25.75], [1304, 36.875], [1313, 29.875], [1324, 57.375], [1327, 19.25], [1329, 18.75], [1340, 43.875], [1350, 12.75], [1357, 24.0], [1392, 8.125], [1394, 40.625], [1415, 49.75], [1421, 18.5], [1435, 23.0], [1450, 12.5], [1488, 47.75], [1489, 7.0], [1509, -6.625], [1526, 13.0], [1530, 13.25], [1551, 66.5], [1557, 38.875], [1558, 62.0], [1565, 24.5], [1580, 55.875], [1583, 19.75], [1588, 60.25], [1660, 60.5], [1675, 30.75], [1684, 14.875], [1694, 47.25], [1696, 29.75], [1703, 17.375], [1705, 40.5], [1755, 8.375], [1762, 47.75], [1764, 20.0], [1788, 49.75], [1796, -6.625], [1811, 34.375], [1814, 67.0], [1830, 34.5], [1834, -11.25], [1836, 24.75], [1851, 4.5], [1852, 42.375], [1870, 6.0], [1871, -8.5], [1889, 18.0], [1898, 31.25], [1907, 16.125], [1914, 51.375], [1915, 49.125], [1916, 27.125], [1918, 1.125], [1925, -17.25], [1927, 68.75], [1928, 45.625], [1970, 57.125], [1995, 19.75], [2002, 16.25], [2016, 63.125], [2019, 10.25], [2020, 21.5], [2083, 24.125], [2120, 45.25], [2135, 46.75], [2146, 27.25], [2153, 45.0], [2195, 22.875], [2203, 29.375], [2226, 58.5], [2231, -1.875], [2253, 8.5], [2254, 21.25], [2269, 1.25], [2275, 41.0], [2290, 46.625], [2303, 46.875], [2311, 46.875], [2312, 45.625], [2347, 8.625], [2357, 35.875], [2368, 52.625], [2369, 25.375], [2376, 85.5], [2380, 5.125], [2414, 36.125], [2425, 8.25], [2454, 40.875], [2462, 51.5], [2481, 22.625], [2483, 24.625], [2485, -8.75], [2490, -18.1875], [2492, 27.25], [2499, 11.75], [2508, 9.375], [2523, 9.25], [2533, 14.25], [2544, 53.25], [2584, 63.375], [2591, 25.25], [2628, 35.25], [2630, -16.0], [2634, 9.375], [2662, 10.625], [2669, -2.875], [2686, 40.25], [2688, 8.0], [2711, 25.0], [2725, 32.625], [2731, 26.75], [2734, 28.625], [2738, 27.375], [2745, -19.0], [2769, 21.25], [2778, 1.125], [2786, 35.125], [2808, 91.0], [2818, 1.0], [2820, 29.625], [2822, 63.875], [2834, 69.25], [2843, 65.125], [2851, 50.25], [2866, -5.0], [2892, 25.25], [2922, 23.25], [2926, 53.875], [2935, 17.875], [2950, 18.25], [2960, 19.75], [2965, 10.5], [2970, 6.5], [2984, 73.875], [2988, 8.5], [2994, 57.625], [3006, 31.125], [3017, 22.625], [3020, 12.125], [3058, 26.875], [3061, 49.75], [3064, 33.125], [3073, 48.875], [3092, 11.0], [3108, 54.0], [3118, 21.75], [3138, 30.375], [3144, 53.5], [3149, 70.125], [3153, 21.0], [3154, 28.0], [3157, 17.375], [3165, 26.0], [3166, 23.625], [3171, 28.5], [3181, 65.0], [3196, 10.75], [3230, 36.0], [3233, 51.875], [3244, 63.25], [3265, 37.875], [3268, 34.125], [3283, 14.875], [3296, -16.0], [3298, 35.5], [3307, 44.75], [3321, 34.25], [3353, -2.375], [3362, 49.5], [3368, 28.125], [3375, 27.625], [3393, 24.125], [3395, 30.5], [3400, 29.25], [3401, 18.625], [3423, 54.375], [3429, -1.25], [3434, -3.25], [3447, 63.5], [3456, 21.75], [3479, 30.5], [3484, 26.0], [3574, 39.75], [3581, 59.75], [3587, -8.125], [3604, 57.25], [3629, 0.0], [3643, 38.25], [3648, 34.0], [3657, 6.5], [3662, 20.125], [3695, 40.125], [3697, 28.875], [3699, 12.125], [3703, 41.875], [3721, 40.625], [3732, 5.5], [3738, 66.75], [3746, 20.5], [3748, 22.75], [3750, 16.75], [3779, 54.875], [3786, 37.875], [3796, 33.0], [3805, 19.75], [3816, 42.75], [3845, 39.125], [3846, -0.75], [3864, 42.125], [3880, 30.5], [3892, 44.25], [3895, 32.5], [3902, 43.0], [3933, 19.5], [3938, 40.0], [3940, 25.125], [3954, 46.25], [3961, 65.0], [3974, 50.75], [3976, -1.75], [3980, 21.5], [3990, 6.5], [3997, 34.375], [3998, 101.5], [3999, 13.75], [4001, 32.125], [4005, 36.375], [4012, 61.125], [4014, 32.875], [4015, 33.0], [4023, 39.0], [4042, -2.75], [4047, 24.75], [4048, 17.75], [4091, 56.375], [4097, 53.125], [4106, 20.375], [4120, 45.5], [4125, 15.75], [4151, 3.5], [4161, 50.625], [4162, 31.5], [4163, 14.5], [4164, -4.625], [4185, 22.5], [4193, 20.625], [4195, 31.125], [4197, 4.625], [4198, 26.75], [4201, 32.375], [4206, 53.875], [4227, 60.375], [4240, 23.75], [4244, 51.5], [4246, 3.5], [4252, 19.0], [4267, -3.0], [4271, 21.625], [4275, 0.25], [4297, -0.625], [4307, 44.5], [4337, 29.5], [4352, 47.75], [4365, 16.5], [4380, 27.875], [4382, 47.5], [4399, 17.625], [4405, 56.0], [4415, 35.25], [4417, 43.875], [4436, 9.75], [4441, 46.75], [4453, 0.625], [4469, 42.125], [4474, -16.5], [4491, 55.5], [4500, 14.625], [4503, 34.875], [4517, 21.375], [4538, 29.5], [4588, 63.375], [4589, 19.25], [4602, 44.125], [4606, 0.875], [4631, 32.875], [4640, 35.75], [4649, 24.625], [4651, 69.125], [4665, 20.625], [4690, 41.25], [4703, 29.125], [4706, 7.75], [4724, 26.625], [4750, 22.0], [4752, 45.0], [4763, 41.75], [4773, 12.75], [4778, 9.25], [4789, 17.75], [4804, 8.0], [4809, 58.5], [4813, 37.125], [4822, 18.375], [4839, 21.125], [4841, -1.375], [4858, 41.0], [4878, 46.375], [4899, 25.25], [4916, 42.5], [4923, 45.0], [4929, 28.0], [4954, 51.5], [4955, 16.125], [4971, 69.625], [4985, 39.5], [4999, 20.75], [5000, 45.75], [5003, 42.125], [5006, 28.25], [5017, 38.75], [5021, 10.25], [5043, 24.875], [5055, 49.625], [5062, 22.5], [5064, 46.875], [5074, 50.125], [5075, 28.75], [5081, 31.125], [5101, 27.625], [5103, 2.375], [5119, 26.625], [5137, 27.75], [5138, 14.25], [5142, 5.75], [5151, 23.625], [5152, 10.375], [5164, 32.5], [5207, 33.875], [5209, 25.75], [5226, 70.125], [5229, 76.5], [5235, 51.125], [5246, -38.8125], [5256, 11.25], [5265, 20.625], [5274, 30.5], [5279, 14.25], [5284, 33.125], [5303, 27.625], [5311, 60.125], [5319, 26.5], [5320, -6.75], [5322, 74.375], [5325, 45.375], [5357, 24.875], [5374, 37.75], [5375, 24.25], [5380, 48.125], [5384, 55.875], [5389, 26.0], [5390, 17.25], [5394, 39.75], [5409, 38.75], [5410, 57.375], [5420, 15.25], [5421, 38.0], [5428, 0.625], [5431, 17.25], [5450, 14.5], [5465, 50.625], [5472, 24.625], [5484, 12.0], [5486, 42.5], [5487, 44.75], [5489, 16.125], [5524, 38.5], [5541, 29.75], [5542, 25.625], [5568, 33.25], [5586, 42.875], [5589, 0.375], [5594, 11.0], [5598, 33.875], [5615, 40.125], [5617, 46.25], [5653, 41.5], [5655, 18.0], [5676, 31.875], [5704, 24.125], [5709, 30.0], [5711, 38.625], [5751, 48.0], [5767, 66.0], [5777, 25.375], [5783, 40.625], [5786, 30.75], [5825, 35.875], [5831, 21.125], [5841, 24.5], [5851, 23.875], [5853, 21.25], [5859, 20.125], [5865, 28.0], [5930, 26.625], [5983, 24.25], [6001, 27.75], [6010, 55.0], [6016, 41.0], [6017, -2.625], [6019, 38.125], [6025, 36.0], [6028, 45.5], [6029, 23.875], [6035, 44.5], [6037, 23.25], [6077, 18.75], [6083, 11.375], [6094, 21.75], [6107, 33.75], [6126, 25.625], [6136, 6.0], [6152, 19.25], [6194, 57.75], [6202, 13.75], [6203, -1.75], [6210, 72.25], [6211, 13.25], [6219, 3.5], [6296, 52.5], [6305, 50.75], [6326, 48.375], [6337, 21.125], [6349, 32.625], [6360, 24.75], [6375, 58.375], [6378, -6.375], [6400, 52.75], [6412, 26.375], [6434, -0.5], [6469, 69.25], [6471, 38.125], [6480, 22.375], [6490, 43.125], [6508, 4.875], [6543, 50.875], [6547, 20.75], [6561, 33.0], [6576, 59.0], [6589, 3.875], [6600, 39.5], [6604, 11.75], [6613, 24.375], [6621, 48.375], [6625, 15.75], [6626, 59.625], [6636, -0.25], [6645, 19.125], [6684, 34.0], [6688, 32.75], [6689, -2.25], [6705, 63.875], [6720, 49.875], [6736, 22.875], [6749, 17.0], [6752, -8.75], [6760, 65.125], [6769, 31.5], [6771, 48.625], [6778, 14.125], [6786, 43.375], [6789, 33.75], [6803, 67.125], [6861, 15.5], [6866, 42.375], [6869, 22.0], [6872, 25.625], [6877, 48.75], [6884, 37.125], [6888, 49.875], [6889, 17.75], [6898, 53.625], [6993, 23.75], [7011, 20.125], [7013, 17.125], [7016, 23.0], [7027, 29.5], [7035, 24.75], [7045, 50.75], [7046, 31.0], [7049, 42.125], [7068, 39.875], [7072, 11.25], [7085, -20.375], [7090, 33.375], [7097, 6.5], [7101, 12.125], [7102, 68.375], [7109, 5.75], [7132, 25.25], [7139, 29.75], [7141, 55.875], [7144, -10.25], [7152, 22.0], [7167, -6.75], [7170, 63.0], [7185, 6.0], [7186, 53.75], [7202, 54.0], [7207, -8.5], [7211, 48.5], [7227, 0.5], [7236, -9.5], [7250, 8.5], [7257, -2.25], [7274, 8.625], [7278, 46.375], [7280, 18.25], [7281, 7.125], [7290, -7.25], [7298, 6.625], [7299, 44.375], [7302, 32.75], [7306, -26.75], [7318, 31.625], [7321, 57.0], [7330, 29.625], [7334, 9.75], [7336, 36.25], [7341, 81.5], [7344, 26.25], [7347, 22.875], [7361, 2.875], [7369, 58.75], [7397, 42.875], [7408, 35.75], [7427, -4.5], [7430, 15.25], [7439, 57.75], [7453, 24.25], [7473, 5.125], [7478, 57.25], [7488, 26.75], [7503, 30.25], [7518, 33.0], [7544, 46.875], [7552, 31.0], [7576, 18.875], [7577, 29.0], [7597, 40.375], [7605, 28.625], [7616, 41.625], [7620, -6.25], [7656, 44.125], [7659, 31.0], [7681, -5.25], [7692, 46.25], [7710, 10.0], [7713, 3.0], [7722, 36.875], [7723, 59.125], [7742, 19.0], [7743, 25.875], [7750, 12.25], [7790, 41.25], [7801, -12.0], [7811, -31.125], [7815, 47.625], [7843, -14.125], [7844, 49.5], [7857, 24.5], [7868, 9.25], [7877, 29.25], [7887, 24.125], [7897, 36.5], [7902, 78.375], [7910, 22.25], [7912, 15.25], [7918, 53.625], [7933, 40.25], [7936, 50.5], [7951, 26.75], [7953, 46.0], [7957, 27.375], [7962, 42.0], [7971, 2.0], [7974, 4.25], [7991, 47.25], [8000, 18.625], [8008, 48.25], [8018, 24.5], [8024, 9.75], [8047, -8.125], [8060, -0.25], [8077, 8.25], [8086, 40.5], [8104, 34.875], [8118, 28.625], [8133, 26.5], [8138, 18.375], [8145, 50.5], [8150, 40.25], [8168, 76.25], [8170, 32.5], [8173, 42.75], [8175, 9.875], [8194, 39.375], [8211, -1.875], [8253, 15.375], [8262, -20.875], [8263, 50.0], [8265, 65.375], [8268, 52.125], [8271, 10.75], [8272, 37.5], [8273, -1.75], [8277, 33.25], [8292, 28.75], [8344, 29.875], [8346, 22.5], [8350, 30.125], [8364, 48.125], [8369, 17.375], [8370, 20.875], [8385, 49.5], [8389, 23.875], [8421, 5.625], [8442, 36.875], [8453, 22.625], [8458, -2.875], [8466, 74.125], [8478, 60.625], [8483, 11.625], [8487, 7.25], [8501, 51.125], [8505, 27.375], [8509, 41.875], [8534, -2.875], [8539, 12.125], [8556, 38.25], [8566, -2.625], [8577, 17.75], [8583, -6.75], [8600, 60.125], [8615, 27.5], [8624, 65.375], [8630, 13.375], [8645, 25.875], [8658, 19.25], [8660, 15.875], [8667, 23.5], [8672, 23.75], [8676, 41.0], [8687, 43.0], [8689, 25.125], [8692, 38.125], [8697, 9.25], [8699, 42.5], [8707, 53.875], [8722, 30.625], [8726, 64.875], [8727, 37.75], [8736, 15.5], [8737, 12.625], [8752, 28.25], [8760, 12.625], [8776, 58.25], [8793, 2.875], [8794, -5.5], [8797, 48.25], [8806, 31.0], [8812, 15.125], [8820, 61.625], [8830, 42.625], [8852, 22.125], [8877, 20.625], [8885, 82.625], [8891, 12.125], [8929, 55.75], [8936, 13.75], [8938, 62.75], [8954, 46.625], [8967, -10.375], [8975, 49.0], [8985, 10.5], [8989, 40.5], [8999, 18.125], [9002, 16.375], [9014, 26.25], [9025, 26.75], [9034, 1.5], [9052, 44.5], [9059, 26.75], [9063, 14.0], [9084, 34.125], [9086, -0.625], [9088, 44.625], [9123, 51.625], [9130, 26.25], [9144, 34.375], [9167, 25.75], [9182, 35.125], [9184, 17.375], [9198, 25.375], [9218, 33.5], [9231, 9.75], [9237, 17.125], [9239, 15.625], [9244, 50.125], [9256, 18.25], [9257, 18.25], [9261, 47.5], [9267, 47.625], [9269, 23.625], [9297, 43.25], [9300, 12.125], [9305, 51.125], [9327, 38.75], [9337, 44.5], [9340, 27.0], [9341, 17.375], [9355, 24.875], [9360, 2.375], [9366, -2.625], [9369, 43.875], [9377, 15.0], [9380, 34.75], [9381, 41.5], [9385, 23.625], [9403, 56.25], [9406, 31.125], [9409, 13.25], [9419, 7.25], [9420, 24.625], [9423, 31.5], [9447, 47.25], [9450, 27.0], [9467, 20.625], [9475, 49.0], [9485, 43.75], [9502, 24.5], [9504, 11.5], [9518, 42.75], [9523, 22.25], [9536, -3.875], [9559, 11.625], [9563, 36.625], [9576, 35.375], [9594, 8.375], [9611, -7.75], [9613, 55.75], [9621, 42.375], [9633, 16.0], [9655, -3.5], [9658, 22.875], [9667, 30.875], [9672, 35.0], [9681, 8.5], [9684, 12.25], [9687, 22.75], [9688, 31.625], [9693, 5.125], [9698, 14.5], [9702, 33.75], [9713, 23.5], [9716, 41.625], [9721, 39.875], [9726, 0.0], [9736, 59.0], [9762, 32.125], [9772, 39.75], [9776, 52.5], [9781, 29.875], [9783, 48.5], [9809, 29.125], [9833, 23.75], [9837, 27.875], [9853, 37.75], [9856, 12.5], [9857, 21.75], [9863, 71.875], [9872, 18.0], [9894, 64.125], [9899, 3.625], [9919, 59.25], [9936, 24.75], [9947, 38.625], [9949, 41.0], [9952, 27.875], [9958, 40.25], [9979, 30.75], [9998, 30.25], [10005, 31.75], [10015, 36.875], [10053, 26.75], [10096, 47.5], [10108, 68.875], [10114, 1.375], [10122, 80.5], [10126, 0.625], [10145, -0.75], [10159, 17.25], [10166, 63.25], [10181, 63.625], [10184, 14.5], [10190, 68.25], [10197, 31.75], [10217, 5.125], [10218, 35.25], [10219, 53.5], [10224, 64.625], [10234, 27.5], [10244, 55.375], [10258, 57.125], [10330, 29.375], [10340, -3.25], [10352, 21.625], [10367, 30.25], [10372, 4.0], [10376, 52.25], [10377, 4.5], [10390, 19.125], [10419, -10.625], [10422, 21.625], [10434, 14.125], [10439, 48.125], [10445, 26.625], [10448, 53.25], [10471, 61.5], [10493, 0.375], [10500, 17.5], [10517, 43.25], [10527, 10.125], [10561, 42.375], [10569, 6.375], [10576, 64.125], [10577, 25.0], [10598, 56.625], [10609, 65.75], [10635, 17.0], [10637, 57.75], [10640, 61.375], [10654, 30.25], [10660, 35.875], [10662, 1.75], [10664, 24.625], [10667, 53.25], [10668, -0.125], [10672, 17.5], [10679, 52.75], [10687, 29.375], [10690, 42.75], [10692, 41.25], [10693, 65.0], [10699, 47.0], [10710, 24.0], [10715, 31.75], [10719, 19.375], [10730, 21.5], [10735, 46.0], [10742, -26.1875], [10746, 23.875], [10750, 51.625], [10753, 25.125], [10754, 20.0], [10758, 1.75], [10766, 58.125], [10768, 13.625], [10773, 35.25], [10780, 20.625], [10785, 44.5], [10789, 11.5], [10798, 48.5], [10817, 33.125], [10821, 38.0], [10822, 62.375], [10862, 19.25], [10863, 36.125], [10866, 26.375], [10889, 36.0], [10924, 32.0], [10944, 57.875], [10955, 40.25], [10966, 41.625], [10969, 52.25], [10978, 19.125], [10979, 2.875], [10987, 29.25], [10999, 26.0], [11025, 9.75], [11026, 38.25], [11031, 38.375], [11034, 46.125], [11048, 14.75], [11050, 46.0], [11053, 11.625], [11055, 35.375], [11056, 23.75], [11057, 5.5], [11067, 30.875], [11069, 28.0], [11072, 53.875], [11074, 15.625], [11085, 44.5], [11111, 14.5], [11112, 44.0], [11123, 41.5], [11149, 68.25], [11185, 29.125], [11221, 5.625], [11250, -2.875], [11266, 38.875], [11279, 25.25], [11280, -22.9375], [11312, 18.75], [11320, 32.25], [11327, 0.25], [11331, 0.125], [11351, 12.375], [11359, 51.75], [11360, 21.125], [11362, 22.0], [11386, 10.25], [11391, 54.375], [11393, 10.5], [11428, 24.25], [11436, 39.875], [11446, 37.875], [11460, 40.375], [11462, 21.0], [11465, 42.25], [11478, 41.125], [11495, 55.25], [11497, 29.375], [11500, 26.625], [11522, 37.125], [11523, 28.75], [11526, 49.75], [11533, 57.5], [11539, 24.375], [11540, 46.375], [11543, 23.5], [11548, 46.0], [11570, 10.625], [11572, 56.375], [11584, 13.0], [11597, 0.0], [11605, 22.125], [11622, 21.25], [11637, 12.25], [11650, 50.875], [11657, -2.125], [11665, 23.875], [11668, 39.25], [11686, 23.25], [11720, 29.75], [11721, 28.875], [11741, 57.875], [11755, 62.5], [11756, 60.5], [11764, -41.0], [11819, 54.625], [11828, 30.5], [11842, 38.5], [11861, -1.75], [11871, 35.0], [11880, 24.625], [11903, 5.5], [11905, 76.75], [11939, 18.25], [11940, 47.5], [11941, 61.0], [11963, 55.25], [11964, 67.875], [11970, 16.5], [11983, -12.0], [11992, 62.0], [12020, 61.125], [12042, 38.625], [12051, 54.25], [12069, 50.0], [12075, 55.375], [12102, 27.125], [12106, 20.25], [12150, 16.5], [12158, 35.125], [12161, -35.75], [12164, 13.125], [12165, 31.625], [12172, 2.125], [12181, 21.5], [12192, 15.5], [12193, 47.75], [12205, 21.625], [12207, 46.875], [12214, 50.375], [12219, 28.75], [12224, 18.5], [12225, 46.625], [12229, 7.5], [12237, 29.5], [12238, 11.5], [12253, 29.125], [12257, 51.5], [12259, 39.125], [12262, 17.5], [12266, 62.625], [12300, 5.25], [12309, 30.25], [12344, 33.75], [12351, 9.375], [12352, 13.125], [12354, 59.5], [12357, 53.625], [12359, 12.25], [12361, 6.375], [12362, 41.875], [12370, -31.125], [12384, 31.5], [12397, 8.75], [12411, 49.0], [12428, 53.875], [12436, 29.375], [12455, 42.375], [12467, 16.25], [12481, 39.125], [12482, 10.75], [12499, -9.625], [12505, 35.125], [12527, 11.0], [12546, 58.25], [12559, 31.75], [12578, 76.25], [12583, 38.0], [12584, 41.875], [12601, 45.75], [12609, 33.75], [12610, 43.375], [12614, 37.25], [12620, 54.875], [12626, 1.0], [12647, 54.0], [12669, 36.0], [12676, 32.0], [12700, 47.875], [12703, -0.875], [12706, 19.75], [12711, -18.375], [12716, 58.25], [12739, 41.75], [12766, 24.5], [12779, 28.375], [12812, 5.375], [12820, 51.5], [12823, 24.5], [12826, 31.375], [12857, -9.5], [12866, 3.625], [12893, 18.75], [12907, 8.125], [12940, 32.75], [12944, 30.875], [12946, 45.5], [12954, 43.875], [12958, 31.25], [12960, 2.0], [12972, 6.5], [13005, -9.25], [13008, -3.0], [13019, 18.875], [13022, 49.125], [13041, 32.25], [13044, 29.5], [13048, 32.0], [13060, -17.75], [13066, 19.25], [13069, 50.375], [13081, 35.875], [13086, 39.875], [13091, 46.875], [13098, 10.125], [13100, 24.625], [13104, 14.0], [13112, 28.875], [13127, 20.0], [13136, 15.5], [13154, 8.5], [13162, 28.875], [13195, 3.75], [13214, 19.25], [13225, 62.75], [13233, 46.75], [13244, 70.875], [13253, 53.0], [13259, 65.0], [13268, 36.75], [13270, 18.25], [13273, 49.25], [13290, 40.125], [13300, 40.75], [13305, 32.5], [13312, 30.0], [13353, 37.75], [13357, 13.625], [13359, 59.625], [13386, 36.375], [13390, 11.25], [13425, 11.0], [13426, 18.375], [13437, 22.25], [13449, 26.875], [13455, 43.0], [13468, 4.25], [13471, 25.25], [13494, 45.875], [13495, -12.25], [13496, 16.25], [13515, -19.75], [13517, 38.625], [13526, 18.375], [13546, -27.6875], [13567, 27.125], [13575, 0.125], [13583, 41.375], [13586, -1.75], [13594, 53.125], [13596, 53.375], [13598, 40.5], [13613, 29.375], [13616, 13.5], [13633, 10.75], [13639, 51.0], [13654, 41.375], [13671, 48.0], [13693, 47.625], [13697, 1.75], [13706, 29.5], [13723, 23.375], [13730, 47.0], [13735, 12.5], [13751, -5.125], [13765, 6.625], [13775, 43.5], [13789, 14.625], [13790, 62.75], [13792, 69.75], [13814, 50.25], [13821, 19.125], [13823, -20.4375], [13838, 23.5], [13843, 36.375], [13866, 42.5], [13868, 11.25], [13870, 27.75], [13874, 19.5], [13887, 0.5], [13891, 18.75], [13895, 43.5], [13901, 6.0], [13931, 8.125], [13950, 36.25], [13952, 41.125], [13957, 60.375], [13964, 60.125], [13968, 26.0], [13970, 56.75], [13974, 51.625], [13976, 22.75], [13978, -5.875], [14000, 16.25], [14004, 39.875], [14005, 64.25], [14006, 9.75], [14017, 37.875], [14030, 26.5], [14037, 16.75], [14054, -10.875], [14068, 31.625], [14080, 22.375], [14083, 42.125], [14084, 11.0], [14092, 11.125], [14103, 1.25], [14109, 8.875], [14132, 40.0], [14157, 60.875], [14165, 78.125], [14172, 26.875], [14180, 38.625], [14203, 53.25], [14207, 40.625], [14210, 44.0], [14248, 43.625], [14260, 73.0], [14273, 28.75], [14279, 39.75], [14282, 11.25], [14283, 69.375], [14285, 7.875], [14291, -2.875], [14294, 60.125], [14304, 60.875], [14312, 5.375], [14319, 50.0], [14326, 18.875], [14358, 7.125], [14373, 30.25], [14380, 28.875], [14385, 42.0], [14417, 42.75], [14421, 13.875], [14424, 35.0], [14429, 47.625], [14433, -2.25], [14441, 42.25], [14456, 21.75], [14458, 9.0], [14475, 14.0], [14524, 45.375], [14531, 57.125], [14532, 41.0], [14551, 24.375], [14556, 41.875], [14566, 31.5], [14567, 2.5], [14574, 20.0], [14576, 60.0], [14597, 39.25], [14603, 23.0], [14622, 41.875], [14664, 27.0], [14665, 33.0], [14668, 29.625], [14670, 60.0], [14671, 30.75], [14676, 28.0], [14682, 46.0], [14686, 46.0], [14688, 53.125], [14694, 39.625], [14701, 30.25], [14717, 60.625], [14743, -10.625], [14744, 45.875], [14750, 25.375], [14764, 27.625], [14770, 11.5], [14779, 15.0], [14784, 13.25], [14787, -9.875], [14803, 23.5], [14805, 38.875], [14808, 25.25], [14821, 25.125], [14823, 17.0], [14825, 18.375], [14831, 19.375], [14833, 15.0], [14851, 16.375], [14866, -14.875], [14899, -2.75], [14901, 37.25], [14911, 1.0], [14914, 27.125], [14921, 46.75], [14944, 29.125], [14947, 45.875], [14949, 14.75], [14951, 47.625], [14953, 60.125], [14959, 22.0], [14962, 32.75], [14970, 60.0], [14974, 11.375], [14997, 11.0], [15000, 48.5], [15001, 40.125], [15003, 58.0], [15006, 23.875], [15019, 48.25], [15024, 3.625], [15028, 63.0], [15032, 46.375], [15045, 48.75], [15054, -14.25], [15069, 48.625], [15070, 21.0], [15095, 15.75], [15118, 27.375], [15133, 18.625], [15142, 57.875], [15143, 6.25], [15164, 42.5], [15172, 13.0], [15182, -10.25], [15185, 35.75], [15197, 9.25], [15204, 25.25], [15214, 23.0], [15236, 13.875], [15242, 40.875], [15247, 8.875], [15251, 31.625], [15257, 17.5], [15316, 44.25], [15334, 21.75], [15336, 42.75], [15344, -23.5], [15366, 14.75], [15373, 42.0], [15380, 7.375], [15382, 39.25], [15412, 11.25], [15416, 55.875], [15434, 52.875], [15436, 25.375], [15441, 72.25], [15444, 54.25], [15457, 54.25], [15465, 46.25], [15475, 0.75], [15496, 18.5], [15500, 39.625], [15522, 37.0], [15529, 39.5], [15531, 51.25], [15562, 32.5], [15565, 4.625], [15569, 37.875], [15576, 37.125], [15594, 38.0], [15597, 22.25], [15614, 37.75], [15627, 21.75], [15640, 28.0], [15664, 53.875], [15667, -10.625], [15679, 16.75], [15680, 36.125], [15698, 41.375], [15730, 41.0], [15731, 24.375], [15745, 44.75], [15759, -12.75], [15766, 15.0], [15791, 16.25], [15801, 54.0], [15808, 25.375], [15822, 9.25], [15834, 49.0], [15838, 36.75], [15844, 32.0], [15850, 8.5], [15862, 20.875], [15872, 35.25], [15887, 19.75], [15931, 49.0], [15942, -5.25], [15945, 27.625], [15955, 61.875], [16000, 30.25], [16042, -10.25], [16043, 1.875], [16060, 5.25], [16063, 52.75], [16073, 62.75], [16076, 54.5], [16078, 17.125], [16140, -3.75], [16164, 51.75], [16165, 10.5], [16169, 23.125], [16210, 54.125], [16225, 27.25], [16262, 37.5], [16269, 22.875], [16277, 46.75], [16282, 8.25], [16295, 57.25], [16312, 4.125], [16316, 34.25], [16328, 18.625], [16346, 32.75], [16389, 21.25], [16434, 19.625], [16472, 35.75], [16474, 34.375], [16489, 46.25], [16502, 55.625], [16531, 57.0], [16532, 51.375], [16539, 38.875], [16541, 21.25], [16571, 21.625], [16572, 57.875], [16580, 70.5], [16582, 47.25], [16598, -36.75], [16605, 13.5], [16606, 19.75], [16619, 20.625], [16643, -11.125], [16657, -18.0625], [16659, 24.125], [16671, 26.25], [16737, 52.0], [16743, 27.5], [16759, 59.0], [16765, 22.0], [16768, 61.125], [16769, 47.875], [16773, 11.875], [16777, 46.125], [16790, -22.1875], [16804, 43.875], [16831, 25.0], [16851, 18.0], [16854, 42.5], [16868, 8.375], [16882, 46.75], [16891, 73.125], [16919, 20.5], [16937, 46.375], [16938, 32.875], [16941, 53.375], [16965, 48.0], [16977, 9.625], [16982, 54.25], [16987, 14.625], [17002, 9.625], [17018, 56.125], [17020, 28.125], [17030, -6.375], [17044, 46.25], [17049, 32.75], [17077, 33.75], [17101, 36.125], [17115, 14.75], [17135, 8.5], [17154, 48.75], [17160, 42.375], [17171, 49.125], [17172, 33.625], [17193, 38.5], [17216, 66.25], [17229, 28.375], [17251, 6.875], [17278, 19.875], [17279, 19.25], [17322, 82.875], [17325, 23.5], [17346, 56.125], [17364, 5.75], [17392, 55.5], [17394, -0.375], [17395, 30.5], [17397, -15.0], [17403, 45.0], [17405, 44.375], [17408, -3.125], [17420, 13.125], [17431, 66.5], [17443, 66.5], [17447, 10.5], [17463, 21.5], [17482, -1.0], [17509, 5.75], [17527, 24.125], [17536, 18.375], [17540, 15.25], [17551, 18.25], [17552, 33.0], [17553, 44.625], [17554, 24.5], [17563, 16.5], [17564, 33.375], [17574, 53.75], [17577, 35.5], [17589, 15.0], [17610, 44.75], [17618, 17.5], [17637, 57.875], [17650, 33.625], [17661, 9.875], [17664, 30.75], [17668, 57.875], [17687, 45.625], [17723, 37.5], [17745, 49.0], [17755, 4.625], [17756, -5.25], [17757, 19.75], [17766, 20.375], [17777, 16.5], [17780, 15.25], [17794, 46.75], [17795, 3.75], [17805, 17.75], [17824, 18.875], [17854, 29.5], [17860, 63.875], [17870, 41.375], [17874, 40.875], [17893, 5.625], [17899, 11.0], [17912, 52.0], [17922, 56.25], [17929, 13.125], [17933, 27.25], [17938, 68.625], [17963, -1.25], [17974, -13.125], [18006, 24.125], [18019, 66.875], [18030, 41.25], [18033, 6.5], [18040, 49.25], [18073, 7.5], [18086, 16.375], [18102, 22.5], [18129, 20.0], [18130, 55.125], [18132, 56.25], [18138, 56.375], [18164, -31.375], [18206, 41.375], [18218, 66.5], [18225, 2.875], [18242, 47.75], [18266, -11.125], [18275, 31.625], [18283, 11.625], [18285, 22.0], [18299, 43.5], [18318, 19.625], [18322, 19.5], [18335, 32.125], [18346, 27.375], [18352, -5.375], [18355, 14.75], [18358, 48.125], [18359, 47.5], [18380, 53.375], [18395, 12.125], [18400, 41.75], [18406, 39.5], [18418, 8.0], [18419, 21.0], [18424, 19.0], [18432, 57.875], [18433, 29.375], [18434, 16.75], [18442, 26.125], [18470, 27.875], [18472, 39.375], [18493, 19.0], [18499, 30.25], [18500, 21.0], [18502, 11.125], [18518, 22.5], [18524, 64.5], [18532, 15.25], [18564, 49.0], [18565, 27.375], [18568, 54.625], [18578, -14.25], [18588, 65.0], [18589, 32.375], [18603, 23.0], [18628, 18.875], [18641, 34.375], [18642, -25.75], [18651, 23.25], [18662, -1.625], [18663, 37.75], [18685, 44.625], [18718, 9.125], [18731, -9.75], [18735, 42.5], [18741, 18.375], [18759, 59.75], [18760, 57.5], [18780, 22.25], [18791, 24.0], [18815, 41.625], [18816, 32.125], [18840, 35.625], [18854, 16.875], [18867, 28.625], [18873, 15.875], [18884, 11.625], [18885, 27.25], [18890, 39.375], [18900, 46.625], [18907, -0.375], [18911, 60.125], [18914, -13.125], [18918, -16.4375], [18924, 31.0], [18927, 33.25], [18934, 45.5], [18939, 6.75], [18940, 27.625], [18945, -0.5], [18947, 46.125], [18958, 36.5], [18972, 25.625], [18977, 52.25], [18987, 16.0], [19008, 43.375], [19009, 29.875], [19044, -2.0], [19051, 36.25], [19054, -6.625], [19070, 49.25], [19071, 31.375], [19072, 43.5], [19074, 19.625], [19078, 49.5], [19082, -27.125], [19090, 51.375], [19097, 34.75], [19110, 46.5], [19123, -8.75], [19139, 45.5], [19147, 15.375], [19160, 36.375], [19200, 43.5], [19216, 40.875], [19222, 18.375], [19262, 71.0], [19264, 42.25], [19273, 12.25], [19287, 30.875], [19290, 44.875], [19316, 69.125], [19342, 13.75], [19347, 31.0], [19363, 23.0], [19364, 8.75], [19378, 59.375], [19385, 65.5], [19386, 14.0], [19394, 16.25], [19396, 8.25], [19400, 49.75], [19401, 47.375], [19407, 41.125], [19416, 10.0], [19417, -28.6875], [19422, 29.0], [19434, 17.625], [19437, 8.625], [19454, 21.0], [19459, 72.125], [19460, 16.75], [19476, 0.375], [19494, -20.8125], [19497, 39.5], [19499, 40.0], [19500, 33.5], [19519, -8.625], [19536, 17.0], [19547, 68.625], [19552, 17.875], [19553, 30.75], [19554, 0.625], [19562, 44.75], [19592, 42.375], [19607, 31.125], [19612, 20.875], [19617, 5.625], [19645, 31.125], [19657, 29.125], [19671, -1.5], [19677, 53.125], [19682, 1.625], [19683, 44.75], [19696, 29.875], [19699, 23.375], [19710, 41.0], [19712, 49.0], [19718, 21.125], [19726, 13.0], [19727, 40.0], [19731, 33.875], [19740, 3.25], [19746, 5.375], [19753, 18.625], [19781, 56.625], [19806, 49.5], [19810, 46.75], [19811, 49.625], [19839, 3.25], [19852, 10.375], [19866, 29.5], [19872, 22.625], [19921, 31.375], [19928, 45.0], [19953, 28.125], [19966, 13.0], [19985, 37.625], [19988, 18.625], [19995, 24.25], [20003, 57.625], [20018, 28.125], [20035, 72.75], [20057, 20.25], [20066, 64.625], [20078, 33.875], [20082, 47.125], [20089, 34.875], [20110, 46.125], [20116, 29.625], [20131, 47.375], [20150, 43.5], [20152, 49.0], [20157, 77.75], [20160, -2.5], [20174, 18.625], [20187, 28.0], [20211, 34.5], [20222, 44.875], [20236, 56.875], [20237, 37.875], [20253, 29.0], [20258, 68.25], [20274, 18.75], [20297, 44.0], [20301, -14.125], [20306, 17.75], [20307, 48.5], [20316, 28.25], [20325, 23.625], [20350, 11.625], [20361, 44.25], [20369, 15.875], [20371, 6.5], [20382, 43.75], [20385, 26.5], [20386, 55.625], [20393, 12.25], [20402, 42.375], [20420, 56.125], [20442, 26.0], [20466, 32.25], [20468, 15.375], [20471, 15.125], [20487, 55.625], [20488, 9.5], [20490, 36.0], [20503, 50.0], [20506, 14.125], [20508, -5.75], [20520, 48.5], [20533, 19.625], [20537, 5.5], [20558, 62.125], [20568, 21.375], [20571, 18.375], [20576, -4.5], [20601, 30.25], [20603, -18.25], [20609, 17.625], [20644, 49.5], [20646, 23.125], [20652, 58.5], [20678, 20.0], [20723, 61.25], [20724, 48.625], [20728, 41.75], [20742, 33.0], [20744, 28.75], [20752, 59.0], [20764, 28.0], [20769, 27.625], [20778, 48.25], [20788, 25.875], [20789, 34.125], [20796, 49.75], [20797, 59.875], [20815, 23.25], [20853, 39.75], [20875, 28.375], [20884, 52.0], [20897, 28.0], [20932, 13.875], [20958, 10.375], [20969, 51.75], [20970, 13.25], [21017, 17.375], [21018, -18.25], [21026, 14.375], [21054, -13.25], [21062, 33.5], [21064, 45.75], [21073, 21.5], [21074, 20.375], [21125, 33.0], [21138, 40.25], [21145, 6.125], [21147, 25.25], [21170, 0.125], [21183, -9.875], [21184, 8.0], [21185, 33.625], [21206, 24.5], [21207, 20.375], [21210, 17.625], [21220, 2.875], [21229, 36.75], [21240, 53.0], [21245, 22.0], [21246, 49.75], [21248, 42.5], [21271, 16.125], [21276, 52.875], [21293, 31.25], [21294, 54.5], [21309, 68.25], [21331, -7.125], [21332, 20.125], [21333, 37.125], [21337, 24.25], [21341, 27.5], [21342, 3.125], [21344, 67.25], [21347, 20.375], [21361, 25.0], [21370, 32.75], [21418, 78.5], [21431, 48.75], [21446, 13.75], [21452, 25.875], [21507, 36.25], [21549, 18.625], [21557, 36.5], [21562, 59.875], [21565, 51.375], [21570, 16.0], [21575, 27.875], [21578, 28.75], [21593, 39.75], [21596, 16.625], [21600, 19.5], [21605, 48.625], [21610, 25.0], [21633, 23.75], [21635, 18.375], [21643, 50.75], [21656, 21.375], [21667, 36.375], [21671, -17.875], [21683, -4.625], [21694, -17.125], [21705, 39.25], [21706, 12.625], [21710, 28.875], [21723, 24.125], [21733, 54.75], [21762, 16.25], [21797, -0.5], [21803, 29.625], [21827, 52.375], [21830, -11.125], [21836, 10.25], [21837, 26.5], [21846, 56.5], [21855, 66.5], [21856, 27.25], [21859, -29.8125], [21884, 23.0], [21894, 56.125], [21895, 36.375], [21910, 41.75], [21952, 26.5], [21960, 34.125], [21965, 5.5], [21973, 23.5], [21984, 37.75], [21988, 30.875], [21997, 37.125], [21999, 30.625]]}

wandb/run-20250502_045804-vkih00cc/files/media/table/eval/table_5500_50778bc668b4a7c3229f.table.json

@@ -0,0 +1 @@
+{"columns": ["data_index", "value"], "data": [[22, 74.625], [86, 29.25], [101, 30.25], [105, 8.625], [110, -4.625], [121, 33.75], [124, 52.375], [135, 39.625], [136, 34.0], [138, 32.375], [160, 65.5], [166, 26.25], [177, 49.25], [180, 39.25], [196, 14.0], [208, 42.75], [226, 25.125], [245, -0.5], [258, 15.75], [259, 83.625], [266, 43.75], [273, 19.625], [275, 34.375], [277, 46.125], [288, 31.25], [324, 32.75], [327, 37.5], [339, 19.125], [340, 22.5], [369, 5.5], [400, 50.75], [402, 14.625], [432, 44.0], [438, 30.75], [440, 45.0], [446, 72.0], [458, 33.875], [461, 25.0], [494, 28.75], [500, 45.0], [503, 48.375], [507, 24.5], [511, 55.875], [525, 42.625], [534, 36.5], [538, 5.5], [543, 32.125], [563, 58.125], [567, 35.625], [569, 45.75], [575, 40.25], [591, 15.375], [594, 17.375], [602, 53.375], [609, 3.75], [620, -5.875], [625, 28.5], [679, 57.25], [687, 69.25], [700, 51.75], [716, 27.625], [725, 16.125], [736, 37.0], [740, 57.625], [757, 65.125], [758, 11.5], [769, 34.5], [795, 56.75], [804, 9.625], [806, -9.125], [816, 75.25], [821, 40.0], [831, 16.25], [842, 22.0], [849, 40.0], [862, 18.0], [889, 35.125], [896, 37.625], [903, 23.125], [930, 10.75], [937, 20.0], [940, 43.5], [945, 47.0], [993, 27.125], [999, -26.0], [1014, 37.0], [1043, 17.625], [1045, 46.75], [1062, 36.5], [1064, 40.5], [1066, 71.375], [1069, 29.25], [1077, 50.75], [1082, 41.625], [1099, 2.875], [1100, 1.25], [1108, 43.375], [1122, 31.75], [1136, 16.75], [1143, 36.375], [1147, 36.0], [1151, 64.375], [1166, 61.625], [1172, 21.625], [1185, 14.25], [1186, 46.25], [1195, 40.125], [1196, 3.125], [1225, 66.25], [1232, 34.0], [1233, 36.375], [1239, 35.0], [1247, 31.125], [1280, 57.875], [1285, 20.25], [1286, 69.75], [1289, 33.75], [1304, 44.5], [1313, 36.0], [1324, 65.875], [1327, 23.25], [1329, 26.875], [1340, 54.5], [1350, 17.875], [1357, 26.75], [1392, 18.5], [1394, 45.25], [1415, 52.75], [1421, 25.875], [1435, 23.5], [1450, 23.0], [1488, 53.75], [1489, 16.125], [1509, -3.625], [1526, 11.0], [1530, 21.5], [1551, 78.0], [1557, 42.875], [1558, 68.75], [1565, 36.75], [1580, 65.625], [1583, 20.75], [1588, 73.875], [1660, 74.875], [1675, 37.875], [1684, 30.125], [1694, 59.25], [1696, 33.375], [1703, 20.375], [1705, 47.0], [1755, 19.75], [1762, 53.125], [1764, 32.625], [1788, 60.25], [1796, 1.125], [1811, 43.125], [1814, 75.5], [1830, 46.375], [1834, -8.875], [1836, 32.0], [1851, 10.5], [1852, 46.75], [1870, 9.5], [1871, -3.25], [1889, 20.0], [1898, 38.375], [1907, 29.125], [1914, 57.875], [1915, 50.625], [1916, 36.625], [1918, 1.125], [1925, -13.75], [1927, 84.75], [1928, 55.25], [1970, 61.25], [1995, 23.75], [2002, 23.5], [2016, 71.125], [2019, 13.0], [2020, 23.875], [2083, 30.75], [2120, 59.25], [2135, 51.5], [2146, 32.5], [2153, 53.0], [2195, 25.625], [2203, 34.5], [2226, 69.125], [2231, -2.5], [2253, 16.25], [2254, 26.375], [2269, 3.25], [2275, 50.75], [2290, 53.375], [2303, 53.5], [2311, 58.75], [2312, 46.625], [2347, 17.125], [2357, 49.375], [2368, 56.0], [2369, 32.5], [2376, 98.75], [2380, 4.5], [2414, 46.25], [2425, 8.375], [2454, 49.0], [2462, 54.0], [2481, 37.75], [2483, 34.5], [2485, 0.875], [2490, -21.1875], [2492, 40.5], [2499, 16.5], [2508, 9.125], [2523, 22.625], [2533, 21.125], [2544, 61.75], [2584, 69.75], [2591, 30.5], [2628, 36.25], [2630, -14.75], [2634, 11.125], [2662, 18.625], [2669, -1.5], [2686, 46.75], [2688, 16.25], [2711, 39.625], [2725, 36.5], [2731, 31.875], [2734, 44.125], [2738, 38.5], [2745, -18.25], [2769, 33.125], [2778, 3.125], [2786, 48.0], [2808, 109.625], [2818, 7.5], [2820, 38.0], [2822, 76.875], [2834, 79.375], [2843, 79.125], [2851, 65.5], [2866, -5.625], [2892, 34.75], [2922, 32.0], [2926, 54.375], [2935, 22.875], [2950, 27.375], [2960, 26.375], [2965, 17.375], [2970, 16.125], [2984, 80.875], [2988, 22.625], [2994, 64.375], [3006, 36.75], [3017, 29.125], [3020, 13.125], [3058, 27.875], [3061, 62.875], [3064, 43.25], [3073, 64.5], [3092, 20.125], [3108, 66.875], [3118, 26.375], [3138, 30.625], [3144, 64.875], [3149, 72.875], [3153, 24.125], [3154, 34.375], [3157, 21.25], [3165, 30.25], [3166, 29.75], [3171, 38.25], [3181, 71.75], [3196, 13.75], [3230, 37.5], [3233, 59.75], [3244, 75.875], [3265, 50.375], [3268, 37.5], [3283, 23.125], [3296, -5.125], [3298, 42.625], [3307, 52.625], [3321, 34.0], [3353, 1.25], [3362, 56.75], [3368, 29.75], [3375, 34.375], [3393, 27.875], [3395, 40.125], [3400, 38.75], [3401, 25.5], [3423, 59.25], [3429, 7.375], [3434, -0.375], [3447, 69.0], [3456, 26.125], [3479, 34.125], [3484, 29.0], [3574, 51.0], [3581, 64.375], [3587, -7.875], [3604, 64.5], [3629, 7.875], [3643, 54.125], [3648, 40.625], [3657, 15.25], [3662, 25.375], [3695, 43.75], [3697, 32.625], [3699, 16.875], [3703, 54.625], [3721, 54.0], [3732, 11.0], [3738, 69.75], [3746, 22.125], [3748, 30.375], [3750, 17.25], [3779, 67.25], [3786, 51.0], [3796, 39.0], [3805, 24.375], [3816, 53.5], [3845, 47.0], [3846, 3.5], [3864, 48.625], [3880, 34.375], [3892, 53.0], [3895, 35.0], [3902, 56.5], [3933, 24.125], [3938, 53.875], [3940, 43.625], [3954, 45.125], [3961, 62.875], [3974, 56.5], [3976, 0.875], [3980, 29.625], [3990, 17.875], [3997, 40.625], [3998, 116.5], [3999, 14.0], [4001, 33.125], [4005, 46.125], [4012, 72.25], [4014, 38.875], [4015, 33.75], [4023, 43.625], [4042, 9.375], [4047, 30.25], [4048, 22.125], [4091, 66.75], [4097, 57.75], [4106, 26.5], [4120, 52.375], [4125, 21.5], [4151, 14.625], [4161, 57.375], [4162, 38.875], [4163, 21.5], [4164, -1.375], [4185, 26.125], [4193, 23.25], [4195, 39.75], [4197, 9.875], [4198, 32.375], [4201, 35.25], [4206, 59.5], [4227, 68.25], [4240, 30.375], [4244, 56.875], [4246, 6.125], [4252, 25.75], [4267, -3.0], [4271, 24.25], [4275, 4.75], [4297, 8.125], [4307, 54.0], [4337, 33.0], [4352, 60.25], [4365, 19.875], [4380, 32.25], [4382, 58.75], [4399, 18.625], [4405, 65.125], [4415, 50.75], [4417, 48.125], [4436, 16.75], [4441, 63.75], [4453, 16.125], [4469, 45.875], [4474, -12.625], [4491, 66.625], [4500, 23.5], [4503, 43.25], [4517, 25.0], [4538, 33.5], [4588, 73.625], [4589, 30.75], [4602, 47.5], [4606, 8.625], [4631, 52.25], [4640, 45.25], [4649, 28.875], [4651, 73.875], [4665, 25.125], [4690, 57.0], [4703, 34.0], [4706, 14.125], [4724, 30.0], [4750, 25.875], [4752, 44.5], [4763, 46.625], [4773, 22.25], [4778, 14.5], [4789, 28.375], [4804, 20.25], [4809, 72.0], [4813, 47.0], [4822, 26.375], [4839, 26.375], [4841, -1.25], [4858, 57.0], [4878, 53.875], [4899, 26.75], [4916, 43.5], [4923, 51.375], [4929, 32.5], [4954, 56.0], [4955, 23.125], [4971, 75.0], [4985, 47.0], [4999, 35.0], [5000, 51.75], [5003, 50.125], [5006, 28.875], [5017, 42.5], [5021, 17.875], [5043, 30.0], [5055, 55.5], [5062, 27.125], [5064, 58.25], [5074, 56.75], [5075, 34.375], [5081, 39.0], [5101, 37.5], [5103, 6.375], [5119, 38.125], [5137, 31.0], [5138, 18.5], [5142, 7.0], [5151, 26.875], [5152, 13.0], [5164, 38.25], [5207, 39.5], [5209, 34.625], [5226, 77.0], [5229, 84.375], [5235, 61.375], [5246, -23.1875], [5256, 11.125], [5265, 25.125], [5274, 39.75], [5279, 18.25], [5284, 36.0], [5303, 34.375], [5311, 72.25], [5319, 33.5], [5320, -3.125], [5322, 81.0], [5325, 52.125], [5357, 31.875], [5374, 38.125], [5375, 29.0], [5380, 55.25], [5384, 62.625], [5389, 40.25], [5390, 21.125], [5394, 42.5], [5409, 49.875], [5410, 63.0], [5420, 14.75], [5421, 43.625], [5428, 6.0], [5431, 25.75], [5450, 12.875], [5465, 53.5], [5472, 23.625], [5484, 13.25], [5486, 53.5], [5487, 57.5], [5489, 19.0], [5524, 48.5], [5541, 33.875], [5542, 31.125], [5568, 37.125], [5586, 53.75], [5589, 3.875], [5594, 17.25], [5598, 37.25], [5615, 46.875], [5617, 58.375], [5653, 41.375], [5655, 24.125], [5676, 43.125], [5704, 31.875], [5709, 35.25], [5711, 48.0], [5751, 47.25], [5767, 70.625], [5777, 32.375], [5783, 45.0], [5786, 34.25], [5825, 39.5], [5831, 27.0], [5841, 33.875], [5851, 27.0], [5853, 25.75], [5859, 22.75], [5865, 38.875], [5930, 36.75], [5983, 31.75], [6001, 32.125], [6010, 66.25], [6016, 46.625], [6017, 0.625], [6019, 50.875], [6025, 54.0], [6028, 58.875], [6029, 30.0], [6035, 50.25], [6037, 29.5], [6077, 20.25], [6083, 12.25], [6094, 29.25], [6107, 41.125], [6126, 32.25], [6136, 10.75], [6152, 28.25], [6194, 62.25], [6202, 25.0], [6203, 4.75], [6210, 85.0], [6211, 18.875], [6219, 16.75], [6296, 60.0], [6305, 53.5], [6326, 53.25], [6337, 32.25], [6349, 36.75], [6360, 28.75], [6375, 71.0], [6378, -3.5], [6400, 61.75], [6412, 33.875], [6434, 3.625], [6469, 88.75], [6471, 51.75], [6480, 32.125], [6490, 52.625], [6508, 13.875], [6543, 59.375], [6547, 21.125], [6561, 38.5], [6576, 58.375], [6589, 14.75], [6600, 48.875], [6604, 18.5], [6613, 34.375], [6621, 54.0], [6625, 28.0], [6626, 75.0], [6636, 2.125], [6645, 28.625], [6684, 44.75], [6688, 36.0], [6689, 1.625], [6705, 73.75], [6720, 56.0], [6736, 30.125], [6749, 29.5], [6752, -4.75], [6760, 75.0], [6769, 29.0], [6771, 65.125], [6778, 20.75], [6786, 45.25], [6789, 44.5], [6803, 74.375], [6861, 16.5], [6866, 46.625], [6869, 26.375], [6872, 30.75], [6877, 53.625], [6884, 45.5], [6888, 56.625], [6889, 24.875], [6898, 58.75], [6993, 36.125], [7011, 28.125], [7013, 15.25], [7016, 27.25], [7027, 38.75], [7035, 31.625], [7045, 64.75], [7046, 39.75], [7049, 43.375], [7068, 50.0], [7072, 11.875], [7085, -17.0], [7090, 35.0], [7097, 14.625], [7101, 19.0], [7102, 73.5], [7109, 14.875], [7132, 30.25], [7139, 46.125], [7141, 61.75], [7144, -4.75], [7152, 30.75], [7167, -1.375], [7170, 72.75], [7185, 12.0], [7186, 59.0], [7202, 62.625], [7207, -8.25], [7211, 51.25], [7227, 5.125], [7236, -7.875], [7250, 10.875], [7257, 3.25], [7274, 14.625], [7278, 48.125], [7280, 15.75], [7281, 12.0], [7290, -4.0], [7298, 9.25], [7299, 48.625], [7302, 40.5], [7306, -22.25], [7318, 30.75], [7321, 62.0], [7330, 34.75], [7334, 19.125], [7336, 48.25], [7341, 91.25], [7344, 30.75], [7347, 29.625], [7361, 10.0], [7369, 59.75], [7397, 48.125], [7408, 41.75], [7427, 0.25], [7430, 24.375], [7439, 67.625], [7453, 30.75], [7473, 7.125], [7478, 60.0], [7488, 31.5], [7503, 39.5], [7518, 40.375], [7544, 55.25], [7552, 33.625], [7576, 26.625], [7577, 38.875], [7597, 40.25], [7605, 30.25], [7616, 48.625], [7620, -3.0], [7656, 50.5], [7659, 43.125], [7681, 4.625], [7692, 52.0], [7710, 15.25], [7713, 11.25], [7722, 45.0], [7723, 69.875], [7742, 25.0], [7743, 25.625], [7750, 19.0], [7790, 45.25], [7801, -7.25], [7811, -31.5], [7815, 56.75], [7843, -14.75], [7844, 60.375], [7857, 34.0], [7868, 12.625], [7877, 30.625], [7887, 33.375], [7897, 50.0], [7902, 93.5], [7910, 23.75], [7912, 20.25], [7918, 64.625], [7933, 45.75], [7936, 64.5], [7951, 34.25], [7953, 48.375], [7957, 26.75], [7962, 42.75], [7971, 8.0], [7974, 11.25], [7991, 58.5], [8000, 25.25], [8008, 51.5], [8018, 29.75], [8024, 11.125], [8047, -6.0], [8060, 5.75], [8077, 9.375], [8086, 42.5], [8104, 40.625], [8118, 30.25], [8133, 29.375], [8138, 29.0], [8145, 52.375], [8150, 46.375], [8168, 83.125], [8170, 41.375], [8173, 46.5], [8175, 14.75], [8194, 47.375], [8211, 0.625], [8253, 23.75], [8262, -20.3125], [8263, 53.0], [8265, 75.0], [8268, 56.0], [8271, 19.25], [8272, 47.125], [8273, 0.375], [8277, 39.875], [8292, 36.75], [8344, 34.375], [8346, 29.25], [8350, 38.125], [8364, 55.5], [8369, 17.625], [8370, 23.625], [8385, 60.75], [8389, 27.25], [8421, 7.875], [8442, 42.5], [8453, 30.125], [8458, 1.5], [8466, 82.75], [8478, 67.375], [8483, 15.125], [8487, 12.125], [8501, 58.75], [8505, 31.625], [8509, 49.375], [8534, 0.875], [8539, 15.5], [8556, 46.375], [8566, 2.375], [8577, 25.625], [8583, 5.25], [8600, 64.375], [8615, 36.125], [8624, 73.375], [8630, 17.625], [8645, 31.875], [8658, 30.625], [8660, 23.375], [8667, 21.25], [8672, 32.75], [8676, 44.5], [8687, 52.875], [8689, 31.5], [8692, 47.5], [8697, 11.75], [8699, 47.125], [8707, 66.875], [8722, 39.125], [8726, 70.375], [8727, 48.5], [8736, 18.125], [8737, 23.25], [8752, 35.875], [8760, 21.375], [8776, 66.25], [8793, 4.25], [8794, -4.0], [8797, 52.25], [8806, 39.0], [8812, 16.875], [8820, 67.625], [8830, 50.375], [8852, 27.875], [8877, 24.25], [8885, 90.125], [8891, 18.5], [8929, 63.625], [8936, 19.25], [8938, 67.75], [8954, 55.75], [8967, -5.75], [8975, 57.5], [8985, 12.375], [8989, 45.625], [8999, 23.25], [9002, 28.375], [9014, 38.5], [9025, 31.25], [9034, 4.75], [9052, 45.875], [9059, 28.375], [9063, 14.75], [9084, 42.125], [9086, 5.25], [9088, 48.875], [9123, 62.0], [9130, 32.625], [9144, 39.875], [9167, 35.875], [9182, 40.875], [9184, 19.5], [9198, 34.375], [9218, 36.875], [9231, 10.375], [9237, 26.875], [9239, 20.75], [9244, 53.625], [9256, 31.0], [9257, 28.375], [9261, 57.125], [9267, 57.875], [9269, 30.375], [9297, 55.375], [9300, 17.625], [9305, 60.5], [9327, 50.0], [9337, 56.0], [9340, 30.5], [9341, 27.0], [9355, 37.375], [9360, 3.625], [9366, 0.125], [9369, 50.75], [9377, 17.25], [9380, 41.375], [9381, 44.0], [9385, 32.375], [9403, 70.375], [9406, 35.25], [9409, 16.75], [9419, 12.125], [9420, 28.0], [9423, 38.5], [9447, 53.875], [9450, 41.125], [9467, 25.25], [9475, 50.5], [9485, 45.875], [9502, 30.125], [9504, 10.75], [9518, 54.25], [9523, 33.75], [9536, -2.5], [9559, 13.375], [9563, 55.0], [9576, 46.5], [9594, 13.0], [9611, 1.0], [9613, 64.25], [9621, 50.5], [9633, 21.125], [9655, 1.75], [9658, 35.375], [9667, 41.875], [9672, 43.0], [9681, 23.0], [9684, 19.25], [9687, 25.5], [9688, 36.125], [9693, 12.875], [9698, 22.625], [9702, 40.625], [9713, 32.0], [9716, 41.75], [9721, 45.75], [9726, 4.125], [9736, 68.375], [9762, 37.875], [9772, 49.75], [9776, 60.625], [9781, 39.0], [9783, 58.5], [9809, 39.875], [9833, 29.375], [9837, 35.875], [9853, 42.375], [9856, 15.375], [9857, 27.0], [9863, 75.75], [9872, 22.0], [9894, 64.875], [9899, 13.875], [9919, 67.75], [9936, 32.625], [9947, 42.125], [9949, 44.375], [9952, 35.25], [9958, 46.875], [9979, 38.75], [9998, 39.0], [10005, 34.125], [10015, 47.0], [10053, 38.875], [10096, 58.625], [10108, 81.0], [10114, 10.0], [10122, 91.5], [10126, 2.75], [10145, 2.375], [10159, 21.875], [10166, 70.625], [10181, 75.125], [10184, 23.625], [10190, 78.75], [10197, 32.75], [10217, 8.0], [10218, 46.25], [10219, 56.25], [10224, 80.5], [10234, 37.375], [10244, 67.125], [10258, 68.5], [10330, 35.25], [10340, 5.25], [10352, 28.75], [10367, 36.25], [10372, 9.75], [10376, 56.875], [10377, 11.0], [10390, 22.375], [10419, -10.0], [10422, 24.875], [10434, 12.5], [10439, 56.75], [10445, 36.375], [10448, 63.375], [10471, 69.875], [10493, 7.5], [10500, 27.0], [10517, 53.625], [10527, 15.75], [10561, 46.5], [10569, 15.875], [10576, 67.125], [10577, 39.0], [10598, 62.5], [10609, 71.0], [10635, 25.25], [10637, 63.125], [10640, 64.375], [10654, 34.375], [10660, 41.5], [10662, 8.375], [10664, 34.875], [10667, 65.5], [10668, -5.5], [10672, 28.375], [10679, 57.375], [10687, 33.125], [10690, 50.375], [10692, 48.5], [10693, 76.625], [10699, 56.0], [10710, 32.75], [10715, 38.625], [10719, 28.75], [10730, 27.25], [10735, 47.5], [10742, -25.0625], [10746, 26.875], [10750, 65.0], [10753, 23.125], [10754, 28.875], [10758, 7.25], [10766, 69.5], [10768, 14.875], [10773, 44.75], [10780, 27.75], [10785, 55.75], [10789, 13.875], [10798, 53.125], [10817, 37.375], [10821, 47.375], [10822, 69.375], [10862, 22.125], [10863, 48.25], [10866, 37.875], [10889, 46.5], [10924, 36.25], [10944, 61.625], [10955, 54.75], [10966, 53.125], [10969, 57.375], [10978, 23.625], [10979, 4.0], [10987, 32.125], [10999, 36.375], [11025, 12.75], [11026, 49.0], [11031, 39.375], [11034, 61.875], [11048, 20.875], [11050, 58.5], [11053, 13.625], [11055, 41.375], [11056, 29.5], [11057, 6.125], [11067, 33.875], [11069, 35.5], [11072, 66.625], [11074, 22.75], [11085, 56.75], [11111, 15.875], [11112, 54.625], [11123, 50.125], [11149, 77.125], [11185, 34.875], [11221, 19.5], [11250, 7.125], [11266, 50.25], [11279, 27.875], [11280, -18.8125], [11312, 21.0], [11320, 38.875], [11327, 12.625], [11331, 8.5], [11351, 19.25], [11359, 57.75], [11360, 30.625], [11362, 27.25], [11386, 16.0], [11391, 58.25], [11393, 11.875], [11428, 41.375], [11436, 48.5], [11446, 45.25], [11460, 47.25], [11462, 29.125], [11465, 54.25], [11478, 41.375], [11495, 63.625], [11497, 29.5], [11500, 32.5], [11522, 44.375], [11523, 34.75], [11526, 63.875], [11533, 70.875], [11539, 30.5], [11540, 58.5], [11543, 30.0], [11548, 51.5], [11570, 19.125], [11572, 67.5], [11584, 27.375], [11597, 1.125], [11605, 21.875], [11622, 31.25], [11637, 14.375], [11650, 54.375], [11657, 6.5], [11665, 31.0], [11668, 43.25], [11686, 28.75], [11720, 35.875], [11721, 35.75], [11741, 62.875], [11755, 70.75], [11756, 71.5], [11764, -28.0], [11819, 63.0], [11828, 36.875], [11842, 49.0], [11861, -1.125], [11871, 43.625], [11880, 28.0], [11903, 6.125], [11905, 82.0], [11939, 22.875], [11940, 57.0], [11941, 76.25], [11963, 56.375], [11964, 70.0], [11970, 23.875], [11983, -7.5], [11992, 64.75], [12020, 70.0], [12042, 37.5], [12051, 60.25], [12069, 56.5], [12075, 56.375], [12102, 33.875], [12106, 21.875], [12150, 24.375], [12158, 38.75], [12161, -39.125], [12164, 22.0], [12165, 47.75], [12172, 5.625], [12181, 29.5], [12192, 28.25], [12193, 57.875], [12205, 27.75], [12207, 51.25], [12214, 56.0], [12219, 29.125], [12224, 21.125], [12225, 55.375], [12229, 16.25], [12237, 34.0], [12238, 21.875], [12253, 40.375], [12257, 59.75], [12259, 46.625], [12262, 21.5], [12266, 70.0], [12300, 10.75], [12309, 42.375], [12344, 37.125], [12351, 9.5], [12352, 16.875], [12354, 68.25], [12357, 57.5], [12359, 21.5], [12361, 9.25], [12362, 45.875], [12370, -26.875], [12384, 42.125], [12397, 14.0], [12411, 57.25], [12428, 65.625], [12436, 35.625], [12455, 51.625], [12467, 20.375], [12481, 51.5], [12482, 9.625], [12499, -7.25], [12505, 46.125], [12527, 17.375], [12546, 71.75], [12559, 40.125], [12578, 81.375], [12583, 43.5], [12584, 49.125], [12601, 54.0], [12609, 34.75], [12610, 47.375], [12614, 44.375], [12620, 61.5], [12626, 4.625], [12647, 58.375], [12669, 44.5], [12676, 46.375], [12700, 47.75], [12703, 2.375], [12706, 22.625], [12711, -17.125], [12716, 69.0], [12739, 49.0], [12766, 32.25], [12779, 31.75], [12812, 12.25], [12820, 56.875], [12823, 27.75], [12826, 34.875], [12857, 0.25], [12866, 7.625], [12893, 22.125], [12907, 11.0], [12940, 39.5], [12944, 38.875], [12946, 50.875], [12954, 47.75], [12958, 45.125], [12960, 7.125], [12972, 5.375], [13005, -8.125], [13008, 0.25], [13019, 25.625], [13022, 51.75], [13041, 37.125], [13044, 37.625], [13048, 41.5], [13060, -13.75], [13066, 18.5], [13069, 52.875], [13081, 42.75], [13086, 51.0], [13091, 56.125], [13098, 10.75], [13100, 32.125], [13104, 24.25], [13112, 35.875], [13127, 22.5], [13136, 20.5], [13154, 8.375], [13162, 36.75], [13195, 3.75], [13214, 26.5], [13225, 68.125], [13233, 57.0], [13244, 86.0], [13253, 53.625], [13259, 74.625], [13268, 43.0], [13270, 26.125], [13273, 51.25], [13290, 45.5], [13300, 45.625], [13305, 44.5], [13312, 38.25], [13353, 47.75], [13357, 19.375], [13359, 66.375], [13386, 37.0], [13390, 15.125], [13425, 13.375], [13426, 23.25], [13437, 30.75], [13449, 31.375], [13455, 49.0], [13468, 5.0], [13471, 29.25], [13494, 53.625], [13495, -8.375], [13496, 24.375], [13515, -14.125], [13517, 36.125], [13526, 26.5], [13546, -21.25], [13567, 31.375], [13575, 3.75], [13583, 45.25], [13586, 6.125], [13594, 63.125], [13596, 55.0], [13598, 45.75], [13613, 32.875], [13616, 21.625], [13633, 16.625], [13639, 58.75], [13654, 47.25], [13671, 55.75], [13693, 59.375], [13697, 1.75], [13706, 32.5], [13723, 36.75], [13730, 53.875], [13735, 15.5], [13751, -0.625], [13765, 12.75], [13775, 52.5], [13789, 19.875], [13790, 67.375], [13792, 81.25], [13814, 55.625], [13821, 24.875], [13823, -19.6875], [13838, 33.5], [13843, 38.0], [13866, 51.0], [13868, 24.75], [13870, 29.875], [13874, 26.625], [13887, 4.375], [13891, 25.125], [13895, 49.0], [13901, 12.25], [13931, 15.375], [13950, 47.75], [13952, 48.875], [13957, 65.25], [13964, 72.75], [13968, 31.75], [13970, 61.0], [13974, 54.75], [13976, 28.5], [13978, -5.125], [14000, 24.0], [14004, 46.0], [14005, 70.875], [14006, 15.875], [14017, 49.75], [14030, 30.625], [14037, 23.0], [14054, -14.75], [14068, 40.375], [14080, 31.25], [14083, 49.25], [14084, 15.5], [14092, 12.875], [14103, 6.625], [14109, 5.5], [14132, 40.0], [14157, 69.75], [14165, 91.25], [14172, 32.0], [14180, 50.125], [14203, 59.875], [14207, 50.25], [14210, 61.0], [14248, 55.625], [14260, 79.0], [14273, 34.125], [14279, 42.75], [14282, 16.375], [14283, 80.875], [14285, 8.125], [14291, 2.125], [14294, 67.25], [14304, 65.0], [14312, 8.75], [14319, 58.0], [14326, 25.0], [14358, 8.875], [14373, 33.25], [14380, 31.5], [14385, 45.875], [14417, 51.0], [14421, 14.5], [14424, 35.625], [14429, 51.75], [14433, 3.0], [14441, 54.125], [14456, 29.0], [14458, 13.25], [14475, 20.5], [14524, 51.625], [14531, 56.75], [14532, 47.375], [14551, 30.875], [14556, 54.75], [14566, 46.25], [14567, 12.75], [14574, 29.0], [14576, 72.0], [14597, 51.25], [14603, 29.75], [14622, 50.875], [14664, 36.75], [14665, 44.5], [14668, 43.125], [14670, 63.0], [14671, 31.5], [14676, 35.125], [14682, 52.25], [14686, 51.0], [14688, 63.625], [14694, 49.375], [14701, 34.625], [14717, 69.5], [14743, -8.125], [14744, 50.75], [14750, 30.625], [14764, 34.25], [14770, 17.0], [14779, 21.0], [14784, 15.125], [14787, -1.25], [14803, 26.0], [14805, 48.25], [14808, 27.375], [14821, 30.875], [14823, 22.125], [14825, 22.125], [14831, 22.625], [14833, 24.375], [14851, 21.375], [14866, -11.875], [14899, 4.75], [14901, 51.625], [14911, 5.875], [14914, 33.875], [14921, 56.5], [14944, 35.75], [14947, 52.125], [14949, 18.5], [14951, 55.5], [14953, 63.625], [14959, 31.25], [14962, 43.625], [14970, 66.5], [14974, 18.25], [14997, 16.0], [15000, 62.0], [15001, 38.5], [15003, 68.375], [15006, 27.875], [15019, 51.625], [15024, 12.375], [15028, 74.5], [15032, 54.125], [15045, 59.875], [15054, -9.375], [15069, 55.5], [15070, 29.625], [15095, 20.625], [15118, 29.875], [15133, 20.375], [15142, 62.75], [15143, 17.5], [15164, 47.75], [15172, 14.5], [15182, -10.0], [15185, 46.75], [15197, 17.75], [15204, 36.625], [15214, 24.625], [15236, 17.5], [15242, 48.0], [15247, 20.75], [15251, 45.875], [15257, 22.125], [15316, 55.75], [15334, 31.125], [15336, 45.75], [15344, -21.625], [15366, 20.125], [15373, 48.625], [15380, 10.75], [15382, 46.0], [15412, 18.5], [15416, 60.125], [15434, 57.375], [15436, 26.75], [15441, 80.875], [15444, 63.125], [15457, 59.5], [15465, 50.625], [15475, 4.0], [15496, 28.375], [15500, 47.875], [15522, 46.125], [15529, 46.875], [15531, 56.25], [15562, 45.25], [15565, 12.375], [15569, 45.5], [15576, 39.5], [15594, 52.75], [15597, 23.5], [15614, 48.25], [15627, 32.0], [15640, 30.75], [15664, 64.875], [15667, -8.75], [15679, 17.875], [15680, 46.25], [15698, 45.75], [15730, 48.625], [15731, 27.25], [15745, 55.375], [15759, -7.0], [15766, 21.375], [15791, 23.0], [15801, 57.5], [15808, 29.25], [15822, 18.5], [15834, 55.625], [15838, 45.0], [15844, 42.5], [15850, 14.375], [15862, 22.5], [15872, 38.375], [15887, 25.75], [15931, 57.375], [15942, -3.5], [15945, 30.5], [15955, 71.0], [16000, 39.375], [16042, -5.0], [16043, 6.875], [16060, 5.375], [16063, 60.125], [16073, 69.75], [16076, 63.875], [16078, 22.0], [16140, -3.0], [16164, 55.875], [16165, 10.5], [16169, 29.0], [16210, 59.0], [16225, 28.5], [16262, 42.5], [16269, 43.0], [16277, 61.625], [16282, 13.25], [16295, 70.875], [16312, 9.125], [16316, 41.875], [16328, 24.25], [16346, 33.375], [16389, 27.25], [16434, 28.0], [16472, 45.75], [16474, 46.625], [16489, 55.75], [16502, 64.0], [16531, 60.75], [16532, 60.25], [16539, 40.75], [16541, 30.625], [16571, 23.125], [16572, 61.125], [16580, 82.75], [16582, 50.375], [16598, -40.375], [16605, 16.0], [16606, 27.0], [16619, 23.375], [16643, -11.625], [16657, -13.75], [16659, 29.25], [16671, 38.125], [16737, 64.375], [16743, 34.75], [16759, 73.25], [16765, 30.75], [16768, 69.875], [16769, 56.125], [16773, 15.75], [16777, 54.25], [16790, -18.9375], [16804, 53.875], [16831, 28.25], [16851, 25.875], [16854, 50.625], [16868, 11.75], [16882, 53.0], [16891, 85.75], [16919, 32.5], [16937, 56.25], [16938, 44.75], [16941, 56.375], [16965, 52.75], [16977, 13.375], [16982, 54.5], [16987, 23.0], [17002, 9.75], [17018, 68.5], [17020, 33.875], [17030, -6.125], [17044, 48.0], [17049, 42.0], [17077, 38.375], [17101, 38.0], [17115, 24.125], [17135, 12.0], [17154, 57.75], [17160, 46.5], [17171, 53.0], [17172, 39.0], [17193, 49.75], [17216, 76.0], [17229, 33.5], [17251, 6.25], [17278, 29.625], [17279, 27.5], [17322, 88.5], [17325, 25.75], [17346, 66.25], [17364, 8.5], [17392, 67.5], [17394, 8.125], [17395, 46.0], [17397, -14.375], [17403, 51.25], [17405, 53.75], [17408, 1.25], [17420, 15.75], [17431, 76.75], [17443, 72.625], [17447, 13.625], [17463, 23.625], [17482, 2.375], [17509, 7.625], [17527, 31.375], [17536, 22.375], [17540, 25.0], [17551, 26.75], [17552, 40.75], [17553, 56.0], [17554, 30.5], [17563, 24.375], [17564, 35.5], [17574, 63.0], [17577, 45.375], [17589, 18.625], [17610, 47.625], [17618, 26.375], [17637, 67.0], [17650, 42.625], [17661, 15.25], [17664, 37.25], [17668, 71.125], [17687, 55.625], [17723, 45.0], [17745, 56.625], [17755, 6.25], [17756, 1.5], [17757, 30.25], [17766, 26.875], [17777, 19.0], [17780, 24.125], [17794, 44.75], [17795, 8.625], [17805, 23.75], [17824, 25.375], [17854, 31.75], [17860, 77.25], [17870, 39.375], [17874, 46.875], [17893, 4.625], [17899, 17.25], [17912, 57.75], [17922, 63.75], [17929, 16.875], [17933, 32.75], [17938, 83.25], [17963, 5.0], [17974, -7.75], [18006, 28.875], [18019, 80.25], [18030, 46.75], [18033, 15.75], [18040, 55.625], [18073, 9.125], [18086, 21.125], [18102, 24.75], [18129, 23.5], [18130, 61.875], [18132, 65.125], [18138, 65.125], [18164, -27.375], [18206, 52.25], [18218, 78.25], [18225, 8.625], [18242, 55.25], [18266, -10.5], [18275, 39.25], [18283, 21.25], [18285, 26.0], [18299, 56.125], [18318, 29.75], [18322, 21.0], [18335, 38.125], [18346, 34.5], [18352, -0.375], [18355, 23.25], [18358, 52.25], [18359, 56.0], [18380, 58.875], [18395, 12.375], [18400, 40.875], [18406, 48.875], [18418, 13.0], [18419, 24.5], [18424, 27.25], [18432, 63.25], [18433, 36.625], [18434, 22.875], [18442, 35.125], [18470, 38.75], [18472, 45.75], [18493, 20.25], [18499, 39.25], [18500, 22.5], [18502, 15.25], [18518, 28.625], [18524, 68.625], [18532, 26.625], [18564, 58.125], [18565, 30.125], [18568, 61.25], [18578, -12.125], [18588, 72.75], [18589, 34.625], [18603, 34.625], [18628, 24.75], [18641, 39.375], [18642, -29.4375], [18651, 33.125], [18662, 6.0], [18663, 43.375], [18685, 44.125], [18718, 18.25], [18731, -4.625], [18735, 51.125], [18741, 23.25], [18759, 67.375], [18760, 62.75], [18780, 31.0], [18791, 32.875], [18815, 48.0], [18816, 54.5], [18840, 47.0], [18854, 18.375], [18867, 34.5], [18873, 23.875], [18884, 18.875], [18885, 28.75], [18890, 50.0], [18900, 55.125], [18907, 8.125], [18911, 68.5], [18914, -7.375], [18918, -12.3125], [18924, 50.375], [18927, 33.25], [18934, 51.25], [18939, 13.5], [18940, 37.875], [18945, 2.5], [18947, 47.125], [18958, 40.5], [18972, 34.0], [18977, 56.125], [18987, 26.75], [19008, 55.625], [19009, 35.875], [19044, 9.75], [19051, 45.875], [19054, 2.75], [19070, 64.75], [19071, 40.625], [19072, 51.125], [19074, 21.125], [19078, 52.5], [19082, -20.0], [19090, 54.0], [19097, 42.125], [19110, 62.0], [19123, -9.0], [19139, 46.125], [19147, 19.75], [19160, 40.5], [19200, 54.5], [19216, 49.125], [19222, 21.125], [19262, 76.25], [19264, 52.5], [19273, 16.25], [19287, 34.75], [19290, 49.125], [19316, 77.5], [19342, 23.75], [19347, 38.625], [19363, 27.0], [19364, 17.5], [19378, 64.25], [19385, 76.75], [19386, 18.75], [19394, 22.375], [19396, 14.375], [19400, 61.125], [19401, 54.375], [19407, 47.875], [19416, 8.75], [19417, -26.8125], [19422, 30.375], [19434, 34.75], [19437, 6.25], [19454, 26.125], [19459, 83.75], [19460, 22.875], [19476, 4.125], [19494, -11.0625], [19497, 45.625], [19499, 47.625], [19500, 40.5], [19519, -8.5], [19536, 27.5], [19547, 79.375], [19552, 25.125], [19553, 48.125], [19554, 8.5], [19562, 51.375], [19592, 49.875], [19607, 35.75], [19612, 26.5], [19617, 18.5], [19645, 39.75], [19657, 36.75], [19671, 3.125], [19677, 62.875], [19682, 2.875], [19683, 45.75], [19696, 35.625], [19699, 30.125], [19710, 53.75], [19712, 51.625], [19718, 26.375], [19726, 17.5], [19727, 56.0], [19731, 39.375], [19740, 6.5], [19746, 9.75], [19753, 21.75], [19781, 64.5], [19806, 61.125], [19810, 54.75], [19811, 60.875], [19839, -0.5], [19852, 20.875], [19866, 33.5], [19872, 33.75], [19921, 31.25], [19928, 54.25], [19953, 34.375], [19966, 15.75], [19985, 47.625], [19988, 27.125], [19995, 31.25], [20003, 67.875], [20018, 35.25], [20035, 80.25], [20057, 25.0], [20066, 67.375], [20078, 45.5], [20082, 52.375], [20089, 44.0], [20110, 57.875], [20116, 36.625], [20131, 57.0], [20150, 50.375], [20152, 59.125], [20157, 93.75], [20160, 1.75], [20174, 27.125], [20187, 38.0], [20211, 37.375], [20222, 56.0], [20236, 67.0], [20237, 45.5], [20253, 36.75], [20258, 81.5], [20274, 27.5], [20297, 51.625], [20301, -8.0], [20306, 24.625], [20307, 49.0], [20316, 35.25], [20325, 31.375], [20350, 21.875], [20361, 52.0], [20369, 17.625], [20371, 4.0], [20382, 56.375], [20385, 34.25], [20386, 62.875], [20393, 20.75], [20402, 49.875], [20420, 56.625], [20442, 36.25], [20466, 32.5], [20468, 22.875], [20471, 15.875], [20487, 60.125], [20488, 22.0], [20490, 50.125], [20503, 53.625], [20506, 24.875], [20508, -3.375], [20520, 56.625], [20533, 24.875], [20537, 8.5], [20558, 70.25], [20568, 32.625], [20571, 23.5], [20576, 1.25], [20601, 39.875], [20603, -21.0], [20609, 19.75], [20644, 53.375], [20646, 28.375], [20652, 64.625], [20678, 27.5], [20723, 71.0], [20724, 53.375], [20728, 44.5], [20742, 33.125], [20744, 32.25], [20752, 69.125], [20764, 29.625], [20769, 41.0], [20778, 56.0], [20788, 39.0], [20789, 39.125], [20796, 59.25], [20797, 62.875], [20815, 34.375], [20853, 44.625], [20875, 39.875], [20884, 60.375], [20897, 38.25], [20932, 19.25], [20958, 13.5], [20969, 64.0], [20970, 13.0], [21017, 24.125], [21018, -17.25], [21026, 16.75], [21054, -15.75], [21062, 38.125], [21064, 51.375], [21073, 32.375], [21074, 26.5], [21125, 40.375], [21138, 42.625], [21145, 14.375], [21147, 33.875], [21170, -3.0], [21183, -4.5], [21184, 17.25], [21185, 46.25], [21206, 29.875], [21207, 30.125], [21210, 29.5], [21220, 9.75], [21229, 46.75], [21240, 72.5], [21245, 25.75], [21246, 56.0], [21248, 51.5], [21271, 25.875], [21276, 61.625], [21293, 40.0], [21294, 58.75], [21309, 75.0], [21331, 3.375], [21332, 24.5], [21333, 44.125], [21337, 30.75], [21341, 34.625], [21342, 1.75], [21344, 72.875], [21347, 20.125], [21361, 31.25], [21370, 34.0], [21418, 87.25], [21431, 66.5], [21446, 18.875], [21452, 26.25], [21507, 40.625], [21549, 24.125], [21557, 42.5], [21562, 69.75], [21565, 56.375], [21570, 18.75], [21575, 35.625], [21578, 34.0], [21593, 47.75], [21596, 18.625], [21600, 30.5], [21605, 53.875], [21610, 33.5], [21633, 30.375], [21635, 25.75], [21643, 58.5], [21656, 30.0], [21667, 40.875], [21671, -18.625], [21683, 0.25], [21694, -14.875], [21705, 41.625], [21706, 14.625], [21710, 33.625], [21723, 24.375], [21733, 60.0], [21762, 25.875], [21797, 9.5], [21803, 32.625], [21827, 63.125], [21830, -5.0], [21836, 16.5], [21837, 29.875], [21846, 63.75], [21855, 72.0], [21856, 33.375], [21859, -19.6875], [21884, 28.25], [21894, 65.5], [21895, 39.125], [21910, 46.5], [21952, 34.0], [21960, 36.375], [21965, 10.75], [21973, 42.75], [21984, 44.875], [21988, 36.5], [21997, 44.875], [21999, 36.375]]}

wandb/run-20250502_045804-vkih00cc/files/media/table/eval/table_8250_5bdaebcde307e5d62610.table.json

@@ -0,0 +1 @@
+{"columns": ["data_index", "value"], "data": [[22, 78.0], [86, 27.125], [101, 29.5], [105, 13.25], [110, -2.75], [121, 36.25], [124, 59.25], [135, 40.0], [136, 35.75], [138, 36.0], [160, 67.25], [166, 28.25], [177, 51.25], [180, 36.375], [196, 17.625], [208, 45.0], [226, 20.25], [245, 4.875], [258, 15.125], [259, 82.75], [266, 43.375], [273, 20.375], [275, 34.75], [277, 44.5], [288, 27.875], [324, 36.0], [327, 39.125], [339, 24.25], [340, 23.25], [369, 7.0], [400, 53.25], [402, 15.5], [432, 44.375], [438, 27.625], [440, 41.0], [446, 75.5], [458, 33.375], [461, 27.0], [494, 31.0], [500, 44.75], [503, 49.0], [507, 22.25], [511, 61.125], [525, 44.0], [534, 40.0], [538, 3.25], [543, 30.75], [563, 61.375], [567, 29.125], [569, 45.25], [575, 43.75], [591, 13.75], [594, 25.875], [602, 52.0], [609, 5.25], [620, -4.375], [625, 24.375], [679, 60.5], [687, 72.5], [700, 50.125], [716, 25.25], [725, 16.375], [736, 38.375], [740, 53.0], [757, 67.25], [758, 14.25], [769, 40.375], [795, 56.25], [804, 6.875], [806, -6.75], [816, 71.875], [821, 42.5], [831, 12.25], [842, 20.875], [849, 43.0], [862, 20.0], [889, 40.125], [896, 37.75], [903, 24.875], [930, 10.25], [937, 18.25], [940, 45.25], [945, 47.5], [993, 28.25], [999, -27.625], [1014, 35.375], [1043, 17.25], [1045, 48.0], [1062, 35.0], [1064, 42.5], [1066, 79.75], [1069, 30.75], [1077, 51.75], [1082, 42.375], [1099, 5.5], [1100, 5.5], [1108, 43.875], [1122, 30.875], [1136, 18.75], [1143, 37.375], [1147, 34.875], [1151, 64.125], [1166, 61.875], [1172, 23.125], [1185, 11.875], [1186, 49.75], [1195, 39.5], [1196, 5.25], [1225, 73.0], [1232, 33.375], [1233, 40.375], [1239, 41.5], [1247, 31.875], [1280, 55.375], [1285, 23.5], [1286, 65.375], [1289, 33.75], [1304, 49.125], [1313, 38.375], [1324, 66.375], [1327, 22.625], [1329, 27.5], [1340, 52.125], [1350, 18.375], [1357, 24.875], [1392, 23.375], [1394, 43.75], [1415, 51.0], [1421, 27.0], [1435, 25.5], [1450, 27.375], [1488, 52.75], [1489, 22.125], [1509, -4.5], [1526, 8.5], [1530, 24.25], [1551, 80.75], [1557, 43.5], [1558, 72.625], [1565, 37.25], [1580, 69.875], [1583, 18.625], [1588, 78.0], [1660, 81.125], [1675, 43.0], [1684, 37.125], [1694, 59.5], [1696, 34.5], [1703, 16.75], [1705, 48.125], [1755, 23.75], [1762, 50.125], [1764, 37.0], [1788, 63.375], [1796, 0.5], [1811, 44.25], [1814, 82.25], [1830, 42.0], [1834, -9.5], [1836, 31.375], [1851, 9.25], [1852, 46.375], [1870, 6.5], [1871, -1.625], [1889, 17.125], [1898, 36.875], [1907, 31.5], [1914, 57.0], [1915, 48.625], [1916, 36.0], [1918, 1.625], [1925, -15.125], [1927, 90.125], [1928, 53.75], [1970, 60.625], [1995, 25.25], [2002, 24.5], [2016, 67.75], [2019, 14.0], [2020, 25.875], [2083, 30.75], [2120, 62.375], [2135, 51.875], [2146, 31.875], [2153, 54.75], [2195, 25.25], [2203, 34.25], [2226, 73.0], [2231, -4.375], [2253, 16.75], [2254, 27.75], [2269, 2.375], [2275, 51.125], [2290, 51.125], [2303, 55.0], [2311, 59.875], [2312, 43.0], [2347, 20.25], [2357, 48.125], [2368, 54.75], [2369, 34.125], [2376, 103.0], [2380, 1.75], [2414, 48.0], [2425, 7.625], [2454, 47.75], [2462, 51.5], [2481, 49.5], [2483, 37.625], [2485, 3.0], [2490, -25.4375], [2492, 39.375], [2499, 17.25], [2508, 13.25], [2523, 24.0], [2533, 21.625], [2544, 56.0], [2584, 71.0], [2591, 34.0], [2628, 36.375], [2630, -11.75], [2634, 10.875], [2662, 19.875], [2669, -0.5], [2686, 50.125], [2688, 19.0], [2711, 40.875], [2725, 35.875], [2731, 31.5], [2734, 45.0], [2738, 42.125], [2745, -18.625], [2769, 35.75], [2778, 1.875], [2786, 53.375], [2808, 109.125], [2818, 8.125], [2820, 40.25], [2822, 79.25], [2834, 79.375], [2843, 80.0], [2851, 68.5], [2866, -7.125], [2892, 34.75], [2922, 34.375], [2926, 52.75], [2935, 21.75], [2950, 31.875], [2960, 23.5], [2965, 19.625], [2970, 18.5], [2984, 78.625], [2988, 29.125], [2994, 63.5], [3006, 41.0], [3017, 31.75], [3020, 13.625], [3058, 29.25], [3061, 66.625], [3064, 40.5], [3073, 64.375], [3092, 22.375], [3108, 70.125], [3118, 27.75], [3138, 27.25], [3144, 67.25], [3149, 68.25], [3153, 26.0], [3154, 35.875], [3157, 20.375], [3165, 31.375], [3166, 29.5], [3171, 42.75], [3181, 67.5], [3196, 15.25], [3230, 35.75], [3233, 60.75], [3244, 77.375], [3265, 50.0], [3268, 39.375], [3283, 22.625], [3296, -2.5], [3298, 46.375], [3307, 56.125], [3321, 32.5], [3353, 1.0], [3362, 56.875], [3368, 28.375], [3375, 35.75], [3393, 29.5], [3395, 43.125], [3400, 41.5], [3401, 27.0], [3423, 57.0], [3429, 9.875], [3434, 2.125], [3447, 68.5], [3456, 25.875], [3479, 33.25], [3484, 30.5], [3574, 53.5], [3581, 63.0], [3587, -6.5], [3604, 62.0], [3629, 9.5], [3643, 54.375], [3648, 40.25], [3657, 20.25], [3662, 26.875], [3695, 48.375], [3697, 33.875], [3699, 17.375], [3703, 55.75], [3721, 57.375], [3732, 15.25], [3738, 73.125], [3746, 19.625], [3748, 30.0], [3750, 14.5], [3779, 69.0], [3786, 50.25], [3796, 37.0], [3805, 25.375], [3816, 57.125], [3845, 47.75], [3846, 1.875], [3864, 51.25], [3880, 35.375], [3892, 57.0], [3895, 31.625], [3902, 58.125], [3933, 24.375], [3938, 54.375], [3940, 54.0], [3954, 44.0], [3961, 63.5], [3974, 55.625], [3976, 1.0], [3980, 29.375], [3990, 22.125], [3997, 43.25], [3998, 119.5], [3999, 15.0], [4001, 29.125], [4005, 45.75], [4012, 70.0], [4014, 38.0], [4015, 33.625], [4023, 41.375], [4042, 9.875], [4047, 29.875], [4048, 25.375], [4091, 72.75], [4097, 56.25], [4106, 27.125], [4120, 54.875], [4125, 19.5], [4151, 19.25], [4161, 61.5], [4162, 37.5], [4163, 24.5], [4164, -3.375], [4185, 25.625], [4193, 24.125], [4195, 40.625], [4197, 11.5], [4198, 29.5], [4201, 34.0], [4206, 61.375], [4227, 68.5], [4240, 33.375], [4244, 58.625], [4246, 6.625], [4252, 26.25], [4267, -5.75], [4271, 18.625], [4275, 11.25], [4297, 8.125], [4307, 53.375], [4337, 33.125], [4352, 60.0], [4365, 19.0], [4380, 33.375], [4382, 59.125], [4399, 15.125], [4405, 64.75], [4415, 59.75], [4417, 47.375], [4436, 19.25], [4441, 70.875], [4453, 24.375], [4469, 48.0], [4474, -13.0], [4491, 66.75], [4500, 27.0], [4503, 46.0], [4517, 24.625], [4538, 34.5], [4588, 76.5], [4589, 37.0], [4602, 48.125], [4606, 12.0], [4631, 57.75], [4640, 46.25], [4649, 28.375], [4651, 71.125], [4665, 25.625], [4690, 62.5], [4703, 35.25], [4706, 15.125], [4724, 28.75], [4750, 24.625], [4752, 44.25], [4763, 48.375], [4773, 23.5], [4778, 14.75], [4789, 30.75], [4804, 24.5], [4809, 72.75], [4813, 47.75], [4822, 27.0], [4839, 26.125], [4841, 1.875], [4858, 59.5], [4878, 50.125], [4899, 22.5], [4916, 44.0], [4923, 52.625], [4929, 32.5], [4954, 56.25], [4955, 27.625], [4971, 74.5], [4985, 45.0], [4999, 42.125], [5000, 49.875], [5003, 49.125], [5006, 29.5], [5017, 42.5], [5021, 19.0], [5043, 31.25], [5055, 54.625], [5062, 27.125], [5064, 59.625], [5074, 59.125], [5075, 34.375], [5081, 38.375], [5101, 42.625], [5103, 5.125], [5119, 40.0], [5137, 31.0], [5138, 21.25], [5142, 5.0], [5151, 27.375], [5152, 10.625], [5164, 41.125], [5207, 41.5], [5209, 37.375], [5226, 81.25], [5229, 85.125], [5235, 63.75], [5246, -21.0625], [5256, 11.0], [5265, 26.375], [5274, 43.0], [5279, 16.875], [5284, 35.625], [5303, 35.25], [5311, 72.875], [5319, 33.25], [5320, -5.25], [5322, 80.875], [5325, 56.125], [5357, 29.375], [5374, 34.875], [5375, 31.875], [5380, 56.5], [5384, 62.5], [5389, 46.25], [5390, 22.875], [5394, 43.875], [5409, 50.375], [5410, 64.75], [5420, 15.25], [5421, 38.625], [5428, 2.25], [5431, 30.875], [5450, 9.5], [5465, 50.625], [5472, 22.5], [5484, 10.625], [5486, 58.125], [5487, 61.25], [5489, 19.375], [5524, 46.125], [5541, 32.875], [5542, 31.625], [5568, 36.625], [5586, 55.875], [5589, 3.375], [5594, 16.875], [5598, 38.625], [5615, 48.875], [5617, 63.0], [5653, 39.375], [5655, 24.75], [5676, 42.0], [5704, 32.625], [5709, 38.25], [5711, 51.875], [5751, 47.0], [5767, 69.0], [5777, 31.375], [5783, 43.0], [5786, 35.0], [5825, 38.75], [5831, 28.0], [5841, 35.875], [5851, 25.875], [5853, 25.125], [5859, 21.875], [5865, 43.375], [5930, 40.5], [5983, 36.25], [6001, 29.625], [6010, 70.25], [6016, 47.375], [6017, 2.625], [6019, 56.625], [6025, 59.375], [6028, 60.0], [6029, 31.125], [6035, 51.75], [6037, 26.0], [6077, 18.5], [6083, 11.875], [6094, 30.375], [6107, 41.75], [6126, 37.25], [6136, 14.0], [6152, 30.625], [6194, 62.375], [6202, 26.375], [6203, 6.5], [6210, 83.375], [6211, 18.125], [6219, 23.25], [6296, 59.0], [6305, 49.0], [6326, 52.75], [6337, 33.375], [6349, 35.25], [6360, 27.5], [6375, 75.75], [6378, -2.875], [6400, 66.25], [6412, 38.625], [6434, 0.375], [6469, 93.75], [6471, 56.0], [6480, 33.75], [6490, 53.75], [6508, 16.25], [6543, 61.625], [6547, 19.25], [6561, 38.75], [6576, 56.75], [6589, 15.5], [6600, 50.0], [6604, 20.75], [6613, 35.25], [6621, 54.125], [6625, 29.5], [6626, 77.875], [6636, 2.75], [6645, 31.375], [6684, 50.25], [6688, 34.0], [6689, 5.375], [6705, 69.5], [6720, 52.5], [6736, 30.125], [6749, 28.125], [6752, -4.25], [6760, 73.875], [6769, 25.875], [6771, 69.125], [6778, 20.0], [6786, 43.625], [6789, 47.125], [6803, 75.75], [6861, 16.25], [6866, 45.25], [6869, 25.25], [6872, 31.25], [6877, 56.5], [6884, 49.25], [6888, 58.5], [6889, 28.25], [6898, 61.0], [6993, 37.125], [7011, 28.5], [7013, 13.75], [7016, 25.75], [7027, 39.25], [7035, 32.875], [7045, 62.125], [7046, 43.5], [7049, 46.125], [7068, 53.25], [7072, 10.75], [7085, -18.0], [7090, 33.125], [7097, 18.375], [7101, 24.625], [7102, 71.0], [7109, 17.375], [7132, 31.75], [7139, 53.25], [7141, 61.375], [7144, -3.5], [7152, 33.0], [7167, -0.25], [7170, 74.625], [7185, 14.125], [7186, 58.375], [7202, 65.5], [7207, -8.5], [7211, 48.625], [7227, 5.625], [7236, -9.375], [7250, 11.5], [7257, 6.375], [7274, 19.125], [7278, 47.5], [7280, 11.875], [7281, 14.5], [7290, -2.625], [7298, 7.875], [7299, 47.25], [7302, 42.125], [7306, -19.0], [7318, 28.25], [7321, 61.125], [7330, 39.125], [7334, 21.625], [7336, 49.375], [7341, 95.25], [7344, 29.5], [7347, 28.0], [7361, 12.5], [7369, 58.875], [7397, 48.625], [7408, 45.5], [7427, 1.875], [7430, 24.375], [7439, 71.625], [7453, 29.5], [7473, 3.75], [7478, 56.0], [7488, 31.25], [7503, 44.5], [7518, 37.375], [7544, 52.375], [7552, 35.125], [7576, 27.625], [7577, 40.5], [7597, 40.75], [7605, 28.0], [7616, 51.25], [7620, -3.125], [7656, 51.25], [7659, 47.375], [7681, 3.0], [7692, 54.5], [7710, 16.375], [7713, 12.75], [7722, 45.625], [7723, 73.25], [7742, 27.625], [7743, 23.75], [7750, 20.25], [7790, 46.875], [7801, -6.5], [7811, -29.875], [7815, 57.125], [7843, -18.125], [7844, 64.0], [7857, 35.75], [7868, 13.625], [7877, 25.75], [7887, 32.875], [7897, 52.25], [7902, 93.0], [7910, 25.5], [7912, 19.0], [7918, 64.875], [7933, 46.375], [7936, 70.5], [7951, 35.5], [7953, 48.625], [7957, 22.75], [7962, 41.75], [7971, 9.5], [7974, 12.75], [7991, 62.5], [8000, 29.0], [8008, 48.625], [8018, 34.0], [8024, 13.0], [8047, -7.125], [8060, 5.25], [8077, 12.0], [8086, 39.625], [8104, 44.0], [8118, 26.5], [8133, 29.875], [8138, 32.375], [8145, 51.375], [8150, 43.125], [8168, 84.5], [8170, 43.625], [8173, 42.625], [8175, 16.375], [8194, 48.875], [8211, 2.875], [8253, 26.625], [8262, -21.3125], [8263, 55.0], [8265, 76.5], [8268, 54.625], [8271, 22.0], [8272, 50.75], [8273, -1.25], [8277, 37.875], [8292, 40.625], [8344, 31.75], [8346, 32.625], [8350, 37.875], [8364, 53.5], [8369, 16.125], [8370, 23.75], [8385, 61.875], [8389, 24.0], [8421, 5.375], [8442, 43.125], [8453, 34.625], [8458, 3.125], [8466, 84.875], [8478, 69.375], [8483, 13.375], [8487, 12.25], [8501, 56.375], [8505, 30.125], [8509, 50.875], [8534, -0.125], [8539, 14.75], [8556, 48.25], [8566, 1.25], [8577, 24.375], [8583, 7.875], [8600, 61.25], [8615, 36.5], [8624, 73.375], [8630, 16.375], [8645, 33.125], [8658, 33.0], [8660, 26.125], [8667, 20.0], [8672, 36.875], [8676, 46.625], [8687, 58.0], [8689, 30.75], [8692, 48.625], [8697, 10.125], [8699, 48.125], [8707, 71.75], [8722, 42.0], [8726, 72.625], [8727, 53.25], [8736, 18.125], [8737, 25.375], [8752, 40.25], [8760, 25.5], [8776, 63.125], [8793, 1.875], [8794, -3.5], [8797, 49.125], [8806, 43.0], [8812, 19.625], [8820, 67.0], [8830, 54.125], [8852, 26.125], [8877, 23.375], [8885, 87.125], [8891, 18.125], [8929, 63.625], [8936, 20.25], [8938, 64.75], [8954, 58.125], [8967, -7.5], [8975, 59.375], [8985, 14.375], [8989, 47.375], [8999, 26.0], [9002, 32.0], [9014, 44.0], [9025, 31.5], [9034, 5.125], [9052, 43.375], [9059, 27.875], [9063, 12.75], [9084, 45.625], [9086, 5.125], [9088, 45.625], [9123, 61.375], [9130, 35.25], [9144, 36.5], [9167, 41.25], [9182, 42.125], [9184, 19.25], [9198, 36.0], [9218, 38.375], [9231, 8.375], [9237, 26.625], [9239, 22.0], [9244, 50.75], [9256, 33.5], [9257, 27.375], [9261, 59.5], [9267, 59.5], [9269, 32.125], [9297, 63.125], [9300, 15.875], [9305, 63.0], [9327, 49.875], [9337, 59.75], [9340, 27.0], [9341, 27.5], [9355, 39.625], [9360, 2.875], [9366, 0.25], [9369, 51.125], [9377, 20.875], [9380, 36.625], [9381, 40.75], [9385, 34.5], [9403, 74.5], [9406, 36.25], [9409, 21.25], [9419, 12.125], [9420, 27.75], [9423, 41.0], [9447, 53.0], [9450, 46.0], [9467, 24.25], [9475, 48.5], [9485, 43.5], [9502, 28.375], [9504, 7.125], [9518, 58.625], [9523, 38.75], [9536, -4.75], [9559, 14.25], [9563, 61.0], [9576, 47.125], [9594, 14.25], [9611, 6.125], [9613, 64.75], [9621, 48.0], [9633, 23.375], [9655, 2.25], [9658, 39.75], [9667, 42.5], [9672, 40.75], [9681, 27.5], [9684, 25.0], [9687, 26.625], [9688, 37.125], [9693, 13.75], [9698, 21.75], [9702, 40.25], [9713, 35.0], [9716, 38.75], [9721, 44.25], [9726, 7.0], [9736, 67.125], [9762, 38.875], [9772, 56.375], [9776, 58.125], [9781, 39.125], [9783, 61.25], [9809, 46.625], [9833, 29.75], [9837, 42.5], [9853, 42.5], [9856, 15.5], [9857, 28.0], [9863, 73.625], [9872, 21.5], [9894, 62.25], [9899, 14.625], [9919, 69.0], [9936, 35.375], [9947, 40.375], [9949, 45.125], [9952, 35.75], [9958, 48.125], [9979, 40.0], [9998, 38.5], [10005, 35.875], [10015, 49.125], [10053, 41.0], [10096, 62.875], [10108, 79.5], [10114, 15.125], [10122, 97.25], [10126, 3.375], [10145, 1.25], [10159, 20.5], [10166, 69.875], [10181, 77.375], [10184, 27.375], [10190, 86.75], [10197, 29.75], [10217, 7.0], [10218, 47.25], [10219, 55.25], [10224, 81.25], [10234, 38.25], [10244, 70.5], [10258, 69.75], [10330, 36.75], [10340, 6.875], [10352, 27.0], [10367, 36.75], [10372, 11.5], [10376, 56.625], [10377, 14.0], [10390, 20.625], [10419, -12.0], [10422, 24.375], [10434, 13.125], [10439, 55.25], [10445, 39.375], [10448, 65.625], [10471, 66.875], [10493, 10.25], [10500, 31.25], [10517, 52.625], [10527, 16.125], [10561, 48.625], [10569, 20.875], [10576, 65.25], [10577, 40.125], [10598, 62.125], [10609, 71.5], [10635, 28.25], [10637, 64.0], [10640, 65.625], [10654, 33.625], [10660, 42.125], [10662, 10.125], [10664, 36.75], [10667, 67.0], [10668, -8.875], [10672, 31.375], [10679, 58.125], [10687, 29.75], [10690, 47.0], [10692, 54.75], [10693, 78.75], [10699, 56.5], [10710, 36.0], [10715, 41.75], [10719, 28.25], [10730, 30.0], [10735, 42.875], [10742, -27.4375], [10746, 23.75], [10750, 69.375], [10753, 21.625], [10754, 35.0], [10758, 7.5], [10766, 72.125], [10768, 12.625], [10773, 49.375], [10780, 26.0], [10785, 56.125], [10789, 14.25], [10798, 54.0], [10817, 38.875], [10821, 50.125], [10822, 67.75], [10862, 21.375], [10863, 50.625], [10866, 39.375], [10889, 48.75], [10924, 39.0], [10944, 62.125], [10955, 58.125], [10966, 51.625], [10969, 54.875], [10978, 23.625], [10979, 3.25], [10987, 31.625], [10999, 38.5], [11025, 14.125], [11026, 53.25], [11031, 41.75], [11034, 66.125], [11048, 23.375], [11050, 56.0], [11053, 12.375], [11055, 44.0], [11056, 32.375], [11057, 5.875], [11067, 34.375], [11069, 36.75], [11072, 70.5], [11074, 24.625], [11085, 59.0], [11111, 14.375], [11112, 54.25], [11123, 53.5], [11149, 79.25], [11185, 34.875], [11221, 24.75], [11250, 10.625], [11266, 54.0], [11279, 26.0], [11280, -18.0625], [11312, 21.25], [11320, 39.0], [11327, 17.375], [11331, 7.125], [11351, 19.875], [11359, 57.875], [11360, 32.125], [11362, 28.75], [11386, 15.75], [11391, 56.375], [11393, 9.125], [11428, 43.5], [11436, 47.875], [11446, 49.25], [11460, 48.125], [11462, 27.25], [11465, 60.0], [11478, 43.125], [11495, 64.0], [11497, 27.875], [11500, 30.125], [11522, 43.125], [11523, 36.0], [11526, 68.125], [11533, 74.875], [11539, 32.25], [11540, 59.625], [11543, 30.5], [11548, 52.875], [11570, 21.75], [11572, 67.125], [11584, 30.0], [11597, 0.625], [11605, 22.375], [11622, 36.75], [11637, 15.875], [11650, 53.375], [11657, 8.25], [11665, 30.625], [11668, 46.0], [11686, 28.5], [11720, 35.75], [11721, 37.625], [11741, 66.375], [11755, 71.75], [11756, 72.875], [11764, -26.5], [11819, 66.0], [11828, 40.375], [11842, 51.625], [11861, -0.5], [11871, 46.125], [11880, 26.625], [11903, 5.25], [11905, 76.75], [11939, 24.625], [11940, 61.0], [11941, 80.0], [11963, 57.25], [11964, 70.0], [11970, 25.875], [11983, -8.625], [11992, 64.125], [12020, 71.5], [12042, 33.375], [12051, 61.375], [12069, 56.875], [12075, 55.375], [12102, 33.375], [12106, 19.5], [12150, 25.125], [12158, 39.125], [12161, -44.875], [12164, 21.625], [12165, 55.5], [12172, 5.625], [12181, 31.25], [12192, 35.0], [12193, 59.125], [12205, 28.5], [12207, 52.5], [12214, 57.75], [12219, 29.0], [12224, 21.375], [12225, 57.75], [12229, 18.5], [12237, 34.25], [12238, 25.5], [12253, 43.125], [12257, 62.5], [12259, 44.75], [12262, 26.0], [12266, 70.25], [12300, 12.0], [12309, 45.875], [12344, 39.5], [12351, 7.75], [12352, 17.0], [12354, 71.125], [12357, 58.375], [12359, 26.75], [12361, 6.75], [12362, 44.125], [12370, -25.75], [12384, 44.375], [12397, 14.75], [12411, 55.625], [12428, 68.25], [12436, 34.125], [12455, 53.75], [12467, 20.875], [12481, 51.375], [12482, 4.125], [12499, -7.5], [12505, 47.25], [12527, 17.875], [12546, 74.5], [12559, 40.625], [12578, 81.25], [12583, 45.25], [12584, 49.75], [12601, 52.25], [12609, 31.625], [12610, 46.625], [12614, 46.125], [12620, 60.75], [12626, 7.0], [12647, 58.125], [12669, 44.25], [12676, 49.75], [12700, 46.75], [12703, 5.625], [12706, 21.625], [12711, -18.375], [12716, 68.875], [12739, 51.0], [12766, 31.75], [12779, 30.0], [12812, 13.625], [12820, 55.625], [12823, 28.125], [12826, 35.0], [12857, 6.25], [12866, 8.25], [12893, 21.0], [12907, 8.75], [12940, 41.25], [12944, 40.0], [12946, 52.125], [12954, 45.125], [12958, 47.5], [12960, 7.375], [12972, 2.375], [13005, -6.375], [13008, -1.125], [13019, 27.625], [13022, 47.875], [13041, 36.375], [13044, 38.25], [13048, 42.75], [13060, -14.5], [13066, 14.75], [13069, 50.0], [13081, 40.5], [13086, 50.5], [13091, 60.25], [13098, 9.0], [13100, 30.625], [13104, 26.75], [13112, 41.5], [13127, 22.75], [13136, 19.75], [13154, 5.5], [13162, 36.25], [13195, 2.5], [13214, 25.75], [13225, 66.25], [13233, 60.0], [13244, 89.375], [13253, 52.75], [13259, 71.25], [13268, 44.5], [13270, 25.25], [13273, 49.375], [13290, 45.375], [13300, 45.375], [13305, 47.5], [13312, 39.0], [13353, 50.0], [13357, 21.75], [13359, 71.5], [13386, 35.5], [13390, 15.125], [13425, 9.375], [13426, 23.25], [13437, 36.0], [13449, 32.5], [13455, 49.375], [13468, 2.0], [13471, 26.375], [13494, 54.625], [13495, -7.875], [13496, 25.625], [13515, -13.625], [13517, 35.0], [13526, 31.125], [13546, -17.8125], [13567, 33.75], [13575, 0.875], [13583, 42.75], [13586, 6.625], [13594, 64.0], [13596, 52.625], [13598, 50.0], [13613, 33.25], [13616, 22.5], [13633, 15.0], [13639, 60.875], [13654, 48.0], [13671, 60.25], [13693, 55.75], [13697, 2.25], [13706, 31.0], [13723, 38.375], [13730, 50.25], [13735, 12.625], [13751, 1.625], [13765, 14.5], [13775, 53.0], [13789, 19.125], [13790, 66.5], [13792, 81.75], [13814, 52.25], [13821, 26.375], [13823, -23.9375], [13838, 35.0], [13843, 39.5], [13866, 52.625], [13868, 29.25], [13870, 30.625], [13874, 25.0], [13887, 4.25], [13891, 28.625], [13895, 53.875], [13901, 15.125], [13931, 17.0], [13950, 52.875], [13952, 49.0], [13957, 70.125], [13964, 77.0], [13968, 29.875], [13970, 59.5], [13974, 49.875], [13976, 30.5], [13978, -8.375], [14000, 27.0], [14004, 44.875], [14005, 66.375], [14006, 16.875], [14017, 49.75], [14030, 25.875], [14037, 24.0], [14054, -19.625], [14068, 42.25], [14080, 34.25], [14083, 52.125], [14084, 16.75], [14092, 13.25], [14103, 7.25], [14109, 2.5], [14132, 40.5], [14157, 72.75], [14165, 91.125], [14172, 28.5], [14180, 50.5], [14203, 59.625], [14207, 53.0], [14210, 63.375], [14248, 59.125], [14260, 80.375], [14273, 36.25], [14279, 39.125], [14282, 13.75], [14283, 81.75], [14285, 8.125], [14291, 1.625], [14294, 66.75], [14304, 67.625], [14312, 9.25], [14319, 54.0], [14326, 29.5], [14358, 9.5], [14373, 32.625], [14380, 29.875], [14385, 44.125], [14417, 54.375], [14421, 9.125], [14424, 37.0], [14429, 50.875], [14433, 2.5], [14441, 59.5], [14456, 29.625], [14458, 21.0], [14475, 20.5], [14524, 51.375], [14531, 51.875], [14532, 46.5], [14551, 31.0], [14556, 60.875], [14566, 50.375], [14567, 15.25], [14574, 32.75], [14576, 75.375], [14597, 56.5], [14603, 31.125], [14622, 51.375], [14664, 37.75], [14665, 45.75], [14668, 45.75], [14670, 62.75], [14671, 30.5], [14676, 36.0], [14682, 53.75], [14686, 49.25], [14688, 66.125], [14694, 50.625], [14701, 33.5], [14717, 67.5], [14743, -8.0], [14744, 51.5], [14750, 30.0], [14764, 40.5], [14770, 20.125], [14779, 25.0], [14784, 16.125], [14787, 4.75], [14803, 27.0], [14805, 49.25], [14808, 27.875], [14821, 34.75], [14823, 23.625], [14825, 21.5], [14831, 21.625], [14833, 28.125], [14851, 24.375], [14866, -13.75], [14899, 6.5], [14901, 52.875], [14911, 6.125], [14914, 33.25], [14921, 58.25], [14944, 36.625], [14947, 52.125], [14949, 19.25], [14951, 55.5], [14953, 60.625], [14959, 32.25], [14962, 47.25], [14970, 67.125], [14974, 20.625], [14997, 17.375], [15000, 68.75], [15001, 36.25], [15003, 69.25], [15006, 27.75], [15019, 52.875], [15024, 14.75], [15028, 76.125], [15032, 54.75], [15045, 56.5], [15054, -9.375], [15069, 55.125], [15070, 32.625], [15095, 21.125], [15118, 29.875], [15133, 20.875], [15142, 60.125], [15143, 21.25], [15164, 49.75], [15172, 16.0], [15182, -11.625], [15185, 47.75], [15197, 21.375], [15204, 40.0], [15214, 23.625], [15236, 18.0], [15242, 49.25], [15247, 24.125], [15251, 49.0], [15257, 23.5], [15316, 59.625], [15334, 31.875], [15336, 44.75], [15344, -17.5], [15366, 18.75], [15373, 49.0], [15380, 8.25], [15382, 44.5], [15412, 21.75], [15416, 58.75], [15434, 55.0], [15436, 22.0], [15441, 83.75], [15444, 64.0], [15457, 61.625], [15465, 53.0], [15475, 4.625], [15496, 34.0], [15500, 45.875], [15522, 41.375], [15529, 47.5], [15531, 52.0], [15562, 48.5], [15565, 14.375], [15569, 45.125], [15576, 34.375], [15594, 53.25], [15597, 23.375], [15614, 53.25], [15627, 33.5], [15640, 31.0], [15664, 68.625], [15667, -11.625], [15679, 14.75], [15680, 48.375], [15698, 45.75], [15730, 51.375], [15731, 25.875], [15745, 54.625], [15759, -8.5], [15766, 19.375], [15791, 25.125], [15801, 61.75], [15808, 30.625], [15822, 22.875], [15834, 58.375], [15838, 45.625], [15844, 44.75], [15850, 14.875], [15862, 20.375], [15872, 38.0], [15887, 26.25], [15931, 59.0], [15942, -6.125], [15945, 26.875], [15955, 72.375], [16000, 39.75], [16042, -2.625], [16043, 7.5], [16060, 2.625], [16063, 62.25], [16073, 66.75], [16076, 69.75], [16078, 23.125], [16140, -5.25], [16164, 53.75], [16165, 11.75], [16169, 29.0], [16210, 62.375], [16225, 28.25], [16262, 39.25], [16269, 51.25], [16277, 62.75], [16282, 15.125], [16295, 72.0], [16312, 8.875], [16316, 44.625], [16328, 28.0], [16346, 32.125], [16389, 25.5], [16434, 29.75], [16472, 49.5], [16474, 49.125], [16489, 58.125], [16502, 63.25], [16531, 58.75], [16532, 63.5], [16539, 37.75], [16541, 32.75], [16571, 24.75], [16572, 60.5], [16580, 88.375], [16582, 49.25], [16598, -43.375], [16605, 20.0], [16606, 26.375], [16619, 24.125], [16643, -11.0], [16657, -16.4375], [16659, 29.875], [16671, 34.875], [16737, 68.0], [16743, 36.25], [16759, 74.5], [16765, 31.625], [16768, 71.5], [16769, 58.5], [16773, 15.375], [16777, 53.375], [16790, -17.1875], [16804, 57.375], [16831, 27.625], [16851, 31.875], [16854, 53.375], [16868, 12.5], [16882, 50.25], [16891, 86.125], [16919, 36.125], [16937, 57.0], [16938, 43.875], [16941, 59.0], [16965, 54.5], [16977, 15.125], [16982, 52.875], [16987, 22.125], [17002, 9.0], [17018, 71.125], [17020, 33.375], [17030, -6.625], [17044, 46.625], [17049, 42.5], [17077, 41.0], [17101, 37.0], [17115, 28.375], [17135, 9.75], [17154, 61.75], [17160, 42.5], [17171, 50.125], [17172, 38.625], [17193, 55.0], [17216, 73.875], [17229, 34.25], [17251, 6.25], [17278, 34.125], [17279, 26.25], [17322, 88.25], [17325, 25.875], [17346, 68.0], [17364, 6.25], [17392, 68.5], [17394, 13.625], [17395, 50.75], [17397, -17.25], [17403, 55.5], [17405, 52.5], [17408, 0.5], [17420, 16.375], [17431, 81.0], [17443, 74.0], [17447, 12.25], [17463, 21.0], [17482, 0.75], [17509, 6.875], [17527, 32.625], [17536, 22.125], [17540, 29.5], [17551, 26.75], [17552, 38.125], [17553, 55.0], [17554, 30.25], [17563, 27.875], [17564, 35.25], [17574, 67.75], [17577, 54.0], [17589, 19.75], [17610, 42.375], [17618, 31.625], [17637, 70.0], [17650, 42.125], [17661, 16.375], [17664, 37.375], [17668, 73.875], [17687, 55.875], [17723, 44.75], [17745, 58.0], [17755, 5.75], [17756, 2.5], [17757, 30.875], [17766, 29.25], [17777, 19.5], [17780, 24.75], [17794, 40.5], [17795, 9.875], [17805, 24.125], [17824, 27.5], [17854, 34.375], [17860, 85.125], [17870, 37.0], [17874, 47.875], [17893, 3.875], [17899, 18.25], [17912, 56.875], [17922, 63.0], [17929, 17.75], [17933, 34.5], [17938, 87.125], [17963, 8.625], [17974, -6.625], [18006, 29.625], [18019, 86.375], [18030, 47.25], [18033, 16.75], [18040, 55.25], [18073, 7.25], [18086, 19.375], [18102, 22.5], [18129, 21.25], [18130, 63.875], [18132, 67.125], [18138, 66.375], [18164, -25.625], [18206, 56.375], [18218, 82.625], [18225, 10.375], [18242, 57.125], [18266, -12.375], [18275, 40.875], [18283, 24.75], [18285, 23.125], [18299, 59.125], [18318, 29.875], [18322, 22.375], [18335, 37.0], [18346, 35.375], [18352, 0.75], [18355, 18.75], [18358, 51.0], [18359, 57.25], [18380, 55.625], [18395, 11.0], [18400, 38.5], [18406, 48.75], [18418, 12.875], [18419, 23.0], [18424, 32.25], [18432, 62.25], [18433, 36.875], [18434, 23.75], [18442, 33.375], [18470, 40.125], [18472, 48.25], [18493, 20.875], [18499, 45.0], [18500, 22.25], [18502, 14.375], [18518, 28.0], [18524, 69.375], [18532, 31.625], [18564, 57.625], [18565, 31.125], [18568, 66.75], [18578, -10.25], [18588, 75.125], [18589, 35.75], [18603, 37.625], [18628, 22.375], [18641, 39.5], [18642, -34.1875], [18651, 37.125], [18662, 8.5], [18663, 46.0], [18685, 40.75], [18718, 21.25], [18731, -4.375], [18735, 51.125], [18741, 23.875], [18759, 67.625], [18760, 63.25], [18780, 33.25], [18791, 36.75], [18815, 47.625], [18816, 58.75], [18840, 50.625], [18854, 17.375], [18867, 39.625], [18873, 28.0], [18884, 20.625], [18885, 24.375], [18890, 55.5], [18900, 57.5], [18907, 11.25], [18911, 69.5], [18914, -4.875], [18918, -12.1875], [18924, 56.875], [18927, 33.125], [18934, 53.125], [18939, 12.75], [18940, 42.0], [18945, 4.25], [18947, 46.375], [18958, 35.0], [18972, 35.25], [18977, 55.25], [18987, 31.75], [19008, 55.75], [19009, 38.125], [19044, 13.375], [19051, 46.625], [19054, 6.0], [19070, 67.625], [19071, 39.75], [19072, 52.25], [19074, 22.25], [19078, 53.875], [19082, -17.625], [19090, 53.875], [19097, 46.625], [19110, 66.5], [19123, -8.5], [19139, 44.375], [19147, 20.75], [19160, 40.75], [19200, 60.25], [19216, 48.125], [19222, 19.75], [19262, 75.5], [19264, 46.125], [19273, 18.5], [19287, 32.5], [19290, 48.875], [19316, 76.125], [19342, 28.125], [19347, 38.0], [19363, 25.875], [19364, 25.75], [19378, 62.0], [19385, 81.75], [19386, 16.5], [19394, 24.375], [19396, 15.875], [19400, 60.5], [19401, 58.0], [19407, 51.5], [19416, 8.75], [19417, -29.5625], [19422, 28.75], [19434, 37.375], [19437, 3.875], [19454, 25.5], [19459, 83.625], [19460, 23.125], [19476, 4.125], [19494, -6.9375], [19497, 47.375], [19499, 49.5], [19500, 40.875], [19519, -8.375], [19536, 33.25], [19547, 82.0], [19552, 25.125], [19553, 51.25], [19554, 10.25], [19562, 50.5], [19592, 49.375], [19607, 33.875], [19612, 26.125], [19617, 25.125], [19645, 43.375], [19657, 39.0], [19671, 4.0], [19677, 64.875], [19682, 3.0], [19683, 45.125], [19696, 36.125], [19699, 35.5], [19710, 55.5], [19712, 48.625], [19718, 26.625], [19726, 20.5], [19727, 60.25], [19731, 40.125], [19740, 7.0], [19746, 8.875], [19753, 21.375], [19781, 67.375], [19806, 60.875], [19810, 57.5], [19811, 65.625], [19839, -2.0], [19852, 21.75], [19866, 33.875], [19872, 37.625], [19921, 29.375], [19928, 57.375], [19953, 34.875], [19966, 15.5], [19985, 48.75], [19988, 27.5], [19995, 29.625], [20003, 71.375], [20018, 38.125], [20035, 81.25], [20057, 26.25], [20066, 65.75], [20078, 45.75], [20082, 45.625], [20089, 46.5], [20110, 58.75], [20116, 37.5], [20131, 56.5], [20150, 51.75], [20152, 60.5], [20157, 101.875], [20160, 2.25], [20174, 28.625], [20187, 42.5], [20211, 36.125], [20222, 61.5], [20236, 66.5], [20237, 45.375], [20253, 42.75], [20258, 78.625], [20274, 27.5], [20297, 49.625], [20301, -4.875], [20306, 26.0], [20307, 48.625], [20316, 39.0], [20325, 34.0], [20350, 23.875], [20361, 52.25], [20369, 17.125], [20371, 3.25], [20382, 59.75], [20385, 36.75], [20386, 63.375], [20393, 22.0], [20402, 51.25], [20420, 53.875], [20442, 40.875], [20466, 28.125], [20468, 26.625], [20471, 16.0], [20487, 57.375], [20488, 23.625], [20490, 50.875], [20503, 57.25], [20506, 28.375], [20508, -2.875], [20520, 57.75], [20533, 25.75], [20537, 8.75], [20558, 74.0], [20568, 34.5], [20571, 26.125], [20576, -0.25], [20601, 42.125], [20603, -24.5], [20609, 18.5], [20644, 51.125], [20646, 29.875], [20652, 66.5], [20678, 32.0], [20723, 68.5], [20724, 56.125], [20728, 44.0], [20742, 31.625], [20744, 29.25], [20752, 71.5], [20764, 23.5], [20769, 43.75], [20778, 56.25], [20788, 40.5], [20789, 36.25], [20796, 62.625], [20797, 64.0], [20815, 40.25], [20853, 45.25], [20875, 41.5], [20884, 61.625], [20897, 41.25], [20932, 21.5], [20958, 10.875], [20969, 66.25], [20970, 10.5], [21017, 26.5], [21018, -19.375], [21026, 14.875], [21054, -19.5], [21062, 39.625], [21064, 50.25], [21073, 33.0], [21074, 26.5], [21125, 43.625], [21138, 42.625], [21145, 15.375], [21147, 37.375], [21170, -4.625], [21183, -7.0], [21184, 20.0], [21185, 49.375], [21206, 33.375], [21207, 31.125], [21210, 29.25], [21220, 14.5], [21229, 50.25], [21240, 78.75], [21245, 26.375], [21246, 58.875], [21248, 52.25], [21271, 28.375], [21276, 65.625], [21293, 39.125], [21294, 55.5], [21309, 73.25], [21331, 8.375], [21332, 23.375], [21333, 47.0], [21337, 30.25], [21341, 36.5], [21342, -2.0], [21344, 74.125], [21347, 21.0], [21361, 30.125], [21370, 30.5], [21418, 92.75], [21431, 73.0], [21446, 17.375], [21452, 22.75], [21507, 41.125], [21549, 23.25], [21557, 40.75], [21562, 70.625], [21565, 58.5], [21570, 17.75], [21575, 38.125], [21578, 33.625], [21593, 51.25], [21596, 18.5], [21600, 38.25], [21605, 51.875], [21610, 31.875], [21633, 35.375], [21635, 26.5], [21643, 57.625], [21656, 30.375], [21667, 38.0], [21671, -22.125], [21683, 1.375], [21694, -15.375], [21705, 40.625], [21706, 13.0], [21710, 33.375], [21723, 16.0], [21733, 59.625], [21762, 29.75], [21797, 13.5], [21803, 29.25], [21827, 67.125], [21830, -3.125], [21836, 18.0], [21837, 28.0], [21846, 66.875], [21855, 73.0], [21856, 34.75], [21859, -17.375], [21884, 26.75], [21894, 69.5], [21895, 43.25], [21910, 48.0], [21952, 33.375], [21960, 33.0], [21965, 13.375], [21973, 47.75], [21984, 45.5], [21988, 39.25], [21997, 46.75], [21999, 34.875]]}

wandb/run-20250502_045804-vkih00cc/files/output.log

@@ -0,0 +1,21 @@
+***** Running training *****
+Training 6/6 epoch (loss 1.0384): 100%|██████████| 16500/16500 [2:38:06<00:00,  1.74it/s]   
+
+***** Evaluating at the beginning *****
+
+***** Evaluating at epoch 1/6 *****
+
+***** Evaluating at epoch 2/6 *****
+
+***** Evaluating at epoch 3/6 *****
+
+***** Evaluating at epoch 4/6 *****
+
+***** Evaluating at epoch 5/6 *****
+
+***** Evaluating at epoch 6/6 *****
+Saving model to "/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10" ...
+Saving Hugging Face Checkpoints...
+/home/panda/miniconda3/envs/pda/lib/python3.11/site-packages/peft/utils/save_and_load.py:220: UserWarning: Setting `save_embedding_layers` to `True` as embedding layers found in `target_modules`.
+  warnings.warn("Setting `save_embedding_layers` to `True` as embedding layers found in `target_modules`.")
+Model saved!

wandb/run-20250502_045804-vkih00cc/files/requirements.txt

@@ -0,0 +1,153 @@
+safe-rlhf==0.0.1.dev0
+numexpr==2.10.1
+transformers==4.49.0
+aiohttp==3.11.10
+filelock==3.17.0
+mdurl==0.1.0
+matplotlib==3.10.0
+tensorboard_data_server==0.7.0
+cycler==0.11.0
+pytz==2024.1
+mkl_fft==1.3.11
+torch==2.5.1
+pillow==11.1.0
+accelerate==1.6.0
+jupyter_client==8.6.3
+mkl-service==2.4.0
+gmpy2==2.2.1
+pydantic==2.10.3
+protobuf==5.29.3
+kiwisolver==1.4.8
+ipykernel==6.29.5
+frozenlist==1.5.0
+pyzmq==26.2.0
+eval_type_backport==0.2.2
+xxhash==3.5.0
+ipython_pygments_lexers==1.1.1
+peft==0.15.1
+regex==2024.11.6
+datasets==3.5.0
+smmap==4.0.0
+sympy==1.13.1
+packaging==24.2
+tensorboard==2.19.0
+dill==0.3.8
+contourpy==1.3.1
+importlib_metadata==8.6.1
+pip==25.0
+httpx==0.28.1
+optree==0.14.1
+pexpect==4.9.0
+setproctitle==1.2.2
+scipy==1.15.2
+py-cpuinfo==9.0.0
+urllib3==2.3.0
+charset-normalizer==3.3.2
+wandb==0.19.9
+aiosignal==1.2.0
+jiter==0.9.0
+comm==0.2.2
+python-dateutil==2.9.0.post0
+nvitop==1.4.2
+httpcore==1.0.9
+triton==3.1.0
+mkl_random==1.2.8
+requests==2.32.3
+huggingface-hub==0.30.2
+deepspeed==0.16.5
+pyparsing==3.2.0
+h11==0.16.0
+safetensors==0.5.3
+pandas==2.2.3
+networkx==3.4.2
+wcwidth==0.2.13
+six==1.17.0
+propcache==0.3.1
+sentencepiece==0.2.0
+pure_eval==0.2.3
+PyYAML==6.0.2
+Brotli==1.0.9
+PySocks==1.7.1
+matplotlib-inline==0.1.7
+pyarrow==19.0.0
+fsspec==2024.12.0
+sniffio==1.3.1
+rich==13.9.4
+decorator==5.2.1
+ptyprocess==0.7.0
+sentry-sdk==2.18.0
+setuptools==75.8.0
+nest_asyncio==1.6.0
+exceptiongroup==1.2.2
+idna==3.7
+Jinja2==3.1.6
+tokenizers==0.21.0
+executing==2.1.0
+mpmath==1.3.0
+zipp==3.21.0
+grpcio==1.71.0
+MarkupSafe==3.0.2
+ninja==1.11.1.4
+attrs==24.3.0
+debugpy==1.8.14
+stack_data==0.6.3
+parso==0.8.4
+jupyter_core==5.7.2
+multiprocess==0.70.15
+hjson==3.1.0
+msgpack==1.1.0
+Pygments==2.15.1
+tornado==6.4.2
+tqdm==4.67.1
+Bottleneck==1.4.2
+prompt_toolkit==3.0.50
+numpy==2.0.1
+asttokens==3.0.0
+nvidia-ml-py==12.535.133
+fonttools==4.55.3
+pickleshare==0.7.5
+yarl==1.18.0
+einops==0.8.1
+psutil==5.9.0
+multidict==6.1.0
+docker-pycreds==0.4.0
+unicodedata2==15.1.0
+safe-rlhf==0.0.1.dev0
+aiohappyeyeballs==2.4.4
+tzdata==2023.3
+anyio==4.9.0
+Markdown==3.4.1
+certifi==2025.1.31
+click==8.1.8
+pydantic_core==2.27.1
+typing_extensions==4.12.2
+distro==1.9.0
+jedi==0.19.2
+appdirs==1.4.4
+gitdb==4.0.7
+Werkzeug==3.1.3
+wheel==0.45.1
+platformdirs==4.3.7
+absl-py==2.1.0
+ipython==9.1.0
+annotated-types==0.6.0
+traitlets==5.14.3
+openai==1.76.0
+GitPython==3.1.43
+markdown-it-py==2.2.0
+more-itertools==10.3.0
+packaging==24.2
+zipp==3.19.2
+jaraco.collections==5.1.0
+inflect==7.3.1
+autocommand==2.2.2
+jaraco.functools==4.0.1
+platformdirs==4.2.2
+tomli==2.0.1
+wheel==0.43.0
+jaraco.context==5.3.0
+typing_extensions==4.12.2
+importlib_metadata==8.0.0
+jaraco.text==3.12.1
+backports.tarfile==1.2.0
+typeguard==4.3.0

wandb/run-20250502_045804-vkih00cc/files/wandb-metadata.json

@@ -0,0 +1,106 @@
+{
+  "os": "Linux-5.15.0-134-generic-x86_64-with-glibc2.31",
+  "python": "CPython 3.11.11",
+  "startedAt": "2025-05-02T08:58:04.016801Z",
+  "args": [
+    "--local_rank=0",
+    "--train_datasets",
+    "SAFE-ALPACA/2000",
+    "--model_name_or_path",
+    "huggyllama/llama-7b",
+    "--cache_dir",
+    "/home/panda/pda-llm/cache/sft-2000",
+    "--safe_sft",
+    "false",
+    "--max_length",
+    "1024",
+    "--trust_remote_code",
+    "True",
+    "--epochs",
+    "6",
+    "--per_device_train_batch_size",
+    "4",
+    "--per_device_eval_batch_size",
+    "4",
+    "--gradient_accumulation_steps",
+    "32",
+    "--gradient_checkpointing",
+    "--learning_rate",
+    "1e-4",
+    "--lr_scheduler_type",
+    "cosine",
+    "--lr_warmup_ratio",
+    "0.03",
+    "--weight_decay",
+    "0.0",
+    "--seed",
+    "42",
+    "--output_dir",
+    "/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10",
+    "--log_type",
+    "wandb",
+    "--log_project",
+    "SAFE-SFT-v3",
+    "--zero_stage",
+    "0",
+    "--offload",
+    "none",
+    "--safety_ratio_tol",
+    "10",
+    "--resilient_coeff",
+    "1",
+    "--lora_r",
+    "4",
+    "--lora_alpha",
+    "16",
+    "--lora_dropout",
+    "0.05",
+    "--bf16",
+    "False",
+    "--fp16",
+    "True",
+    "--tf32",
+    "True"
+  ],
+  "program": "-m safe_rlhf.algorithms.safe_ft.__main__",
+  "git": {
+    "remote": "git@github.com:IgnacioBoero/pda-llm.git",
+    "commit": "7c9f4e02dcd0647951942cf40568db8fe194c59e"
+  },
+  "email": "iboero@upenn.edu",
+  "root": "/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10",
+  "host": "jason",
+  "executable": "/home/panda/miniconda3/envs/pda/bin/python",
+  "cpu_count": 24,
+  "cpu_count_logical": 48,
+  "gpu": "NVIDIA RTX A6000",
+  "gpu_count": 2,
+  "disk": {
+    "/": {
+      "total": "982820896768",
+      "used": "824755863552"
+    }
+  },
+  "memory": {
+    "total": "270090043392"
+  },
+  "cpu": {
+    "count": 24,
+    "countLogical": 48
+  },
+  "gpu_nvidia": [
+    {
+      "name": "NVIDIA RTX A6000",
+      "memoryTotal": "51527024640",
+      "cudaCores": 10752,
+      "architecture": "Ampere"
+    },
+    {
+      "name": "NVIDIA RTX A6000",
+      "memoryTotal": "51527024640",
+      "cudaCores": 10752,
+      "architecture": "Ampere"
+    }
+  ],
+  "cudaVersion": "12.4"
+}

wandb/run-20250502_045804-vkih00cc/files/wandb-summary.json

@@ -0,0 +1 @@
+{"train/epoch":6,"train/lr":9.830211892492003e-10,"eval/min_log_ratio":-52.75,"eval/max_log_ratio":123,"_runtime":9488.021707284,"eval/step":16500,"train/loss":1.038447618484497,"eval/mean_safe_log_ratio":37.375,"eval/table":{"_type":"table-file","sha256":"685f19d324d44ea11afa433fef1b5d13235c08b746b63f18185c566955528c75","size":31315,"artifact_path":"wandb-client-artifact://5pkipr26605bnt9ou1j7z76bz95zfkyymqndue75vnels7uhgq0civrimavoai10fw2ntiu3f4wug37p58gzcuub7mbw1i089qtemq3dzsmi57oaut0s4sps9ij1ns6q/eval/table.table.json","_latest_artifact_path":"wandb-client-artifact://0lvdtj0q9p0857tu31fkv89hkbqvjrqq10sb59um1zyiti1yl46w20offn3834m27u9p5xy0cuasevcbp3g8m2o1aoli2iwzoms6dqc5klazlx4ptks5ivofh6u9zd96:latest/eval/table.table.json","path":"media/table/eval/table_16500_685f19d324d44ea11afa.table.json","ncols":2,"nrows":2000},"_timestamp":1.7461857713190172e+09,"_step":16500,"_wandb":{"runtime":9488},"train/step":16500,"eval/hist_log_ratio":{"bins":[-52.75,-50,-47.25,-44.5,-41.75,-39,-36.28125,-33.53125,-30.78125,-28.03125,-25.28125,-22.546875,-19.8125,-17.0625,-14.3125,-11.5625,-8.8125,-6.0625,-3.3125,-0.5625,2.1875,4.90625,7.65625,10.40625,13.125,15.875,18.625,21.375,24.125,26.875,29.625,32.375,35.125,37.875,40.625,43.375,46.125,48.875,51.625,54.375,57.125,59.8125,62.5625,65.3125,68.0625,70.8125,73.5625,76.375,79,81.75,84.5,87.25,90,92.75,95.5,98.25,101,103.75,106.5,109.25,112,114.75,117.5,120.25,123],"_type":"histogram","values":[1,0,1,0,0,1,1,1,5,4,2,6,8,6,11,11,10,18,23,27,38,43,31,34,53,69,63,80,89,103,91,91,92,102,77,74,87,91,78,70,57,72,51,50,33,30,33,20,16,12,13,4,4,3,3,1,2,1,1,1,0,0,0,1]}}

wandb/run-20250502_045804-vkih00cc/logs/debug-core.log

@@ -0,0 +1,15 @@
+{"time":"2025-05-02T04:58:03.675207888-04:00","level":"INFO","msg":"main: starting server","port-filename":"/tmp/tmpe4w6wcef/port-2178487.txt","pid":2178487,"log-level":0,"disable-analytics":false,"shutdown-on-parent-exit":false}
+{"time":"2025-05-02T04:58:03.68112496-04:00","level":"INFO","msg":"Will exit if parent process dies.","ppid":2178487}
+{"time":"2025-05-02T04:58:03.68113657-04:00","level":"INFO","msg":"server is running","addr":{"IP":"127.0.0.1","Port":44261,"Zone":""}}
+{"time":"2025-05-02T04:58:03.861925318-04:00","level":"INFO","msg":"connection: ManageConnectionData: new connection created","id":"127.0.0.1:42082"}
+{"time":"2025-05-02T04:58:04.018848124-04:00","level":"INFO","msg":"handleInformInit: received","streamId":"vkih00cc","id":"127.0.0.1:42082"}
+{"time":"2025-05-02T04:58:04.19718495-04:00","level":"INFO","msg":"handleInformInit: stream started","streamId":"vkih00cc","id":"127.0.0.1:42082"}
+{"time":"2025-05-02T07:36:12.683239982-04:00","level":"INFO","msg":"handleInformFinish: finish message received","streamId":"vkih00cc","id":"127.0.0.1:42082"}
+{"time":"2025-05-02T07:36:12.683381516-04:00","level":"INFO","msg":"handleInformFinish: stream closed","streamId":"vkih00cc","id":"127.0.0.1:42082"}
+{"time":"2025-05-02T07:36:13.678517867-04:00","level":"INFO","msg":"handleInformTeardown: server teardown initiated","id":"127.0.0.1:42082"}
+{"time":"2025-05-02T07:36:13.678551108-04:00","level":"INFO","msg":"handleInformTeardown: server shutdown complete","id":"127.0.0.1:42082"}
+{"time":"2025-05-02T07:36:13.678560758-04:00","level":"INFO","msg":"server is shutting down"}
+{"time":"2025-05-02T07:36:13.67860682-04:00","level":"INFO","msg":"connection: closing","id":"127.0.0.1:42082"}
+{"time":"2025-05-02T07:36:13.678722893-04:00","level":"INFO","msg":"connection: closed successfully","id":"127.0.0.1:42082"}
+{"time":"2025-05-02T07:36:13.678754653-04:00","level":"INFO","msg":"connection: ManageConnectionData: connection closed","id":"127.0.0.1:42082"}
+{"time":"2025-05-02T07:36:13.678769414-04:00","level":"INFO","msg":"server is closed"}

wandb/run-20250502_045804-vkih00cc/logs/debug-internal.log

@@ -0,0 +1,18 @@
+{"time":"2025-05-02T04:58:04.019119391-04:00","level":"INFO","msg":"stream: starting","core version":"0.19.9","symlink path":"/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10/wandb/run-20250502_045804-vkih00cc/logs/debug-core.log"}
+{"time":"2025-05-02T04:58:04.197136128-04:00","level":"INFO","msg":"created new stream","id":"vkih00cc"}
+{"time":"2025-05-02T04:58:04.197176589-04:00","level":"INFO","msg":"stream: started","id":"vkih00cc"}
+{"time":"2025-05-02T04:58:04.19719247-04:00","level":"INFO","msg":"writer: Do: started","stream_id":"vkih00cc"}
+{"time":"2025-05-02T04:58:04.197232281-04:00","level":"INFO","msg":"handler: started","stream_id":"vkih00cc"}
+{"time":"2025-05-02T04:58:04.197265422-04:00","level":"INFO","msg":"sender: started","stream_id":"vkih00cc"}
+{"time":"2025-05-02T04:58:04.358999441-04:00","level":"INFO","msg":"Starting system monitor"}
+{"time":"2025-05-02T04:58:04.359026392-04:00","level":"WARN","msg":"handleCodeSave: program relative path is empty"}
+{"time":"2025-05-02T04:58:04.359089224-04:00","level":"ERROR","msg":"git repo not found","error":"repository does not exist"}
+{"time":"2025-05-02T07:36:12.038523234-04:00","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2025-05-02T07:36:12.038620077-04:00","level":"INFO","msg":"Stopped system monitor"}
+{"time":"2025-05-02T07:36:12.460553289-04:00","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
+{"time":"2025-05-02T07:36:12.675372877-04:00","level":"INFO","msg":"handler: operation stats","stats":{}}
+{"time":"2025-05-02T07:36:12.683269813-04:00","level":"INFO","msg":"stream: closing","id":"vkih00cc"}
+{"time":"2025-05-02T07:36:12.683289333-04:00","level":"INFO","msg":"handler: closed","stream_id":"vkih00cc"}
+{"time":"2025-05-02T07:36:12.683301114-04:00","level":"INFO","msg":"writer: Close: closed","stream_id":"vkih00cc"}
+{"time":"2025-05-02T07:36:12.683364415-04:00","level":"INFO","msg":"sender: closed","stream_id":"vkih00cc"}
+{"time":"2025-05-02T07:36:12.683374416-04:00","level":"INFO","msg":"stream: closed","id":"vkih00cc"}

wandb/run-20250502_045804-vkih00cc/logs/debug.log

@@ -0,0 +1,29 @@
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_setup.py:_flush():67] Current SDK version is 0.19.9
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_setup.py:_flush():67] Configure stats pid to 2178487
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_setup.py:_flush():67] Loading settings from /home/panda/.config/wandb/settings
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_setup.py:_flush():67] Loading settings from /home/panda/pda-llm/scripts/wandb/settings
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_setup.py:_flush():67] Loading settings from environment variables
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:setup_run_log_directory():662] Logging user logs to /home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10/wandb/run-20250502_045804-vkih00cc/logs/debug.log
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:setup_run_log_directory():663] Logging internal logs to /home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10/wandb/run-20250502_045804-vkih00cc/logs/debug-internal.log
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:init():781] calling init triggers
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:init():786] wandb.init called with sweep_config: {}
+config: {'model_name_or_path': 'huggyllama/llama-7b', 'recompute_baseline': False, 'cache_dir': '/home/panda/pda-llm/cache/sft-2000', 'max_length': 1024, 'trust_remote_code': True, 'train_datasets': [('SAFE-ALPACA/2000', {'proportion': 1.0})], 'eval_datasets': None, 'safety_ratio_tol': 10.0, 'safe_sft': False, 'resilient_coeff': 1.0, 'epochs': 6, 'per_device_train_batch_size': 4, 'per_device_eval_batch_size': 4, 'gradient_accumulation_steps': 32, 'gradient_checkpointing': True, 'lr': 0.0001, 'lr_scheduler_type': <SchedulerType.COSINE: 'cosine'>, 'lr_warmup_ratio': 0.03, 'weight_decay': 0.0, 'seed': 42, 'fp16': True, 'bf16': False, 'tf32': True, 'lora_r': 4, 'lora_alpha': 16, 'lora_dropout': 0.05, 'eval_strategy': 'epoch', 'eval_interval': 1000000, 'need_eval': True, 'eval_split_ratio': None, 'output_dir': '/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10', 'log_type': 'wandb', 'log_dir': '/home/panda/pda-llm/output/sft-safe/2000/run-false-2000-1-10', 'log_project': 'SAFE-SFT-v3', 'log_run_name': 'safe-sft-2025-05-02-04-58-03', 'save_16bit': False, 'save_interval': 1000000, 'local_rank': 0, 'zero_stage': 0, 'offload': 'none', 'deepspeed': False, 'deepspeed_config': None, 'deepscale': False, 'deepscale_config': None, 'global_rank': 0, 'device': device(type='cuda', index=0), 'num_update_steps_per_epoch': 86, 'total_training_steps': 516, '_wandb': {}}
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:init():809] starting backend
+2025-05-02 04:58:04,014 INFO    MainThread:2178487 [wandb_init.py:init():813] sending inform_init request
+2025-05-02 04:58:04,016 INFO    MainThread:2178487 [backend.py:_multiprocessing_setup():101] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2025-05-02 04:58:04,016 INFO    MainThread:2178487 [wandb_init.py:init():823] backend started and connected
+2025-05-02 04:58:04,018 INFO    MainThread:2178487 [wandb_init.py:init():915] updated telemetry
+2025-05-02 04:58:04,024 INFO    MainThread:2178487 [wandb_init.py:init():939] communicating run to backend with 90.0 second timeout
+2025-05-02 04:58:04,356 INFO    MainThread:2178487 [wandb_init.py:init():1014] starting run threads in backend
+2025-05-02 04:58:04,428 INFO    MainThread:2178487 [wandb_run.py:_console_start():2454] atexit reg
+2025-05-02 04:58:04,428 INFO    MainThread:2178487 [wandb_run.py:_redirect():2306] redirect: wrap_raw
+2025-05-02 04:58:04,428 INFO    MainThread:2178487 [wandb_run.py:_redirect():2371] Wrapping output streams.
+2025-05-02 04:58:04,428 INFO    MainThread:2178487 [wandb_run.py:_redirect():2394] Redirects installed.
+2025-05-02 04:58:04,430 INFO    MainThread:2178487 [wandb_init.py:init():1056] run started, returning control to user process
+2025-05-02 07:36:12,036 INFO    MainThread:2178487 [wandb_run.py:_finish():2189] finishing run alelab/SAFE-SFT-v3/vkih00cc
+2025-05-02 07:36:12,037 INFO    MainThread:2178487 [wandb_run.py:_atexit_cleanup():2419] got exitcode: 0
+2025-05-02 07:36:12,037 INFO    MainThread:2178487 [wandb_run.py:_restore():2401] restore
+2025-05-02 07:36:12,037 INFO    MainThread:2178487 [wandb_run.py:_restore():2407] restore done
+2025-05-02 07:36:12,678 INFO    MainThread:2178487 [wandb_run.py:_footer_history_summary_info():4064] rendering history
+2025-05-02 07:36:12,679 INFO    MainThread:2178487 [wandb_run.py:_footer_history_summary_info():4096] rendering summary
+2025-05-02 07:36:12,682 INFO    MainThread:2178487 [wandb_run.py:_footer_sync_info():4025] logging synced files

wandb/run-20250502_045804-vkih00cc/run-vkih00cc.wandb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee99a74ce18669acc19568f8df4397ecec5761c1ff301cdcab0d15ababf45a7e
+size 14200750