Upload folder using huggingface_hub

data/I1_simulation.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:babf58d3c7b50f7b392891ae9b49679fc43366e1d432803cbe2c4f46ba3c8e12
+size 2018739266

data/MDB.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8a2a9d7ae1ae7674b894ced60dc2fb9d3aad70bb61359ecf8968d30c4aa9b4e1
+size 5582289686

data/aviris_hsi_balanced.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:479bd99baeb8b5f5406ccc265fad9a2a6900ee91c41032f9a07f6a604a3e4e8b
+size 55956860020

data/aviris_hsi_clean.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2ae0c0bbba731a6015d478deab4501c2e55fb819037a40ed4d06eb7b3d0bfc17
+size 34120339460

data/captions_balanced.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:767f55f5a74448368ee11dcad58e8cf67be82fa8ca0bdba734fd15d71e293169
+size 95279

data/captions_clean.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aa087c23b9da9bc91b5f4314f367976d3e9cfeefff64a834a784e85c4a1788a2
+size 157411

data/readme.md

@@ -0,0 +1,117 @@
+# Methane Benchmark Dataset (PINEAPPLE + Clean)
+
+This folder contains the **Methane Benchmark Dataset** in two variants:
+- **balanced**: a balanced mix of methane and non-methane patches
+- **clean**: **no-methane only** (negative patches)
+
+The dataset combines multiple modalities (HSI and RGB), **simulated Sentinel-2 BOA reflectance (S2 BOA refl)** derived from HSI, **TerraMind TiM-generated products** (including **S2L2A** and **LULC**), text captions, and labels produced by different sources (LLM, human, and TiM/TerraMind). The clean split additionally contains **Intuition-1 simulated data**.
+
+---
+
+## 1. Dataset overview
+
+### 1.1 balanced (PINEAPPLE: methane + non-methane)
+- **178 patches**, **27 flights**
+- **HSI**: AVIRIS-NG
+- **RGB**: RGB renderings / visualizations aligned with the patches
+- **Simulated Sentinel-2 (BOA reflectance)**: derived from HSI and stored under `simulated_s2_boarefl_balanced/`
+- **TerraMind TiM products** (derived from simulated S2 BOA reflectance; stored under `tim_generation_balanced/`):
+  - **S2L2A** (TiM-generated)
+  - **LULC** (TiM-generated, pixel-level)
+  - Plots and auxiliary outputs
+- **Annotations**
+  - Urban vs. non-urban (image-level): **LLM**
+  - Urban vs. non-urban (image-level): **human**
+  - Textual description: **LLM**
+
+### 1.2 clean (no-methane only)
+- **261 patches** (neighboring patches; center patch excluded), **20 flights**
+- **HSI**: AVIRIS-NG
+- **RGB**: RGB renderings / visualizations aligned with the patches
+- **Simulated Sentinel-2 (BOA reflectance)**: derived from HSI and stored under `simulated_s2_boareflclean/` (folder name preserved as exported)
+- **TerraMind TiM products** (derived from simulated S2 BOA reflectance; stored under `tim_generation_clean/`):
+  - **S2L2A** (TiM-generated)
+  - **LULC** (TiM-generated, pixel-level)
+  - Plots and auxiliary outputs
+- **Intuition-1 simulated data (clean only)**: additional simulated modality for extended ablations and robustness checks (see notes in Section 2)
+- **Annotations**
+  - Urban vs. non-urban (image-level): **LLM**
+  - Urban vs. non-urban (image-level): **human**
+  - Textual description: **LLM**
+
+---
+
+## 2. Folder structure
+
+Top-level directories:
+- `aviris_hsi_balanced/`  
+  AVIRIS-NG hyperspectral patches for the balanced split.
+- `aviris_hsi_clean/`  
+  AVIRIS-NG hyperspectral patches for the clean (no-methane) split.
+
+- `rgb_balanced/`  
+  RGB images for the balanced split (aligned to patches).
+- `rgb_clean/`  
+  RGB images for the clean split (aligned to patches).
+
+- `captions_balanced/`  
+  LLM-generated text captions/descriptions for the balanced split.
+- `captions_clean/`  
+  LLM-generated text captions/descriptions for the clean split.
+
+- `simulated_s2_boarefl_balanced/`  
+  Simulated Sentinel-2 BOA reflectance images for the balanced split (simulated from HSI).
+- `simulated_s2_boareflclean/`  
+  Simulated Sentinel-2 BOA reflectance images for the clean split (simulated from HSI; folder name preserved as exported).
+
+- `tim_generation_balanced/`  
+  TerraMind TiM outputs generated from simulated S2 BOA reflectance (balanced split).  
+  Contains (at least): `s2l2a/`, `lulc/`, `classes/`, `plots/`, and auxiliary files (e.g., a legend script).
+- `tim_generation_clean/`  
+  TerraMind TiM outputs generated from simulated S2 BOA reflectance (clean split).  
+  Contains the same product types as the balanced split.
+
+- `I1_simulation` 
+  Additional Intuition-1 simulated data aligned with clean split patches. 
+
+Other files:
+- `truth_false_labels.xlsx`  
+  A compact label file (yes/no style) aggregating selected annotations (LLM, human, TiM classes), depending on your export.
+
+
+---
+
+## 3. Labels and annotation sources
+
+The dataset provides yes/no labels and/or categorical classes from the following sources:
+
+### 3.1 LLM labels (image-level)
+- Urban vs. non-urban classification at image/patch level
+- Stored in the exported label file and/or per-sample metadata (depending on your pipeline)
+
+### 3.2 Human labels (image-level)
+- Urban vs. non-urban classification at image/patch level
+- Available for at least the clean split (and optionally balanced, depending on the export)
+
+### 3.3 TerraMind TiM products (pixel-level and per-image products)
+- **S2L2A** generated by TerraMind TiM from simulated S2 BOA reflectance
+- **LULC** (pixel-level) generated by TerraMind TiM from simulated S2 BOA reflectance
+- Stored under `tim_generation_*` (subfolders `s2l2a/`, `lulc/`, and `classes/`)
+
+---
+
+## 4. Modality relationships
+
+- **HSI (AVIRIS-NG)** is the primary observation modality.
+- **RGB** is a visualization or derived view aligned to the same patch footprint.
+- **Simulated Sentinel-2 BOA reflectance (S2 BOA refl)** is simulated from HSI and used as input to TiM/TerraMind.
+- **S2L2A** is not directly stored as a standalone raw simulation in the root; it is produced by **TerraMind TiM** and stored inside `tim_generation_*`.
+- **LULC** is produced by **TerraMind TiM** (pixel-level) and stored inside `tim_generation_*`.
+- **Captions** provide text descriptions for multimodal experiments (retrieval, captioning, instruction-following, VLM/LLM alignment).
+- **Intuition-1 simulated data** (clean only) provides an extra modality for robustness and domain-shift experiments.
+
+---
+
+## 5. Warning
+
+Before using check dataset class if there was any changes with naming convention of the files.

data/rgb_balanced.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:80eb453237fda6d1357641cc57e0ef7e2d2ca8ec8741b72fc56dd87bed13ea09
+size 79739401

data/rgb_clean.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a95ad50a176d49b45fb06debb31dbd26b7872e5a9d2765fb585898c0e6c23375
+size 107771981

data/simulated_s2_boarefl_balanced.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9474513a0f13aca907674ae54fd71b875d1758e143037fae55e9f166ded6c51
+size 92085964

data/simulated_s2_boarefl_clean.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4497cba5b8607b4da1918867daf157f172993648d8d2ef5567e8390e55783395
+size 121582695

data/tim_generation_balanced.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b2b92cf4de8b1eff54d85a7feb3cf843f12ae87adbfc521226a5ff35cd28102e
+size 208484041

data/tim_generation_clean.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:119d16495ebe0d14bac3c89b00341d4211b9b773475a6deb89e5ea51346fd4ff
+size 284308187