Update README.md
Browse files
README.md
CHANGED
|
@@ -1,36 +1,67 @@
|
|
| 1 |
---
|
| 2 |
base_model:
|
| 3 |
-
- ibm-esa-geospatial/TerraMind-1.0-base
|
| 4 |
pipeline_tag: image-classification
|
| 5 |
tags:
|
| 6 |
-
- methane
|
| 7 |
-
- detection
|
| 8 |
-
- geospatial
|
|
|
|
| 9 |
---
|
|
|
|
| 10 |
# FAST-EO Use Case 2 - Methane Detection
|
| 11 |
|
| 12 |
-
This
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
|
| 14 |
-
|
| 15 |
|
| 16 |
-
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
-
|
| 19 |
|
| 20 |
-
|
|
|
|
|
|
|
| 21 |
|
| 22 |
-
|
| 23 |
|
| 24 |
-
|
| 25 |
|
| 26 |
-
|
| 27 |
|
| 28 |
-
|
| 29 |
|
| 30 |
-
|
| 31 |
|
| 32 |
-
|
| 33 |
|
| 34 |
-
##
|
| 35 |
|
| 36 |
-
|
|
|
|
|
|
| 1 |
---
|
| 2 |
base_model:
|
| 3 |
+
- ibm-esa-geospatial/TerraMind-1.0-base
|
| 4 |
pipeline_tag: image-classification
|
| 5 |
tags:
|
| 6 |
+
- methane
|
| 7 |
+
- detection
|
| 8 |
+
- geospatial
|
| 9 |
+
- terramind
|
| 10 |
---
|
| 11 |
+
|
| 12 |
# FAST-EO Use Case 2 - Methane Detection
|
| 13 |
|
| 14 |
+
This repository contains data and code to reproduce experiments for fine-tuning **TerraMind-Base** to detect methane-related signatures in multispectral imagery. It includes multiple experiment variants and their corresponding datasets.
|
| 15 |
+
|
| 16 |
+
The file `Methane_benchmark_patches_summary_v3.xlsx` provides per-patch descriptions and defines the **fold splits** used to ensure non-overlapping partitions. Runner scripts use this Excel file to build train/val/test splits, typically reserving one fold for testing.
|
| 17 |
+
|
| 18 |
+
All scripts provide usage instructions via `--help` (or `-h`).
|
| 19 |
+
|
| 20 |
+
## Requirements
|
| 21 |
+
|
| 22 |
+
- Install the TerraMind/Terratorch stack used by the project before running experiments.
|
| 23 |
+
- Ensure your environment has the required dependencies for data loading and training.
|
| 24 |
+
|
| 25 |
+
## Experiments
|
| 26 |
+
|
| 27 |
+
### Experiment 1: Fine-tuning on Methane Benchmark Dataset (MBD)
|
| 28 |
+
|
| 29 |
+
Fine-tune TerraMind-Base on the Methane Benchmark Dataset. The normalized dataset is provided in:
|
| 30 |
+
|
| 31 |
+
- `MBD_nan_S2_zscore/`
|
| 32 |
+
|
| 33 |
+
Training code is located in:
|
| 34 |
+
|
| 35 |
+
- `classification/` (includes dataset and dataloader classes)
|
| 36 |
+
|
| 37 |
+
### Experiment 2: Fine-tuning on MBD with text captions
|
| 38 |
|
| 39 |
+
This experiment modifies the TerraMind-Base model to concatenate text-caption embeddings with visual embeddings.
|
| 40 |
|
| 41 |
+
- Caption embeddings are computed with `all-MiniLM-L6-v2`.
|
| 42 |
+
- Code and resources are in `classification_with_text/`.
|
| 43 |
+
- Original captions: `classification_with_text/MBD_text/`
|
| 44 |
+
- Precomputed embeddings: `combined_caption_embeddings.csv`
|
| 45 |
|
| 46 |
+
### Experiment 3: Sentinel-2 with simulated atmospheric conditions
|
| 47 |
|
| 48 |
+
Evaluate generalization on Sentinel-2 data with simulated atmospheric conditions in both:
|
| 49 |
+
- Top-of-Atmosphere (TOA)
|
| 50 |
+
- Bottom-of-Atmosphere (BOA)
|
| 51 |
|
| 52 |
+
The model can be trained on this simulated data or used only for inference to test cross-domain robustness.
|
| 53 |
|
| 54 |
+
### Experiment 4: Intuition-1 with simulated atmospheric conditions
|
| 55 |
|
| 56 |
+
Analogous to Experiment 3, but using Intuition-1 imagery with simulated atmospheric conditions (TOA and BOA). This experiment tests robustness under domain shift.
|
| 57 |
|
| 58 |
+
### Experiment 5: Urban dataset without methane (false-positive stress test)
|
| 59 |
|
| 60 |
+
A control dataset containing only urban imagery without methane is used to check whether models learn methane-specific cues rather than urban signatures. The goal is to quantify false positives.
|
| 61 |
|
| 62 |
+
Scripts for loading and running inference on this dataset are provided in the repository.
|
| 63 |
|
| 64 |
+
## Notes
|
| 65 |
|
| 66 |
+
- Use `--help` on each runner/training script to see available options.
|
| 67 |
+
- Keep fold definitions consistent with `Methane_benchmark_patches_summary_v3.xlsx` to ensure comparable results across experiments.
|