| --- |
| license: mit |
| language: |
| - en |
| tags: |
| - remote-sensing |
| - earth-observation |
| - vision |
| - feature-extraction |
| - galileo |
| - sentinel-1 |
| - sentinel-2 |
| - multimodal |
| library_name: transformers |
| pipeline_tag: feature-extraction |
| --- |
| |
| # Galileo Transformers Models |
|
|
| Self-contained HuggingFace model checkpoints for [Galileo](https://arxiv.org/abs/2502.09356). |
|
|
| Each checkpoint subfolder ships remote code for model, processor, and custom pipeline loading with `trust_remote_code=True`. No external `galileo` package is required at inference time. |
|
|
| ## Available checkpoints |
|
|
| | Folder | Hidden size | Layers | Heads | |
| |--------|-------------|--------|-------| |
| | `galileo-nano-patch8/` | 128 | 4 | 8 | |
| | `galileo-tiny-patch8/` | 192 | 12 | 3 | |
| | `galileo-base-patch8/` | 768 | 12 | 12 | |
|
|
| ## Usage |
|
|
| Galileo operates on native patch grids (default **`patch_size: 8`** in `preprocessor_config.json`). Stack shapes are `(H, W, T, C)`; no fixed 224×224 resize is applied. |
| |
| ```python |
| from transformers import pipeline |
| import numpy as np |
| |
| MODEL = "/path/to/GALILEO-transformers/galileo-nano-patch8" |
| |
| pipe = pipeline( |
| task="galileo-feature-extraction", |
| model=MODEL, |
| trust_remote_code=True, |
| ) |
| |
| # 10-band Sentinel-2 stack at native spatial size |
| s2 = np.random.randn(64, 64, 1, 10).astype(np.float32) |
| features = pipe(s2=s2, pool=True, return_tensors=True) |
| ``` |
| |
| Sentinel-1 only: |
| |
| ```python |
| s1 = np.random.randn(64, 64, 1, 2).astype(np.float32) |
| features = pipe(s1=s1, pool=True, return_tensors=True) |
| ``` |
| |
| ## Test CLI |
| |
| ```bash |
| conda activate rsgen |
| python test_galileo.py |
| python test_galileo.py --model galileo-tiny-patch8 |
| python test_galileo.py --model galileo-base-patch8 --no-pool |
| ``` |
| |
| ## Dependencies |
| |
| - `transformers` |
| - `torch` |
| - `einops` |
| |
| ## Per-folder contents |
| |
| Each checkpoint folder is self-contained: |
| |
| - `config.json` — HF config with `auto_map` and `custom_pipelines` |
| - `model.safetensors` — converted encoder weights |
| - `preprocessor_config.json` — processor settings |
| - `modeling_galileo.py` — config + encoder + `GalileoEncoderModel` |
| - `processing_galileo.py` — `GalileoProcessor` |
| - `pipeline_galileo.py` — `GalileoImageFeatureExtractionPipeline` |
| |
