Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
mikonvergenceย 
posted an update 17 days ago
Post
182
๐Ÿฅ• Introducing BetaEarth - your own Earth embedding emulator [๐๐ซ๐ž-๐‘๐ž๐ฅ๐ž๐š๐ฌ๐ž]

The past year has brought many notable embedding products, like AlphaEarth, TESSERA or OlmoEarth. We are entering a phase where embeddings begin to act as a substitute for real observation data.

BetaEarth is an attempt to explore how much one can learn from a model based on its embeddings alone, and whether those embeddings can serve as a useful training target for other models. Huge credit to the AlphaEarth team for releasing the embedding archive openly โ€” it's what made this kind of community-built extension possible.

[๐๐ž๐ญ๐š๐„๐š๐ซ๐ญ๐ก ๐ข๐ฌ ๐ง๐จ๐ญ ๐š ๐Ÿ๐จ๐ฎ๐ง๐๐š๐ญ๐ข๐จ๐ง ๐ฆ๐จ๐๐ž๐ฅ ๐›๐ฎ๐ญ ๐ข๐ญ ๐ญ๐ซ๐ข๐ž๐ฌ ๐ข๐ญ๐ฌ ๐›๐ž๐ฌ๐ญ]

BetaEarth is a flexible (and relatively lightweight) emulator of the AlphaEarth annual product. It doesn't reproduce AlphaEarth's exact outputs, nor the product, but it reaches ~0.87 cosine similarity on held-out data and retains 97% of downstream land-cover classification accuracy. It only took 1-2 days to train.

It can encode any combination (including multi-temporal) of:
- Sentinel-2 L1C
- Sentinel-2 L2A
- Sentinel-1 RTC
- COP-DEM 30 product

The model weights are open, just like its training data (built exclusively using Major TOM). The GitHub repository provides a script for automated generation of embeddings across any footprint.
You can also try the workflow over small bounding boxes on the free Hugging Face web app!

โš™๏ธ GitHub: https://github.com/asterisk-labs/beta-earth
๐Ÿ–ฅ๏ธ Web App: asterisk-labs/betaearth
๐Ÿญ Models: https://huggingface.co/collections/asterisk-labs/beta-earth
๐ŸŸจ Colab: https://colab.research.google.com/github/asterisk-labs/beta-earth/blob/main/examples/generate_demo.ipynb
๐Ÿ—ž๏ธ Pre-print: https://github.com/asterisk-labs/beta-earth/blob/main/docs/beta_earth_preprint.pdf