Hugging Face's logo

niobures
/
Clay

ONNX
Model card Files
xet
Community
niobures commited on
Commit
7cc3f35
·
verified ·
1 Parent(s): de930e8

Clay (code, models)

Browse files
Files changed (29) hide show
  1. .gitattributes +6 -0
  2. Revolutionizing Earth observation with geospatial foundation models on AWS.pdf +3 -0
  3. Uncertainty and Generalizability in Foundation Models for Earth Observation.pdf +3 -0
  4. code/model.zip +3 -0
  5. code/releases/model-0.0.1.zip +3 -0
  6. code/releases/model-1.0.1.zip +3 -0
  7. code/releases/model-1.0.zip +3 -0
  8. models/Clay-legacy/.gitattributes +39 -0
  9. models/Clay-legacy/README.md +8 -0
  10. models/Clay-legacy/config.json +4 -0
  11. models/Clay-legacy/source.txt +1 -0
  12. models/Clay-legacy/v0/Clay-v0.0_epoch-02_val-loss-0.52.ckpt +3 -0
  13. models/Clay-legacy/v0/Clay_v0.1_epoch-24_val-loss-0.46.ckpt +3 -0
  14. models/Clay-legacy/v0/README.md +1 -0
  15. models/Clay-legacy/v1.5/compiled/clay-v1.5-encoder-cpu.onnx +3 -0
  16. models/Clay-legacy/v1.5/compiled/clay-v1.5-encoder-cpu.pt2 +3 -0
  17. models/Clay-legacy/v1.5/compiled/clay-v1.5-encoder.onnx +3 -0
  18. models/Clay-legacy/v1.5/compiled/clay-v1.5-encoder.pt2 +3 -0
  19. models/Clay-legacy/v1/Clay-text2earth-v1.0.ckpt +3 -0
  20. models/Clay-legacy/v1/Clay-text2earth-v1.0.yaml +52 -0
  21. models/Clay-legacy/v1/clay-v1-base.ckpt +3 -0
  22. models/Clay-legacy/v1/compiled/clay-v1-encoder-cpu.onnx +3 -0
  23. models/Clay-legacy/v1/compiled/clay-v1-encoder-cpu.pt2 +3 -0
  24. models/Clay-legacy/v1/compiled/clay-v1-encoder.pt2 +3 -0
  25. models/Clay/.gitattributes +36 -0
  26. models/Clay/README.md +27 -0
  27. models/Clay/config.json +4 -0
  28. models/Clay/source.txt +1 -0
  29. models/Clay/v1.5/clay-v1.5.ckpt +3 -0
.gitattributes CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ models/Clay-legacy/v1.5/compiled/clay-v1.5-encoder-cpu.pt2 filter=lfs diff=lfs merge=lfs -text
37
+ models/Clay-legacy/v1.5/compiled/clay-v1.5-encoder.pt2 filter=lfs diff=lfs merge=lfs -text
38
+ models/Clay-legacy/v1/compiled/clay-v1-encoder-cpu.pt2 filter=lfs diff=lfs merge=lfs -text
39
+ models/Clay-legacy/v1/compiled/clay-v1-encoder.pt2 filter=lfs diff=lfs merge=lfs -text
40
+ Revolutionizing[[:space:]]Earth[[:space:]]observation[[:space:]]with[[:space:]]geospatial[[:space:]]foundation[[:space:]]models[[:space:]]on[[:space:]]AWS.pdf filter=lfs diff=lfs merge=lfs -text
41
+ Uncertainty[[:space:]]and[[:space:]]Generalizability[[:space:]]in[[:space:]]Foundation[[:space:]]Models[[:space:]]for[[:space:]]Earth[[:space:]]Observation.pdf filter=lfs diff=lfs merge=lfs -text
Revolutionizing Earth observation with geospatial foundation models on AWS.pdf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21eaca0533c11a59eff46d28570911e83c3f9436a2b546b35144d6455c6fc166
3
+ size 2376062
Uncertainty and Generalizability in Foundation Models for Earth Observation.pdf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55496921e38aab348e5903032d3296096ae849bafe829f17b15a003ab9d56bac
3
+ size 1292104
code/model.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8c1828f572a131b96e363ae1fb45e4a8b1c5c0d9468f5374329fac5940b8b78
3
+ size 236649274
code/releases/model-0.0.1.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d85333b26c88d779faa45e776fc77f0e7e6ddc334d0ee3efe90c0a5b6bfd555e
3
+ size 131148
code/releases/model-1.0.1.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4a788ae55e991e4bf5a579b25ade54c7215316ac3232ab18811be30ada57cb9
3
+ size 16318225
code/releases/model-1.0.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ced64635b88341f92076e808f4861833ec63e42ab43a026594a595f802180f99
3
+ size 598687
models/Clay-legacy/.gitattributes ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ v1/compiled/clay-v1-encoder-cpu.pt2 filter=lfs diff=lfs merge=lfs -text
37
+ v1/compiled/clay-v1-encoder.pt2 filter=lfs diff=lfs merge=lfs -text
38
+ v1.5/compiled/clay-v1.5-encoder-cpu.pt2 filter=lfs diff=lfs merge=lfs -text
39
+ v1.5/compiled/clay-v1.5-encoder.pt2 filter=lfs diff=lfs merge=lfs -text
models/Clay-legacy/README.md ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ license_link: https://raw.githubusercontent.com/Clay-foundation/model/main/LICENSE.md
4
+ ---
5
+
6
+ # Clay Foundation Model
7
+
8
+ This HF repo hosts the legacy versions of https://huggingface.co/made-with-clay/Clay
models/Clay-legacy/config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "made-with-clay/Clay-legacy",
3
+ "model_type": "geovit+DOFA",
4
+ }
models/Clay-legacy/source.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ https://huggingface.co/made-with-clay/Clay-legacy
models/Clay-legacy/v0/Clay-v0.0_epoch-02_val-loss-0.52.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1578ae89ba12bb2553b768c06613a26dba43e5ec883fd3ce35c2def648efd6ee
3
+ size 510924971
models/Clay-legacy/v0/Clay_v0.1_epoch-24_val-loss-0.46.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5efd4073b0602e5625cce629756abfd0f10fcb6fdfa9aee02088ea735d253cd
3
+ size 510924971
models/Clay-legacy/v0/README.md ADDED
@@ -0,0 +1 @@
 
 
1
+ v0 model
models/Clay-legacy/v1.5/compiled/clay-v1.5-encoder-cpu.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b3f6624af8fb513492ebe547eb30ba9296568ba7f3d90994508c38acad2336e
3
+ size 1246840201
models/Clay-legacy/v1.5/compiled/clay-v1.5-encoder-cpu.pt2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba4e3f0378128e320bc7e1560da5dde391fd9718e93bd6ac26c1c722d3e8b544
3
+ size 1247987208
models/Clay-legacy/v1.5/compiled/clay-v1.5-encoder.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e05564a83ddb31e504f8370a5c2c6120609e9bb3e637ad9c5c0a6163e08b0356
3
+ size 1246823841
models/Clay-legacy/v1.5/compiled/clay-v1.5-encoder.pt2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:096cfc51bb8ca9dafe7e0e833dd4e63209370a1b04760e0594add69a9add04b9
3
+ size 1248026787
models/Clay-legacy/v1/Clay-text2earth-v1.0.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d538f87e88b827b36cd8590c8a357fd38ac9738918b97dfbe8cadbd3194da4a
3
+ size 16952268
models/Clay-legacy/v1/Clay-text2earth-v1.0.yaml ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ dataloader:
2
+ _target_: earthtext.datamodules.chipmultilabel.ChipMultilabelModule
3
+ metadata_file: /opt/data/california-worldcover-chips/california-worldcover-chips-osm-multilabels_mod-prec70pc_emb-v1s2.parquet
4
+ embeddings_folder: /opt/data/california-worldcover-chips/embeddings_v1.0
5
+ chips_folder: /opt/data/clay-california-worldcover-rgbnir-vvvh-chips/chips
6
+ get_osm_strlabels: true
7
+ get_osm_ohearea: true
8
+ get_osm_ohecount: true
9
+ get_osm_ohelength: true
10
+ embeddings_normalization: mean_stdev_norm
11
+ multilabel_threshold_osm_ohecount: 1
12
+ normalize_input: true
13
+ batch_size: 32
14
+ model:
15
+ _target_: earthtext.models.osmencoder.OSMEncoder
16
+ output_dim: 768
17
+ layers_spec:
18
+ - 512
19
+ - 1024
20
+ - 2048
21
+ use_osm_counts: true
22
+ use_osm_lengths: true
23
+ osm_tags_indexes:
24
+ - 2
25
+ - 3
26
+ - 4
27
+ - 5
28
+ - 6
29
+ - 7
30
+ - 8
31
+ - 13
32
+ - 14
33
+ - 18
34
+ - 23
35
+ - 30
36
+ - 33
37
+ - 37
38
+ - 43
39
+ - 58
40
+ - 61
41
+ - 68
42
+ - 71
43
+ - 84
44
+ - 87
45
+ - 93
46
+ - 95
47
+ - 96
48
+ - 98
49
+ activation_fn: relu
50
+ training:
51
+ loss: rmse
52
+ epochs: 1
models/Clay-legacy/v1/clay-v1-base.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e41ece5741b41a4e4fdb57199e353702ec34524e334017b543ebdaad3d90184
3
+ size 1726997970
models/Clay-legacy/v1/compiled/clay-v1-encoder-cpu.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8698029244666fcdd13aa387704752175cc0c7483939c1d3d6adadde6088cc7
3
+ size 369126050
models/Clay-legacy/v1/compiled/clay-v1-encoder-cpu.pt2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4bb58c25c6d763bf27ff89487bf827efaff5e33547d362f3a64de2858fc135ca
3
+ size 370177966
models/Clay-legacy/v1/compiled/clay-v1-encoder.pt2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:572ba7873a1dff85226ff82a18b15a4bee46a0d71ef0aac8bbb0837a2c7eb9e6
3
+ size 370195133
models/Clay/.gitattributes ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.pt2 filter=lfs diff=lfs merge=lfs -text
models/Clay/README.md ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ license_link: https://raw.githubusercontent.com/Clay-foundation/model/main/LICENSE.md
4
+ ---
5
+
6
+ # Clay Foundation Model
7
+
8
+ ## An open source AI model for Earth
9
+
10
+ Clay is a foundational model of Earth. It uses an expanded visual transformer upgraded to understand geospatial and temporal relations on Earth data. The model is trained as a self-supervised Masked Autoencoder (MAE).
11
+
12
+ The Clay model can be used in three main ways:
13
+ - Generate semantic embeddings for any location and time.
14
+ - Fine-tune the model for downstream tasks such as classification, regression, and generative tasks.
15
+ - Use the model as a backbone for other models.
16
+
17
+
18
+ ## Where is what
19
+
20
+ - Our **website** is [madewithclay.org](https://madewithclay.org).
21
+ - The Clay model **code** lives on [Github](https://github.com/Clay-foundation/model). License: [Apache](https://github.com/Clay-foundation/model/LICENSE). The latest release is [v0.0.1](https://github.com/Clay-foundation/model/releases/tag/v0.0.1)
22
+ - The Clay model **weights** on [Hugging Face](https://huggingface.co/made-with-clay/Clay/). License: [Apache](https://github.com/Clay-foundation/model/LICENSE).
23
+ - Legacy versions on https://huggingface.co/made-with-clay/Clay-legacy
24
+ - The Clay **documentation** [lives on this site](https://clay-foundation.github.io/model/). License: [CC-BY](http://creativecommons.org/licenses/by/4.0/).
25
+ - We maintain a set of **embeddings** on [Source Cooperative](https://beta.source.coop/clay/). License: [ODC-BY](https://opendatacommons.org/licenses/by/).
26
+
27
+ CLAY v0 to v1.5 fiscal sponsored projects of the 501c3 non-profit [Radiant Earth Foundation](https://www.radiant.earth/).
models/Clay/config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "made-with-clay/Clay",
3
+ "model_type": "geovit+DOFA",
4
+ }
models/Clay/source.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ https://huggingface.co/made-with-clay/Clay
models/Clay/v1.5/clay-v1.5.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21432069250b9b3f9a65ffd0071c5ad56b793247285ab0604edf7f531d4798d0
3
+ size 5158764629