IMvision12 commited on
Commit
67e8621
·
verified ·
1 Parent(s): 20a38ac

fix readme.md

Browse files
Files changed (1) hide show
  1. README.md +66 -8
README.md CHANGED
@@ -1,21 +1,79 @@
1
  ---
2
  pipeline_tag: depth-estimation
3
- license: cc-by-nc-4.0
 
4
  library_name: kerasformers
5
  tags:
6
  - keras
7
  - kerasformers
8
- - depth_anything_v2
9
- - tf
10
- - jax
11
  - pytorch
 
 
12
  ---
13
 
14
- # depth_anything_v2_base (Keras 3)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
 
16
- Pure-Keras 3 weights for [kerasformers](https://github.com/IMvision12/KerasFormers). License: `cc-by-nc-4.0`.
17
 
18
  ```python
19
- from kerasformers.models.depth_anything_v2 import DepthAnythingV2DepthEstimation
20
- model = DepthAnythingV2DepthEstimation.from_weights("depth_anything_v2_base")
 
 
 
 
 
 
 
 
 
 
 
 
 
21
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  pipeline_tag: depth-estimation
3
+ license: apache-2.0
4
+ base_model: depth-anything/Depth-Anything-V2-Base-hf
5
  library_name: kerasformers
6
  tags:
7
  - keras
8
  - kerasformers
9
+ - depth-anything-v2
10
+ - depth-estimation
11
+ - arxiv:2406.09414
12
  - pytorch
13
+ - jax
14
+ - tf
15
  ---
16
 
17
+ ## ***See [our collection](https://huggingface.co/collections/kerasformers/depth-anything-v1-and-v2-6a6a965e3e9e4847e424dde2) for all versions of Depth Anything V2.***
18
+
19
+ # Run Depth Anything V2 with Keras 3: JAX, PyTorch, or TensorFlow
20
+
21
+ [![GitHub](https://img.shields.io/badge/GitHub-KerasFormers-black?logo=github)](https://github.com/IMvision12/KerasFormers) [![Docs](https://img.shields.io/badge/Docs-Depth--Anything--V2-blue)](https://imvision12.github.io/KerasFormers/depth_anything_v2/) [![Collection](https://img.shields.io/badge/HF-Depth--Anything--V2%20collection-yellow)](https://huggingface.co/collections/kerasformers/depth-anything-v1-and-v2-6a6a965e3e9e4847e424dde2)
22
+
23
+ # kerasformers/depth_anything_v2_base
24
+
25
+ Paper: [Depth Anything V2 (arXiv:2406.09414)](https://arxiv.org/abs/2406.09414) · [HF Papers](https://huggingface.co/papers/2406.09414)
26
+
27
+ Depth Anything V2 keeps V1's architecture and improves data (synthetic labels plus large-scale pseudo-labeling). Relative heads return unitless inverse depth; metric indoor/outdoor heads return metres.\n
28
+ For more details on the model, please go to the upstream [model card](https://huggingface.co/depth-anything/Depth-Anything-V2-Base-hf).
29
+
30
+ Pure-**Keras 3** conversion of [`depth-anything/Depth-Anything-V2-Base-hf`](https://huggingface.co/depth-anything/Depth-Anything-V2-Base-hf) for [kerasformers](https://github.com/IMvision12/KerasFormers). One implementation runs unmodified on **TensorFlow / Torch / JAX**.
31
+
32
+ This is a **monocular depth** checkpoint (`DepthAnythingV2DepthEstimation`, relative).
33
 
34
+ ## Quick start
35
 
36
  ```python
37
+ import os
38
+ os.environ["KERAS_BACKEND"] = "torch" # or "jax" / "tensorflow"
39
+
40
+ from PIL import Image
41
+ from {meta['import_path']} import {meta['load_cls']}, {meta['proc_cls']}
42
+
43
+ model = {meta["load_cls"]}.from_weights("kerasformers/{variant}")
44
+ processor = {meta['proc_cls']}()
45
+
46
+ image = Image.open("your_image.jpg").convert("RGB")
47
+ output = model(processor(image)["pixel_values"], training=False)
48
+ depth = processor.post_process_depth_estimation(
49
+ output, original_size=(image.height, image.width)
50
+ )
51
+ print(depth.shape)
52
  ```
53
+
54
+ Load any Depth Anything V2 variant the same way with `from_weights("kerasformers/<variant>")`:
55
+
56
+ | Variant | Hub | Output |
57
+ |---|---|---|
58
+ | `depth_anything_v2_small` | [`kerasformers/depth_anything_v2_small`](https://huggingface.co/kerasformers/depth_anything_v2_small) | relative |
59
+ | `depth_anything_v2_base` | [`kerasformers/depth_anything_v2_base`](https://huggingface.co/kerasformers/depth_anything_v2_base) | relative |
60
+ | `depth_anything_v2_large` | [`kerasformers/depth_anything_v2_large`](https://huggingface.co/kerasformers/depth_anything_v2_large) | relative |
61
+ | `depth_anything_v2_metric_indoor_small` | [`kerasformers/depth_anything_v2_metric_indoor_small`](https://huggingface.co/kerasformers/depth_anything_v2_metric_indoor_small) | metric indoor |
62
+ | `depth_anything_v2_metric_indoor_base` | [`kerasformers/depth_anything_v2_metric_indoor_base`](https://huggingface.co/kerasformers/depth_anything_v2_metric_indoor_base) | metric indoor |
63
+ | `depth_anything_v2_metric_indoor_large` | [`kerasformers/depth_anything_v2_metric_indoor_large`](https://huggingface.co/kerasformers/depth_anything_v2_metric_indoor_large) | metric indoor |
64
+ | `depth_anything_v2_metric_outdoor_small` | [`kerasformers/depth_anything_v2_metric_outdoor_small`](https://huggingface.co/kerasformers/depth_anything_v2_metric_outdoor_small) | metric outdoor |
65
+ | `depth_anything_v2_metric_outdoor_base` | [`kerasformers/depth_anything_v2_metric_outdoor_base`](https://huggingface.co/kerasformers/depth_anything_v2_metric_outdoor_base) | metric outdoor |
66
+ | `depth_anything_v2_metric_outdoor_large` | [`kerasformers/depth_anything_v2_metric_outdoor_large`](https://huggingface.co/kerasformers/depth_anything_v2_metric_outdoor_large) | metric outdoor |
67
+
68
+ ## Tips
69
+
70
+ - Set `KERAS_BACKEND` **before** importing Keras / kerasformers.
71
+ - Indoor and outdoor metric heads are not interchangeable.
72
+ - See [Depth Anything V2 docs]({DOCS_URL}) and [Loading Weights](https://imvision12.github.io/KerasFormers/loading_weights/).
73
+ - Community / upstream weights: `DepthAnythingV2DepthEstimation.from_weights("hf:depth-anything/Depth-Anything-V2-Base-hf")`.
74
+
75
+ ## Special Thanks
76
+
77
+ A huge thank you to the Depth Anything authors for creating and releasing these models.
78
+
79
+ License: Apache 2.0.