Commit ·
802f6fb
1
Parent(s): 7f39788
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,14 +1,82 @@
|
|
| 1 |
# Hypernerf Practice
|
| 2 |
|
| 3 |
-
This README contains overview on applyiing
|
| 4 |
- hand
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |

|
|
|
|
| 6 |

|
| 7 |
|
| 8 |
PSNR: <br>
|
| 9 |
coarse metrics: metric/psnr≈31.7468 <br>
|
| 10 |
fine metrics: metric/psnr≈32.5462
|
| 11 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
|
| 14 |
---
|
|
|
|
| 1 |
# Hypernerf Practice
|
| 2 |
|
| 3 |
+
This README contains overview on applyiing several custom scenes to reproduce the hypernerf project.
|
| 4 |
- hand
|
| 5 |
+
- dvd
|
| 6 |
+
- tomato-mark
|
| 7 |
+
|
| 8 |
+
|
| 9 |
+
## hand
|
| 10 |
+
|
| 11 |
+
most successful one, trained extensively on V100
|
| 12 |
+
|
| 13 |
+
### interpolation:
|
| 14 |

|
| 15 |
+
### novelview:
|
| 16 |

|
| 17 |
|
| 18 |
PSNR: <br>
|
| 19 |
coarse metrics: metric/psnr≈31.7468 <br>
|
| 20 |
fine metrics: metric/psnr≈32.5462
|
| 21 |
|
| 22 |
+
## dvd
|
| 23 |
+
|
| 24 |
+
not so great
|
| 25 |
+
|
| 26 |
+
### interpolation & novelview:
|
| 27 |
+

|
| 28 |
+
|
| 29 |
+
PSNR: <br>
|
| 30 |
+
coarse metrics: metric/psnr≈ <br>
|
| 31 |
+
fine metrics: metric/psnr≈
|
| 32 |
+
|
| 33 |
+
## tomato-mark
|
| 34 |
+
|
| 35 |
+
more artifacts
|
| 36 |
+
|
| 37 |
+

|
| 38 |
+
PSNR: <br>
|
| 39 |
+
coarse metrics: metric/psnr≈ <br>
|
| 40 |
+
fine metrics: metric/psnr≈
|
| 41 |
+
|
| 42 |
+
# reproduction steps
|
| 43 |
+
|
| 44 |
+
Due to deprecation, the hypernerf project doesn't work out of the box. <br>
|
| 45 |
+
We need code modifications to the environments, dependencies set up and rendering part. <br>
|
| 46 |
+
For this reproduction, I only used the notebooks. <br>
|
| 47 |
+
The provided instructions below are guaranteed to work.
|
| 48 |
+
|
| 49 |
+
## before getting started
|
| 50 |
+
|
| 51 |
+
Python 3.8 and Python 3.9 has been tested to work flawlessly. Python 3.10 will fail.
|
| 52 |
+
|
| 53 |
+
### Colab
|
| 54 |
+
|
| 55 |
+
Important Information: in May 2023, colab is updated to python 3.10, in order for this reproduction to work, select tools- command palatte - use fallback runtime.
|
| 56 |
+
This will change the runtime back to python 3.9. <br>
|
| 57 |
+
The fallback runtime is supported until mid May 2023, after that, we could only use other tricks to change the colab python version. <br>
|
| 58 |
+
Colab TPU doesnot work here anymore, GPU runs flawlessly.
|
| 59 |
+
|
| 60 |
+
|
| 61 |
+
### local machine
|
| 62 |
+
|
| 63 |
+
Start with python 3.8 or python 3.9
|
| 64 |
+
|
| 65 |
+
Install the following:
|
| 66 |
+
|
| 67 |
+
sudo apt-get install libilmbase-dev libopenexr-dev ffmpeg
|
| 68 |
+
|
| 69 |
+
Follow official colmap project to install with cuda support, or use default package manager to install colmap, but might only has cpu support.
|
| 70 |
+
|
| 71 |
+
Then install pip requirements:
|
| 72 |
+
|
| 73 |
+
wget https://raw.githubusercontent.com/xieyizheng/hypernerf/main/requirements.txt
|
| 74 |
+
pip install -r requirements.txt
|
| 75 |
+
|
| 76 |
+
With this, everything is set! The Processing, Training and Rendering notebooks should now work!
|
| 77 |
+
|
| 78 |
+
|
| 79 |
+
|
| 80 |
|
| 81 |
|
| 82 |
---
|