nerfstudio
inverse-rendering
neural-rendering
relighting
outdoor-scenes
File size: 2,451 Bytes
806b928
c854e91
806b928
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c854e91
806b928
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c854e91
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
---
license: apache-2.0
library_name: nerfstudio
tags:
- inverse-rendering
- neural-rendering
- relighting
- outdoor-scenes
- nerfstudio
datasets:
- jadgardner/neusky-synthetic
- jadgardner/neusky-nerfosr-overlay
---

# NeuSky Checkpoints

This repository contains the scene-specific checkpoints used for the NeuSky
experiments in *Learning Representations for Incomplete Spherical Scene
Signals*.

Two collections are provided:

- `nerf-osr`: the final `lk2`, `lwp` and `st` models used for the NeRF-OSR
  evaluation and thesis figures.
- `synthetic`: the final five NeuSky models used in the accepted synthetic
  benchmark matrix.

Every model directory contains its nerfstudio `config.yml`,
`dataparser_transforms.json`, and final checkpoint. `MODEL_MANIFEST.json`
records the original source run, byte size and SHA256 of every file. Failed,
superseded and diagnostic runs are not included.

All models use the exact channelwise, two-bracket RENI prior released as
`neusky-prior` in
[jadgardner/reni-models](https://huggingface.co/jadgardner/reni-models).
They do not use the later joint-frame RENI thesis model.

## Download

From a clone of NeuSky, download all three NeRF-OSR models:

```bash
python scripts/download_models.py model-storage/neusky
```

Download one scene or the synthetic collection:

```bash
python scripts/download_models.py model-storage/neusky --scene lk2
python scripts/download_models.py model-storage/neusky --collection synthetic
```

The required RENI prior is downloaded from the `ns_reni` submodule:

```bash
python ns_reni/scripts/download_models.py \
  model-storage/reni \
  --group neusky-prior
```

Files can also be retrieved directly:

```bash
hf download jadgardner/neusky-models \
  --revision v1.0.1 \
  --include "nerf-osr/lk2/*" "nerf-osr/lk2/**/*" \
  --local-dir model-storage/neusky
```

## Data

- [NeuSky Synthetic v1.0](https://huggingface.co/datasets/jadgardner/neusky-synthetic)
  contains the five released synthetic scene datasets.
- [NeuSky NeRF-OSR Overlay v1.0](https://huggingface.co/datasets/jadgardner/neusky-nerfosr-overlay)
  contains only the NeuSky masks, registered point clouds and environment-map
  rotations to layer over the official NeRF-OSR data.

The original NeRF-OSR images, poses and environment maps are not redistributed
here.

## Licence

The NeuSky checkpoint release is available under the Apache License 2.0.
Third-party datasets and assets retain their own licences.