Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,32 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
| 4 |
+
|
| 5 |
+

|
| 6 |
+

|
| 7 |
+
|
| 8 |
+
|
| 9 |
+
# WorldModel
|
| 10 |
+
Note: This was a passion project, crafted in two days. I hope it can be of help to many!
|
| 11 |
+
|
| 12 |
+
WorldModel is a MaskGIT model trained on 8x8x8 Minecraft voxel volumes. Beyond generating blocks from scratch,
|
| 13 |
+
it excels in filling spaces based on neighboring blocks, ensuring seamless integration in Minecraft worlds
|
| 14 |
+
|
| 15 |
+
The model weights can be found [here](https://drive.google.com/file/d/1--4Z5VQ-mRQz805yDmJPsPKrIrVCaoCv/view?usp=sharing)
|
| 16 |
+
|
| 17 |
+
## Prerequisites:
|
| 18 |
+
Ensure your server has the mcpi package installed. This code relies on it to place blocks.
|
| 19 |
+
|
| 20 |
+
## Functionality:
|
| 21 |
+
This tool uses a special mask token, designated as 831. When you provide a tensor of shape [1,512] containing
|
| 22 |
+
block values ranging from 0-831(including the mask token), the generate function will intelligently fill in
|
| 23 |
+
the masked areas until none remain.
|
| 24 |
+
|
| 25 |
+
|
| 26 |
+
## Sampling Strategy Adjustments to maskGIT:
|
| 27 |
+
In contrast to the original maskGIT, sampling solely from the most confident tokens can lead to mode collapse, often
|
| 28 |
+
resulting in generating only stones or air. To address this, I've introduced a random sampling strategy. In the early
|
| 29 |
+
sampling phases, the confidence of potential tokens is disregarded, and tokens are selected for unmasking at random.
|
| 30 |
+
|
| 31 |
+
You can fine-tune this behavior using the "random_steps" variable. It's crucial to strike a balance between "random_steps"
|
| 32 |
+
and other parameters such as the total "timesteps", "temperature", and "topk_filter_thres".
|