Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- crystal-generation
|
| 5 |
+
- diffusion-model
|
| 6 |
+
- materials-science
|
| 7 |
+
- probe-gradient-guidance
|
| 8 |
+
library_name: pytorch
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Crystalite Balanced 100K (Production)
|
| 12 |
+
|
| 13 |
+
Crystalite checkpoint trained for 100K steps on a balanced 32K subset of Alex-MP-20 with 35% insulators (vs 2.1% in the full dataset). This is the production model for guided crystal generation.
|
| 14 |
+
|
| 15 |
+
**Architecture**: 67.8M-parameter Diffusion Transformer with subatomic tokenizer and GEM attention bias ([Crystalite](https://arxiv.org/abs/2604.02270), Hadzi Veljkovic et al.).
|
| 16 |
+
|
| 17 |
+
## Results at w=3 (production operating point)
|
| 18 |
+
|
| 19 |
+
| Metric | Value |
|
| 20 |
+
|---|---|
|
| 21 |
+
| In-window rate (4-6 eV) | 42.6% |
|
| 22 |
+
| Lattice validity | 100% |
|
| 23 |
+
| Geometry validity | 99.6% |
|
| 24 |
+
| Compositional uniqueness | 78% |
|
| 25 |
+
| Metal fraction | 0.2% |
|
| 26 |
+
|
| 27 |
+
Formation energy probe AUROC: 0.990. Band gap probe AUROC: ~0.95.
|
| 28 |
+
|
| 29 |
+
## Multi-constraint generation
|
| 30 |
+
|
| 31 |
+
Hybrid gradient steering + token masking produces: 100% refractory, 0% cobalt/nickel, 100% insulator, 30% in target window.
|
| 32 |
+
|
| 33 |
+
## Usage
|
| 34 |
+
|
| 35 |
+
Requires the [Crystalite](https://github.com/joshrosie/crystalite) codebase and [probe-gradient-guidance](https://github.com/Dynamical-Systems-Research/probe-gradient-guidance) scripts.
|
| 36 |
+
|
| 37 |
+
```python
|
| 38 |
+
from scripts.train_probe import load_model
|
| 39 |
+
model = load_model("final.pt", device="cuda")
|
| 40 |
+
```
|
| 41 |
+
|
| 42 |
+
## Links
|
| 43 |
+
|
| 44 |
+
- **Blog post**: [Scaling Test-Time Verification for Novel Materials](https://dynamicalsystems.ai/blog/scaling-test-time-verification)
|
| 45 |
+
- **Code**: [Dynamical-Systems-Research/probe-gradient-guidance](https://github.com/Dynamical-Systems-Research/probe-gradient-guidance)
|
| 46 |
+
- **Crystalite paper**: [arXiv:2604.02270](https://arxiv.org/abs/2604.02270)
|