JulesLT commited on
Commit
9176bf8
·
verified ·
1 Parent(s): 4d15cee

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -61
README.md CHANGED
@@ -1,64 +1,49 @@
1
- # eSEN
2
-
3
- ## Reference
4
-
5
- TBD
6
-
7
- ## How to Use
8
-
9
- For complete usage instructions, please refer to our [documentation](https://instadeepai.github.io/mlip)
10
-
11
- ## Model architecture
12
- | Parameter | Value | Description |
13
- |---------------------------|-----------------------------------------------|---------------------------------------------|
14
- | `num_layers` | `5` | Number of NequIP layers. |
15
- | `node_irreps` | `64x0e + 64x0o + 32x1e + 32x1o + 4x2e + 4x2o` | O3 representation space of node features. |
16
- | `l_max` | `2` | Maximal degree of spherical harmonics. |
17
- | `num_bessel` | `8` | Number of Bessel basis functions. |
18
- | `radial_net_nonlinearity` | `swish` | Activation function for radial MLP. |
19
- | `radial_net_n_hidden` | `64` | Number of hidden features in radial MLP. |
20
- | `radial_net_n_layers` | `2` | Number of layers in radial MLP. |
21
- | `radial_envelope` | `polynomial_envelope` | Radial envelope function. |
22
- | `scalar_mlp_std` | `4` | Standard deviation of weight initialisation.|
23
- | `atomic_energies` | `None` | Treatment of the atomic energies. |
24
- | `avg_um_neighbors` | `None` | Mean number of neighbors. |
25
-
26
- For more information about NequIP hyperparameters,
27
- please refer to our [documentation](https://instadeepai.github.io/mlip/api_reference/models/nequip.html#mlip.models.nequip.config.NequipConfig)
28
-
29
- ## Training
30
-
31
- Training is performed over 220 epochs, with an exponential moving average (EMA) decay rate of 0.99.
32
- The model employs a Huber loss function with scheduled weights for the energy and force components.
33
- Initially, the energy term is weighted at 40 and the force term at 1000.
34
- At epoch 115, these weights are flipped.
35
-
36
- We use our default MLIP optimizer in v1.0.0 with the following settings:
37
- | Parameter | Value | Description |
38
- |----------------------------------|----------------|-----------------------------------------------------------------|
39
- | `init_learning_rate` | `0.002` | Initial learning rate. |
40
- | `peak_learning_rate` | `0.002` | Peak learning rate. |
41
- | `final_learning_rate` | `0.002` | Final learning rate. |
42
- | `weight_decay` | `0` | Weight decay. |
43
- | `warmup_steps` | `4000` | Number of optimizer warm-up steps. |
44
- | `transition_steps` | `360000` | Number of optimizer transition steps. |
45
- | `grad_norm` | `500` | Gradient norm used for gradient clipping. |
46
- | `num_gradient_accumulation_steps`| `1` | Steps to accumulate before taking an optimizer step. |
47
-
48
- For more information about the optimizer,
49
- please refer to our [documentation](https://instadeepai.github.io/mlip/api_reference/training/optimizer.html#mlip.training.optimizer_config.OptimizerConfig)
50
- ## Dataset
51
- | Parameter | Value | Description |
52
- |-----------------------------|-------|--------------------------------------------|
53
- | `graph_cutoff_angstrom` | `5` | Graph cutoff distance (in Å). |
54
- | `max_n_node` | `32` | Maximum number of nodes allowed in a batch.|
55
- | `max_n_edge` | `288` | Maximum number of edges allowed in a batch.|
56
- | `batch_size` | `16` | Number of graphs in a batch. |
57
-
58
- This model was trained on the [SPICE2_curated dataset](https://huggingface.co/datasets/InstaDeepAI/SPICE2-curated).
59
- For more information about dataset configuration
60
- please refer to our [documentation](https://instadeepai.github.io/mlip/api_reference/data/dataset_configs.html#mlip.data.configs.GraphDatasetBuilderConfig)
61
- ## License summary
62
 
63
  1. The Licensed Models are **only** available under this License for Non-Commercial Purposes.
64
  2. You are permitted to reproduce, publish, share and adapt the Output generated by the Licensed Model only for Non-Commercial Purposes and in accordance with this License.
 
1
+ # Overview
2
+
3
+ We present for pre-trained models to illustrate the use of the *mlip* library. Below are the references for each of these models (MACE, NequIP, ViSNet, eSEN).
4
+ # References
5
+ ## MACE
6
+
7
+ Ilyes Batatia, Dávid Péter Kovács, Gregor N. C. Simm, Christoph Ortner, and Gábor Csányi.
8
+ Mace: Higher order equivariant message passing neural networks for fast and accurate force fields,
9
+ 2023.
10
+
11
+ URL: https://arxiv.org/abs/2206.07697
12
+
13
+ ## NequIP
14
+
15
+ Simon Batzner, Albert Musaelian, Lixin Sun, Mario Geiger, Jonathan P. Mailoa,
16
+ Mordechai Kornbluth, Nicola Molinari, Tess E. Smidt, and Boris Kozinsky.
17
+ E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials.
18
+ Nature Communications, 13(1), May 2022. ISSN: 2041-1723.
19
+
20
+ URL: https://dx.doi.org/10.1038/s41467-022-29939-5.
21
+
22
+ ## ViSNet
23
+
24
+ Yusong Wang, Tong Wang, Shaoning Li, Xinheng He, Mingyu Li, Zun Wang, Nanning Zheng, Bin Shao, and Tie-Yan Liu.
25
+ Enhancing geometric representations for molecules with equivariant vector-scalar interactive message passing.
26
+ Nature Communications, 15(1), January 2024. ISSN: 2041-1723.
27
+
28
+ URL: https://dx.doi.org/10.1038/s41467-023-43720-2.
29
+
30
+ ## eSEN
31
+
32
+ Xiang Fu, Brandon M. Wood, Luis Barroso-Luque, Daniel S. Levine, Meng Gao, Misko
33
+ Dzamba, and C. Lawrence Zitnick. Learning smooth and expressive interatomic potentials for
34
+ physical property prediction, 2025.
35
+
36
+ URL https://arxiv.org/abs/2502.12147.
37
+
38
+ # Relevant documentation
39
+
40
+ For a complete usage instructions, model configs and more information, please refer to our [documentation](https://instadeepai.github.io/mlip).
41
+ We also present all model hyperparameters and training strategy in the associate [white paper](link.TBD).
42
+
43
+ These models were trained on the [SPICE2_curated dataset](https://huggingface.co/datasets/InstaDeepAI/SPICE2_curated_v2).
44
+ For more information about dataset configuration please refer to our [documentation](https://instadeepai.github.io/mlip/api_reference/data/dataset_configs.html#mlip.data.configs.GraphDatasetBuilderConfig)
45
+
46
+ # License summary
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
47
 
48
  1. The Licensed Models are **only** available under this License for Non-Commercial Purposes.
49
  2. You are permitted to reproduce, publish, share and adapt the Output generated by the Licensed Model only for Non-Commercial Purposes and in accordance with this License.