yuanhangtangle-air commited on
Commit
ee37a0f
Β·
verified Β·
1 Parent(s): 2c5d821

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +279 -0
README.md ADDED
@@ -0,0 +1,279 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "MoMa: Modular Deep Learning Framework for Material Property Prediction"
3
+ emoji: πŸ§ͺ
4
+ colorFrom: blue
5
+ colorTo: purple
6
+ sdk: static
7
+ pinned: false
8
+ license: mit
9
+ tags:
10
+ - materials-science
11
+ - deep-learning
12
+ - modular-framework
13
+ - property-prediction
14
+ - pytorch
15
+ ---
16
+
17
+ # πŸ§ͺ MoMa: Modular Deep Learning Framework for Material Property Prediction
18
+
19
+ <div align="center">
20
+
21
+ [![arXiv](https://img.shields.io/badge/arXiv-2502.15483-b31b1b.svg)](https://arxiv.org/abs/2502.15483)
22
+ [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
23
+ [![Python 3.8+](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/downloads/)
24
+ [![PyTorch](https://img.shields.io/badge/PyTorch-2.0+-ee4c2c.svg)](https://pytorch.org/)
25
+ [![HuggingFace Models](https://img.shields.io/badge/πŸ€—-Models-yellow)](https://huggingface.co/yuanhangtangle-air/moma-modules)
26
+
27
+ **[πŸ“„ Paper](https://arxiv.org/abs/2502.15483) | [🌐 Project Page](https://yuanhangtangle-air.github.io/moma-modules/) | [πŸ’» Code](https://github.com/your-repo) | [πŸ“Š Datasets](https://huggingface.co/datasets/your-datasets)**
28
+
29
+ </div>
30
+
31
+ ## πŸš€ Overview
32
+
33
+ MoMa introduces a revolutionary **modular approach** to material property prediction that fundamentally shifts from traditional pre-training paradigms. Instead of using a single pre-trained model fine-tuned for each task, MoMa trains specialized modules across diverse material properties and adaptively composes them for downstream applications.
34
+
35
+ ### 🎯 Key Achievements
36
+ - **πŸ† State-of-the-art performance** on 17 material property prediction datasets
37
+ - **πŸ“ˆ 14% average improvement** over strongest baselines
38
+ - **πŸ”§ 107 specialized modules** covering major material property domains
39
+ - **⚑ Superior few-shot** and continual learning capabilities
40
+
41
+ ### 🧠 Why MoMa?
42
+
43
+ | Traditional Approach | MoMa Framework |
44
+ |---------------------|----------------|
45
+ | Single pre-trained model β†’ Fine-tune | Multiple specialized modules β†’ Adaptive composition |
46
+ | Limited task specificity | Task-specific optimization |
47
+ | Poor generalization to new properties | Enhanced generalization through modularity |
48
+ | High computational cost for each task | Efficient module reuse and composition |
49
+
50
+ ## πŸ“¦ Available Modules (107 Total)
51
+
52
+ Our repository contains **107 pre-trained modules** spanning **6 major domains** of material science:
53
+
54
+ ### πŸ“Š Module Distribution by Domain
55
+
56
+ | Domain | Count | Description |
57
+ |--------|-------|-------------|
58
+ | **πŸ”¬ Electronic Structure** | 28 | Band gaps, HOMO-LUMO, DOS, dielectric properties |
59
+ | **🌑️ Thermodynamics** | 20 | Formation energy, Gibbs free energy, stability |
60
+ | **βš—οΈ Spectroscopy** | 24 | EXAFS, XANES spectral features |
61
+ | **🧲 Mechanical** | 8 | Elastic moduli, piezoelectric properties |
62
+ | **πŸ”‹ Photovoltaic** | 8 | Solar cell performance metrics |
63
+ | **🌊 Adsorption** | 8 | Gas adsorption in MOFs |
64
+ | **⚑ Thermoelectric** | 8 | Seebeck coefficients, thermal conductivity |
65
+ | **πŸ” Other Properties** | 3 | Specialized material characteristics |
66
+
67
+ ### πŸ” Featured Modules
68
+
69
+ <details>
70
+ <summary><strong>πŸ”¬ Electronic Structure Modules</strong></summary>
71
+
72
+ | Module | Property | Description |
73
+ |--------|----------|-------------|
74
+ | `HL_Gap.pt` | HOMO-LUMO Gap | Electronic band gap prediction |
75
+ | `HOMO_Energy.pt` | HOMO Energy | Highest occupied molecular orbital energy |
76
+ | `LUMO_Energy.pt` | LUMO Energy | Lowest unoccupied molecular orbital energy |
77
+ | `Polarizability.pt` | Polarizability | Electron cloud deformation under external field |
78
+ | `jarvis_bandgap.pt` | Band Gap | Fundamental electronic property |
79
+ | `mp_bandgap.pt` | Material Band Gap | Electronic structure parameter |
80
+
81
+ </details>
82
+
83
+ <details>
84
+ <summary><strong>🌑️ Thermodynamics Modules</strong></summary>
85
+
86
+ | Module | Property | Description |
87
+ |--------|----------|-------------|
88
+ | `jarvis_eform.pt` | Formation Energy | Thermodynamic stability indicator |
89
+ | `mp_eform.pt` | Formation Energy | Energy of formation from elements |
90
+ | `gibbs_free_energy.pt` | Gibbs Free Energy | Chemical reaction spontaneity |
91
+ | `surface_energy.pt` | Surface Energy | Cost of creating new surfaces |
92
+ | `mp_energy_above_hull.pt` | Energy Above Hull | Phase stability metric |
93
+
94
+ </details>
95
+
96
+ <details>
97
+ <summary><strong>βš—οΈ Spectroscopy Modules</strong></summary>
98
+
99
+ | Module | Property | Description |
100
+ |--------|----------|-------------|
101
+ | `spec_EXAFS_Fe_EdgeEnergy.pt` | EXAFS Edge Energy | Iron K-edge absorption |
102
+ | `spec_XANES_Co_PeakHeight.pt` | XANES Peak Height | Cobalt absorption intensity |
103
+ | `spec_EXAFS_Cu_WhiteLineHeight.pt` | White Line Height | Copper spectral feature |
104
+
105
+ </details>
106
+
107
+ ## πŸ› οΈ Installation & Usage
108
+
109
+ ### Quick Start
110
+
111
+ ```bash
112
+ # Install required packages
113
+ pip install torch huggingface_hub pandas tqdm
114
+
115
+ # Clone or download the modules
116
+ git clone https://huggingface.co/yuanhangtangle-air/moma-modules
117
+ ```
118
+
119
+ ### πŸ“₯ Download Individual Modules
120
+
121
+ ```python
122
+ import shutil
123
+ from huggingface_hub import hf_hub_download
124
+
125
+ # Download a specific module
126
+ cached_file = hf_hub_download(
127
+ repo_id="yuanhangtangle-air/moma-modules",
128
+ filename="Dipole_M.pt", # Replace with desired module
129
+ repo_type="model"
130
+ )
131
+
132
+ # Copy to your local directory
133
+ save_path = "./moma-hub/"
134
+ shutil.copy(cached_file, save_path)
135
+ ```
136
+
137
+ ### πŸ“¦ Download All Modules
138
+
139
+ ```python
140
+ import shutil
141
+ import pandas as pd
142
+ from huggingface_hub import hf_hub_download
143
+ from tqdm import tqdm
144
+
145
+ # Load module list
146
+ module_info_url = "https://huggingface.co/yuanhangtangle-air/moma-modules/resolve/main/domain-dataset-concept-en.csv"
147
+ df = pd.read_csv(module_info_url)
148
+ module_list = df['Dataset']
149
+
150
+ # Download all modules
151
+ cached_files = []
152
+ for module_name in tqdm(module_list, desc="Downloading modules"):
153
+ cached_file = hf_hub_download(
154
+ repo_id="yuanhangtangle-air/moma-modules",
155
+ filename=f"{module_name}.pt",
156
+ repo_type="model"
157
+ )
158
+ cached_files.append(cached_file)
159
+
160
+ # Copy to local directory
161
+ save_path = "./moma-hub/"
162
+ for cached_file in cached_files:
163
+ shutil.copy(cached_file, save_path)
164
+ ```
165
+
166
+ ### πŸš€ Using MoMa Framework
167
+
168
+ ```python
169
+ # Import the framework (pseudo-code - actual implementation may vary)
170
+ from moma import MaterialPropertyPredictor, ModularNetwork
171
+
172
+ # Initialize with pre-trained modules
173
+ model = MaterialPropertyPredictor(
174
+ network=ModularNetwork.from_pretrained('material-property-base'),
175
+ modules=['structure_encoder', 'property_decoder']
176
+ )
177
+
178
+ # Load your material data
179
+ materials = load_material_dataset('your_dataset.csv')
180
+
181
+ # Train the model
182
+ model.train(materials, epochs=100, batch_size=32)
183
+
184
+ # Make predictions
185
+ predictions = model.predict(new_materials)
186
+
187
+ # Evaluate performance
188
+ metrics = model.evaluate(test_materials)
189
+ print(f"Accuracy: {metrics['accuracy']:.3f}")
190
+ ```
191
+
192
+ ## πŸ“Š Performance Results
193
+
194
+ Our experimental evaluation across **17 datasets** demonstrates MoMa's superior performance:
195
+
196
+ - πŸ₯‡ **Rank 1.35** average ranking among 5 competing methods
197
+ - πŸ† **14/17 tasks** achieve state-of-the-art performance
198
+ - πŸ“ˆ **14% average improvement** over strongest baseline
199
+ - ⚑ **Superior few-shot learning** capabilities
200
+ - πŸ”„ **Excellent continual learning** performance
201
+
202
+ ## πŸ“ Module File Structure
203
+
204
+ ```
205
+ moma-modules/
206
+ β”œβ”€β”€ README.md # This file
207
+ β”œβ”€β”€ domain-dataset-concept-en.csv # Module descriptions
208
+ β”œβ”€β”€ Electronic_Structure/ # 28 modules
209
+ β”‚ β”œβ”€β”€ HL_Gap.pt
210
+ β”‚ β”œβ”€β”€ HOMO_Energy.pt
211
+ β”‚ β”œβ”€β”€ LUMO_Energy.pt
212
+ β”‚ └── ...
213
+ β”œβ”€β”€ Thermodynamics/ # 20 modules
214
+ β”‚ β”œβ”€β”€ jarvis_eform.pt
215
+ β”‚ β”œβ”€β”€ gibbs_free_energy.pt
216
+ β”‚ └── ...
217
+ β”œβ”€β”€ Spectroscopy/ # 24 modules
218
+ β”‚ β”œβ”€β”€ spec_EXAFS_Fe_EdgeEnergy.pt
219
+ β”‚ β”œβ”€β”€ spec_XANES_Co_PeakHeight.pt
220
+ β”‚ └── ...
221
+ └── Other_Domains/ # 35 modules
222
+ β”œβ”€β”€ Mechanical/
223
+ β”œβ”€β”€ Photovoltaic/
224
+ β”œβ”€β”€ Adsorption/
225
+ β”œβ”€β”€ Thermoelectric/
226
+ └── ...
227
+ ```
228
+
229
+ ## πŸ”¬ Research Impact
230
+
231
+ ### πŸ“ Citation
232
+
233
+ If you use MoMa in your research, please cite our paper:
234
+
235
+ ```bibtex
236
+ @article{wang2025moma,
237
+ title={MoMa: A Modular Deep Learning Framework for Material Property Prediction},
238
+ author={Wang, Botian and Ouyang, Yawen and Li, Yaohui and Wang, Yiqun and Cui, Haorui and Zhang, Jianbing and Wang, Xiaonan and Ma, Wei-Ying and Zhou, Hao},
239
+ journal={arXiv preprint arXiv:2502.15483},
240
+ year={2025}
241
+ }
242
+ ```
243
+
244
+ ### 🌟 Key Contributions
245
+
246
+ 1. **Novel Modular Paradigm**: First framework to replace pre-training with specialized module composition
247
+ 2. **Comprehensive Evaluation**: Extensive benchmarking across 17 diverse material property datasets
248
+ 3. **Open Science**: All 107 modules freely available to accelerate materials discovery
249
+ 4. **Superior Performance**: Consistent improvements over traditional approaches
250
+
251
+ ## 🀝 Community & Support
252
+
253
+ - πŸ“§ **Contact**: [Your contact information]
254
+ - πŸ› **Issues**: [Report bugs or request features]
255
+ - πŸ’¬ **Discussions**: [Community discussions]
256
+ - πŸ“š **Documentation**: [Detailed documentation]
257
+
258
+ ## πŸ“œ License
259
+
260
+ This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
261
+
262
+ ## πŸ™ Acknowledgments
263
+
264
+ We gratefully acknowledge the materials science community and the datasets that made this research possible. Special thanks to:
265
+
266
+ - Materials Project (MP)
267
+ - Open Quantum Materials Database (OQMD)
268
+ - Joint Automated Repository for Various Integrated Simulations (JARVIS)
269
+ - And all other data contributors
270
+
271
+ ---
272
+
273
+ <div align="center">
274
+
275
+ **🌟 Star this repository if you find it useful! 🌟**
276
+
277
+ **πŸš€ Accelerating Materials Discovery Through Modular AI πŸš€**
278
+
279
+ </div>