Update README.md
Browse files
README.md
CHANGED
|
@@ -1,4 +1,52 @@
|
|
| 1 |
-
SurfaceScienceAssistant: A Fine-Tuned Llama-3.1-8B for On-Surface Synthesis
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
|
| 3 |
model_id = "JuanXiang-SHU/SurfaceScienceAssistant"
|
| 4 |
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
|
@@ -7,18 +55,4 @@ model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto", load_i
|
|
| 7 |
messages = [
|
| 8 |
{"role": "system", "content": "You are a professional researcher in Surface Chemistry."},
|
| 9 |
{"role": "user", "content": "How does the Au(111) substrate influence the Ullmann coupling of 1,4-dibromobenzene compared to Cu(111)?"}
|
| 10 |
-
]
|
| 11 |
-
|
| 12 |
-
# Standard inference pipeline follows...
|
| 13 |
-
6. Limitations & Disclaimer / 局限性与免责声明Validation Required: As with all AI models, the chemical predictions and mechanistic proposals should be treated as hypotheses and verified via experimental methods or high-level DFT simulations.Domain Scope: While proficient in surface science, the model’s performance in unrelated fields (e.g., macro-economics, creative writing) may be diminished compared to the base Llama-3.1 model.7. Citation & Contact / 引用与联系If you find this model useful for your research, please cite:代码段@software{SurfaceScienceAssistant2026,
|
| 14 |
-
author = {Juan Xiang, Hao Jiang, and the Cosine Intelligence Team},
|
| 15 |
-
title = {SurfaceScienceAssistant: A Specialized LLM for On-Surface Synthesis Discovery},
|
| 16 |
-
year = {2026},
|
| 17 |
-
publisher = {Hugging Face},
|
| 18 |
-
url = {https://huggingface.co/JuanXiang-SHU/SurfaceScienceAssistant}
|
| 19 |
-
}
|
| 20 |
-
Contact: Juan Xiang | Materials Genome Institute, Shanghai University.
|
| 21 |
-
|
| 22 |
-
---
|
| 23 |
-
license: mit
|
| 24 |
-
---
|
|
|
|
| 1 |
+
# SurfaceScienceAssistant: A Fine-Tuned Llama-3.1-8B for On-Surface Synthesis Reasoning
|
| 2 |
+
|
| 3 |
+
[](https://opensource.org/licenses/Apache-2.0)
|
| 4 |
+
[](https://huggingface.co/meta-llama/Llama-3.1-8B)
|
| 5 |
+
[](https://en.wikipedia.org/wiki/Surface_science)
|
| 6 |
+
|
| 7 |
+
## 1. Overview
|
| 8 |
+
**SurfaceScienceAssistant** is a specialized Large Language Model (LLM) fine-tuned for reasoning and knowledge synthesis in the field of **Surface Chemistry** and **On-Surface Synthesis (OSS)**.
|
| 9 |
+
|
| 10 |
+
While general-purpose models often struggle with the niche nomenclature and complex mechanistic logic of surface-confined reactions, this model has been specifically adapted to understand the synergistic interactions between organic precursors and metal substrates (e.g., Au, Ag, Cu). It serves as the intelligent reasoning core for the **OSS Assistant** platform, providing expert-level insights into reaction pathways.
|
| 11 |
+
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
## 2. Model Specifications
|
| 15 |
+
* **Developer:** Materials Genome Institute (MGI), Shanghai University.
|
| 16 |
+
* **Architecture:** Meta-Llama-3.1-8B (Transformer-based).
|
| 17 |
+
* **Adaptation Method:** **QLoRA (4-bit Low-Rank Adaptation)** — ensuring a balance between maintaining foundational scientific priors and acquiring domain-specific expertise.
|
| 18 |
+
* **Primary Objective:** **Targeted Scientific Reasoning** — This model has been specifically fine-tuned to master the intricate nuances of surface science, enabling dialogue regarding surface-confined chemical reactions, substrate-molecule interaction
|
| 19 |
+
* **Training Infrastructure:** BitsAndBytes 4-bit NormalFloat (NF4) quantization with gradient checkpointing for resource-efficient, high-performance training.
|
| 20 |
+
|
| 21 |
+
---
|
| 22 |
+
## 3. Training & Dataset
|
| 23 |
+
The model underwent domain-specific instruction tuning using the [**Surface_Chemistry**](https://huggingface.co/datasets/JuanXiang-SHU/Surface_Chemistry) dataset. This curated collection integrates high-quality instruction-following pairs derived from extensive surface science literature and expert-annotated reasoning chains.
|
| 24 |
+
* **Mechanistic Reasoning:** On-surface reactions and molecular self-assembly, facilitating precise functionalization and structural evolution.
|
| 25 |
+
* **Substrate Effects:** The influence of crystalline facets and electronic structures on molecular behavior.
|
| 26 |
+
|
| 27 |
+
|
| 28 |
+
### Hyperparameters:
|
| 29 |
+
| Parameter | Value | Description |
|
| 30 |
+
| :--- | :--- | :--- |
|
| 31 |
+
| **LoRA Rank ($r$)** | 16 | Capturing domain-specific manifolds |
|
| 32 |
+
| **LoRA Alpha ($\alpha$)** | 32 | Scaling factor for stable weight updates |
|
| 33 |
+
| **Learning Rate** | 2e-4 | Optimized for Llama-3.1 backbone |
|
| 34 |
+
| **Effective Batch Size** | 4 | Achieved via Gradient Accumulation |
|
| 35 |
+
|
| 36 |
+
---
|
| 37 |
+
|
| 38 |
+
## 4. Key Capabilities
|
| 39 |
+
**Expert-Level QA:** Provides grounded answers regarding surface-confined reaction conditions and catalyst-precursor interactions.
|
| 40 |
+
**Mechanistic Insight:** Capable of reasoning through multi-step debromination or cyclodehydrogenation processes.
|
| 41 |
+
|
| 42 |
+
---
|
| 43 |
+
|
| 44 |
+
## 5. Usage & Implementation
|
| 45 |
+
This model is best utilized with a system prompt that defines its role as a "Surface Science Expert."
|
| 46 |
+
|
| 47 |
+
### Example Inference (Python):
|
| 48 |
+
```python
|
| 49 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 50 |
|
| 51 |
model_id = "JuanXiang-SHU/SurfaceScienceAssistant"
|
| 52 |
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
|
|
|
| 55 |
messages = [
|
| 56 |
{"role": "system", "content": "You are a professional researcher in Surface Chemistry."},
|
| 57 |
{"role": "user", "content": "How does the Au(111) substrate influence the Ullmann coupling of 1,4-dibromobenzene compared to Cu(111)?"}
|
| 58 |
+
]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|