toolevalxm commited on
Commit
0d7c289
·
verified ·
1 Parent(s): 9e2055b

Upload folder using huggingface_hub

Browse files
Files changed (6) hide show
  1. README.md +63 -0
  2. config.json +6 -0
  3. figures/fig1.png +0 -0
  4. figures/fig2.png +0 -0
  5. figures/fig3.png +0 -0
  6. pytorch_model.bin +3 -0
README.md ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: transformers
4
+ ---
5
+ # ScienceGPT
6
+ <!-- markdownlint-disable first-line-h1 -->
7
+ <!-- markdownlint-disable html -->
8
+ <!-- markdownlint-disable no-duplicate-header -->
9
+
10
+ <div align="center">
11
+ <img src="figures/fig1.png" width="60%" alt="ScienceGPT" />
12
+ </div>
13
+ <hr>
14
+
15
+ <div align="center" style="line-height: 1;">
16
+ <a href="LICENSE" style="margin: 2px;">
17
+ <img alt="License" src="figures/fig2.png" style="display: inline-block; vertical-align: middle;"/>
18
+ </a>
19
+ </div>
20
+
21
+ ## 1. Introduction
22
+
23
+ ScienceGPT is a specialized language model fine-tuned for scientific reasoning and knowledge. The model has been trained on extensive scientific literature and datasets, demonstrating exceptional capabilities in physics, chemistry, biology, mathematics, and earth sciences. It excels at solving complex scientific problems and explaining scientific concepts.
24
+
25
+ <p align="center">
26
+ <img width="80%" src="figures/fig3.png">
27
+ </p>
28
+
29
+ The model shows remarkable improvements in scientific domain understanding compared to general-purpose models. For instance, in standardized science examinations, ScienceGPT achieves 85% accuracy compared to 65% for baseline models.
30
+
31
+ ## 2. Evaluation Results
32
+
33
+ ### Comprehensive Benchmark Results
34
+
35
+ <div align="center">
36
+
37
+ | | Benchmark | BaseModel | Model-v1 | Model-v2 | ScienceGPT |
38
+ |---|---|---|---|---|---|
39
+ | **Core Sciences** | Physics | 0.620 | 0.645 | 0.660 | 0.593 |
40
+ | | Chemistry | 0.580 | 0.595 | 0.610 | 0.628 |
41
+ | | Biology | 0.640 | 0.670 | 0.685 | 0.735 |
42
+ | | Mathematics | 0.710 | 0.735 | 0.750 | 0.727 |
43
+ | | Earth Science | 0.590 | 0.615 | 0.630 | 0.661 |
44
+
45
+ </div>
46
+
47
+ ### Overall Performance Summary
48
+ ScienceGPT demonstrates strong performance across all scientific benchmark categories, with particularly notable results in mathematics and biology.
49
+
50
+ ## 3. Usage
51
+
52
+ ```python
53
+ from transformers import AutoModelForCausalLM, AutoTokenizer
54
+
55
+ model = AutoModelForCausalLM.from_pretrained("username/ScienceGPT-TestRepo")
56
+ tokenizer = AutoTokenizer.from_pretrained("username/ScienceGPT-TestRepo")
57
+ ```
58
+
59
+ ## 4. License
60
+ This model is licensed under the [Apache 2.0 License](LICENSE).
61
+
62
+ ## 5. Contact
63
+ For questions, please contact science@example.com.
config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "model_type": "gpt2",
3
+ "architectures": [
4
+ "GPT2LMHeadModel"
5
+ ]
6
+ }
figures/fig1.png ADDED
figures/fig2.png ADDED
figures/fig3.png ADDED
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:350e68608a530a3244e854a991e3d3f025a07c8abb504323edc74f8f8d02ae3f
3
+ size 1400