Anoopsingh53 commited on
Commit
bf7fa4c
Β·
verified Β·
1 Parent(s): e7af25e

Add professional ISRO SpaceAI Model Card

Browse files
Files changed (1) hide show
  1. README.md +69 -0
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ base_model: Qwen/Qwen2.5-7B-Instruct
6
+ tags:
7
+ - space
8
+ - astrophysics
9
+ - cosmology
10
+ - astronomy
11
+ - isro
12
+ - nasa
13
+ - planetary-science
14
+ - qlora
15
+ - multimodal
16
+ datasets:
17
+ - UniverseTBD/arxiv-qa-astro-ph
18
+ pipeline_tag: text-generation
19
+ library_name: transformers
20
+ ---
21
+
22
+ # πŸš€ SpaceAI-v1 (ISRO & Astrophysics 7B Expert)
23
+
24
+ **SpaceAI-v1** is a high-precision, fine-tuned 7-Billion parameter foundation language model purpose-built for **Astrophysics, Space Exploration, Heliophysics, Planetary Science, and Remote Sensing Analytics**.
25
+
26
+ Trained on peer-reviewed astrophysical literature and space agency datasets, SpaceAI-v1 is engineered to eliminate domain hallucinations, understand space physics laws, and power multimodal space & ocean research pipelines.
27
+
28
+ ## 🌟 Key Capabilities
29
+
30
+ - πŸ”­ **Astrophysics & Cosmology:** Deep reasoning over stellar spectra, dark matter/energy cosmology, galactic dynamics, black hole thermodynamics, and gravitational wave astronomy.
31
+ - πŸ›°οΈ **Space Missions & Instrumentation:** Detailed knowledge of ISRO (*Aditya-L1, Chandrayaan-3, Gaganyaan, Shukrayaan, XPoSat*), NASA (*JWST, Hubble, Artemis*), and ESA science payloads.
32
+ - 🌑️ **Domain-Aware Physics Guardrails:** Adheres to cryogenic interstellar baselines (~2.7K - 20K) vs terrestrial surface dynamics.
33
+ - 🌊 **Multimodal Architecture Ready:** Built as the reasoning engine for *Geospatial Multimodal Atmospheric & Oceanographic Sonification* workflows.
34
+
35
+ ## πŸ“Š Training & Performance Metrics
36
+
37
+ | Metric | Result | Description |
38
+ | :--- | :--- | :--- |
39
+ | **Base Architecture** | Qwen2.5-7B-Instruct | 28 Layers, Grouped-Query Attention (GQA), 32k context |
40
+ | **Dataset** | `UniverseTBD/arxiv-qa-astro-ph` | 10,294 cleaned, peer-reviewed space QA pairs |
41
+ | **Tokens Ingested** | **~2.96 Million Tokens** | Curated astrophysical corpus |
42
+ | **Final Training Loss** | **`0.617`** | Smooth convergence across 644 optimizer steps |
43
+ | **Mean Token Accuracy** | **`91.5%`** | Highly accurate scientific terminology prediction |
44
+ | **Precision** | Safe Merged FP16 | Full unquantized FP16 weights |
45
+
46
+ ## πŸ’» How to Use
47
+
48
+ ```python
49
+ import torch
50
+ from transformers import AutoModelForCausalLM, AutoTokenizer
51
+
52
+ model_id = "Anoopsingh53/isro-spaceai-v1"
53
+ tokenizer = AutoTokenizer.from_pretrained(model_id)
54
+ model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float16, device_map="auto")
55
+
56
+ messages = [
57
+ {"role": "system", "content": "You are SpaceAI, an advanced scientific AI specialized in astrophysics and ISRO missions."},
58
+ {"role": "user", "content": "Explain the scientific payload objectives of Aditya-L1 SUIT instrument."}
59
+ ]
60
+ prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
61
+ inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
62
+ outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.3, top_p=0.9)
63
+ print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))
64
+ ```
65
+
66
+ ## πŸ›οΈ Project Alignment
67
+
68
+ - **Submission:** National Space Day 2026 / ISRO Research
69
+ - **Lead Developer:** Anoop Singh ([@Anoopsingh53](https://huggingface.co/Anoopsingh53))