README.md

---
base_model: unsloth/meta-llama-3.1-8b-instruct-unsloth-bnb-4bit
tags:
  - text-generation-inference
  - transformers
  - llama
  - gguf
license: apache-2.0
language:
  - en
---

# 🚀 NASA Systems Engineering LLaMA-3.1 8B Instruct (Fine-Tuned)

[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)  
[![Parameters](https://img.shields.io/badge/Parameters-8.1B%20total%20(%2B83.8M%20LoRA)-lightgrey.svg)]()  
[![Context Window](https://img.shields.io/badge/Context%20Window-128K%20tokens-lightgrey.svg)]()

![NASA SE Handbook Preview](https://www.nasa.gov/sites/default/files/atoms/files/nasa_systems_engineering_handbook_0.pdf#page=1)

**Developed by:** MarshallDoyle  
**Fine-tuned from:** `unsloth/meta-llama-3.1-8b-instruct-unsloth-bnb-4bit`  
**Specialization:** NASA *Systems Engineering Handbook* (2018) Q&A  
**Training recipe:** LoRA rank=16, epochs=3, steps=285, final loss≈0.40–0.60

---

## ✨ Key Features

| Feature               | Details                                                |
|-----------------------|--------------------------------------------------------|
| **Domain Expertise**  | Deep knowledge of NASA SE lifecycle, terminology, and best practices.  |
| **Compact Footprint** | +83.8M trainable via LoRA on 8B base.                 |
| **Long Context**      | Up to 128K token support for large documents.          |
| **Fast Inference**    | Efficient TRL & Unsloth pipeline.                       |

---

## 🎯 Intended Use Cases

- **Interactive Q&A:** Rapid lookup of definitions, processes, and phase purposes.
- **Summarization:** Concise overviews of complex sections in the handbook.
- **Educational Tools:** Training aids for systems engineering students and professionals.
- **Mission Planning:** Quick reference for verification, validation, and lifecycle checkpoints.

---

## 📊 Example Comparisons

<details>
<summary><strong>Phase C Purpose</strong></summary>

| Model             | Response Snippet                                                                                                                                                         |
|-------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| **Base LLaMA-3.1**| _“Phase C covers detailed design and preparations for manufacturing…”_ (generic)                                                                                          |
| **Fine-Tuned**    | _“The main purpose is to complete the detailed design of system elements, fabricate hardware, and code software, ensuring all end products are defined for integration.”_  |

</details>

<details>
<summary><strong>Verification vs. Validation</strong></summary>

| Model             | Response Snippet                                                                                                                                                          |
|-------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| **Base LLaMA-3.1**| _“Verification checks requirements; validation checks user needs…”_ (too brief)                                                                                            |
| **Fine-Tuned**    | _“Verification ensures the system meets specified requirements; validation confirms it satisfies stakeholder expectations in its intended environment.”_                     |

</details>

---

## ⚠️ Limitations

- **Scope Bounded:** Content based on the 2018 handbook; may omit newer updates.
- **Hallucinations:** Possible on out-of-handbook queries.
- **Bias:** NASA-specific terminology; verify critical engineering decisions against official documents.

---

🔗 **Download & Details:** [Hugging Face model page](https://huggingface.co/MarshallDoyle/NASA-Systems-Engineering)