---
license: apache-2.0
base_model: Qwen/Qwen2.5-1.5B-Instruct
tags:
  - materials-science
  - condensed-matter-physics
  - device-engineering
  - gguf
  - qlora
  - qwen2
  - chat
language:
  - en
pipeline_tag: text-generation
---

# MIRA-mini v1.0 — Materials Intelligence and Reasoning Agent

MIRA is a domain-specialized chat model fine-tuned from **Qwen2.5-1.5B-Instruct** to explain
material stacks, physical mechanisms, and correlations between material properties and
phenomena in condensed matter physics, device engineering, and materials science.

Developed by **[DeviceAlchemy.ai](https://devicealchemy.ai)**.

This repo hosts the **GGUF (Q4_K_M quantized)** version for local inference with
[Ollama](https://ollama.com) or [llama.cpp](https://github.com/ggerganov/llama.cpp).

Training code: **[github.com/DeviceAlchemy/devicealchemy-mira-mini](https://github.com/DeviceAlchemy/devicealchemy-mira-mini)**

## Model details

- **Base model:** [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) (Alibaba, Apache 2.0)
- **Fine-tuning method:** QLoRA — continued pre-training on raw abstracts, followed by
  instruction tuning on synthetically generated Q&A pairs derived from those abstracts
- **Quantization:** Q4_K_M (~940 MB)
- **Training data:** Openly licensed (CC BY) scientific text dataset containing 120 million words.
- **Context length:** 4096 tokens (inference); trained on 384-token blocks

## Intended use

MIRA-mini is designed to:
- Explain why specific material stacks are predicted to exhibit a given phenomenon
- Describe physical mechanisms at material interfaces (spin-orbit coupling, exchange
  interactions, band hybridization, etc.)
- Answer domain questions in condensed matter physics, materials science, and device & circuit
  engineering

It is **not** a substitute for primary literature, peer review, or experimental
validation. Outputs may contain errors, omissions, or hallucinations and should be
verified against original research.

## How to use (Ollama)

```bash
ollama pull hf.co/DeviceAlchemy/devicealchemy-mira-mini
ollama run hf.co/DeviceAlchemy/devicealchemy-mira-mini
```

Or download the GGUF directly and build a local `Modelfile`:

```
FROM ./mira-mini-q4_k_m.gguf

TEMPLATE """<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""

SYSTEM """You are MIRA, Materials Intelligence and Reasoning Agent. You have been trained on a large corpus of scientific abstracts on condensed matter physics, device engineering, and materials science. You explain material stack predictions, physical mechanisms, and correlations between material properties and phenomena. Be precise, scientific, and concise."""

PARAMETER temperature 0.8
PARAMETER top_p 0.9
PARAMETER top_k 40
PARAMETER repeat_penalty 1.5
PARAMETER num_ctx 4096
PARAMETER stop "<|im_end|>"
PARAMETER stop "<|im_start|>"
```

```bash
ollama create mira-mini -f Modelfile
ollama run mira-mini
```

## Training pipeline

Full training code (4-step pipeline: data prep → continued pre-training → chat
fine-tuning → GGUF export) is available at:
**[github.com/DeviceAlchemy/devicealchemy-mira-mini](https://github.com/DeviceAlchemy/devicealchemy-mira-mini)**

## Limitations

- This is a 1.5B parameter model — it has narrower general-purpose reasoning ability
  than larger models, and is specifically tuned toward the materials science and device engineering domain.
- Training data consists of abstracts only (not full papers), so depth on any single
  topic is bounded by what's typically conveyed in an abstract.
- Q4_K_M quantization trades a small amount of precision for a ~3x smaller file size
  and faster local inference; the full-precision merged model is referenced in the
  GitHub repo for those who want F16 or further quantization options.

## Disclaimer

MIRA-mini outputs are for informational and exploratory purposes only and should not
be considered professional, scientific, medical, legal, or financial advice. Always
verify critical information against original research papers and conventional
theoretical/experimental means. DeviceAlchemy.ai is not affiliated with, endorsed by,
or partnered with any academic publishers.

## Author

Shehrin Sayed, Ph.D. — Founder, [DeviceAlchemy.ai](https://devicealchemy.ai)