---
language:
- en
pipeline_tag: text-generation
license: apache-2.0
---

# Model Card for Gear-1-160M

## Model Details

### Model Description

Gear-1-160M is a small Transformer LLM with about 160 million parameters in GGUF format, designed to run fast on local machines with low memory (CPU/GPU). It’s good for simple chat and basic tasks, but it may be slow or make mistakes since this is my first attempt at making a neural network. I plan to improve it in the future, so please bear with it. A 300M-parameter version will be coming soon.

- **Developed by:** HeavensHack
- **Model type:** GPTNeoX (general.architecture = gptneox).
- **Language(s) (NLP):** English
- **License:**  MIT 


## Uses

### Direct Use

- Simple question answering

### Out-of-Scope Use

- Complex reasoning tasks
- High-stakes decision making
- Content requiring very high accuracy

## Bias, Risks, and Limitations

- May make mistakes or “hallucinate” answers
- First experimental version, so behavior can be inconsistent
- Not suitable for critical tasks

### Recommendations

- Use for learning, demos, or hobby projects
- Do not rely on it for serious or sensitive tasks

## How to Get Started

- Load the GGUF model in your preferred LLM inference framework (LMStudio)
- Designed for CPU/GPU local inference

## Training Details

- **Training Data:** Custom dataset / small-scale experimental
- **Training Procedure:** First experimental training, not fully optimized
- **Training Regime:** Mixed precision (FP16/FP32)

## Evaluation

- Tested on small chat prompts
- Can respond to simple queries
- Results may vary; not benchmarked for production use

## Environmental Impact

- Small-scale training, low compute and low carbon footprint

## Model Card Contact

- **Author:** HeavensHackDev


# But...

- **At first, only the GGUF file will be available. The rest will follow later.**