| | --- |
| | language: |
| | - en |
| | pipeline_tag: text-generation |
| | license: apache-2.0 |
| | --- |
| | |
| | # Model Card for Gear-1-160M |
| |
|
| | ## Model Details |
| |
|
| | ### Model Description |
| |
|
| | Gear-1-160M is a small Transformer LLM with about 160 million parameters in GGUF format, designed to run fast on local machines with low memory (CPU/GPU). It’s good for simple chat and basic tasks, but it may be slow or make mistakes since this is my first attempt at making a neural network. I plan to improve it in the future, so please bear with it. A 300M-parameter version will be coming soon. |
| |
|
| | - **Developed by:** HeavensHack |
| | - **Model type:** GPTNeoX (general.architecture = gptneox). |
| | - **Language(s) (NLP):** English |
| | - **License:** MIT |
| |
|
| |
|
| | ## Uses |
| |
|
| | ### Direct Use |
| |
|
| | - Simple question answering |
| |
|
| | ### Out-of-Scope Use |
| |
|
| | - Complex reasoning tasks |
| | - High-stakes decision making |
| | - Content requiring very high accuracy |
| |
|
| | ## Bias, Risks, and Limitations |
| |
|
| | - May make mistakes or “hallucinate” answers |
| | - First experimental version, so behavior can be inconsistent |
| | - Not suitable for critical tasks |
| |
|
| | ### Recommendations |
| |
|
| | - Use for learning, demos, or hobby projects |
| | - Do not rely on it for serious or sensitive tasks |
| |
|
| | ## How to Get Started |
| |
|
| | - Load the GGUF model in your preferred LLM inference framework (LMStudio) |
| | - Designed for CPU/GPU local inference |
| |
|
| | ## Training Details |
| |
|
| | - **Training Data:** Custom dataset / small-scale experimental |
| | - **Training Procedure:** First experimental training, not fully optimized |
| | - **Training Regime:** Mixed precision (FP16/FP32) |
| |
|
| | ## Evaluation |
| |
|
| | - Tested on small chat prompts |
| | - Can respond to simple queries |
| | - Results may vary; not benchmarked for production use |
| |
|
| | ## Environmental Impact |
| |
|
| | - Small-scale training, low compute and low carbon footprint |
| |
|
| | ## Model Card Contact |
| |
|
| | - **Author:** HeavensHackDev |
| |
|
| |
|
| | # But... |
| |
|
| | - **At first, only the GGUF file will be available. The rest will follow later.** |
