---
license: apache-2.0
datasets:
- HuggingFaceFW/fineweb-edu
language:
- en
tags:
- small
- cpu
- fast
- opensource
- open
- free
base_model:
- LH-Tech-AI/Apex-1-Instruct-350M
pipeline_tag: text-generation
---

**Apex 1.5: Improved reasoning and logic. Fixed wrong facts and hallucinations by increasing FineWeb-Edu ratio while finetuning to 4:1.**

**Update**: Due to the great community feedback on Apex 1.0, I've trained Apex 1.5 with a focus on world knowledge (FineWeb-Edu) and coding logic. Enjoy the massive jump in reasoning!

# How to train it
You can train it, using the **base model** of LH-Tech-AI/Apex-1-Instruct-350M (you need to train that base model first!).
Then, use the prepare-script and the finetuning script in the files list of this HF model.

# How to use it
You can download the `apex_1.5.gguf` or use `ollama run hf.co/LH-Tech-AI/Apex-1.5-Instruct-350M`. And you can also use it in LM Studio for example, just by searching for "Apex 1.5".

You can directly download the final model as ONNX format - so it runs without the need to install a huge Python environment with PyTorch, CUDA, etc... - as INT8 and in full precision.
Use `inference.py` for local inference on CUDA or CPU! First, install `pip install onnxruntime-gpu tiktoken numpy nvidia-cudnn-cu12 nvidia-cublas-cu12` on your system (in a Python VENV for Linux users).


Have fun! :D

# Recommendation of newer model - Apex 1.5 Coder
Don't get confused by the name - "Coder" doesn't mean, that the model can code very well! But it is finetuned based on this finetuned model (Apex 1.5 Instruct) with CodeAlpaca.
Link: https://huggingface.co/LH-Tech-AI/Apex-1.5-Coder-Instruct-350M/  - Have fun with it - it is the newest and best model from LH-Tech AI.