---
license: other
language:
- en
pipeline_tag: text-generation
library_name: transformers
tags:
- Smilyai
- transformers
- LLM
- coding
- CodVa
---

## CodVa-1-Small is a LLM pre-trained by smilyai-labs on a corpus of 10B tokens in total, consisting of 5B in code, 2.5B in math and 1B in general knowledge and 0.9B in reasoning.