--- title: README emoji: ๐ colorFrom: red colorTo: purple pinned: true --- # Welcome to ThingsAI! ๐ค **Building efficient, bilingual AI models that run anywhere.** ๐ฎ๐น ๐ฌ๐ง --- ## ๐ค Our Models ### [Quark-135M](https://huggingface.co/ThingAI/Quark-135m-Bilingual) A lightweight bilingual (Italian + English) language model with **135M parameters**. Features GQA, SwiGLU, RMSNorm, and RoPE. Trained on 50B+ tokens of curated Italian and English data. ### Quark-270M *(training now)* Our most powerful small model โ **270M parameters** with 32 layers, 768 hidden dimensions, and 65K vocabulary. Currently in active training on 10B+ tokens with planned scaling to 135B tokens. ### [Quark-Mod](https://huggingface.co/ThingAI/Quark-Mod) A multi-label moderation model covering **9 categories** for safe AI deployment: toxic, severe_toxic, obscene, threat, insult, identity_hate, cyberbullying, hate_speech, offensive. --- ## ๐ฏ What We Focus On - โก **Small, efficient architectures** โ GQA, weight tying, deep-thin design - ๐ **Bilingual training** โ Italian + English from scratch - ๐ **Open-source everything** โ weights, code, datasets - ๐ป **Real-world deployment** โ runs on consumer hardware --- ## ๐ Resources | | | |---|---| | ๐ [Quark-135M-Bilingual](https://huggingface.co/ThingAI/Quark-135m-Bilingual) | Our flagship bilingual model | | ๐ก๏ธ [Quark-Moderation-Multi](https://huggingface.co/ThingsAI/Quark-Mod) | Multi-label content moderation | | ๐ [HuggingFace Community](https://huggingface.co/ThingsAI) | All our models and datasets | | ๐ป [GitHub](https://github.com/overcastlab) | Code, scripts, and tools | ---