--- title: README emoji: ๐Ÿ“š colorFrom: red colorTo: purple pinned: true --- # Welcome to ThingsAI! ๐Ÿค— **Building efficient, bilingual AI models that run anywhere.** ๐Ÿ‡ฎ๐Ÿ‡น ๐Ÿ‡ฌ๐Ÿ‡ง --- ## ๐Ÿค– Our Models ### [Quark-135M](https://huggingface.co/ThingAI/Quark-135m-Bilingual) A lightweight bilingual (Italian + English) language model with **135M parameters**. Features GQA, SwiGLU, RMSNorm, and RoPE. Trained on 50B+ tokens of curated Italian and English data. ### Quark-270M *(training now)* Our most powerful small model โ€” **270M parameters** with 32 layers, 768 hidden dimensions, and 65K vocabulary. Currently in active training on 10B+ tokens with planned scaling to 135B tokens. ### [Quark-Mod](https://huggingface.co/ThingAI/Quark-Mod) A multi-label moderation model covering **9 categories** for safe AI deployment: toxic, severe_toxic, obscene, threat, insult, identity_hate, cyberbullying, hate_speech, offensive. --- ## ๐ŸŽฏ What We Focus On - โšก **Small, efficient architectures** โ€” GQA, weight tying, deep-thin design - ๐ŸŒ **Bilingual training** โ€” Italian + English from scratch - ๐Ÿ”“ **Open-source everything** โ€” weights, code, datasets - ๐Ÿ’ป **Real-world deployment** โ€” runs on consumer hardware --- ## ๐Ÿ“‚ Resources | | | |---|---| | ๐Ÿ“š [Quark-135M-Bilingual](https://huggingface.co/ThingAI/Quark-135m-Bilingual) | Our flagship bilingual model | | ๐Ÿ›ก๏ธ [Quark-Moderation-Multi](https://huggingface.co/ThingsAI/Quark-Mod) | Multi-label content moderation | | ๐Ÿ“ [HuggingFace Community](https://huggingface.co/ThingsAI) | All our models and datasets | | ๐Ÿ’ป [GitHub](https://github.com/overcastlab) | Code, scripts, and tools | ---

Made with โค๏ธ by ThingsAI ยท Website ยท GitHub