Aquiles-ai/MoonViT-3D
Image Feature Extraction • 0.4B • Updated • 1
AI & ML interests
None defined yet.
Recent Activity
FredyRivera-dev
published a
model about 2 hours ago
FredyRivera-dev
updated a
model about 3 hours ago
FredyRivera-dev
posted an update 7 days ago
Post
6279
We wrote a full technical guide on how to train a bilingual (ES/EN) LLM from scratch: TinyQwen.
Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source
With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.
Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch
Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.
Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source
With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.
Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch
Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.
- 3 replies
FredyRivera-dev
updated 2
datasets 8 days ago
FredyRivera-dev
published a
dataset 18 days ago
FredyRivera-dev
published a
dataset 19 days ago
FredyRivera-dev
updated a
dataset 25 days ago
FredyRivera-dev
updated a
Space 28 days ago
FredyRivera-dev
published a
dataset about 1 month ago
FredyRivera-dev
updated a
collection about 1 month ago
FredyRivera-dev
updated a
dataset about 1 month ago
FredyRivera-dev
published a
dataset about 1 month ago
FredyRivera-dev
updated a
model 2 months ago
FredyRivera-dev
updated a
collection 4 months ago
FredyRivera-dev
updated a
model 4 months ago
FredyRivera-dev
published a
model 4 months ago