devngho PRO

devngho's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted an article 2 months ago

view article

Article

Distillation in 2026 (so far): which frontier models use it and how

• 

sergiopaniego

•

Jul 8

• 21

upvoted a paper 4 months ago

Cosmos 3: Omnimodal World Models for Physical AI

Paper • 2606.02800 • Published Jun 1 • 143

upvoted an article 5 months ago

view article

Article

Pallas for people who know JAX but not kernels yet

• 

ariG23498

•

Apr 29

• 26

upvoted a paper 7 months ago

dLLM: Simple Diffusion Language Modeling

Paper • 2602.22661 • Published Feb 26 • 154

upvoted a paper 8 months ago

What Users Leave Unsaid: Under-Specified Queries Limit Vision-Language Models

Paper • 2601.06165 • Published Jan 7 • 16

upvoted a paper 9 months ago

Bolmo: Byteifying the Next Generation of Language Models

Paper • 2512.15586 • Published Dec 17, 2025 • 19

upvoted a collection 9 months ago

Kanana-2

Collection

Open Source Kanana-2 • 29 items • Updated May 20 • 41

upvoted a paper 10 months ago

DoPE: Denoising Rotary Position Embedding

Paper • 2511.09146 • Published Nov 12, 2025 • 76

upvoted a collection 10 months ago

📄 FinePDFs

Collection

82 items • Updated Jan 9 • 29

upvoted an article 10 months ago

view article

Article

The 1 Billion Token Challenge: Finding the Perfect Pre-training Mix

• 

codelion

•

Nov 3, 2025

• 65

upvoted a paper almost 2 years ago

Were RNNs All We Needed?

Paper • 2410.01201 • Published Oct 2, 2024 • 53

upvoted a collection almost 2 years ago

Qwen2.5

Collection

Qwen2.5 language models, including pretrained and instruction-tuned models of 7 sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B. • 43 items • Updated Mar 2 • 736

upvoted a paper about 2 years ago

CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages

Paper • 2309.09400 • Published Sep 17, 2023 • 87

upvoted an article about 2 years ago

view article

Article

Mergoo: Efficiently Build Your Own MoE LLM

• 

alirezamsh

•

Jun 3, 2024

• 48

upvoted 4 papers about 2 years ago

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20, 2024 • 96

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

Paper • 2304.01373 • Published Apr 3, 2023 • 9

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published Jul 18, 2024 • 56

Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP

Paper • 2408.04303 • Published Aug 8, 2024 • 22

upvoted 2 articles over 2 years ago

view article

Article

Expanding Model Context and Creating Chat Models with a Single Click

• 

maywell

•

Apr 28, 2024

• 38

view article

Article

Can We Train Chat Models with Raw Data?

• 

maywell

•

Apr 25, 2024

• 19