🔄 In a Training Loop

Ramshreyas Rao PRO

EXDai

1

·

AI & ML interests

Post training, fine-tuning, quantization, distillation, pruning, SLMs, Local AI

Recent Activity

published an article 3 days ago

Attention in Qwen3.6-35B-A3B

updated a dataset 3 days ago

EXDai/attention-mechanism

published a dataset 4 days ago

EXDai/attention-mechanism

View all activity

Organizations

Articles 8

Article

Attention in Qwen3.6-35B-A3B

Article

Q, K and V

View all Articles

spaces 4

Qwen3 Architecture

Explore the Qwen 3.6‑35B model architecture

Speculative Decoding Simulator

LLM Inference Simulator — Extended

LLM Inference Pipeline Simulator

models 0

None public yet

datasets 8

EXDai/attention-mechanism

Viewer • Updated 3 days ago • 11 • 198

EXDai/qkv-projection

Viewer • Updated 23 days ago • 10 • 332

EXDai/linear-algebra-transformers

Viewer • Updated 28 days ago • 6 • 205

EXDai/mrope-exploration

Updated Jul 12 • 39

EXDai/episode-08-positional-embeddings

Viewer • Updated Jun 26 • 1 • 27

EXDai/episode-07-tokenization

Updated Jun 26 • 15

EXDai/vllm-configs

Updated Jun 26 • 287

EXDai/benchmark-results

Viewer • Updated Jun 26 • 35 • 17