🔄 In a Training Loop

Ramshreyas Rao PRO

EXDai

1

·

AI & ML interests

Post training, fine-tuning, quantization, distillation, pruning, SLMs, Local AI

Organizations

Articles 8

Article

Attention in Qwen3.6-35B-A3B

Article

Q, K and V

View all Articles

spaces 4

Qwen3 Architecture

Explore the Qwen 3.6‑35B model architecture

Speculative Decoding Simulator

LLM Inference Simulator — Extended

LLM Inference Pipeline Simulator

models 0

None public yet

datasets 8

EXDai/attention-mechanism

Viewer • Updated Aug 16 • 11 • 129

EXDai/qkv-projection

Viewer • Updated Jul 27 • 10 • 49

EXDai/linear-algebra-transformers

Viewer • Updated Jul 22 • 6 • 53

EXDai/mrope-exploration

Updated Jul 12 • 7

EXDai/episode-08-positional-embeddings

Viewer • Updated Jun 26 • 1 • 13

EXDai/episode-07-tokenization

Updated Jun 26 • 4

EXDai/vllm-configs

Updated Jun 26 • 47

EXDai/benchmark-results

Viewer • Updated Jun 26 • 35 • 7