Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Rakshitagg06
/
anlp-assignment2

Safetensors
PyTorch
anlp-assignment-2
mixture-of-experts
optimizers
Model card Files Files and versions
xet
Community
anlp-assignment2 / part1
1.1 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 5 commits
Rakshitagg06's picture
Rakshitagg06
Upload Part 1 moe_baseline: Dense 2-layer MLP (baseline)
e4724a3 verified 18 days ago
  • moe_baseline
    Upload Part 1 moe_baseline: Dense 2-layer MLP (baseline) 18 days ago
  • moe_equal
    Upload Part 1 moe_equal: MoE, 4 experts, top-2, active params = dense baseline 19 days ago
  • moe_shared
    Upload Part 1 moe_shared: MoE, 1 shared expert + 3 routed experts, top-1 19 days ago
  • moe_top1
    Upload Part 1 moe_top1: MoE, 4 experts, top-1 routing 19 days ago
  • moe_top2
    Upload Part 1 moe_top2: MoE, 4 experts, top-2 routing 19 days ago