MoNE

community

AI & ML interests

None defined yet.

Recent Activity

yx1998 authored a paper about 1 month ago

MoNE: Replacing Redundant Experts with Lightweight Novices for Structured Pruning of MoE

yx1998 updated a model about 1 month ago

MoNE-Pruning/Qwen2-57B-A14B-Instruct-MoNE-48-gsm8k-100

yx1998 updated a model about 1 month ago

MoNE-Pruning/Qwen2-57B-A14B-Instruct-MoNE-48-math-100

View all activity

models 6

MoNE-Pruning/Qwen2-57B-A14B-Instruct-MoNE-48-gsm8k-100

Text Generation • 45B • Updated about 1 month ago • 25

MoNE-Pruning/Qwen2-57B-A14B-Instruct-MoNE-48-math-100

Text Generation • 45B • Updated about 1 month ago • 25

MoNE-Pruning/Qwen2-57B-A14B-MoNE-48-zyda2-100

Text Generation • 45B • Updated Feb 28 • 3

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-zyda2-100

Text Generation • 12B • Updated Feb 28 • 4

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-zyda2-1000

Text Generation • 12B • Updated Feb 28 • 5

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-c4-1000

Text Generation • 12B • Updated Feb 28 • 38

datasets 0

None public yet