Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

RedHatAI
/

moe

Model card Files Files and versions

moe / marlin-moe /marlin_kernels

69.4 kB

Ctrl+K

Ctrl+K

4 contributors

History: 2 commits

danieldk's picture

danieldk HF Staff

Sync with upstream

6eaa88c over 1 year ago

marlin_moe_kernel.h

63.7 kB
Sync with upstream over 1 year ago
marlin_moe_kernel_ku4.cu

1.09 kB
Add MoE kernels from vLLM over 1 year ago
marlin_moe_kernel_ku4.h

850 Bytes
Add MoE kernels from vLLM over 1 year ago
marlin_moe_kernel_ku4b8.cu

1.11 kB
Add MoE kernels from vLLM over 1 year ago
marlin_moe_kernel_ku4b8.h

852 Bytes
Add MoE kernels from vLLM over 1 year ago
marlin_moe_kernel_ku8b128.cu

1.12 kB
Add MoE kernels from vLLM over 1 year ago
marlin_moe_kernel_ku8b128.h

732 Bytes
Add MoE kernels from vLLM over 1 year ago