metadata
license: apache-2.0
language:
- en
- zh
pipeline_tag: text-generation
BlockFFN-Medium
This is the original 0.5B BlockFFN checkpoint used in the paper BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity for acceleration tests.
You can load and use this model simply by using AutoTokenizer and AutoModelForCausalLM.