GeneZC
/

bert-base-minimoe-4L-384H

Model card Files Files and versions

bert-base-minimoe-4L-384H / README.md

GeneZC's picture

Update README.md

f7e1fcf almost 3 years ago

|

history blame contribute delete

296 Bytes

license: apache-2.0
datasets:
  - wikipedia

Model details

minimoe-4L-384H distilled from bert-base-uncased on Wikipedia.

Repository: https://github.com/GeneZC/MiniMoE arXiv: https://arxiv.org/abs/2305.12129