I put MuRIL base in BigBird.
Research supported with Cloud TPUs from Google's TPU Research Cloud (TRC)