Transformers How to use GeneZC/bert-large-minimoe-4L-384H with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, MoEBertMiniLM
tokenizer = AutoTokenizer.from_pretrained("GeneZC/bert-large-minimoe-4L-384H")
model = MoEBertMiniLM.from_pretrained("GeneZC/bert-large-minimoe-4L-384H", device_map="auto") 
