How to use dotslashderek/flan-t5-small-compression with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("dotslashderek/flan-t5-small-compression") model = AutoModelForSeq2SeqLM.from_pretrained("dotslashderek/flan-t5-small-compression", device_map="auto")
https://huggingface.co/dotslashderek/flan-t5-small-compression/resolve/main/eval_loss.png
hf download hf://dotslashderek/flan-t5-small-compression/eval_loss.png
curl -L -o eval_loss.png https://huggingface.co/dotslashderek/flan-t5-small-compression/resolve/main/eval_loss.png
