multilingual-ili-detection-bernice

This model is a fine-tuned version of jhu-clsp/bernice for Influenza-Like-Illness(ILI) detection in multilingual tweets.

Please reach out to Niti Mishra K.C. (nitimkc at gmail.com) or open an issue if there are questions.

Model description

The model can be loaded with the following lines of code:

from transformers import AutoModelForSequenceClassification

ili_classification_model = AutoModelForSequenceClassification.from_pretrained('nitimkc/multilingual-ili-detection-bernice', num_labels = 2)

Training hyperparameters

The following hyperparametesr were used during training:

• learning_rate: 0.0000227436540339458
• train_batch_size: 32
• eval_batch_size: 32
• seed: 712
• num_epochs: 3
• max_len: 64

Training results

Training Loss	Epoch	Validation Loss	Validation f1
0.4067	1.0	0.3081	0.8658
0.2686	2.0	0.3037	0.8821
0.1881	3.0	0.3140	0.8800

Framework versions

• Transformers 4.35.2
• Pytorch 2.1.2
• scikit-learn 1.3.2
• sentencepiece 0.1.99
• Tokenizers 0.15.2
• wandb 0.16.3