BERT-IMDB

What is it?

BERT ( bert-large-cased ) trained for sentiment classification on the IMDB dataset .

Training setting

The model was trained on 80% of the IMDB dataset for sentiment classification for three epochs with a learning rate of 1e-5 with the simpletransformers library. The library uses a learning rate schedule.

Result

The model achieved 90% classification accuracy on the validation set.

Reference

The full experiment is available in the tlr repo .