train BERT on COVID corpus #264
Description
Since Bert is trained on BookCorpus and Wikipedia it may not work well for Covid language. Continue Bert training on large Covid corpus.
{{ message }}
Since Bert is trained on BookCorpus and Wikipedia it may not work well for Covid language. Continue Bert training on large Covid corpus.