Training ELMO on TPU for generating embedding from custom dataset

[hazalturkmen]

Hi everyone!
Is it possible training ELMO model from scratch on tpu instead of gpu?
i want to generate turkish elmo embedding from custom large corpus.