Training on a pretrained Bert language model ?

[karanchahal]

Do you want to train this thing on a BERT language model base ? I think you'll get really great results ? I wouldn't mind working on this if you want to do it together.

[goru001]

Thanks for reaching out!
I'll not be able to do it because of bandwidth constraints, but feel free to checkout code, dataset and play with it! Shout out if you get stuck somewhere!