We are currently using RoBERTa model as a baseline for both the subtasks
- Build other different transformer models such as
- BERT
- SPECTER
- XLNET
- PubMedBERT
- SciBERT
and there are many other models for NLP you can build as long as its giving better scores than the RoBERTa baseline model
- Also build the model in different notebooks for both the subtasks
We are currently using RoBERTa model as a baseline for both the subtasks
and there are many other models for NLP you can build as long as its giving better scores than the RoBERTa baseline model