BERT finetuning

[siemdejong]

Research question
Does BERT finetuning increase performance?

Hypothesis
Yes, the classifier in BERT will also pull apart the word embeddings belonging to specific locations, making it easier to distinguish images with different tumour classes.

Method
Train BERT with frozen and trainable parameters. Keep everything else the same. See if the performance is increased.

Finetuning BERT will take longer as a (backward) pass through BERT is costly.

Result comments on this should include results and a discussion.

[siemdejong]

This accounts for the testing in #39