MT-clinical BERT: scaling clinical information extraction with multitask learning.

We find our single system performs competitively with all state-the-art task-specific systems while also benefiting from massive computational benefits at inference.