Fill-in-the-BERT uses pre-trained BERT Masked Language Model for Infering the task of fill in the blanks.