Solution 1:

A Dev explains this predicament at this Git Issue.

The Notebook experiments with BERT, which uses token_type_ids.

DistilBERT does not use token_type_ids for training.

So, this would require re-developing the notebook; removing/ conditioning all mentions of token_type_ids for this model specifically.