Longformer: The Long-Document Transformer

Modifications from Huggingface's Implementation

Steps to Fine-tune on MNLI

Prepare the pre-trained checkpoint

[Optional] Prepare the input file

Training