SLiM-Performer

Code for the paper "Sub-Linear Memory: How to Make Performers SLiM", by Valerii Likhosherstov, published as a conference paper at Neural Information Processing Systems (NeurIPS) 2021.

If you've found this codebase useful, please consider citing the paper:

@inproceedings{slim_performer,
  author    = {Valerii Likhosherstov and
               Krzysztof Choromanski and
               Jared Davis and
               Xingyou Song and
               Adrian Weller},
  title     = {Sub-Linear Memory: How to Make Performers SLiM},
  booktitle = {Neural Information Processing Systems, {NeurIPS} 2021},
  year      = {2021},
}