Memorizing Transformers – Pytorch (wip)
Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch
Citations
@article{wu2022memorizing,
title = {Memorizing transformers},
author = {Wu, Yuhuai and Rabe, Markus N and Hutchins, DeLesley and Szegedy, Christian},
journal = {arXiv preprint arXiv:2203.08913},
year = {2022}
}