WIRED published a story on Transformer invention

The history of the creation of "Attention Is All You Need", arxiv.org/abs/1706.03762

It's pretty intense; it's very interesting what it took to achieve that.