WIRED published a story on Transformer invention

[dmm]

The history of the creation of "Attention Is All You Need", arxiv.org/abs/1706.03762

It's pretty intense; it's very interesting what it took to achieve that.

Comments

[dmm]

I think we'll do more sophisticated things again soon.

But I was stunned with their description of the last few weeks of working on that paper; that was intense...

[chaource]

Пусть Jakob Uszkoreit тамъ все ускоряетъ!