The Transformer paper was submitted to arXiv on June 12, 2017

The paper “Attention Is All You Need”, which introduced the Transformer architecture, was submitted to arXiv on June 12, 2017 (arXiv:1706.03762). It was subsequently published at NIPS 2017.