JSC, the Otto von Guericke University of Magdeburg, and the Technical University of Munich jointly organised a workshop on “Transformers for Environmental Science” on September 22 and 23, 2022. The workshop was co-sponsored by the ERC grant IntelliAQ and brought together about 40 participants in Magdeburg and up to 20 additional online participants, who discussed the potential of this new AI technology for environmental applications. The program included lectures on recent advances in transformer architectures and transfer learning as well as on prototype developments focusing largely on atmospheric research and remote sensing. Keynote presentations were given by Peter Düben (ECMWF), Pedram Hassanzadeh (Rice University, Houston), Duncan Watson-Parris (Oxford University), Lucas Beyer (Google Brain) and Jonathan Godwin (Google Deepmind). A poster session and panel discussion provided opportunities for an exchange of ideas. Large transformer models require huge amounts of data and constitute an attractive application for accelerated supercomputers such as JUWELS Booster. Within the atmorep compute time project, first steps towards training such a model for atmospheric research are being taken.