Skip to main content
EuroPythonCode of ConductLive 📹

Unfolding the paper windmills

Liffey Hall 2
Start (Dublin time):
Start (your time):
30 minutes


Research is done on the shoulders of giants. Luckily and unluckily, those giants spoke paper-English and documented their achievements kind of publicly so we could advance the science.

In this talk, we will dissect the structure of a paper, looking for the essential points that will help us understand it and implement it. Following we will get our hands dirty and implement the paper using Python. In particular, we will dive into the seminal paper "Attention is all you need" and implement a transformer using JAX.

The key takeaways from this talk are:

  • Demystify academic reading.
  • Understand the Transformer architecture.
  • An introduction to the JAX ecosystem.

TalkPyData: Deep Learning, NLP, CV

The speaker

Mai Giménez

Mai Giménez is a research engineer working at Deepmind. She holds a PhD in natural language processing, and her main research interest is in language and the sociotechnical impacts of these models in the real world. She's a former board member of the Spanish Python Association, helped organise several PyConES conferences and is a proud member of the Pyladies.

← Back to schedule