Skip to content

2024

Transformer understanding

The transformer model was introduced in 2017 by Google's paper Attention Is All You Need.

Below image shows the architecture of the transformer model which is from the Google's paper Attention Is All You Need.

Python attrdict trap

AttrDict is an MIT-licensed library that provides mapping objects that allow their elements to be accessed both as keys and as attributes.

It's already not support the current python version now, for the lower version python, it's a useful library.

However, there is some magic behavior while using it.