> For the complete documentation index, see [llms.txt](https://legacy.cookielau.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://legacy.cookielau.com/machine-learning/nlp/01-transformer.md).

# Transformers

## Bookmarks

* [ ] [Transformer和Bert相关知识解答](https://zhuanlan.zhihu.com/p/149634836)
* [ ] [BERT预训练实操总结](https://zhuanlan.zhihu.com/p/337212893)
* [ ] [NLP的12种后BERT预训练方法](https://mp.weixin.qq.com/s/mkDmn4zy_s87kiiDIkx0VQ)
* [ ] [Transformer Unit | Stanford](https://web.stanford.edu/class/cs25/)

## Pitfalls

### Unaligned