<a name="for-beginner">For Beginners</a>

• *Pytorch version*
• *Tensorflow version* - pytorch)
• *BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding*
• *GPT-1* - 2*](https://github.com/openai/gpt-2)
• *ColossalAI*
• *A Detailed Reading of the Transformer Paper*
• *Details of Transformer*
• *Attention Is All You Need*
• *A Detailed Reading of the BERT Paper*
• *Illustration of BERT*
• *A Detailed Reading of the GPT-1,2&3 Paper*
• *The Evolution of GPT Series*
• *Improving Language Understanding by Generative Pre-Training (GPT-1)*
• *Language Models are Unsupervised Multitask Learners (GPT-2)*
• *Language Models are Few-Shot Learners (GPT-3)*
• *A Detailed Reading of the Instruct-GPT Paper*
• *Details of Instruct-GPT/ChatGPT*
• *InstructGPT: Training Language Models to Follow Instructions With Human Feedback*
• [Blog
• [Blog - us/research/uploads/prod/2023/02/ChatGPT___Robotics.pdf)], Object-Goal Navigation [[Paper](https://arxiv.org/pdf/2301.13166.pdf)] and Task Planning [[Blog](https://zhuanlan.zhihu.com/p/501856356), [Paper](https://arxiv.org/pdf/2204.01691.pdf)].
• [Paper
• *Details of Instruct-GPT/ChatGPT*
• *GPT-4 Technical Report*