Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Next-Generation-AI-awesome
An up-to-date list of progress made in next-generation AI.
https://github.com/SCUT-AILab/Next-Generation-AI-awesome
- *A Detailed Reading of the Transformer Paper*
- *Details of Transformer*
- *Pytorch version*
- *Attention Is All You Need*
- *A Detailed Reading of the BERT Paper*
- *Illustration of BERT*
- *Tensorflow version* - pytorch)
- *BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding*
- *A Detailed Reading of the GPT-1,2&3 Paper*
- *The Evolution of GPT Series*
- *GPT-1* - 2*](https://github.com/openai/gpt-2)
- *Improving Language Understanding by Generative Pre-Training (GPT-1)*
- *Language Models are Unsupervised Multitask Learners (GPT-2)*
- *Language Models are Few-Shot Learners (GPT-3)*
- *GPT-4 Technical Report*
- *A Detailed Reading of the Instruct-GPT Paper*
- *Details of Instruct-GPT/ChatGPT*
- *ColossalAI*
- *InstructGPT: Training Language Models to Follow Instructions With Human Feedback*
- [Blog
- [Blog - us/research/uploads/prod/2023/02/ChatGPT___Robotics.pdf)], Object-Goal Navigation [[Paper](https://arxiv.org/pdf/2301.13166.pdf)] and Task Planning [[Blog](https://zhuanlan.zhihu.com/p/501856356), [Paper](https://arxiv.org/pdf/2204.01691.pdf)].
- [Paper
Programming Languages
Keywords
deep-learning
2
natural-language-processing
2
nlp
2
attention
1
attention-is-all-you-need
1
pytorch
1
google
1
natural-language-understanding
1
tensorflow
1
paper
1
ai
1
big-model
1
data-parallelism
1
distributed-computing
1
foundation-models
1
heterogeneous-training
1
hpc
1
inference
1
large-scale
1
model-parallelism
1
pipeline-parallelism
1