https://github.com/arunprsh/ChatGPT-Decoded-GPT2-FAQ-Bot-RLHF-PPO

A Practical Guide to Developing a Reliable FAQ Chatbot with Reinforcement Learning and Human Feedback using GPT-2 on AWS
https://github.com/arunprsh/ChatGPT-Decoded-GPT2-FAQ-Bot-RLHF-PPO

aws chatbot gpt-2 gpt2 question-answering reinforcement-learning rlhf sagemaker transformers

Last synced: 4 months ago
JSON representation

A Practical Guide to Developing a Reliable FAQ Chatbot with Reinforcement Learning and Human Feedback using GPT-2 on AWS

• Host: GitHub
• URL: https://github.com/arunprsh/ChatGPT-Decoded-GPT2-FAQ-Bot-RLHF-PPO
• Owner: arunprsh
• License: apache-2.0
• Created: 2023-01-30T19:11:03.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-02-11T20:41:13.000Z (over 1 year ago)
• Last Synced: 2024-01-16T13:13:47.958Z (6 months ago)
• Topics: aws, chatbot, gpt-2, gpt2, question-answering, reinforcement-learning, rlhf, sagemaker, transformers
• Language: Jupyter Notebook
• Homepage:
• Size: 20.9 MB
• Stars: 9
• Watchers: 1
• Forks: 4
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Lists

• awesome-human-in-the-loop - Github - arunprsh/ChatGPT-Decoded-GPT2-FAQ-Bot-RLHF-PPO - 2 on AWS (Awesome RHLF / Tools and Resources)

README

        
## ChatGPT Decoded: An expert guide to mastering the technology and building domain-specific intelligent bots with GPT and reinforcement learning on AWS SageMaker

Welcome to this hands-on guide on how to train a robust FAQ chatbot from scratch using GPT-2 on AWS. This guide will take you step-by-step through the process of building a FAQ chatbot from scratch, using the GPT-2 language model and reinforcement learning techniques on the AWS platform.

### Prerequisites

* Basic understanding of machine learning and deep learning concepts

* AWS account and knowledge of AWS services

* Familiarity with GPT-2 and reinforcement learning

* Python coding experience