{"id":35887423,"url":"https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent","last_synced_at":"2026-01-15T06:00:44.748Z","repository":{"id":313103260,"uuid":"1050016559","full_name":"codingforentrepreneurs/Reddit-Content-Research-Agent","owner":"codingforentrepreneurs","description":"Build a Reddit Content Research Agent with LLMs, LangChain, SERP, Jupyter, Django, Bright Data, and much more.","archived":false,"fork":false,"pushed_at":"2025-09-03T22:09:33.000Z","size":8,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-09-04T00:12:24.910Z","etag":null,"topics":["brightdata","django","jupyter","langchain","langgraph","reddit","scraping","serp"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/codingforentrepreneurs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-09-03T20:31:06.000Z","updated_at":"2025-09-03T22:09:36.000Z","dependencies_parsed_at":"2025-09-04T00:12:27.149Z","dependency_job_id":"93a84685-bd83-42e4-9104-0b67766e4ef2","html_url":"https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent","commit_stats":null,"previous_names":["codingforentrepreneurs/reddit-content-research-agent"],"tags_count":null,"template":false,"template_full_name":null,"purl":"pkg:github/codingforentrepreneurs/Reddit-Content-Research-Agent","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingforentrepreneurs%2FReddit-Content-Research-Agent","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingforentrepreneurs%2FReddit-Content-Research-Agent/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingforentrepreneurs%2FReddit-Content-Research-Agent/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingforentrepreneurs%2FReddit-Content-Research-Agent/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/codingforentrepreneurs","download_url":"https://codeload.github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingforentrepreneurs%2FReddit-Content-Research-Agent/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28444124,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-15T05:05:00.929Z","status":"ssl_error","status_checked_at":"2026-01-15T05:04:58.515Z","response_time":62,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["brightdata","django","jupyter","langchain","langgraph","reddit","scraping","serp"],"created_at":"2026-01-08T22:00:39.537Z","updated_at":"2026-01-15T06:00:44.730Z","avatar_url":"https://github.com/codingforentrepreneurs.png","language":"Jupyter Notebook","funding_links":[],"categories":["Agent Categories"],"sub_categories":["\u003ca name=\"Unclassified\"\u003e\u003c/a\u003eUnclassified"],"readme":"[![Video Thumbnail](https://img.youtube.com/vi/XI-iP-qk_Vk/maxresdefault.jpg)](https://www.youtube.com/watch?v=XI-iP-qk_Vk)\n\n# Reddit Content Research Agent\n\nUsing LangChain, Jupyter, Django, [Bright Data](https://kirr.co/9i3tja), and other tools, let's build an app that can find near real-time information on keywords and topics you care about all trending on Reddit and various sub-Reddits.\n\n\n## Video Chapters\n**🎥 [Watch Full Video: Building an AI-Powered Reddit Scraping System](https://www.youtube.com/watch?v=XI-iP-qk_Vk)**\n\n- [00:00:00](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=0s) Welcome\n- [00:03:46](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=226s) Demo ([final code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/18635852dbd04ba4d5b03dfe673b19071c616b0a))\n- [00:12:03](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=723s) Using Search Engine Results\n- [00:14:16](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=856s) Setup your Python Project ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/d669a4dd13613e52d15efbdfd11b898a9994dceb))\n- [00:20:36](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=1236s) Load API Keys with Dotenv Files ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/d2c82fdabdf536db40423083d9f0c3b80c585efc))\n- [00:24:26](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=1466s) Intro to LangChain\n- [00:26:19](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=1579s) Bright Data Serp API with Python \u0026 LangChain ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/642a7019ed32b97723396e454416a7eb21aa58af))\n- [00:38:01](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=2281s) Strip Notebook Outputs for Security with pre-commit ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/79ce005f1e4b73151292f6c43cb10d27b52121c6))\n- [00:42:56](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=2576s) Setup Google Gemini Models with LangChain ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/9eb770cab51eaa96cdcaf5ca28129aadd1583fa9))\n- [00:52:43](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=3163s) LLM with Structured Output ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/319300402466e573c5e69c278cc6a38d9efcb350))\n- [00:59:58](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=3598s) LLM Tool Calling The Hard Way ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/7d4d7ef68b760d2946181053fc47112b9a8a4892))\n- [01:08:19](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=4099s) Tool Calling with LangGraph ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/471c7dbd04113e86272df81f075e646e51a92380))\n- [01:23:41](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=5021s) Search \u0026 Format Reddit Communities via LLM and Bright Data ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/d4f54053dc4068a659b9edaf21bd92f3c987e800))\n- [01:29:38](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=5378s) Scrape Reddit with the Bright Data Crawl API ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/01119492ce657de9d4f0e6dedcaace563bf3caa2))\n- [01:41:58](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=6118s) Get Crawl API Snapshot Progress ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/4faf585e231b12890347e41b3451fc3dc0363ea9))\n- [01:47:00](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=6420s) Download Data from the Crawl API ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/f2f38af08e6f61e62668c1e9f8b39fa55d971a8f))\n- [01:54:53](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=6893s) Automating Data Pulls for Users\n- [01:58:39](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=7119s) Install \u0026 Start the Django Project ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/f392920e99bb2580874da73c55cf4121721c294f))\n- [02:02:31](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=7351s) Combine Django with Jupyter ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/7057029eba690ac3e956b6d32aba671bd7f8a03a))\n- [02:05:23](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=7523s) Implement Postgres Database with Django ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/6ce67a9a42c2128a7f17516d49146e27d8430f0a))\n- [02:15:19](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=8119s) Setup Redis for Django \u0026 Caching ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/bf031d02d0abe94663428db538388421f1f7c7ba))\n- [02:22:36](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=8556s) Getting Started with Celery \u0026 Django ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/d50f6bed0695f57c69738282022257e75eea1350))\n- [02:33:51](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=9231s) Webhooks \u0026 Cloudflare Tunnels\n- [02:36:47](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=9407s) Setup Cloudflare Tunnel with a Custom Domain ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/fb1f847441c5a55fb8c51542bc58ba3477a4f56a))\n- [02:45:24](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=9924s) Django Qstash for Webhook-based Background Tasks ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/5b8f673b79ebd18f3ff646efe62c46f1bb7aa7df))\n- [02:52:55](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=10375s) Bright Data to Django Model Part 1 ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/b748e2570854e0ec609c7387668b571e9dbfa3b0))\n- [03:02:16](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=10936s) Bright Data to Django Model Part 2 ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/b748e2570854e0ec609c7387668b571e9dbfa3b0))\n- [03:09:38](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=11378s) Store Bright Data Snapshots ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/bf045d6804247adfd0d3ee7e9ee16b7cc46900f3))\n- [03:17:38](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=11858s) Helper Functions for Scraping Events Part 1 ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/3b76912e3e7eeec8fc1a43e96a896399bd3310f6))\n- [03:24:56](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=12296s) Helper Functions for Scraping Events Part 2 ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/3b76912e3e7eeec8fc1a43e96a896399bd3310f6))\n- [03:32:52](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=12772s) Saving Snapshot Scraping Results ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/1a7b5b5330fbd5171ca29dd0999150795e6de806))\n- [03:38:29](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=13109s) Configure Scraping as Background Tasks ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/435218753e1a1ef2684f1235cc6fecff93a1e23a))\n- [03:49:48](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=13788s) Run Background Scraping Tasks ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/48ded25b2de7b40b36cbd9b9bd1d0bc913865765))\n- [03:53:48](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=14028s) Poll Scrape Status as Background Task ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/80b0eb4db19b0c758d0813b6da266e5965750e14))\n- [04:02:04](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=14524s) Tracking Scrape Event Finished At Time ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/5199c3ed4a30accd0d97ce327aab3bb75a80337a))\n- [04:08:36](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=14916s) A Webhook Handler View in Django ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/5c1a8f386ea3a3c4f42d081e66007d355f881483))\n- [04:16:11](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=15371s) Tracking Scraping Snapshots through Webhooks with Django ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/3ee59c0c7164e615a0206cb63af0e7acd4780a20))\n- [04:25:48](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=15948s) Improved Auth Key for Webhooks ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/5bf8e146450df3d5ac420bac0b97c99243ad02aa))\n- [04:30:42](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=16242s) Webhook Handler for Reddit Posts ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/a5a065757a3c7b1a9746a96458ad16f8b99d4acc))\n- [04:38:32](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=16712s) Adjust Data to Scrape ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/eb5fc4732c3d9e3bf6d4c10e79db5ed2207143b1))\n- [04:50:47](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=17447s) Background Sync Snapshot Reddit Results ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/9ad4599646e2ec48409d61485a8d2344dc61fbcb))\n- [05:04:39](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=18279s) Storing Reddit Communities in Django ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/7534eccf9779104190c772ae3e8773571a75c8fb))\n- [05:16:53](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=18893s) Reddit AI Agent into Django Project ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/878cea21e0e439b772a412d0f3aaa4541116f080))\n- [05:26:04](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=19564s) Topic Extraction Agent ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/99a81bb03a73a17bdc001d5662f7a85d5e81da1e))\n- [05:32:50](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=19970s) Fuzzy Query to Scraping ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/a1179cd74ec26ec01f0cdb59ffbe7c948b531dfa))\n- [05:40:45](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=20445s) Auto Scrape Reddit Communities on Save ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/3ed252380c9030286a8f6b0a55a1eef97a9e47b2))\n- [05:52:37](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=21157s) Scraping Workflow as a Service Function ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/94fbe18e76fff91f6664f930b2fc6a12a0f21ed0))\n- [06:00:17](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=21617s) Store Queries \u0026 Topics ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/06464b722be0d517ea8892d0ef755d215c7c4287))\n- [06:09:24](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=22164s) Topics to Reddit Communities ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/483966a1388bff5ead548d3186698f6119c6286f))\n- [06:16:41](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=22601s) Full Query Automation ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/c024d814cebd0c885cd3fd922b5b06309782cda1))\n- [06:23:09](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=22989s) Reddit Community Trackablity ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/2bf0e6170c6ae9db34b38e55f056f7e95f73e079))\n- [06:28:19](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=23299s) Scheduled Background Task to Trigger Reddit Scraping ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/8503189ae9404dce83c841e1f35b4ebeb7bcbae7))\n- [06:33:27](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=23607s) Django Management Command to Trigger Scraping ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/1dcaf36637e2a2ac9d7f282f948dff59ab23e664))\n- [06:36:17](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=23777s) Final Query Commands ([section code](https://github.com/codingforentrepreneurs/Reddit-Content-Research-Agent/tree/a89c1162137364ad21af3bff9d8532e0cc9b2d6c))\n- [06:38:22](https://www.youtube.com/watch?v=XI-iP-qk_Vk\u0026t=23902s) Thank you and next steps","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodingforentrepreneurs%2FReddit-Content-Research-Agent","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcodingforentrepreneurs%2FReddit-Content-Research-Agent","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodingforentrepreneurs%2FReddit-Content-Research-Agent/lists"}