{"id":19288526,"url":"https://github.com/samber/the-great-gpt-firewall","last_synced_at":"2025-08-17T14:04:41.933Z","repository":{"id":222377064,"uuid":"757115484","full_name":"samber/the-great-gpt-firewall","owner":"samber","description":"🤖 A curated list of websites that restrict access to AI Agents, AI crawlers and GPTs","archived":false,"fork":false,"pushed_at":"2025-08-03T15:42:53.000Z","size":4663,"stargazers_count":92,"open_issues_count":1,"forks_count":6,"subscribers_count":6,"default_branch":"main","last_synced_at":"2025-08-03T17:32:12.212Z","etag":null,"topics":["agent","anthropic","blocklist","censorship","crawler","firewall","genai","generative-ai","gpt","gpt-4","llm","openai","robots-txt","user-agent"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/samber.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"github":["samber"]}},"created_at":"2024-02-13T20:49:03.000Z","updated_at":"2025-08-03T15:42:57.000Z","dependencies_parsed_at":"2024-05-01T21:29:44.193Z","dependency_job_id":"7698fbb2-add8-432e-85ca-c6063848e5a0","html_url":"https://github.com/samber/the-great-gpt-firewall","commit_stats":{"total_commits":26,"total_committers":3,"mean_commits":8.666666666666666,"dds":0.07692307692307687,"last_synced_commit":"404b4a460bd99c590c6ee9bf2155101b63d10ae7"},"previous_names":["samber/the-great-gpt-firewall"],"tags_count":3,"template":false,"template_full_name":null,"purl":"pkg:github/samber/the-great-gpt-firewall","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samber%2Fthe-great-gpt-firewall","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samber%2Fthe-great-gpt-firewall/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samber%2Fthe-great-gpt-firewall/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samber%2Fthe-great-gpt-firewall/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/samber","download_url":"https://codeload.github.com/samber/the-great-gpt-firewall/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samber%2Fthe-great-gpt-firewall/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":270856775,"owners_count":24657700,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-17T02:00:09.016Z","response_time":129,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agent","anthropic","blocklist","censorship","crawler","firewall","genai","generative-ai","gpt","gpt-4","llm","openai","robots-txt","user-agent"],"created_at":"2024-11-09T22:09:17.250Z","updated_at":"2025-08-17T14:04:41.917Z","avatar_url":"https://github.com/samber.png","language":"Python","funding_links":["https://github.com/sponsors/samber"],"categories":[],"sub_categories":[],"readme":"\n# The Great GPT Firewall 📛\n\nThis collection is a curated list of websites that employ the `robots.txt` file to restrict access to AI Agents, AI crawlers and GPTs.\n\nIt will be updated monthly.\n\n\u003cimg align=\"right\" title=\"We need a plan!\" alt=\"We need a plan!\" style=\"width: 50%; max-width: 390px;\" src=\"assets/we-need-a-plan.png\"\u003e\n\n## User agents \u0026 robots.txt\n\nThe `robots.txt` file allows website owners to control and limit the access of these user agents to certain areas of their website by specifying rules and directives.\n\n```txt\n# OpenAI’s web crawler: GPT3.5, GPT4, ChatGPT\n# https://platform.openai.com/docs/bots\nUser-agent: GPTBot\n\n# ChatGPT plugins\n# https://platform.openai.com/docs/bots\nUser-agent: ChatGPT-User\n\n# OpenAI Search bot\n# https://platform.openai.com/docs/bots\nUser-agent: OAI-SearchBot\n\n# Google's web crawler: Bard, VertexAI, Gemini\n# https://blog.google/technology/ai/an-update-on-web-publisher-controls/\nUser-agent: Google-Extended\n\n# Apple's web crawler, dedicated to GenAI projects\n# https://support.apple.com/en-us/119829\nUser-agent: Applebot-Extended\n\n# Claude\nUser-agent: anthropic-ai\n\n# Claude Bot\nUser-agent: ClaudeBot\n\n# Claude web\nUser-agent: Claude-Web\n\n# Amazonbot\n# https://developer.amazon.com/amazonbot\nUser-agent: Amazonbot\n\n# Cohere\nUser-agent: Cohere-ai\n\n# Perplexity\nUser-agent: PerplexityBot\n\n# You\n# https://about.you.com/fr/youbot/\nUser-agent: YouBot\n\n# Common Crawl\n# https://commoncrawl.org/ccbot\nUser-agent: CCBot\n\n# Omglibot: webz.io\n# https://webz.io/blog/web-data/what-is-the-omgili-bot-and-why-is-it-crawling-your-website/\nUser-agent: Omgilibot\nUser-agent: Omgili\nUser-agent: Webzio-Extended\n\n# Facebook: Llama\n# https://developers.facebook.com/docs/sharing/bot/\nUser-agent: FacebookBot\n\n# Facebook\n# https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/\nUser-agent: Meta-ExternalAgent\n\n# ByteDance: Duobao\nUser-agent: Bytespider\n\n# Ai2\n# https://allenai.org/crawler\nUser-agent: Ai2bot\nUser-agent: Ai2Bot-Dolma\n\n# Diffbot\nUser-agent: Diffbot\n\n# Huawei\n# https://darkvisitors.com/agents/pangubot\nUser-agent: PanguBot\n\n# Petal Search\n# https://datadome.co/learning-center/how-to-block-petal-bot/\nUser-agent: PetalBot\n\n# Timpibot\n# https://darkvisitors.com/agents/timpibot\nUser-agent: Timpibot\n\n# DeepSeek\nUser-agent: DeepSeek\nUser-agent: DeepSeekBot\n\n# Censorship area\nDisallow: /\n```\n\n## Disclaimer\n\nPlease note that this blocklist is intended for informational purposes only. Despite the provoking project name, it's fine to disallow web crawling and protect content ownership. \n\n## 2025-08 update\n\n\n### Category: Press\n\n- Scanned: 66\n- ✅ Passing: 29 %\n- 🔐 Blocked: 71 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [The Times](https://www.thetimes.co.uk) | 🇬🇧 | 🔐 |\n| [BBC](https://www.bbc.com) | 🇬🇧 | 🔐 |\n| [The Guardian](https://www.theguardian.com) | 🇬🇧 | 🔐 |\n| [The Economist](https://www.economist.com) | 🇬🇧 | 🔐 |\n| [Financial Times](https://www.ft.com) | 🇬🇧 | 🔐 |\n| [The Independent](https://www.independent.co.uk) | 🇬🇧 | ✅ |\n| [The Telegraph](https://www.telegraph.co.uk) | 🇬🇧 | 🔐 |\n| [Daily Mail](https://www.dailymail.co.uk) | 🇬🇧 | 🔐 |\n| [The Sun](https://www.thesun.co.uk) | 🇬🇧 | 🔐 |\n| [Daily Mirror](https://www.mirror.co.uk) | 🇬🇧 | 🔐 |\n| [Daily Express](https://www.express.co.uk) | 🇬🇧 | 🔐 |\n| [Washington Post](https://www.washingtonpost.com) | 🇺🇸 | 🔐 |\n| [USA Today](https://www.usatoday.com) | 🇺🇸 | 🔐 |\n| [Fox News](https://www.foxnews.com) | 🇺🇸 | ✅ |\n| [ABC News](https://abcnews.go.com) | 🇺🇸 | 🔐 |\n| [NBC News](https://www.nbcnews.com) | 🇺🇸 | 🔐 |\n| [CBS News](https://www.cbsnews.com) | 🇺🇸 | 🔐 |\n| [Los Angeles Times](https://www.latimes.com) | 🇺🇸 | 🔐 |\n| [Chicago Tribune](https://www.chicagotribune.com) | 🇺🇸 | 🔐 |\n| [New York Post](https://nypost.com) | 🇺🇸 | 🔐 |\n| [New York Daily News](https://www.nydailynews.com) | 🇺🇸 | 🔐 |\n| [The New Yorker](https://www.newyorker.com) | 🇺🇸 | 🔐 |\n| [Vice](https://www.vice.com) | 🇺🇸 | ✅ |\n| [New York Times](https://www.nytimes.com) | 🇺🇸 | 🔐 |\n| [Wall Street Journal](https://www.wsj.com) | 🇺🇸 | 🔐 |\n| [CNN](https://cnn.com) | 🇺🇸 | 🔐 |\n| [El País](https://elpais.com) | 🇪🇸 | ✅ |\n| [Süddeutsche Zeitung](https://www.sueddeutsche.de) | 🇩🇪 | 🔐 |\n| [Der Spiegel](https://www.spiegel.de) | 🇩🇪 | 🔐 |\n| [Corriere della Sera](https://www.corriere.it) | 🇮🇹 | 🔐 |\n| [La Repubblica](https://www.repubblica.it) | 🇮🇹 | 🔐 |\n| [Le Monde](https://www.lemonde.fr) | 🇫🇷 | 🔐 |\n| [Libération](https://www.liberation.fr) | 🇫🇷 | 🔐 |\n| [Le Figaro](https://www.lefigaro.fr) | 🇫🇷 | 🔐 |\n| [20 Minutes](https://www.20minutes.fr) | 🇫🇷 | 🔐 |\n| [Ouest France](https://www.ouest-france.fr) | 🇫🇷 | 🔐 |\n| [Le Parisien](https://www.leparisien.fr) | 🇫🇷 | 🔐 |\n| [L'Equipe](https://www.lequipe.fr) | 🇫🇷 | 🔐 |\n| [Le Point](https://www.lepoint.fr) | 🇫🇷 | 🔐 |\n| [Marianne](https://www.marianne.net) | 🇫🇷 | 🔐 |\n| [Le Nouvel Observateur](https://www.nouvelobs.com) | 🇫🇷 | 🔐 |\n| [L'Express](https://www.lexpress.fr) | 🇫🇷 | 🔐 |\n| [France 24](https://www.france24.com) | 🇫🇷 | 🔐 |\n| [BFMTV](https://www.bfmtv.com) | 🇫🇷 | 🔐 |\n| [CNews](https://www.cnews.fr) | 🇫🇷 | ✅ |\n| [Le Monde Diplomatique](https://www.monde-diplomatique.fr) | 🇫🇷 | ✅ |\n| [Mediapart](https://www.mediapart.fr) | 🇫🇷 | 🔐 |\n| [Courrier International](https://www.courrierinternational.com) | 🇫🇷 | 🔐 |\n| [Brut](https://www.brut.media) | 🇫🇷 | ✅ |\n| [IMDB](https://www.imdb.com) | 🌍 | 🔐 |\n| [Allocine](https://www.allocine.fr) | 🇫🇷 | 🔐 |\n| [Fakt](https://fakt.pl) | 🇵🇱 | ✅ |\n| [Super Express](https://www.se.pl) | 🇵🇱 | ✅ |\n| [Gazeta Wyborcza](https://wyborcza.pl) | 🇵🇱 | 🔐 |\n| [Rzeczpospolita](https://www.rp.pl) | 🇵🇱 | ✅ |\n| [Dziennik Gazeta Prawna](https://www.gazetaprawna.pl) | 🇵🇱 | ✅ |\n| [Polityka](https://www.polityka.pl) | 🇵🇱 | ✅ |\n| [Newsweek Polska](https://www.newsweek.pl) | 🇵🇱 | ✅ |\n| [Gość Niedzielny](https://www.gosc.pl) | 🇵🇱 | ✅ |\n| [Sieci](https://www.sieciprawdy.pl) | 🇵🇱 | ✅ |\n| [Do Rzeczy](https://dorzeczy.pl) | 🇵🇱 | ✅ |\n| [Twój Styl](https://twojstyl.pl) | 🇵🇱 | ✅ |\n| [Zwierciadło](https://zwierciadlo.pl) | 🇵🇱 | ✅ |\n| [Wysokie Obcasy Extra](https://www.wysokieobcasy.pl) | 🇵🇱 | 🔐 |\n| [Pani](https://pani.pl) | 🇵🇱 | ✅ |\n| [Elle](https://www.elle.pl) | 🇵🇱 | 🔐 |\n\n### Category: Video on demand\n\n- Scanned: 9\n- ✅ Passing: 56 %\n- 🔐 Blocked: 44 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [Prime Video](https://www.primevideo.com) | 🌍 | ✅ |\n| [Netflix](https://www.netflix.com) | 🌍 | ✅ |\n| [Disney+](https://www.disneyplus.com) | 🌍 | 🔐 |\n| [Hulu](https://www.hulu.com) | 🇺🇸 | 🔐 |\n| [HBO Max](https://www.max.com) | 🇺🇸 | ✅ |\n| [Canal+](https://www.canalplus.com) | 🇫🇷 | 🔐 |\n| [FranceTV](https://www.france.tv) | 🇫🇷 | ✅ |\n| [TF1](https://www.tf1.fr) | 🇫🇷 | 🔐 |\n| [6Play](https://www.6play.fr) | 🇫🇷 | ✅ |\n\n### Category: Music\n\n- Scanned: 6\n- ✅ Passing: 67 %\n- 🔐 Blocked: 33 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [Soundcloud](https://soundcloud.com) | 🌍 | 🔐 |\n| [Youtube](https://www.youtube.com) | 🌍 | ✅ |\n| [Apple Music](https://music.apple.com) | 🌍 | ✅ |\n| [Spotify](https://open.spotify.com) | 🌍 | 🔐 |\n| [Deezer](https://www.deezer.com) | 🇫🇷 | ✅ |\n| [LastFM](https://www.last.fm) | 🇬🇧 | ✅ |\n\n### Category: Podcast\n\n- Scanned: 8\n- ✅ Passing: 75 %\n- 🔐 Blocked: 25 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [Google Podcasts](https://play.google.com) | 🌍 | ✅ |\n| [Apple Podcast](https://podcasts.apple.com) | 🌍 | ✅ |\n| [Spotify Podcaster](https://podcasters.spotify.com) | 🌍 | 🔐 |\n| [Buzzsprout](https://www.buzzsprout.com) | 🌍 | ✅ |\n| [Podbean](https://watchifyoudare.podbean.com) | 🌍 | ✅ |\n| [Acast](https://www.acast.com) | 🇬🇧 | ✅ |\n| [AudioMeans](https://podcasts.audiomeans.fr) | 🇫🇷 | ✅ |\n| [Radio France](https://www.radiofrance.fr) | 🇫🇷 | 🔐 |\n\n### Category: X\n\n- Scanned: 6\n- ✅ Passing: 67 %\n- 🔐 Blocked: 33 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [PornHub](https://www.pornhub.com) | 🌍 | 🔐 |\n| [YouPorn](https://www.youporn.com) | 🌍 | 🔐 |\n| [Xnxx](https://www.xnxx.com) | 🌍 | ✅ |\n| [Xvideos](https://www.xvideos.com) | 🌍 | ✅ |\n| [Xhamster](https://xhamster.com) | 🌍 | ✅ |\n| [OnlyFan](https://onlyfans.com) | 🌍 | ✅ |\n\n### Category: Religion\n\n- Scanned: 5\n- ✅ Passing: 100 %\n- 🔐 Blocked: 0 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [Bible](https://www.bible.com) | 🇺🇸 | ✅ |\n| [Bible gateway](https://www.biblegateway.com) | 🇺🇸 | ✅ |\n| [Jehovah's Witnesses](https://jw.org) | 🇺🇸 | ✅ |\n| [Vatican](https://www.vatican.va) | 🇻🇦 | ✅ |\n| [Islamweb](https://www.islamweb.net) | 🌍 | ✅ |\n\n### Category: Social media\n\n- Scanned: 13\n- ✅ Passing: 15 %\n- 🔐 Blocked: 77 %\n- ❓ Unknown: 8 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [Facebook](https://www.facebook.com) | 🌍 | 🔐 |\n| [Instagram](https://www.instagram.com) | 🌍 | 🔐 |\n| [Reddit](https://www.reddit.com) | 🌍 | ✅ |\n| [Hacker News](https://https://news.ycombinator.com/) | 🌍 | ❓ |\n| [Lobsters](https://lobste.rs) | 🌍 | 🔐 |\n| [Pinterest](https://www.pinterest.com) | 🌍 | 🔐 |\n| [TikTok](https://www.tiktok.com) | 🌍 | 🔐 |\n| [Twitter](https://twitter.com) | 🌍 | 🔐 |\n| [LinkedIn](https://linkedin.com) | 🌍 | 🔐 |\n| [Quora](https://quora.com) | 🌍 | 🔐 |\n| [VK](https://vk.com) | 🇷🇺 | ✅ |\n| [TripAdvisor](https://www.tripadvisor.com) | 🌍 | 🔐 |\n| [Yelp](https://www.yelp.com) | 🌍 | 🔐 |\n\n### Category: Artist\n\n- Scanned: 42\n- ✅ Passing: 81 %\n- 🔐 Blocked: 12 %\n- ❓ Unknown: 7 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [Michael Jackson](https://www.michaeljackson.com) | 🇺🇸 | ✅ |\n| [Madonna](https://www.madonna.com) | 🇺🇸 | ✅ |\n| [Taylor Swift](https://www.taylorswift.com) | 🇺🇸 | 🔐 |\n| [Rihanna](https://www.rihanna.com) | 🇺🇸 | ✅ |\n| [Bruno Mars](https://www.brunomars.com) | 🇺🇸 | ✅ |\n| [Justin Bieber](https://www.justinbiebermusic.com) | 🇺🇸 | 🔐 |\n| [Beyoncé](https://www.beyonce.com) | 🇺🇸 | ✅ |\n| [Katy Perry](https://www.katyperry.com) | 🇺🇸 | 🔐 |\n| [Lady Gaga](https://www.ladygaga.com) | 🇺🇸 | ✅ |\n| [Hardwell](https://www.djhardwell.com) | 🇺🇸 | ✅ |\n| [Dimitri Vegas \u003cRESULT\u003e Like Mike](https://www.dimitrivegasandlikemike.com) | 🇺🇸 | ✅ |\n| [Kanye West](https://www.kanyewest.com) | 🇺🇸 | ❓ |\n| [Black Eyed Peas](https://www.blackeyedpeas.com) | 🇺🇸 | ✅ |\n| [Imagine Dragons](https://www.imaginedragonsmusic.com) | 🇺🇸 | ✅ |\n| [Twenty One Pilots](https://www.twentyonepilots.com) | 🇺🇸 | ✅ |\n| [Maroon 5](https://www.maroon5.com) | 🇺🇸 | 🔐 |\n| [Selena Gomez](https://www.selenagomez.com) | 🇺🇸 | ✅ |\n| [Usher](https://www.usherworld.com) | 🇺🇸 | 🔐 |\n| [Stromae](https://www.stromae.com) | 🇧🇪 | ✅ |\n| [Aya Nakamura](https://www.ayanakamura.fr) | 🇫🇷 | ❓ |\n| [Soprano](https://www.soprano-lesite.fr) | 🇫🇷 | ✅ |\n| [Johnny Hallyday](https://www.johnnyhallyday.com) | 🇫🇷 | ✅ |\n| [Grand Corps Malade](https://www.grandcorpsmalade.fr) | 🇫🇷 | ❓ |\n| [Zaho](https://zahomusic.com) | 🇫🇷 | ✅ |\n| [Jean Louis Aubert](https://www.jeanlouisaubert.com) | 🇫🇷 | ✅ |\n| [Camelia Jordana](https://www.cameliajordana.com) | 🇫🇷 | ✅ |\n| [Indochine](https://indo.fr) | 🇫🇷 | ✅ |\n| [Tryo](https://tryo.com) | 🇫🇷 | ✅ |\n| [David Guetta](https://davidguetta.com) | 🇫🇷 | ✅ |\n| [Mc Solaar](https://www.mcsolaar.com) | 🇫🇷 | ✅ |\n| [Zaz](https://www.zazofficial.com) | 🇫🇷 | ✅ |\n| [Christine and the Queens](https://www.christineandthequeens.com) | 🇫🇷 | ✅ |\n| [Boulevard des Airs](https://bda-boulevarddesairs.com) | 🇫🇷 | ✅ |\n| [Calogero](https://calogero.fr) | 🇫🇷 | ✅ |\n| [Hoshi](https://www.hoshimusic-store.com) | 🇫🇷 | ✅ |\n| [Avicii](https://avicii.com) | 🇸🇪 | ✅ |\n| [Adele](https://www.adele.com) | 🇬🇧 | ✅ |\n| [Calvin Harris](https://calvinharris.com) | 🇬🇧 | ✅ |\n| [Ed Sheeran](https://www.edsheeran.com) | 🇬🇧 | ✅ |\n| [Arctic Monkeys](https://arcticmonkeys.com) | 🇬🇧 | ✅ |\n| [Coldplay](https://www.coldplay.com) | 🇬🇧 | ✅ |\n| [The Weeknd](https://www.theweeknd.com) | 🇨🇦 | ✅ |\n\n### Category: Gov\n\n- Scanned: 3\n- ✅ Passing: 100 %\n- 🔐 Blocked: 0 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [White House](https://www.whitehouse.gov) | 🇺🇸 | ✅ |\n| [Elysée](https://www.elysee.fr) | 🇫🇷 | ✅ |\n| [Europe](https://www.europa.eu) | 🇪🇺 | ✅ |\n\n### Category: Science\n\n- Scanned: 28\n- ✅ Passing: 71 %\n- 🔐 Blocked: 29 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [Google Scholar](https://scholar.google.com) | 🌍 | 🔐 |\n| [Sci-Hub](https://sci-hub.se) | 🌍 | ✅ |\n| [PubPeer](https://pubpeer.com) | 🌍 | ✅ |\n| [Scopus](https://www.scopus.com) | 🇳🇱 | ✅ |\n| [Elsevier](https://www.elsevier.com) | 🇳🇱 | ✅ |\n| [ScienceDirect](https://www.sciencedirect.com) | 🇳🇱 | ✅ |\n| [MDPI](https://www.mdpi.com) | 🇨🇭 | ✅ |\n| [Springer](https://www.springer.com) | 🇩🇪 | ✅ |\n| [Wiley](https://www.wiley.com) | 🇺🇸 | ✅ |\n| [American Chemical Society](https://www.acs.org) | 🇺🇸 | ✅ |\n| [PubMed](https://pubmed.ncbi.nlm.nih.gov) | 🇺🇸 | ✅ |\n| [Academia](https://www.academia.edu) | 🇺🇸 | 🔐 |\n| [Science](https://www.science.org) | 🇺🇸 | 🔐 |\n| [ArXiv](https://arxiv.org) | 🇺🇸 | ✅ |\n| [American Physical Society](https://www.aps.org) | 🇺🇸 | ✅ |\n| [Mendeley](https://www.mendeley.com) | 🇬🇧 | ✅ |\n| [Nature](https://www.nature.com) | 🇬🇧 | 🔐 |\n| [Taylor \u003cRESULT\u003e Francis](https://www.taylorandfrancis.com) | 🇬🇧 | 🔐 |\n| [Oxford University Press](https://www.oup.com) | 🇬🇧 | ✅ |\n| [Cambridge University Press](https://www.cambridge.org) | 🇬🇧 | 🔐 |\n| [Royal Society of Chemistry](https://www.rsc.org) | 🇬🇧 | ✅ |\n| [ResearchGate](https://www.researchgate.net) | 🇩🇪 | ✅ |\n| [BNF](https://www.bnf.fr) | 🇫🇷 | ✅ |\n| [Cairn](https://www.cairn.info) | 🇫🇷 | ✅ |\n| [Persee](https://www.persee.fr) | 🇫🇷 | ✅ |\n| [Gallica](https://gallica.bnf.fr) | 🇫🇷 | 🔐 |\n| [HAL](https://hal.archives-ouvertes.fr) | 🇫🇷 | 🔐 |\n| [OpenEdition](https://www.openedition.org) | 🇫🇷 | ✅ |\n\n### Category: Dev\n\n- Scanned: 3\n- ✅ Passing: 100 %\n- 🔐 Blocked: 0 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [Github](https://github.com) | 🌍 | ✅ |\n| [Gitlab](https://gitlab.com) | 🌍 | ✅ |\n| [Stack Overflow](https://stackoverflow.com) | 🌍 | ✅ |\n\n### Category: Other content\n\n- Scanned: 19\n- ✅ Passing: 63 %\n- 🔐 Blocked: 37 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [Wikipedia](https://www.wikipedia.org) | 🌍 | ✅ |\n| [Medium](https://medium.com) | 🌍 | 🔐 |\n| [Substack](https://www.substack.com) | 🌍 | ✅ |\n| [Common Crawl](https://commoncrawl.org) | 🌍 | ✅ |\n| [Internet Archive](https://archive.org) | 🌍 | ✅ |\n| [Wayback Machine](https://web.archive.org) | 🌍 | ✅ |\n| [Notion](https://www.notion.so) | 🌍 | 🔐 |\n| [Weather](https://www.weather.com) | 🇺🇸 | 🔐 |\n| [AccuWeather](https://www.accuweather.com) | 🇺🇸 | ✅ |\n| [Météo France](https://www.meteofrance.com) | 🇫🇷 | ✅ |\n| [Getty Images](https://www.gettyimages.com) | 🇺🇸 | ✅ |\n| [Shutterstock](https://www.shutterstock.com) | 🇺🇸 | 🔐 |\n| [Adobe Stock](https://stock.adobe.com) | 🇺🇸 | 🔐 |\n| [Unsplash](https://unsplash.com) | 🇨🇦 | ✅ |\n| [Pexels](https://www.pexels.com) | 🇩🇪 | ✅ |\n| [Pixabay](https://www.pixabay.com) | 🇩🇪 | 🔐 |\n| [Flickr](https://www.flickr.com) | 🇺🇸 | 🔐 |\n| [500px](https://500px.com) | 🇨🇦 | ✅ |\n| [Giphy](https://giphy.com) | 🇺🇸 | ✅ |\n\n### Category: Other\n\n- Scanned: 1\n- ✅ Passing: 100 %\n- 🔐 Blocked: 0 %\n- ❓ Unknown: 0 %\n\n| Name | Country | Status |\n| ---- | ------- | ------ |\n| [Indeed](https://www.indeed.com) | 🇺🇸 | ✅ |\n\n## 🤝 Contributing\n\nLooking for contributions:\n- Enrich website database\n- Chinese websites\n- New categories\n\nPlease open issues!\n\n- Ping me on Twitter [@samuelberthe](https://twitter.com/samuelberthe) (DMs, mentions, whatever :))\n- Fork the [project](https://github.com/samber/the-great-gpt-firewall)\n- Fix [open issues](https://github.com/samber/the-great-gpt-firewall/issues) or request new features\n\nDon't hesitate ;)\n\n### Build\n\n```bash\npython -m venv venv\nsource ./venv/bin/activate\npip3 install -r requirements.txt\npython3 scrape.py\n# then copy the last version into readme\n```\n\n## 👤 Contributors\n\n![Contributors](https://contrib.rocks/image?repo=samber/the-great-gpt-firewall)\n\n## 💫 Show your support\n\nGive a ⭐️ if this project helped you!\n\n[![GitHub Sponsors](https://img.shields.io/github/sponsors/samber?style=for-the-badge)](https://github.com/sponsors/samber)\n\n## 📝 License\n\nCopyright © 2024 [Samuel Berthe](https://github.com/samber).\n\nThis project is [MIT](./LICENSE) licensed.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsamber%2Fthe-great-gpt-firewall","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsamber%2Fthe-great-gpt-firewall","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsamber%2Fthe-great-gpt-firewall/lists"}