Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/samber/the-great-gpt-firewall
๐ค A curated list of websites that restrict access to AI Agents, AI crawlers and GPTs
https://github.com/samber/the-great-gpt-firewall
agent anthropic blocklist censorship crawler firewall genai generative-ai gpt gpt-4 llm openai robots-txt user-agent
Last synced: 5 days ago
JSON representation
๐ค A curated list of websites that restrict access to AI Agents, AI crawlers and GPTs
- Host: GitHub
- URL: https://github.com/samber/the-great-gpt-firewall
- Owner: samber
- License: mit
- Created: 2024-02-13T20:49:03.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2024-11-02T18:02:51.000Z (13 days ago)
- Last Synced: 2024-11-02T19:17:21.788Z (13 days ago)
- Topics: agent, anthropic, blocklist, censorship, crawler, firewall, genai, generative-ai, gpt, gpt-4, llm, openai, robots-txt, user-agent
- Language: Python
- Homepage:
- Size: 1.47 MB
- Stars: 77
- Watchers: 7
- Forks: 4
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
README
# The Great GPT Firewall ๐
This collection is a curated list of websites that employ the `robots.txt` file to restrict access to AI Agents, AI crawlers and GPTs.
It will be updated monthly.
## User agents & robots.txt
The `robots.txt` file allows website owners to control and limit the access of these user agents to certain areas of their website by specifying rules and directives.
```txt
# OpenAIโs web crawler: GPT3.5, GPT4, ChatGPT
# https://platform.openai.com/docs/bots
User-agent: GPTBot
# ChatGPT plugins
# https://platform.openai.com/docs/bots
User-agent: ChatGPT-User
# OpenAI Search bot
# https://platform.openai.com/docs/bots
User-agent: OAI-SearchBot
# Google's web crawler: Bard, VertexAI, Gemini
# https://blog.google/technology/ai/an-update-on-web-publisher-controls/
User-agent: Google-Extended
# Apple's web crawler, dedicated to GenAI projects
# https://support.apple.com/en-us/119829
User-agent: Applebot-Extended
# Claude
User-agent: anthropic-ai
# Claude Bot
User-agent: ClaudeBot
# Claude web
User-agent: Claude-Web
# Cohere
User-agent: Cohere-ai
# Perplexity
User-agent: PerplexityBot
# Common Crawl
# https://commoncrawl.org/ccbot
User-agent: CCBot
# Omglibot: webz.io
# https://webz.io/blog/web-data/what-is-the-omgili-bot-and-why-is-it-crawling-your-website/
User-agent: Omgilibot
User-agent: Omgili
User-agent: Webzio-Extended
# Facebook: Llama
# https://developers.facebook.com/docs/sharing/bot/
User-agent: FacebookBot
# ByteDance: Duobao
User-agent: Bytespider
# Censorship area
Disallow: /
```
## Disclaimer
Please note that this blocklist is intended for informational purposes only. Despite the provoking project name, it's fine to disallow web crawling and protect content ownership.
## 2024-05 update
### Category: Press
- Scanned: 66
- โ
Passing: 38 %
- ๐ Blocked: 62 %
- โ Unknown: 0 %
| Name | Country | Status |
| --------------------------------------------------------------- | ------- | ------ |
| [The Times](https://www.thetimes.co.uk) | ๐ฌ๐ง | ๐ |
| [BBC](https://www.bbc.com) | ๐ฌ๐ง | ๐ |
| [The Guardian](https://www.theguardian.com) | ๐ฌ๐ง | ๐ |
| [The Economist](https://www.economist.com) | ๐ฌ๐ง | ๐ |
| [Financial Times](https://www.ft.com) | ๐ฌ๐ง | ๐ |
| [The Independent](https://www.independent.co.uk) | ๐ฌ๐ง | โ
|
| [The Telegraph](https://www.telegraph.co.uk) | ๐ฌ๐ง | ๐ |
| [Daily Mail](https://www.dailymail.co.uk) | ๐ฌ๐ง | ๐ |
| [The Sun](https://www.thesun.co.uk) | ๐ฌ๐ง | ๐ |
| [Daily Mirror](https://www.mirror.co.uk) | ๐ฌ๐ง | ๐ |
| [Daily Express](https://www.express.co.uk) | ๐ฌ๐ง | ๐ |
| [Washington Post](https://www.washingtonpost.com) | ๐บ๐ธ | ๐ |
| [USA Today](https://www.usatoday.com) | ๐บ๐ธ | โ
|
| [Fox News](https://www.foxnews.com) | ๐บ๐ธ | โ
|
| [ABC News](https://abcnews.go.com) | ๐บ๐ธ | ๐ |
| [NBC News](https://www.nbcnews.com) | ๐บ๐ธ | ๐ |
| [CBS News](https://www.cbsnews.com) | ๐บ๐ธ | ๐ |
| [Los Angeles Times](https://www.latimes.com) | ๐บ๐ธ | ๐ |
| [Chicago Tribune](https://www.chicagotribune.com) | ๐บ๐ธ | โ
|
| [New York Post](https://nypost.com) | ๐บ๐ธ | ๐ |
| [New York Daily News](https://www.nydailynews.com) | ๐บ๐ธ | โ
|
| [The New Yorker](https://www.newyorker.com) | ๐บ๐ธ | ๐ |
| [Vice](https://www.vice.com) | ๐บ๐ธ | โ
|
| [New York Times](https://www.nytimes.com) | ๐บ๐ธ | ๐ |
| [Wall Street Journal](https://www.wsj.com) | ๐บ๐ธ | ๐ |
| [CNN](https://cnn.com) | ๐บ๐ธ | ๐ |
| [El Paรญs](https://elpais.com) | ๐ช๐ธ | โ
|
| [Sรผddeutsche Zeitung](https://www.sueddeutsche.de) | ๐ฉ๐ช | ๐ |
| [Der Spiegel](https://www.spiegel.de) | ๐ฉ๐ช | ๐ |
| [Corriere della Sera](https://www.corriere.it) | ๐ฎ๐น | ๐ |
| [La Repubblica](https://www.repubblica.it) | ๐ฎ๐น | ๐ |
| [Le Monde](https://www.lemonde.fr) | ๐ซ๐ท | ๐ |
| [Libรฉration](https://www.liberation.fr) | ๐ซ๐ท | ๐ |
| [Le Figaro](https://www.lefigaro.fr) | ๐ซ๐ท | ๐ |
| [20 Minutes](https://www.20minutes.fr) | ๐ซ๐ท | ๐ |
| [Ouest France](https://www.ouest-france.fr) | ๐ซ๐ท | ๐ |
| [Le Parisien](https://www.leparisien.fr) | ๐ซ๐ท | ๐ |
| [L'Equipe](https://www.lequipe.fr) | ๐ซ๐ท | ๐ |
| [Le Point](https://www.lepoint.fr) | ๐ซ๐ท | ๐ |
| [Marianne](https://www.marianne.net) | ๐ซ๐ท | ๐ |
| [Le Nouvel Observateur](https://www.nouvelobs.com) | ๐ซ๐ท | ๐ |
| [L'Express](https://www.lexpress.fr) | ๐ซ๐ท | ๐ |
| [France 24](https://www.france24.com) | ๐ซ๐ท | ๐ |
| [BFMTV](https://www.bfmtv.com) | ๐ซ๐ท | ๐ |
| [CNews](https://www.cnews.fr) | ๐ซ๐ท | โ
|
| [Le Monde Diplomatique](https://www.monde-diplomatique.fr) | ๐ซ๐ท | โ
|
| [Mediapart](https://www.mediapart.fr) | ๐ซ๐ท | ๐ |
| [Courrier International](https://www.courrierinternational.com) | ๐ซ๐ท | ๐ |
| [Brut](https://www.brut.media) | ๐ซ๐ท | โ
|
| [IMDB](https://www.imdb.com) | ๐ | โ
|
| [Allocine](https://www.allocine.fr) | ๐ซ๐ท | โ
|
| [Fakt](https://fakt.pl) | ๐ต๐ฑ | โ
|
| [Super Express](https://www.se.pl) | ๐ต๐ฑ | โ
|
| [Gazeta Wyborcza](https://wyborcza.pl) | ๐ต๐ฑ | ๐ |
| [Rzeczpospolita](https://www.rp.pl) | ๐ต๐ฑ | โ
|
| [Dziennik Gazeta Prawna](https://www.gazetaprawna.pl) | ๐ต๐ฑ | โ
|
| [Polityka](https://www.polityka.pl) | ๐ต๐ฑ | โ
|
| [Newsweek Polska](https://www.newsweek.pl) | ๐ต๐ฑ | โ
|
| [Goลฤ Niedzielny](https://www.gosc.pl) | ๐ต๐ฑ | โ
|
| [Sieci](https://www.sieciprawdy.pl) | ๐ต๐ฑ | โ
|
| [Do Rzeczy](https://dorzeczy.pl) | ๐ต๐ฑ | โ
|
| [Twรณj Styl](https://twojstyl.pl) | ๐ต๐ฑ | โ
|
| [Zwierciadลo](https://zwierciadlo.pl) | ๐ต๐ฑ | โ
|
| [Wysokie Obcasy Extra](https://www.wysokieobcasy.pl) | ๐ต๐ฑ | ๐ |
| [Pani](https://pani.pl) | ๐ต๐ฑ | โ
|
| [Elle](https://www.elle.pl) | ๐ต๐ฑ | โ
|
### Category: Video on demand
- Scanned: 9
- โ
Passing: 56 %
- ๐ Blocked: 44 %
- โ Unknown: 0 %
| Name | Country | Status |
| ----------------------------------------- | ------- | ------ |
| [Prime Video](https://www.primevideo.com) | ๐ | โ
|
| [Netflix](https://www.netflix.com) | ๐ | โ
|
| [Disney+](https://www.disneyplus.com) | ๐ | ๐ |
| [Hulu](https://www.hulu.com) | ๐บ๐ธ | ๐ |
| [HBO Max](https://www.max.com) | ๐บ๐ธ | โ
|
| [Canal+](https://www.canalplus.com) | ๐ซ๐ท | ๐ |
| [FranceTV](https://www.france.tv) | ๐ซ๐ท | โ
|
| [TF1](https://www.tf1.fr) | ๐ซ๐ท | ๐ |
| [6Play](https://www.6play.fr) | ๐ซ๐ท | โ
|
### Category: Music
- Scanned: 6
- โ
Passing: 67 %
- ๐ Blocked: 33 %
- โ Unknown: 0 %
| Name | Country | Status |
| -------------------------------------- | ------- | ------ |
| [Soundcloud](https://soundcloud.com) | ๐ | ๐ |
| [Youtube](https://www.youtube.com) | ๐ | โ
|
| [Apple Music](https://music.apple.com) | ๐ | โ
|
| [Spotify](https://open.spotify.com) | ๐ | ๐ |
| [Deezer](https://www.deezer.com) | ๐ซ๐ท | โ
|
| [LastFM](https://www.last.fm) | ๐ฌ๐ง | โ
|
### Category: Podcast
- Scanned: 8
- โ
Passing: 75 %
- ๐ Blocked: 25 %
- โ Unknown: 0 %
| Name | Country | Status |
| --------------------------------------------------- | ------- | ------ |
| [Google Podcasts](https://play.google.com) | ๐ | โ
|
| [Apple Podcast](https://podcasts.apple.com) | ๐ | โ
|
| [Spotify Podcaster](https://podcasters.spotify.com) | ๐ | ๐ |
| [Buzzsprout](https://www.buzzsprout.com) | ๐ | โ
|
| [Podbean](https://watchifyoudare.podbean.com) | ๐ | โ
|
| [Acast](https://www.acast.com) | ๐ฌ๐ง | โ
|
| [AudioMeans](https://podcasts.audiomeans.fr) | ๐ซ๐ท | โ
|
| [Radio France](https://www.radiofrance.fr) | ๐ซ๐ท | ๐ |
### Category: X
- Scanned: 6
- โ
Passing: 67 %
- ๐ Blocked: 33 %
- โ Unknown: 0 %
| Name | Country | Status |
| ---------------------------------- | ------- | ------ |
| [PornHub](https://www.pornhub.com) | ๐ | ๐ |
| [YouPorn](https://www.youporn.com) | ๐ | ๐ |
| [Xnxx](https://www.xnxx.com) | ๐ | โ
|
| [Xvideos](https://www.xvideos.com) | ๐ | โ
|
| [Xhamster](https://xhamster.com) | ๐ | โ
|
| [OnlyFan](https://onlyfans.com) | ๐ | โ
|
### Category: Religion
- Scanned: 5
- โ
Passing: 100 %
- ๐ Blocked: 0 %
- โ Unknown: 0 %
| Name | Country | Status |
| --------------------------------------------- | ------- | ------ |
| [Bible](https://www.bible.com) | ๐บ๐ธ | โ
|
| [Bible gateway](https://www.biblegateway.com) | ๐บ๐ธ | โ
|
| [Jehovah's Witnesses](https://jw.org) | ๐บ๐ธ | โ
|
| [Vatican](https://www.vatican.va) | ๐ป๐ฆ | โ
|
| [Islamweb](https://www.islamweb.net) | ๐ | โ
|
### Category: Social media
- Scanned: 13
- โ
Passing: 31 %
- ๐ Blocked: 62 %
- โ Unknown: 8 %
| Name | Country | Status |
| ---------------------------------------------------- | ------- | ------ |
| [Facebook](https://www.facebook.com) | ๐ | ๐ |
| [Instagram](https://www.instagram.com) | ๐ | ๐ |
| [Reddit](https://www.reddit.com) | ๐ | โ
|
| [Hacker News](https://https://news.ycombinator.com/) | ๐ | โ |
| [Lobsters](https://lobste.rs) | ๐ | ๐ |
| [Pinterest](https://www.pinterest.com) | ๐ | ๐ |
| [TikTok](https://www.tiktok.com) | ๐ | โ
|
| [Twitter](https://twitter.com) | ๐ | ๐ |
| [LinkedIn](https://linkedin.com) | ๐ | โ
|
| [Quora](https://quora.com) | ๐ | ๐ |
| [VK](https://vk.com) | ๐ท๐บ | โ
|
| [TripAdvisor](https://www.tripadvisor.com) | ๐ | ๐ |
| [Yelp](https://www.yelp.com) | ๐ | ๐ |
### Category: Artist
- Scanned: 42
- โ
Passing: 76 %
- ๐ Blocked: 19 %
- โ Unknown: 5 %
| Name | Country | Status |
| -------------------------------------------------------------------- | ------- | ------ |
| [Michael Jackson](https://www.michaeljackson.com) | ๐บ๐ธ | โ
|
| [Madonna](https://www.madonna.com) | ๐บ๐ธ | โ
|
| [Taylor Swift](https://www.taylorswift.com) | ๐บ๐ธ | ๐ |
| [Rihanna](https://www.rihanna.com) | ๐บ๐ธ | โ
|
| [Bruno Mars](https://www.brunomars.com) | ๐บ๐ธ | โ
|
| [Justin Bieber](https://www.justinbiebermusic.com) | ๐บ๐ธ | ๐ |
| [Beyoncรฉ](https://www.beyonce.com) | ๐บ๐ธ | โ
|
| [Katy Perry](https://www.katyperry.com) | ๐บ๐ธ | ๐ |
| [Lady Gaga](https://www.ladygaga.com) | ๐บ๐ธ | ๐ |
| [Hardwell](https://www.djhardwell.com) | ๐บ๐ธ | โ
|
| [Dimitri Vegas & Like Mike](https://www.dimitrivegasandlikemike.com) | ๐บ๐ธ | โ
|
| [Kanye West](https://www.kanyewest.com) | ๐บ๐ธ | โ |
| [Black Eyed Peas](https://www.blackeyedpeas.com) | ๐บ๐ธ | โ
|
| [Imagine Dragons](https://www.imaginedragonsmusic.com) | ๐บ๐ธ | โ
|
| [Twenty One Pilots](https://www.twentyonepilots.com) | ๐บ๐ธ | โ
|
| [Maroon 5](https://www.maroon5.com) | ๐บ๐ธ | ๐ |
| [Selena Gomez](https://www.selenagomez.com) | ๐บ๐ธ | ๐ |
| [Usher](https://www.usherworld.com) | ๐บ๐ธ | ๐ |
| [Stromae](https://www.stromae.com) | ๐ง๐ช | โ
|
| [Aya Nakamura](https://www.ayanakamura.fr) | ๐ซ๐ท | โ |
| [Soprano](https://www.soprano-lesite.fr) | ๐ซ๐ท | โ
|
| [Johnny Hallyday](https://www.johnnyhallyday.com) | ๐ซ๐ท | โ
|
| [Grand Corps Malade](https://www.grandcorpsmalade.fr) | ๐ซ๐ท | โ
|
| [Zaho](https://zahomusic.com) | ๐ซ๐ท | โ
|
| [Jean Louis Aubert](https://www.jeanlouisaubert.com) | ๐ซ๐ท | โ
|
| [Camelia Jordana](https://www.cameliajordana.com) | ๐ซ๐ท | โ
|
| [Indochine](https://indo.fr) | ๐ซ๐ท | โ
|
| [Tryo](https://tryo.com) | ๐ซ๐ท | โ
|
| [David Guetta](https://davidguetta.com) | ๐ซ๐ท | โ
|
| [Mc Solaar](https://www.mcsolaar.com) | ๐ซ๐ท | โ
|
| [Zaz](https://www.zazofficial.com) | ๐ซ๐ท | โ
|
| [Christine and the Queens](https://www.christineandthequeens.com) | ๐ซ๐ท | โ
|
| [Boulevard des Airs](https://bda-boulevarddesairs.com) | ๐ซ๐ท | โ
|
| [Calogero](https://calogero.fr) | ๐ซ๐ท | โ
|
| [Hoshi](https://www.hoshimusic-store.com) | ๐ซ๐ท | โ
|
| [Avicii](https://avicii.com) | ๐ธ๐ช | โ
|
| [Adele](https://www.adele.com) | ๐ฌ๐ง | โ
|
| [Calvin Harris](https://calvinharris.com) | ๐ฌ๐ง | โ
|
| [Ed Sheeran](https://www.edsheeran.com) | ๐ฌ๐ง | โ
|
| [Arctic Monkeys](https://arcticmonkeys.com) | ๐ฌ๐ง | โ
|
| [Coldplay](https://www.coldplay.com) | ๐ฌ๐ง | โ
|
| [The Weeknd](https://www.theweeknd.com) | ๐จ๐ฆ | ๐ |
### Category: Gov
- Scanned: 3
- โ
Passing: 100 %
- ๐ Blocked: 0 %
- โ Unknown: 0 %
| Name | Country | Status |
| ----------------------------------------- | ------- | ------ |
| [White House](https://www.whitehouse.gov) | ๐บ๐ธ | โ
|
| [Elysรฉe](https://www.elysee.fr) | ๐ซ๐ท | โ
|
| [Europe](https://www.europa.eu) | ๐ช๐บ | โ
|
### Category: Science
- Scanned: 28
- โ
Passing: 82 %
- ๐ Blocked: 18 %
- โ Unknown: 0 %
| Name | Country | Status |
| ------------------------------------------------------- | ------- | ------ |
| [Google Scholar](https://scholar.google.com) | ๐ | โ
|
| [Sci-Hub](https://sci-hub.se) | ๐ | โ
|
| [PubPeer](https://pubpeer.com) | ๐ | โ
|
| [Scopus](https://www.scopus.com) | ๐ณ๐ฑ | ๐ |
| [Elsevier](https://www.elsevier.com) | ๐ณ๐ฑ | ๐ |
| [ScienceDirect](https://www.sciencedirect.com) | ๐ณ๐ฑ | ๐ |
| [MDPI](https://www.mdpi.com) | ๐จ๐ญ | โ
|
| [Springer](https://www.springer.com) | ๐ฉ๐ช | โ
|
| [Wiley](https://www.wiley.com) | ๐บ๐ธ | โ
|
| [American Chemical Society](https://www.acs.org) | ๐บ๐ธ | โ
|
| [PubMed](https://pubmed.ncbi.nlm.nih.gov) | ๐บ๐ธ | โ
|
| [Academia](https://www.academia.edu) | ๐บ๐ธ | โ
|
| [Science](https://www.science.org) | ๐บ๐ธ | ๐ |
| [ArXiv](https://arxiv.org) | ๐บ๐ธ | โ
|
| [American Physical Society](https://www.aps.org) | ๐บ๐ธ | โ
|
| [Mendeley](https://www.mendeley.com) | ๐ฌ๐ง | โ
|
| [Nature](https://www.nature.com) | ๐ฌ๐ง | ๐ |
| [Taylor & Francis](https://www.taylorandfrancis.com) | ๐ฌ๐ง | โ
|
| [Oxford University Press](https://www.oup.com) | ๐ฌ๐ง | โ
|
| [Cambridge University Press](https://www.cambridge.org) | ๐ฌ๐ง | โ
|
| [Royal Society of Chemistry](https://www.rsc.org) | ๐ฌ๐ง | โ
|
| [ResearchGate](https://www.researchgate.net) | ๐ฉ๐ช | โ
|
| [BNF](https://www.bnf.fr) | ๐ซ๐ท | โ
|
| [Cairn](https://www.cairn.info) | ๐ซ๐ท | โ
|
| [Persee](https://www.persee.fr) | ๐ซ๐ท | โ
|
| [Gallica](https://gallica.bnf.fr) | ๐ซ๐ท | โ
|
| [HAL](https://hal.archives-ouvertes.fr) | ๐ซ๐ท | โ
|
| [OpenEdition](https://www.openedition.org) | ๐ซ๐ท | โ
|
### Category: Dev
- Scanned: 3
- โ
Passing: 67 %
- ๐ Blocked: 33 %
- โ Unknown: 0 %
| Name | Country | Status |
| ------------------------------------------- | ------- | ------ |
| [Github](https://github.com) | ๐ | โ
|
| [Gitlab](https://gitlab.com) | ๐ | โ
|
| [Stack Overflow](https://stackoverflow.com) | ๐ | ๐ |
### Category: Other content
- Scanned: 19
- โ
Passing: 74 %
- ๐ Blocked: 26 %
- โ Unknown: 0 %
| Name | Country | Status |
| -------------------------------------------- | ------- | ------ |
| [Wikipedia](https://www.wikipedia.org) | ๐ | โ
|
| [Medium](https://medium.com) | ๐ | ๐ |
| [Substack](https://www.substack.com) | ๐ | โ
|
| [Common Crawl](https://commoncrawl.org) | ๐ | โ
|
| [Internet Archive](https://archive.org) | ๐ | โ
|
| [Wayback Machine](https://web.archive.org) | ๐ | โ
|
| [Notion](https://www.notion.so) | ๐ | โ
|
| [Weather](https://www.weather.com) | ๐บ๐ธ | ๐ |
| [AccuWeather](https://www.accuweather.com) | ๐บ๐ธ | โ
|
| [Mรฉtรฉo France](https://www.meteofrance.com) | ๐ซ๐ท | โ
|
| [Getty Images](https://www.gettyimages.com) | ๐บ๐ธ | โ
|
| [Shutterstock](https://www.shutterstock.com) | ๐บ๐ธ | ๐ |
| [Adobe Stock](https://stock.adobe.com) | ๐บ๐ธ | ๐ |
| [Unsplash](https://unsplash.com) | ๐จ๐ฆ | ๐ |
| [Pexels](https://www.pexels.com) | ๐ฉ๐ช | โ
|
| [Pixabay](https://www.pixabay.com) | ๐ฉ๐ช | โ
|
| [Flickr](https://www.flickr.com) | ๐บ๐ธ | โ
|
| [500px](https://500px.com) | ๐จ๐ฆ | โ
|
| [Giphy](https://giphy.com) | ๐บ๐ธ | โ
|
### Category: Other
- Scanned: 1
- โ
Passing: 100 %
- ๐ Blocked: 0 %
- โ Unknown: 0 %
| Name | Country | Status |
| -------------------------------- | ------- | ------ |
| [Indeed](https://www.indeed.com) | ๐บ๐ธ | โ
|
## WTF list
A.k.a: do they understand their business model? ๐ธ
| Name | Status |
| ------------------------------------------- | ------ |
| [Getty Images](https://www.gettyimages.com) | โ
|
| [Pexels](https://www.pexels.com) | โ
|
| [500px](https://500px.com) | โ
|
## Shame list
A.k.a: this is public interest. ๐
| Name | Status |
| ---------------------------------------------- | ------ |
| [Medium](https://medium.com) | ๐ |
| [Quora](https://quora.com) | ๐ |
| [Elsevier](https://www.elsevier.com) | ๐ |
| [Scopus](https://www.scopus.com) | ๐ |
| [Science](https://www.science.org) | ๐ |
| [ScienceDirect](https://www.sciencedirect.com) | ๐ |
| [Nature](https://www.nature.com) | ๐ |
## ๐ค Contributing
Looking for contributions:
- Enrich website database
- Chinese websites
- New categories
Please open issues!
- Ping me on Twitter [@samuelberthe](https://twitter.com/samuelberthe) (DMs, mentions, whatever :))
- Fork the [project](https://github.com/samber/the-great-gpt-firewall)
- Fix [open issues](https://github.com/samber/the-great-gpt-firewall/issues) or request new features
Don't hesitate ;)
### Build
```bash
python -m venv venv
source ./venv/bin/activate
pip3 install -r requirements.txt
python3 scrape.py
# then copy the last version into readme
```
## ๐ค Contributors
## ๐ซ Show your support
Give a โญ๏ธ if this project helped you!
[](https://github.com/sponsors/samber)
## ๐ License
Copyright ยฉ 2024 [Samuel Berthe](https://github.com/samber).
This project is [MIT](./LICENSE) licensed.