{"id":19035261,"url":"https://github.com/omkarcloud/duckduckgo-scraper","last_synced_at":"2025-08-06T16:10:57.056Z","repository":{"id":218931769,"uuid":"737492542","full_name":"omkarcloud/duckduckgo-scraper","owner":"omkarcloud","description":"DuckDuckGo Scraper helps you collect search results from DuckDuckGo.","archived":false,"fork":false,"pushed_at":"2024-01-24T14:34:40.000Z","size":2574,"stargazers_count":5,"open_issues_count":0,"forks_count":2,"subscribers_count":0,"default_branch":"master","last_synced_at":"2024-12-30T03:44:30.349Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/omkarcloud.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null},"funding":{"github":["Chetan11-Dev"],"patreon":null,"open_collective":null,"ko_fi":null,"tidelift":null,"community_bridge":null,"liberapay":null,"issuehunt":null,"otechie":null,"lfx_crowdfunding":null,"custom":null}},"created_at":"2023-12-31T08:39:56.000Z","updated_at":"2024-11-25T16:24:38.000Z","dependencies_parsed_at":"2024-01-24T15:46:31.310Z","dependency_job_id":"6d5e7a6c-1adc-4b8e-bba6-e93af68f2c16","html_url":"https://github.com/omkarcloud/duckduckgo-scraper","commit_stats":null,"previous_names":["omkarcloud/duckduckgo-scraper"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omkarcloud%2Fduckduckgo-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omkarcloud%2Fduckduckgo-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omkarcloud%2Fduckduckgo-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omkarcloud%2Fduckduckgo-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/omkarcloud","download_url":"https://codeload.github.com/omkarcloud/duckduckgo-scraper/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":232155271,"owners_count":18480387,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dork-scanner","duckduckgo","duckduckgo-api","duckduckgo-scraper","duckduckgo-scraper-github","duckduckgo-scraping","duckduckgo-search","duckduckgo-search-api","duckduckgo-search-engine-scrap","duckduckgo-search-results","duckduckgo-search-using-python","duckduckgo-serp-api","duckduckgo-serp-scraping","google-dorking","google-dorks","gscraper","how-to-scrape-data-from-duckduckgo-using-python","scrape-duckduckgo","serp-api","serpapi"],"created_at":"2024-11-08T21:49:49.066Z","updated_at":"2025-01-02T05:21:38.373Z","avatar_url":"https://github.com/omkarcloud.png","language":"Python","readme":"![DuckDuckGo Scraper Featured Image](https://raw.githubusercontent.com/omkarcloud/duckduckgo-scraper/master/images/duckduckgo-scraper-featured-image.png)\n\n\u003cdiv align=\"center\" style=\"margin-top: 0;\"\u003e\n  \u003ch1\u003e✨ DuckDuckGo Scraper 🚀\u003c/h1\u003e\n  \u003cp\u003e💦 DuckDuckGo Scraper helps you collect search results from DuckDuckGo. 💦\u003c/p\u003e\n\u003c/div\u003e\n\u003cem\u003e\n  \u003ch5 align=\"center\"\u003e(Programming Language - Python 3)\u003c/h5\u003e\n\u003c/em\u003e\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"#\"\u003e\n    \u003cimg alt=\"duckduckgo-scraper forks\" src=\"https://img.shields.io/github/forks/omkarcloud/duckduckgo-scraper?style=for-the-badge\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"#\"\u003e\n    \u003cimg alt=\"Repo stars\" src=\"https://img.shields.io/github/stars/omkarcloud/duckduckgo-scraper?style=for-the-badge\u0026color=yellow\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"#\"\u003e\n    \u003cimg alt=\"duckduckgo-scraper License\" src=\"https://img.shields.io/github/license/omkarcloud/duckduckgo-scraper?color=orange\u0026style=for-the-badge\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://github.com/omkarcloud/duckduckgo-scraper/issues\"\u003e\n    \u003cimg alt=\"issues\" src=\"https://img.shields.io/github/issues/omkarcloud/duckduckgo-scraper?color=purple\u0026style=for-the-badge\" /\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://views.whatilearened.today/views/github/omkarcloud/duckduckgo-scraper.svg\" width=\"80px\" height=\"28px\" alt=\"View\" /\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://gitpod.io/#https://github.com/omkarcloud/duckduckgo-scraper\"\u003e\n    \u003cimg alt=\"Open in Gitpod\" src=\"https://gitpod.io/button/open-in-gitpod.svg\" /\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n  \n---\n\n## Disclaimer for DuckDuckGo Scraper Project\n\n\u003e By using DuckDuckGo Scraper, you agree to comply with all applicable local and international laws related to data scraping, copyright, and privacy. The developers of DuckDuckGo Scraper will not be held liable for any misuse of this software. It is the user's sole responsibility to ensure adherence to all relevant laws regarding data scraping, copyright, and privacy, and to use DuckDuckGo Scraper in an ethical and legal manner, in line with both local and international regulations.\n\nWe take concerns related to the DuckDuckGo Scraper Project very seriously. If you have any inquiries or issues, please contact Chetan Jain at [chetan@omkar.cloud](mailto:chetan@omkar.cloud). We will take prompt and necessary action in response to your emails.\n\n## 👉 Explore Our Other Awesome Products\n\n- ✅ [Botasaurus](https://github.com/omkarcloud/botasaurus): The All-in-One Web Scraping Framework with Anti-Detection, Parallelization, Asynchronous, and Caching Superpowers.\n\n---\n\nDuckDuckGo Scraper helps you collect search results from DuckDuckGo.\n\n## 🚀 Getting Started\n\n1️⃣ **Clone the Magic 🧙‍♀:**\n```shell\ngit clone https://github.com/omkarcloud/duckduckgo-scraper\ncd duckduckgo-scraper\n```\n2️⃣ **Install Dependencies 📦:**\n```shell\npython -m pip install -r requirements.txt\n```\n3️⃣ **Let the Scraping Begin 😎**:\n```shell\npython main.py\n```\n\nFind your data in the `output` directory.\n\n![DuckDuckGo Scraper CSV Result](https://raw.githubusercontent.com/omkarcloud/duckduckgo-scraper/master/images/duckduckgo-scraper-csv-result.png)\n\n*Note: If you don't have Python installed. Follow this Simple FAQ [here](https://github.com/omkarcloud/duckduckgo-scraper/blob/master/advanced.md#-i-dont-have-python-installed-how-can-i-run-the-scraper) and you will have your DuckDuckGo data in next 5 Minutes*\n\n## 🤔 FAQs\n\n### ❓ How to Scrape DuckDuckGo ?\n\n1. Open the `main.py` file.\n2. Update the `queries` list with the locations you are interested in. For example:\n\n```python\nqueries = [\n  \"Mango\",\n  \"Watermelon\",\n]\n\nDuckDuckGo.search(queries, max=10)\n```\n\n3. Run it.\n\n```bash\npython main.py\n```\n\nThen find your data in the `output` directory.\n\n\n### ❓ How to Scrape More DuckDuckGo Search Results Using Your DuckDuckGo API?\n\nTo scrape additional data, follow these steps to use our DuckDuckGo API. You can make 50 requests for free:\n\n1. Sign up on RapidAPI by visiting [this link](https://rapidapi.com/auth/sign-up).\n\n![Sign Up on RapidAPI](https://raw.githubusercontent.com/omkarcloud/assets/master/images/sign-up.png)\n\n2. Then, subscribe to our Free Plan by visiting [this link](https://rapidapi.com/Chetan11dev/api/duckduckgo-scraper/pricing).\n\n![Subscribe to Free Plan](https://raw.githubusercontent.com/omkarcloud/assets/master/images/free-subscription.png)\n\n3. Now, copy the API key.\n\n![Copy the API Key](https://raw.githubusercontent.com/omkarcloud/assets/master/images/api-key.png) \n\n4. Use it in the scraper as follows:\n```python\nDuckDuckGo.search(\"Orange\", max=10, key=\"YOUR_API_KEY\")\n```\n\n5. Run the script, and you'll find your data in the `output` folder.\n```bash\npython main.py\n```   \n\nThe first 50 requests are free. After that, you can upgrade to the Pro Plan, which will get you 1000 requests for just $9.\n\n\n### ❓ How did you build it?\n\nWe used Botasaurus, It's an All-in-One Web Scraping Framework with Anti-Detection, Parallelization, Asynchronous, and Caching Superpowers.\n\nBotasaurus helped us cut down the development time by 50% and helped us focus only on the core extraction logic of the scraper.\n\nIf you are a Web Scraper, you should learn about Botasaurus [here](https://github.com/omkarcloud/botasaurus), because Botasaurus will save you countless hours in your life as a Web Scraper.\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/omkarcloud/botasaurus\"\u003e\n  \u003cimg src=\"https://raw.githubusercontent.com/omkarcloud/assets/master/images/mascot.png\" alt=\"botasaurus\" /\u003e\n\u003c/a\u003e\n\u003c/p\u003e\n\n\n### ❓ Need More Help or Have Additional Questions?\n\nFor further help, contact us on WhatsApp. We'll be happy to help you out.\n\n[![Contact Us on WhatsApp about DuckDuckGo Scraper](https://raw.githubusercontent.com/omkarcloud/assets/master/images/whatsapp-us.png)](https://api.whatsapp.com/send?phone=918295042963\u0026text=Hi,%20I%20would%20like%20to%20learn%20more%20about%20your%20products.)\n\n## Love It? [Star It! ⭐](https://github.com/omkarcloud/duckduckgo-scraper/stargazers)\n\n## Made with ❤️ using [Botasaurus Web Scraping Framework](https://github.com/omkarcloud/botasaurus)","funding_links":["https://github.com/sponsors/Chetan11-Dev"],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fomkarcloud%2Fduckduckgo-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fomkarcloud%2Fduckduckgo-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fomkarcloud%2Fduckduckgo-scraper/lists"}