{"id":26659852,"url":"https://github.com/n8nhackers/n8n-nodes-brightdata","last_synced_at":"2025-04-11T15:11:15.578Z","repository":{"id":283322583,"uuid":"951421984","full_name":"n8nhackers/n8n-nodes-brightdata","owner":"n8nhackers","description":"Community node to work with Bright Data service for scraping purposes","archived":false,"fork":false,"pushed_at":"2025-04-09T20:42:15.000Z","size":719,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-09T21:26:08.267Z","etag":null,"topics":["brightdata","fingerprinting","n8n","n8n-community-node-package","n8nhackers","proxy","scraping"],"latest_commit_sha":null,"homepage":"https://brightdata.com/","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/n8nhackers.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-19T16:46:59.000Z","updated_at":"2025-04-09T20:42:18.000Z","dependencies_parsed_at":null,"dependency_job_id":"fdcf59f7-4657-4389-a694-1f3f584f38e4","html_url":"https://github.com/n8nhackers/n8n-nodes-brightdata","commit_stats":null,"previous_names":["n8nhackers/n8n-nodes-brightdata"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/n8nhackers%2Fn8n-nodes-brightdata","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/n8nhackers%2Fn8n-nodes-brightdata/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/n8nhackers%2Fn8n-nodes-brightdata/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/n8nhackers%2Fn8n-nodes-brightdata/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/n8nhackers","download_url":"https://codeload.github.com/n8nhackers/n8n-nodes-brightdata/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248118475,"owners_count":21050744,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["brightdata","fingerprinting","n8n","n8n-community-node-package","n8nhackers","proxy","scraping"],"created_at":"2025-03-25T11:15:43.495Z","updated_at":"2025-04-11T15:11:15.568Z","avatar_url":"https://github.com/n8nhackers.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"![Banner image](images/n8n-and-n8nhackers.png)\n\n# n8n-nodes-brightdata\n\nThis is an n8n community node. It helps you to use [Bright Data APIs](https://docs.brightdata.com/scraping-automation/introduction) from n8n.\n\nIf you have any questions or remarks please [contact me](mailto:support@n8nhackers.com).\n\n[n8n](https://n8n.io/) is a [fair-code licensed](https://docs.n8n.io/reference/license/) workflow automation platform.\n\n## Installation\n\nFollow the [installation guide](https://docs.n8n.io/integrations/community-nodes/installation/) in the n8n community nodes documentation.\n\n## Compatibility\n\nThis node was developed and tested with n8n version 1.81.4\n\n## Resources\n\n### Web Unlocker\n\nBright Data’s Web Unlocker API makes data collection easy by managing proxies and avoiding blocks. \n\nJust send an API request with the target website, and get clean HTML/JSON responses.\n\nThe Web Unlocker handles:\n\n- Optimal proxy selection\n- Custom headers\n- Fingerprinting\n- CAPTCHAs\n\nIdeal for:\n\n- Scraping any website without blocks\n- Emulating real-user behavior\n- Teams without proxy infrastructure\n- Paying only for successful requests\n- [Premium domains](https://docs.brightdata.com/scraping-automation/web-unlocker/features#current-list-of-premium-domains) hard to be scraped (MediaMarkt, Hermes... )\n\nPlease, follow [documentation](https://docs.brightdata.com/scraping-automation/web-unlocker/introduction) to setup this API.\n\n#### Usage\n\n- Resource: choose Unlocker API\n\t- Operation: choose \"Send a Request\".\n\t\t- Properties:\n\t\t\t- zone: Choose between your existing zone names.\n\t\t\t- url: The target URL you wish to access via Web Unlocker API.\n\t\t\t- method: The method to call the target URL.\n\t\t\t- format: Defines the response format. Use raw to receive the raw response from the target site. JSON is simpler for managing the output.\n\t\t\t- country: The country you will use to access the target URL.\n\n### TL;DR\n![Get deals of the day](images/workflow-sample.png?raw=true \"Get deals of the day\")\n\nDon't want to read? Install n8n-nodes-brightdata in your n8n from Settings / Community nodes. Copy the URL of [Get deals of the day](https://raw.githubusercontent.com/n8nhackers/n8n-nodes-brightdata/refs/heads/main/use-cases/workflow-sample.json \"Get deals of the day\") and paste into \"Import for URL\" submenu at n8n.\n\nThis n8n workflow automates the process of collecting and delivering the \"Deals of the Day\" from MediaMarkt, specifically tailored to user preferences, and sends those deals via email.\n\nThis workflow is useful for automating product deal recommendations based on user input and sending personalized emails with the best deals available.\n\n#### Workflow Overview:\n\n1. **User Interaction via Form**:\n\t- The user submits a form where they can select categories (such as appliances, cell phones, etc.) and provide their email address. This triggers the workflow to gather personalized deals based on their input.\n2. **Data Extraction**:\n\t- Once the form is submitted, the workflow calls **Bright Data** community node to scrape data from the MediaMarkt website (`https://www.mediamarkt.es/es/campaign/campanas-y-ofertas`) using a proxy service. The data is retrieved in JSON format.\n3. **HTML Content Extraction**:\n\t- The raw HTML content from the website is extracted, focusing on the title and body, which are key to processing the content for recommendation.\n4. **Recommendation Generation using OpenAI**:\n\t- The extracted data is processed through **OpenAI** (GPT-4o-mini) to generate a list of recommended deals. This involves categorizing deals based on the user-selected categories, and filtering or translating content if necessary. The deal list includes properties like name, description, price, and a link.\n5. **Data Structuring**:\n\t- The generated list of deals is split into individual deal items using **SplitOut**.\n6. **Document Creation**:\n\t- Using **[Document Generator](https://www.npmjs.com/package/n8n-nodes-document-generator)** community node, an HTML template is populated with the recommended deals and structured into a user-friendly format.\n7. **Email Delivery**:\n\t- The document containing the recommended deals is sent to the user's email via **SMTP email send** with a personalized message that includes the list of deals.\n\n#### Workflow Connections:\n\n1. **Form Submission** → **Bright Data (Scrape Deals)**: The form triggers the request to scrape the MediaMarkt deals page.\n2. **Bright Data** → **HTML Extraction**: The scraped content is processed to extract key page data.\n3. **HTML Extraction** → **OpenAI (Deal Generation)**: The extracted content is used as input for GPT-4o-mini to generate deal recommendations.\n4. **OpenAI** → **SplitOut**: The results are split into individual deal items.\n5. **SplitOut** → **DocumentGenerator**: The items are formatted into an HTML document.\n6. **DocumentGenerator** → **Send Email**: The document is emailed to the user.\n\n#### Final Output:\n\n- The user receives an email with a personalized list of the best deals based on their selected categories.\n\n#### Credentials Used:\n\n- **Bright Data API**: For scraping data from MediaMarkt.\n- **OpenAI API**: To generate the list of recommended deals using GPT-4o-mini.\n- **SMTP**: For sending the email with the deals.\n\n#### External nodes Used:\n\n- **[Bright Data](https://www.npmjs.com/package/n8n-nodes-brightdata)**: For scrapping data from MediaMarkt.\n- **[Document Generator](https://www.npmjs.com/package/n8n-nodes-document-generator)**: For generating html output using templates.\n\n# Changelog\nHere you can find the list of changes applied to this node:\n- 1.0.11: Added support for using this node as tool from an Agent\n\n# Contribution\n\nTo make this node even better, please let us know, [how you use it](mailto:support@n8nhackers.com). Commits are always welcome.\n\n# Issues\n\nIf you have any issues, please [let us know on GitHub](https://github.com/n8nhackers/n8n-nodes-brightdata/issues).\n\n# About\n\nNodes by [n8nhackers.com](https://n8nhackers.com). For productive use and consulting on this, [contact us please](mailto:support@n8nhackers.com).\n\nSpecial thanks to [N8n nodemation](https://n8n.io) workflow automation by Jan Oberhauser.\n\n# License\n\n[MIT](https://github.com/n8n-io/n8n-nodes-starter/blob/master/LICENSE.md)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fn8nhackers%2Fn8n-nodes-brightdata","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fn8nhackers%2Fn8n-nodes-brightdata","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fn8nhackers%2Fn8n-nodes-brightdata/lists"}