{"id":15167326,"url":"https://github.com/jihefel/internubel-website-scraping","last_synced_at":"2026-02-28T10:33:54.415Z","repository":{"id":246428565,"uuid":"820496244","full_name":"Jihefel/Internubel-website-scraping","owner":"Jihefel","description":"This repository contains a Puppeteer-based script for scraping product details from Internubel's website. ","archived":false,"fork":false,"pushed_at":"2024-06-28T17:11:46.000Z","size":72,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-02-10T15:47:43.431Z","etag":null,"topics":["nodejs","puppeteer","scraper","scraping","scraping-websites"],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Jihefel.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-26T15:25:40.000Z","updated_at":"2024-06-28T17:11:49.000Z","dependencies_parsed_at":null,"dependency_job_id":"a88a6fe7-d4d6-4765-965c-6cfb9475f960","html_url":"https://github.com/Jihefel/Internubel-website-scraping","commit_stats":{"total_commits":9,"total_committers":2,"mean_commits":4.5,"dds":"0.11111111111111116","last_synced_commit":"4e1e2f4cf8e801720962675516ffb26677bb727f"},"previous_names":["jihefel/internubel-website-scraping"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jihefel%2FInternubel-website-scraping","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jihefel%2FInternubel-website-scraping/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jihefel%2FInternubel-website-scraping/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jihefel%2FInternubel-website-scraping/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Jihefel","download_url":"https://codeload.github.com/Jihefel/Internubel-website-scraping/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240059328,"owners_count":19741634,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["nodejs","puppeteer","scraper","scraping","scraping-websites"],"created_at":"2024-09-27T06:00:20.073Z","updated_at":"2026-02-28T10:33:54.366Z","avatar_url":"https://github.com/Jihefel.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"                                  \n# Internubel product data scraping script\n\nThis repository contains a Puppeteer-based script for scraping product data from Internubel's website (https://www.internubel.be). \n\nThe script logs into the site, navigates through product groups, and extracts product details including title, image, nutrition score, and nutritional information. \n\nData is structured and saved into JSON files categorized by product groups, sub-groups, and sub-sub-groups.\n \n## Prerequisites\n\nRequirements for the script:\n- Node.js\n- npm\n- Create an account on the Internubel website if you do not already have one.  (https://www.internubel.be/Register.aspx?lId=3)\n\n## Installation\n\n1. Clone the repository\n   ```sh\n   git clone https://github.com/Jihefel/Internubel-website-scraping.git\n   ```\n2. Install NPM packages\n   ```sh\n   npm install\n   ```\n3. Change the **14th line** of **internubel.js** to select the language you want to use.\n   * Replace \"francais\" by one of the languages shown above (11th line) if needed : \"nederlands\", \"english\", \"deutsch\"\n \n### Config .env variables\n\nCreate your configuration file `.env` in the root directory as the following to store your credentials.\n\n```yaml\nLOGIN_EMAIL=your_email\nLOGIN_PASSWORD=your_password\n```\n\nReplace ```your_email``` and ```your_password``` with your Internubel login credentials.\n \n## Usage\n\nRun the scraping script using Node.js in your terminal:\n```bash\nnode internubel.js\n```\n\nAnd wait for a moment...\n\nThe script will launch a Puppeteer-controlled browser, log into Internubel using provided credentials, and scrape product data into structured JSON files stored in the data directory.\n\n## Dependencies\n\n- [Puppeteer](https://www.npmjs.com/package/puppeteer)\n- [dotenv](https://www.npmjs.com/package/dotenv)\n- [Jest](https://www.npmjs.com/package/jest)\n\n## License\n\nDistributed under the MIT License. See [MIT License](https://opensource.org/licenses/MIT) for more information.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjihefel%2Finternubel-website-scraping","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjihefel%2Finternubel-website-scraping","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjihefel%2Finternubel-website-scraping/lists"}