{"id":22774347,"url":"https://github.com/yr72dpi/mysql_error_google_scrapper","last_synced_at":"2026-05-08T07:33:02.747Z","repository":{"id":171558923,"uuid":"530768283","full_name":"YR72dpi/mysql_error_google_scrapper","owner":"YR72dpi","description":"¤ This nodeJs script scrappes mysql errors found on google using puppeteer.","archived":false,"fork":false,"pushed_at":"2023-10-23T11:54:22.000Z","size":425,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-10-22T18:56:50.221Z","etag":null,"topics":["google","mysql","nodejs","osint","puppeteer","scrapper","scrapper-script"],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/YR72dpi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-08-30T17:50:23.000Z","updated_at":"2023-08-02T05:52:29.000Z","dependencies_parsed_at":null,"dependency_job_id":"a6a0906c-b702-4f77-8b1f-2fab30418050","html_url":"https://github.com/YR72dpi/mysql_error_google_scrapper","commit_stats":null,"previous_names":["yr72dpi/mysql_error_google_scrapper"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/YR72dpi/mysql_error_google_scrapper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/YR72dpi%2Fmysql_error_google_scrapper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/YR72dpi%2Fmysql_error_google_scrapper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/YR72dpi%2Fmysql_error_google_scrapper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/YR72dpi%2Fmysql_error_google_scrapper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/YR72dpi","download_url":"https://codeload.github.com/YR72dpi/mysql_error_google_scrapper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/YR72dpi%2Fmysql_error_google_scrapper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32771029,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-08T02:36:36.067Z","status":"ssl_error","status_checked_at":"2026-05-08T02:36:07.210Z","response_time":54,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["google","mysql","nodejs","osint","puppeteer","scrapper","scrapper-script"],"created_at":"2024-12-11T18:14:21.240Z","updated_at":"2026-05-08T07:33:02.718Z","avatar_url":"https://github.com/YR72dpi.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"![image](docs/FireFly_logo_megs.jpg)\n\u003ccenter\u003e\u003csup\u003e\u003csub\u003eAdobe FireFly Generation\u003c/sub\u003e\u003c/sup\u003e\u003c/center\u003e\n\n# MEGS\n\n**M**ySQL **E**rror **G**oogle **S**crapper\n\nThis nodeJs script scrappes mysql errors found on google using [puppeteer](https://github.com/puppeteer/puppeteer).\n\nAll error will be save on a file *.txt*\n\nIt's look like [THIS](https://www.instagram.com/reel/Chm_IjoDS5n/)\n\n## Summary\n\n1. [USAGE](#Usage)\n\n2. [Config](#Config)\n\n3. [ISSUES](#ISSUES)\n\n4. [To improve it](#to-improve-it)\n\n## Usage\n\n**Installation**\n\n```cmd\nmkdir megs\ncd megs\ngit clone https://github.com/YR72dpi/mysql_error_google_scrapper.git\n# unzip\nnpm update\n```\n\n**Usage**\n\n```cmd\nnpm run megs\n```\n\n\n## Config\n\n1. config.js\n\n```javascript\nconst config = []\n\nconfig[\"watcher\"] = false /* true if you want to watch all error found in real time */\nconfig[\"headless\"] = false /* true if you want to hidde the google chrome copy */\nconfig[\"file\"] = \"error.csv\" /* csv file with all error */\nconfig['print_excl_w'] = false /* true if you want to print the url even if there is excluded word */\n\n/**\n * These string will be put on regex expression\n */\nconst exclude = [\n    \"stackoverflow\\.com\",\n    \"openclassrooms\\.com\",\n    \"php\\.net\",\n    \"dev\",\n    \"forum(s)?\"\n]\n\nconst regexFlag = \"gmi\"\n\n```\n\n2. error.csv\n\nDon't edit the fisrt line\n```csv\nERROR \ninurl:id= \u0026 intext:\"Warning: mysql_fetch_assoc()\"\ninurl:id= \u0026 intext:\"Warning: query()\"\ninurl:id= \u0026 intext:\"Warning: mysql_fetch_array()\"\ninurl:id= \u0026 intext:\"Warning: mysql_num_rows()\"\ninurl:id= \u0026 intext:\"Warning: mysql_result()\"\ninurl:id= \u0026 intext:\"Warning: pg_exec()\"\ninurl:id= \u0026 intext:\"Warning: mysql_result()\"\ninurl:id= \u0026 intext:\"Warning: mysql_num_rows()\"\ninurl:id= \u0026 intext:\"Warning: mysql_query()\"\n\n```\n\n\n## ISSUES\n\n### Issues n° 1\nThis script work only for french google.\n\nWatch in *pupperteer.js*. It's because of css selectors\n\n\u003e**Solution** : [X]\n\n### Issues n° 2\nThis script is caught as a robot, often, after **~35** query.\n\n\u003e**Solution** :    \n\u003e- connect the script to a vpn and change of vpn each 25 query\n\u003e- connect the script to a google account and manage the reCaptcha (which already trust you)\n\u003e- Install an extension which solve the recaptcha like [Buster](https://chrome.google.com/webstore/detail/buster-captcha-solver-for/mpbjkejclgfgadiemmefgebjfooflfhl)\n\n## To improve it\n\nAs well as solve these two issues, it's could be good to :\n\n- Make possible to save information in another format than *.txt*\n- Make a file with words to exclude instead of config file  \n- Make one command line system to catch MySQL Error with one command line\n- Make a GUI interface","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyr72dpi%2Fmysql_error_google_scrapper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyr72dpi%2Fmysql_error_google_scrapper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyr72dpi%2Fmysql_error_google_scrapper/lists"}