{"id":26413044,"url":"https://github.com/devscanr/extractors","last_synced_at":"2025-10-06T00:33:25.254Z","repository":{"id":257907700,"uuid":"865317393","full_name":"devscanr/extractors","owner":"devscanr","description":null,"archived":false,"fork":false,"pushed_at":"2024-10-29T13:14:05.000Z","size":971,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-10-29T14:33:42.757Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/devscanr.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-09-30T10:37:38.000Z","updated_at":"2024-10-29T13:14:09.000Z","dependencies_parsed_at":"2024-11-06T10:39:25.898Z","dependency_job_id":"ddafbe6d-10e2-457f-a618-d5f094e422f1","html_url":"https://github.com/devscanr/extractors","commit_stats":null,"previous_names":["devscanr/extractors"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/devscanr/extractors","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devscanr%2Fextractors","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devscanr%2Fextractors/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devscanr%2Fextractors/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devscanr%2Fextractors/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/devscanr","download_url":"https://codeload.github.com/devscanr/extractors/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devscanr%2Fextractors/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":278542644,"owners_count":26004060,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-05T02:00:06.059Z","response_time":54,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-03-17T22:53:52.295Z","updated_at":"2025-10-06T00:33:25.220Z","avatar_url":"https://github.com/devscanr.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"## Extractors\n\nMine DEV related data from badly formatted texts:\n\n- `category`: categorize small texts (like GH bios): infer dev/nondev roles and extra flags;\n- `contacts`: extract emails, phones, websites;\n- `language`: detect used language (human);\n- `skills`: extract tech. skills with rule-based system (spaCy);\n\n--\n\n## Phone Extractor\n\n### Recognizes\n\n- International format (e.g `+49 30 xxxxxxxx`)\n- Preceded by trigger words (e.g. `Phone: xxx`, `Whatsapp: xxx`)\n- Preceded by unicode emojis (e.g. `📞 xxx`)\n- From URLs (e.g. `t.me/xxxxxxxx`)\n\n### Rejected existing libraries\n\n- https://github.com/daviddrysdale/python-phonenumbers\n- and more\n\n### Rejection notes\n\n#### Ambiguity\n\nPhone numbers, in general, are ambiguos. They can match numbers in math formulas,\ncrypto wallet ids, different card numbers, etc. To prevent false positives, we can't simply\ncapture anything \"resembling a phone\". Emails, at least, have globally unique formatting and while\nthere's always potential for ambiguity and contextuality (should we capture emails from markdown code),\nit's less likely to capture a non-email token as an email.\n\n#### Complexity\n\n`python-phonenumbers` in particular claims to take 12Mb of RAM just to load locale-specific\ndata. How much of that is really useful? People mistype numbers, forget to\nclose parentheses... You can't match against formats that are not obeyed, to begin with.\n\n#### Culture agnostic\n\n`python-phonenumbers` can parse properly formatted international numbers. In many cases \nyou have to provide a locale to disambiguate. This is inacceptable for real-world parsing \nwhere we often don't know the locale.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdevscanr%2Fextractors","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdevscanr%2Fextractors","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdevscanr%2Fextractors/lists"}