{"id":18373110,"url":"https://github.com/thanatisia/py-web-utils","last_synced_at":"2025-07-23T15:40:08.728Z","repository":{"id":231893149,"uuid":"782972795","full_name":"Thanatisia/py-web-utils","owner":"Thanatisia","description":"Webscraper CLI utilities and implementations focused on YouTube (and other video source) titles","archived":false,"fork":false,"pushed_at":"2024-05-05T01:46:46.000Z","size":53,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-06-23T01:37:08.587Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Thanatisia.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOGS.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-04-06T15:19:41.000Z","updated_at":"2024-05-05T01:46:09.000Z","dependencies_parsed_at":"2024-04-29T01:41:56.945Z","dependency_job_id":"cfa58b21-5fbb-4b35-8d42-786631b2e3c9","html_url":"https://github.com/Thanatisia/py-web-utils","commit_stats":null,"previous_names":["thanatisia/py-webscraper-yt"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Thanatisia/py-web-utils","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Thanatisia%2Fpy-web-utils","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Thanatisia%2Fpy-web-utils/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Thanatisia%2Fpy-web-utils/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Thanatisia%2Fpy-web-utils/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Thanatisia","download_url":"https://codeload.github.com/Thanatisia/py-web-utils/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Thanatisia%2Fpy-web-utils/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266706638,"owners_count":23971904,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-23T02:00:09.312Z","response_time":66,"last_error":null,"robots_txt_status":null,"robots_txt_updated_at":null,"robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-06T00:08:43.736Z","updated_at":"2025-07-23T15:40:08.703Z","avatar_url":"https://github.com/Thanatisia.png","language":"Python","readme":"Network/Web Application Webscraper CLI libraries, utilities and implementations\n===============================================================================\n\n## Information\n### Description\n- Collection of useful webscraper CLI utilities powered by BeautifulSoup\n    + With this being based around Video searches and obtaining information via HTML Parsing\n\n### Package\n+ Version: v0.5.0\n\n### Scripts\n+ urltitlextr : Previously named yt-obtain-url, This is a Simple URL title extractor CLI utility that does 1 thing - extracts title from a given (or set of) URLs and returns it in a new file\n\n### DISCLAIMER\n+ This is for educational and for trial and error and testing purposes only\n+ Please do not use this for any illegal purposes (if applicable)\n\n## Setup\n### Dependencies\n+ python\n+ python-pip\n+ python-venv\n\n### Pre-Requisites\n- Create Python Virtual Environment\n    - Generate Virtual Environment\n        ```bash\n        python3 -m venv [virtual-environment-name]\n        ```\n    - Chroot into Virtual Environment\n        - Linux-based\n            ```bash\n            . [virtual-environment-name]/bin/activate\n            ```\n        - Windows-based\n            ```bash\n            .\\[virtual-environment-name]\\Scripts\\activate\n            ```\n\n- Optionals\n    - Append the Virtual Environment directories into system path\n        - 'bin' (binaries) directory\n            ```bash\n            export PATH+=\"/path/to/[virtual-environment-name]/bin:\"\n            ```\n\n### Installation\n- Install using pip\n    ```bash\n    pip install git+https://github.com/Thanatisia/py-web-utils\n    ```\n\n- Install from requirements.txt\n    - Include the project repository url mapped to the package name in 'requirements.txt'\n        ```\n        web-utils @ git+https://github.com/Thanatisia/py-web-utils\n        ```\n    - Install python package dependencies\n        ```bash\n        python3 -m pip install -Ur requirements.txt\n        ```\n\n- Install locally in development mode\n    - Clone repository\n        ```bash\n        git clone https://github.com/Thanatisia/py-web-utils\n        ```\n    - Change directory into repository\n        ```bash\n        cd frameworks/beautifulsoup4/apps/youtube\n        ```\n    - Install python package dependencies\n        ```bash\n        python3 -m pip install -Ur requirements.txt\n        ```\n    - (Optional) Uninstall package\n        ```bash\n        pip uninstall web-utils\n        ```\n    - Install locally in development mode\n        ```bash\n        pip install .\n        ```\n\n## Documentations\n\n## Resources\n\n## References\n\n## Remarks\n\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fthanatisia%2Fpy-web-utils","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fthanatisia%2Fpy-web-utils","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fthanatisia%2Fpy-web-utils/lists"}