{"id":23613632,"url":"https://github.com/publishername/software-company-profiler","last_synced_at":"2025-11-06T09:30:33.799Z","repository":{"id":269951439,"uuid":"908941664","full_name":"PublisherName/Software-Company-Profiler","owner":"PublisherName","description":"SoftwareCompanyProfiler is a tool for extracting and organizing detailed information about software companies. It gathers contact details, career opportunities, LinkedIn links, office locations, and other key insights, streamlining research and decision-making for businesses, recruiters, and professionals.","archived":false,"fork":false,"pushed_at":"2025-01-03T11:55:00.000Z","size":16,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-03T12:39:57.707Z","etag":null,"topics":["scraper"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/PublisherName.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-12-27T10:53:27.000Z","updated_at":"2025-01-03T11:55:03.000Z","dependencies_parsed_at":"2024-12-27T12:29:03.238Z","dependency_job_id":null,"html_url":"https://github.com/PublisherName/Software-Company-Profiler","commit_stats":null,"previous_names":["publishername/software-company-profiler"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PublisherName%2FSoftware-Company-Profiler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PublisherName%2FSoftware-Company-Profiler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PublisherName%2FSoftware-Company-Profiler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PublisherName%2FSoftware-Company-Profiler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/PublisherName","download_url":"https://codeload.github.com/PublisherName/Software-Company-Profiler/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":239491349,"owners_count":19647810,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["scraper"],"created_at":"2024-12-27T17:18:28.101Z","updated_at":"2025-11-06T09:30:33.761Z","avatar_url":"https://github.com/PublisherName.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"## Software Company Profiler\n\nSoftware Company Profiler is a comprehensive solution for extracting and organizing detailed information about software companies. It efficiently gathers critical data, including contact details, career opportunities, LinkedIn profiles, office locations, and other key insights, enabling businesses and professionals to streamline research, networking, and decision-making.\n\n## Installation\n\n1. Clone the repository\n```bash\ngit clone git@github.com:PublisherName/Software-Company-Profiler.git\n```\n2. Change the directory to the project directory\n```bash\ncd Software-Company-Profiler\n```\n3. Create a virtual environment using the following command:\n```bash\npython3 -m venv .venv\n```\n4. Activate the virtual environment\n```bash\nsource .venv/bin/activate\n```\n5. Install the required packages using the following command:\n```bash\npip install -r requirements.txt\n```\n\n6. Run the following command to start the web scraper:\n```bash\nscrapy crawl \u003cscraper\u003e -o \u003cfilename\u003e -a url=\"\u003curl_to_scrape\u003e\"\n```\n7. To manually populate the data, run the following command:\n```bash\npython main.py \u003coption\u003e --file \u003cfile_name\u003e\n```\noptions:\n- `--update` : Update the data\n- `--view` : Search the data\n- `--add` : Add the data\n\n\n## CSV FORMAT\n\n| name        | address     | city      | website      | career page  | email       | linkedIn    | phone       |\n|-------------|-------------|-----------|--------------|--------------|-------------|-------------|-------------|\n|             |             |           |              |              |             |             |             |\n\n\n## Supported Websites\n\n## 1. [NepalYP](https://www.nepalyp.com/)\n\n### Usage:\n\n```bash\nscrapy crawl nepalyp -o nepalyp.csv -a url=\"https://www.nepalyp.com/category/Software_applications\"\n```\n\n## 2. [Techbehemoths](https://techbehemoths.com/)\n\n### Usage:\n\n```bash\nscrapy crawl techbehemoths -o techbehemoths.csv -a url=\"https://techbehemoths.com/companies/nepal\"\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpublishername%2Fsoftware-company-profiler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpublishername%2Fsoftware-company-profiler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpublishername%2Fsoftware-company-profiler/lists"}