{"id":19045511,"url":"https://github.com/yoast/singer-tap-builtwith","last_synced_at":"2025-07-18T01:37:40.921Z","repository":{"id":49971009,"uuid":"371700252","full_name":"Yoast/singer-tap-builtwith","owner":"Yoast","description":null,"archived":false,"fork":false,"pushed_at":"2022-09-30T08:29:00.000Z","size":26,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":4,"default_branch":"main","last_synced_at":"2025-01-02T08:31:41.468Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"agpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Yoast.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-05-28T12:54:11.000Z","updated_at":"2021-08-17T16:16:25.000Z","dependencies_parsed_at":"2023-01-18T21:16:27.660Z","dependency_job_id":null,"html_url":"https://github.com/Yoast/singer-tap-builtwith","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Yoast%2Fsinger-tap-builtwith","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Yoast%2Fsinger-tap-builtwith/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Yoast%2Fsinger-tap-builtwith/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Yoast%2Fsinger-tap-builtwith/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Yoast","download_url":"https://codeload.github.com/Yoast/singer-tap-builtwith/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240102167,"owners_count":19747958,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-08T22:50:29.042Z","updated_at":"2025-02-21T23:41:00.016Z","avatar_url":"https://github.com/Yoast.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# tap-builtwith\n\nThis is a [Singer](https://singer.io) tap that produces JSON-formatted data\nfollowing the [Singer\nspec](https://github.com/singer-io/getting-started/blob/master/SPEC.md).\n\nThis tap:\n\n- Pulls raw data from [BuiltWith](https://api.builtwith.com/)\n- Extracts the following resources:\n  - [Trends](https://api.builtwith.com/trends-api)\n- Outputs the schema for each resource\n- Incrementally pulls data based on the input state\n\n### Step 1: Create an API key\n\nCreate an API key in BuiltWith\n\n### Step 2: Configure\n\nCreate a file called `builtwith_config.json` in your working directory, following [builtwith_config.json](builtwith_config.json). The required parameters is the `api_key`.\n\nThis requires a `state.json` file to let the tap know from when to retrieve data. For example:\n```json\n{\n    \"bookmarks\": {\n        \"trends\": {\n            \"start_date\": \"2021-05-26\"\n        }\n    }\n}\n```\nWill replicate data from those dates.\n\n### Step 3: Install and Run\n\nCreate a virtual Python environment for this tap. This tap has been tested with Python 3.7, 3.8 and 3.9 and might run on future versions without problems.\n```bash\npython -m venv singer-builtwith\nsinger-builtwith/bin/python -m pip install --upgrade pip\nsinger-builtwith/bin/pip install git+https://github.com/Yoast/singer-tap-builtwith.git\n```\n\nThis tap can be tested by piping the data to a local JSON target. For example:\n\nCreate a virtual Python environment with `singer-json`\n```\npython -m venv singer-json\nsinger-json/bin/python -m pip install --upgrade pip\nsinger-json/bin/pip install target-json\n```\n\nTest the tap:\n\n```\nsinger-builtwith/bin/tap-builtwith --state state.json -c builtwith_config.json | singer-json/bin/target-json \u003e\u003e state_result.json\n```\n\nCopyright \u0026copy; 2021 Yoast\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyoast%2Fsinger-tap-builtwith","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyoast%2Fsinger-tap-builtwith","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyoast%2Fsinger-tap-builtwith/lists"}