{"id":24317890,"url":"https://github.com/fulldecent/findchildcarewa.org-scraper","last_synced_at":"2025-09-27T02:30:41.373Z","repository":{"id":147413618,"uuid":"534395957","full_name":"fulldecent/findchildcarewa.org-scraper","owner":"fulldecent","description":"Converts website to CSV file","archived":false,"fork":false,"pushed_at":"2022-09-08T21:21:56.000Z","size":1,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-01-17T14:07:51.734Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/fulldecent.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-09-08T21:16:08.000Z","updated_at":"2022-09-08T21:16:08.000Z","dependencies_parsed_at":null,"dependency_job_id":"5ad9bccf-6258-4307-9caf-0dd7e57b1ad2","html_url":"https://github.com/fulldecent/findchildcarewa.org-scraper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/fulldecent/findchildcarewa.org-scraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fulldecent%2Ffindchildcarewa.org-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fulldecent%2Ffindchildcarewa.org-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fulldecent%2Ffindchildcarewa.org-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fulldecent%2Ffindchildcarewa.org-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/fulldecent","download_url":"https://codeload.github.com/fulldecent/findchildcarewa.org-scraper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fulldecent%2Ffindchildcarewa.org-scraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":277171402,"owners_count":25773204,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-27T02:00:08.978Z","response_time":73,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-01-17T14:04:32.899Z","updated_at":"2025-09-27T02:30:41.365Z","avatar_url":"https://github.com/fulldecent.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# findchildcarewa.org scraper\n\nThis project assists you to access the public data at findchildcarewa.org and save to a usable CSV file.\n\n## Why?\n\nThe findchildcarewa.org is the official website listing child care providers in Washington. The information is public and in response to a Washington right to know law request were a reference to the website.\n\n## Step 1 get keys\n\nThe website provides access keys for each data element.\n\n```sh\ncurl 'https://www.findchildcarewa.org/apexremote' \\\n  -H 'Content-Type: application/json' \\\n  -H 'Referer: https://www.findchildcarewa.org/PSS_Search?p=DEL%20Licensed' \\\n  --data-raw '{\"action\":\"PSS_SearchController\",\"method\":\"getSOSLKeys\",\"data\":[\"\",\"\",[\"DEL Licensed\"],[],null,null,null,[]],\"type\":\"rpc\",\"tid\":2,\"ctx\":{\"csrf\":\"1\",\"vid\":\"\",\"ns\":\"\",\"ver\":1}}' |\n  jq '.[0].result' \u003e keys.json\n```\n\n## Step 2 get result pages\n\nInstall node packages axios using Yarn.\n\nThen run this script.\n\n```javascript\nimport fs from 'fs';\nimport axios from 'axios';\nconst keysFile = fs.readFileSync('./keys.json');\nconst keys = JSON.parse(keysFile);\n\nfor (let i = 0; i \u003c keys.length; i+=10) {\n    const keysSlice = keys.slice(i, i+10);\n    console.log(i);\n\n    // Make synchronous HTTP request to get data\n    const response = await axios.post('https://www.findchildcarewa.org/apexremote', {\n        \"action\": \"PSS_SearchController\",\n        \"method\": \"queryProviders\",\n        \"data\": [keysSlice],\n        \"type\": \"rpc\",\n        \"tid\": 5,\n        \"ctx\": {\n            \"csrf\": \"1\",\n            \"vid\": \"\",\n            \"ns\": \"\",\n            \"ver\": 1\n        }\n    }, {\n        headers: {\n            'Content-Type': 'application/json',\n            'Referer': 'https://www.findchildcarewa.org/PSS_Search?p=DEL%20Licensed'\n        }\n    });\n\n    // Save data to file\n    fs.writeFileSync(`pages/${i}.json`, JSON.stringify(response.data));\n}\n```\n\n## Step 3 combine results\n\n```sh\ncat pages/*json | jq '.[0].result' | jq -s add \u003e all.json\n```\n\n## Step 3 convert to CSV\n\nInstall json2csv NPM CLI package. And then:\n\n```sh\njson2csv \u003c all.json \u003e all.csv\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffulldecent%2Ffindchildcarewa.org-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffulldecent%2Ffindchildcarewa.org-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffulldecent%2Ffindchildcarewa.org-scraper/lists"}