{"id":20067807,"url":"https://github.com/dean9703111/humandesign_nodejs","last_synced_at":"2026-05-15T01:32:35.089Z","repository":{"id":39998012,"uuid":"275961251","full_name":"dean9703111/humandesign_nodejs","owner":"dean9703111","description":"用nodejs爬蟲工具將人類圖網頁上的資訊爬下來，再存到雲端的google excel","archived":false,"fork":false,"pushed_at":"2022-12-11T12:06:03.000Z","size":110,"stargazers_count":1,"open_issues_count":3,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-10-20T23:34:51.344Z","etag":null,"topics":["crawler","googlesheetapi","googlesheets","nodejs"],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dean9703111.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-06-30T01:00:58.000Z","updated_at":"2020-09-13T03:13:05.000Z","dependencies_parsed_at":"2023-01-26T22:45:36.195Z","dependency_job_id":null,"html_url":"https://github.com/dean9703111/humandesign_nodejs","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/dean9703111/humandesign_nodejs","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dean9703111%2Fhumandesign_nodejs","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dean9703111%2Fhumandesign_nodejs/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dean9703111%2Fhumandesign_nodejs/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dean9703111%2Fhumandesign_nodejs/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dean9703111","download_url":"https://codeload.github.com/dean9703111/humandesign_nodejs/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dean9703111%2Fhumandesign_nodejs/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33050193,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-13T13:14:54.681Z","status":"online","status_checked_at":"2026-05-14T02:00:06.663Z","response_time":57,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","googlesheetapi","googlesheets","nodejs"],"created_at":"2024-11-13T14:03:53.496Z","updated_at":"2026-05-15T01:32:35.060Z","avatar_url":"https://github.com/dean9703111.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# humandesign_nodejs\n\n基本上這個專案是應朋友之邀來做的實驗性project  \n\n### 專案目標\n1. 能成功抓取網頁資料\n2. 能依據class來分析所需要的資訊\n3. 將抓取到的資料塞到雲端google excel\n\n### 專案技術\n1. nodejs\n2. npm相關爬蟲套件\n3. google 雲端相關api\n\n### 安裝套件\n```\nyarn\n```\n### 套件說明\n1. cheerio: 把它當成 jquery，可以做標籤的擷取\n2. request: 把他想像成 ajax 撈取網頁資料的請求方式，可以把整個網頁的 HTML 抓取下來\n3. dotenv: 抓.env的環境設定檔\n4. googleapis: 存取google sheets相關api\n\n\n## 啟動node \u0026\u0026 開啟google sheets授權\n請先依照[google sheets api 教學](https://developers.google.com/sheets/api/quickstart/nodejs)完成申請\n接著下指令\n```\nnode index.js\n```\n然後會跳出一個網址讓你去得到認證碼  \n複製貼上後就能把資料寫進去google sheets嚕\n\n\n### 錯誤處理(這是google sheets權限不足時會有的問題)\n[GaxiosError: Insufficient Permission](https://www.itread01.com/content/1525348938.html)\n\n\n### 參考資訊\n[google sheets api 教學](https://developers.google.com/sheets/api/quickstart/nodejs)\n[Oxxo做個簡單的爬蟲](https://www.oxxostudio.tw/articles/201512/spider-basic.html)\n[Node.js 爬蟲](https://andy6804tw.github.io/2018/02/11/nodejs-crawler/)","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdean9703111%2Fhumandesign_nodejs","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdean9703111%2Fhumandesign_nodejs","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdean9703111%2Fhumandesign_nodejs/lists"}