{"id":20544398,"url":"https://github.com/toddbirchard/lambda-metadata-scraper","last_synced_at":"2025-04-14T09:52:30.971Z","repository":{"id":48061518,"uuid":"276987652","full_name":"toddbirchard/lambda-metadata-scraper","owner":"toddbirchard","description":"🟩 🌐 Netlify Lambda function to scrape metadata from a target URL.","archived":false,"fork":false,"pushed_at":"2022-01-19T14:26:58.000Z","size":11126,"stargazers_count":4,"open_issues_count":3,"forks_count":3,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-27T23:11:22.584Z","etag":null,"topics":["go","golang","lambda","lambda-functions","netlify","scrape","scraper","serverless"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/toddbirchard.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-07-03T21:08:39.000Z","updated_at":"2022-10-19T22:24:18.000Z","dependencies_parsed_at":"2022-08-12T17:41:00.210Z","dependency_job_id":null,"html_url":"https://github.com/toddbirchard/lambda-metadata-scraper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/toddbirchard%2Flambda-metadata-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/toddbirchard%2Flambda-metadata-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/toddbirchard%2Flambda-metadata-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/toddbirchard%2Flambda-metadata-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/toddbirchard","download_url":"https://codeload.github.com/toddbirchard/lambda-metadata-scraper/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248860015,"owners_count":21173339,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["go","golang","lambda","lambda-functions","netlify","scrape","scraper","serverless"],"created_at":"2024-11-16T01:44:15.133Z","updated_at":"2025-04-14T09:52:30.914Z","avatar_url":"https://github.com/toddbirchard.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Lambda Metadata Scraper\n\n![Go](https://img.shields.io/badge/Go-1.17.6-blue.svg?logo=go\u0026longCache=true\u0026logoColor=white\u0026colorB=88C0D0\u0026style=flat-square\u0026colorA=4c566a)\n![Goquery](https://img.shields.io/badge/Goquery-1.8.0-blue.svg?logo=go\u0026longCache=true\u0026logoColor=white\u0026colorB=88C0D0\u0026style=flat-square\u0026colorA=4c566a)\n![AWS Lambda](https://img.shields.io/badge/AWS--Lambda-1.28.0-blue.svg?logo=go\u0026longCache=true\u0026logoColor=white\u0026colorB=88C0D0\u0026style=flat-square\u0026colorA=4c566a)\n![GitHub Last Commit](https://img.shields.io/github/last-commit/google/skia.svg?style=flat-square\u0026colorA=4c566a\u0026colorB=a3be8c\u0026logo=GitHub)\n[![GitHub Issues](https://img.shields.io/github/issues/toddbirchard/lambda-metadata-scraper.svg?style=flat-square\u0026colorA=4c566a\u0026colorB=ebcb8b\u0026logo=GitHub)](https://github.com/toddbirchard/lambda-metadata-scraper/issues)\n[![GitHub Stars](https://img.shields.io/github/stars/toddbirchard/lambda-metadata-scraper.svg?style=flat-square\u0026colorB=ebcb8b\u0026colorA=4c566a\u0026logo=GitHub)](https://github.com/toddbirchard/lambda-metadata-scraper/stargazers)\n[![GitHub Forks](https://img.shields.io/github/forks/toddbirchard/lambda-metadata-scraper.svg?style=flat-square\u0026colorA=4c566a\u0026colorB=ebcb8b\u0026logo=GitHub)](https://github.com/toddbirchard/lambda-metadata-scraper/network)\n\nLambda function which returns basic metadata for a single URL provided as a `?url` querystring parameter. Intended to be deployed as an endpoint served with Netlify functions.\n\n### Example Usage\n\n* Request Type: `GET`\n* Endpoint: `https://hackersandslackers.com/.netlify/functions/scrape`\n* Parameter: `?url=[TARGET_URL]`\n\n```bash\n$ curl https://hackersandslackers.com/.netlify/functions/scrape?url=https://toddbirchard.com \\\n   -H \"Content-Type: application/json\"\n```\n\n**Response:**\n\n```json\n{\n   \"Title\": \"Todd Birchard: Engineering, Product, Technology.\",\n   \"Image\": \"https://storage.googleapis.com/toddbirchard-cdn/2019/08/cover.jpeg\",\n   \"Description\": \"Giant reptile giving technology a good name. Occasional tangents of mass destruction. Made in Silicon Alley.\",\n   \"Favicon\": \"/icons/icon-48x48.png\"\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftoddbirchard%2Flambda-metadata-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftoddbirchard%2Flambda-metadata-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftoddbirchard%2Flambda-metadata-scraper/lists"}