{"id":49072425,"url":"https://github.com/garybake/siteanalyzer","last_synced_at":"2026-04-20T08:06:52.306Z","repository":{"id":50156582,"uuid":"263925815","full_name":"garybake/siteanalyzer","owner":"garybake","description":"Determine topic of a website from classifying the images.","archived":false,"fork":false,"pushed_at":"2024-07-06T20:58:34.000Z","size":164,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2024-12-06T20:38:26.190Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/garybake.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-05-14T13:40:25.000Z","updated_at":"2024-07-06T20:58:30.000Z","dependencies_parsed_at":"2024-04-12T08:13:00.485Z","dependency_job_id":"ca7e33e7-2e66-4f8d-9b4b-2dc61e4a0655","html_url":"https://github.com/garybake/siteanalyzer","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/garybake/siteanalyzer","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/garybake%2Fsiteanalyzer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/garybake%2Fsiteanalyzer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/garybake%2Fsiteanalyzer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/garybake%2Fsiteanalyzer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/garybake","download_url":"https://codeload.github.com/garybake/siteanalyzer/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/garybake%2Fsiteanalyzer/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32038482,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-20T00:18:06.643Z","status":"online","status_checked_at":"2026-04-20T02:00:06.527Z","response_time":94,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-04-20T08:06:50.505Z","updated_at":"2026-04-20T08:06:52.296Z","avatar_url":"https://github.com/garybake.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"GB WebPage Classifier\n=====================\nApp to determine what a web page is about by classifying the image\n\nUses serverless aws architecture\n\nArchitecture\n============\n![Architecture](/docs/SiteAnalyzer.png)\n\nEndpoints\n=========\n## Get list of all registered sites \ncurl https://gbimmageclassifier.\u003cyourdomain\u003e/url/list \n\n## Get list of images for specific site\ncurl https://gbimmageclassifier.\u003cyourdomain\u003e/image/list?pageid=7213c7e3.www.garybake.com\n\n## Request analysis of web page\ncurl --header \"Content-Type: application/json\" \\\n  --request POST \\\n  --data '{\"url\":\"http://garybake.com\"}' \\\n  https://gbimmageclassifier.\u003cyourdomain\u003e/url/analyze\n\nAWS\n===\nCloudformation\nRoute53\nAPI gateway\nLambda\nS3\nDynamoDB\nSQS\nCloudwatch \n\nPython\n======\nBoto3\nBeautifulSoup\nRequests\n\nENV\n===\nNeeds the following environment variables set\n\nexport AWS_ACCOUNT_ID=***\nexport AWS_ACCESS_KEY_ID=***\nexport AWS_SECRET_ACCESS_KEY=***\nexport AWS_DEFAULT_REGION=***\n\nexport GBIMAGECLASSIFIER_BUCKET=***\nexport GBIMAGECLASSIFIER_TABLE=WebPage\nexport GBIMAGECLASSIFIER_CRAWLERQUEUE=CrawlerQueue\nexport GBIMAGECLASSIFIER_ANALYSISQUEUE=AnalysisQueue\nexport GBIMAGECLASSIFIER_DOMAIN=***\nexport GBIMAGECLASSIFIER_REGION=$AWS_DEFAULT_REGION\n\nTODO\n====\n\nFront end UI\nAdd ui-service to deploy.sh\nRefactor project layout\nMove boto objects out of functions\nAWS_DEFAULT_REGION is a reserved parameter (ui-service)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgarybake%2Fsiteanalyzer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgarybake%2Fsiteanalyzer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgarybake%2Fsiteanalyzer/lists"}