{"id":25054610,"url":"https://github.com/delabi/typescript-scraper","last_synced_at":"2026-04-08T16:31:05.927Z","repository":{"id":191837494,"uuid":"591000086","full_name":"delabi/typescript-scraper","owner":"delabi","description":"A website scraper, API generator and backend for sugar price data around Africa build on Node.JS, ExpressJS, TypeORM and Axios","archived":false,"fork":false,"pushed_at":"2023-01-28T03:35:57.000Z","size":141,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-31T07:44:01.972Z","etag":null,"topics":["axios-restful","database","expressjs","nodejs","typeorm","typescript"],"latest_commit_sha":null,"homepage":"https://sugar-scraper.onrender.com/sugars","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/delabi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-01-19T17:48:33.000Z","updated_at":"2023-01-23T20:50:59.000Z","dependencies_parsed_at":"2023-09-01T03:13:16.236Z","dependency_job_id":null,"html_url":"https://github.com/delabi/typescript-scraper","commit_stats":null,"previous_names":["delabi/typescript-scraper"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/delabi/typescript-scraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/delabi%2Ftypescript-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/delabi%2Ftypescript-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/delabi%2Ftypescript-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/delabi%2Ftypescript-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/delabi","download_url":"https://codeload.github.com/delabi/typescript-scraper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/delabi%2Ftypescript-scraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31564777,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-08T14:31:17.711Z","status":"ssl_error","status_checked_at":"2026-04-08T14:31:17.202Z","response_time":54,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["axios-restful","database","expressjs","nodejs","typeorm","typescript"],"created_at":"2025-02-06T12:17:40.791Z","updated_at":"2026-04-08T16:31:05.891Z","avatar_url":"https://github.com/delabi.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"This is the backend of the sugar index application.\n\nIt handles\n1. Sugar information Scrapper from 3 jumia websites: Kenya, Uganda and Nigeria every 6 hours.\n2. Stores the scrapped data in a PostgreSQL database via TypeORM.\n3. Type ORM also Generates a REST API that can be used to consume the data.\n\nSteps to run this project after cloning this repository:\n\n1. Run `npm i` command in the project folder to install dependencies\n2. Setup database settings inside `data-source.ts` file\n3. Run `npm start` commands\n\nThe live application is running on https://sugar-scraper.onrender.com/sugars\nYou will be able to access the api locally using https://localhost:3000/sugars\n\nFrom there you can access the REST API with information about sugar prices obtained from the Jumia Websites.\n\nThe current POSGTRES database is hosted on AWS RDS and the configurations are in the datasource.ts file.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdelabi%2Ftypescript-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdelabi%2Ftypescript-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdelabi%2Ftypescript-scraper/lists"}