{"id":17809576,"url":"https://github.com/ldd/anime_rankings","last_synced_at":"2025-07-10T22:07:29.519Z","repository":{"id":47973999,"uuid":"205700041","full_name":"ldd/anime_rankings","owner":"ldd","description":"anime rankings fetcher for MAL","archived":false,"fork":false,"pushed_at":"2021-08-11T10:20:38.000Z","size":91,"stargazers_count":0,"open_issues_count":4,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-02T06:33:52.257Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ldd.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-09-01T16:02:25.000Z","updated_at":"2020-07-18T12:14:18.000Z","dependencies_parsed_at":"2022-08-12T15:40:30.364Z","dependency_job_id":null,"html_url":"https://github.com/ldd/anime_rankings","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/ldd/anime_rankings","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ldd%2Fanime_rankings","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ldd%2Fanime_rankings/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ldd%2Fanime_rankings/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ldd%2Fanime_rankings/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ldd","download_url":"https://codeload.github.com/ldd/anime_rankings/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ldd%2Fanime_rankings/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":264674661,"owners_count":23647840,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-27T15:19:55.541Z","updated_at":"2025-07-10T22:07:29.462Z","avatar_url":"https://github.com/ldd.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Anime ranking crawler\n\nThis small collection of scripts will fetch data from [MAL](https://myanimelist.net/) every day.\n\nThe idea is to get the daily score changes for each airing show.\n\nIf you have an instance on GCP, Azure, AWS, etc, simply run\n\n\u003e `PG_PASSWORD=hunter2 ./scripts/setup.sh`\n\nto install everything on your host, create a systemd service, etc.\n\nIf you only want to crawl things once, or have no need for a service:\n\n1. `yarn`\n2. `PGPASSWORD=hunter2 node creator.js`\n3. `PGPASSWORD=hunter2 node crawler.js`\n\n\u003e Notice that the underscore from `PG_PASSWORD` is gone. This is intentional\n\n## Other useful commands:\n\n- check the state of systemd timers\n\n  `systemctl list-timers`\n\n- copy files to a GCP instance (e.g: `interceptor-01`)\n\n  `gcloud compute scp --recurse git/anime_rankings/scripts worker@interceptor-01:~/git/anime_rankings`\n\n- [dump database](https://www.postgresql.org/docs/8.0/backup.html)\n\n  `pg_dump $PG_USER \u003e dump.sql`\n\n- [restore from dump](https://www.postgresql.org/docs/8.0/backup.html)\n\n  `psql $PG_USER \u003c dump.sql`\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fldd%2Fanime_rankings","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fldd%2Fanime_rankings","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fldd%2Fanime_rankings/lists"}