{"id":19639297,"url":"https://github.com/mikestreety/data-collector","last_synced_at":"2025-02-26T22:25:06.002Z","repository":{"id":80706178,"uuid":"604339461","full_name":"mikestreety/data-collector","owner":"mikestreety","description":null,"archived":false,"fork":false,"pushed_at":"2024-01-30T09:58:35.000Z","size":115,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":4,"default_branch":"main","last_synced_at":"2025-02-09T22:48:26.354Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mikestreety.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-02-20T21:11:41.000Z","updated_at":"2024-01-30T09:57:27.000Z","dependencies_parsed_at":"2024-11-11T12:45:51.794Z","dependency_job_id":"3293afd3-110d-4e2a-aa7f-75d9ee3ec46e","html_url":"https://github.com/mikestreety/data-collector","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikestreety%2Fdata-collector","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikestreety%2Fdata-collector/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikestreety%2Fdata-collector/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikestreety%2Fdata-collector/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mikestreety","download_url":"https://codeload.github.com/mikestreety/data-collector/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240943366,"owners_count":19882387,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-11T12:45:45.849Z","updated_at":"2025-02-26T22:25:05.952Z","avatar_url":"https://github.com/mikestreety.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Data Collector\n\nBuilt with https://oclif.io/\n\n- [Data Collector](#data-collector)\n\t- [Installation](#installation)\n\t\t- [Global](#global)\n\t- [Services](#services)\n\t\t- [Webmentions](#webmentions)\n\t\t- [RSS](#rss)\n\t\t- [Letterboxd](#letterboxd)\n\t- [Roadmap](#roadmap)\n\t- [Releasing](#releasing)\n\n## Installation\n\n```\nnpm i @mikestreety/data-collector\n```\n\nYou can then access it with the following:\n\n```\n./node_modules/.bin/datacollector\n```\n\nIn your `package.json`, you can add specific commands or a shortcut to the main command\n\n```json\n\"scripts\": {\n  \"datacollector\": \"datacollector\"\n},\n```\n\nWith this set, you can pass in your commands to a slightly shorter (and more memorable) command:\n\n```bash\nnpm run datacollector -- letterboxd letterboxd.json -u mikestreety\n```\n\n### Global\n\nYou can install it globally if you wish\n\n```\nnpm i -g @mikestreety/data-collector\n```\n\nWhich would allow you to run `datacollector` in your terminal\n\n## Services\n\n### Webmentions\n\n\n- `-d`, `--domain` - the domain to get the webmentions from\n- `-t`, `--token` - your webmentions token from https://webmention.io/settings\n\n```\ndatacollector webmentions webmentions.json --domain www.mikestreety.co.uk --token 123456\n```\n\nCode adapted from [Max Böck](https://mxb.dev/)'s [11ty Webmentions repo](https://github.com/maxboeck/eleventy-webmentions)\n\n### RSS\n\nAny RSS feed provided (or searches for RSS) of a given domain\n\n- `-f`, `--feed` - the RSS feed\n- `-d`, `--domain` - the domain to search for the RSS feeds\n\n```\ndatacollector rss rss.json -f https://www.mikestreety.co.uk/rss-notes.xml\n```\n\nor\n\n```\ndatacollector rss rss.json -d www.mikestreety.co.uk\n```\n\n### Letterboxd\n\nGet the films for a user from letterboxd\n\n- `-u`, `--username` - the Letterboxd username\n\n```\ndatacollector letterboxd letterboxd.json -u mikestreety\n```\n\n## Roadmap\n\n- Allow `.env` files\n- Create oAuth workflow\n- Add Strava\n\n## Releasing\n\nOnce ready to release, run the following\n\n- `npm version (major|minor|patch)`\n- `npm publish`\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikestreety%2Fdata-collector","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmikestreety%2Fdata-collector","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikestreety%2Fdata-collector/lists"}