{"id":20002516,"url":"https://github.com/mirkoschubert/feeder","last_synced_at":"2025-06-22T13:08:34.941Z","repository":{"id":96509409,"uuid":"99516805","full_name":"mirkoschubert/feeder","owner":"mirkoschubert","description":"Feed and Web Scraper","archived":false,"fork":false,"pushed_at":"2021-09-16T16:58:48.000Z","size":3871,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-06-22T13:08:28.008Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mirkoschubert.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-08-06T22:28:16.000Z","updated_at":"2021-09-16T16:58:51.000Z","dependencies_parsed_at":"2023-03-13T16:30:21.047Z","dependency_job_id":null,"html_url":"https://github.com/mirkoschubert/feeder","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/mirkoschubert/feeder","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mirkoschubert%2Ffeeder","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mirkoschubert%2Ffeeder/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mirkoschubert%2Ffeeder/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mirkoschubert%2Ffeeder/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mirkoschubert","download_url":"https://codeload.github.com/mirkoschubert/feeder/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mirkoschubert%2Ffeeder/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":261296968,"owners_count":23137221,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-13T05:21:57.640Z","updated_at":"2025-06-22T13:08:29.928Z","avatar_url":"https://github.com/mirkoschubert.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Feeder CLI\n\n**Feeder** is a command-line interface to parse multiple feeds, scrape some extra information such as meta data from websites and export new feed entries for multiple uses. It mainly will be used observing and collecting data for a dictionary website.\n\n## Installation\n\nSince Feeder is written for node.js installing is pretty easy. Fork or download the code and switch to the working folder, then just type the following command in your shell:\n\n```\nnpm install --global\n```\nAfter the first release it also will be available as a npm package.\n\n## Usage\n\n### Add feed to the queue\n\nTo generate a queue of multiple feeds just type the following command in your shell:\n\n```\nfeeder add domain.com\n```\n\nSimply follow the instructions on screen. You will be asked for a name which represents the Feed. It will auto-discover the feed and ask for validation if there are found more than one feed. You can also enter full URLs or a specific Feed URL.\n\nThe queue list will be saved in the directory of the package under `/data/feeds.json`. Soon it will be possible to specify an alternate path.\n\n### List the whole queue\n\nTo show all feeds in the queue please type this command in your shell:\n\n```\nfeeder list\n```\n\nIt will display the name and url of each feed as well as a short description, which has been parsed from the `og:dscription` or `description` meta data of the home page.\n\n## Roadmap\n\n- [x] Add Feed to the queue\n- [x] List the whole queue\n- [x] Check for broken feed links\n- [x] Remove broken feed links\n- [x] Retrieve any new data from a feed url\n- [ ] Retrieve and save any new data from all feeds of the queue\n- [ ] Read new feed entries in plain text\n- [ ] Save any article as text, markdown or html\n- [ ] Export any new feed entries to a file as CSV, XML, JSON or HTML\n- [ ] Set up a basic configuration for using multiple instances of the Feeder command and saving the data outside the package\n\n## License \u0026 Contribution\n\nThis software is licensed under the MIT License.\n\nSince I'm new to node.js and asynchronous JavaScript programming and this is actually my first attempt I will be glad for any hints and best practices. Feel free to contact me or contribute with a fork of this project!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmirkoschubert%2Ffeeder","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmirkoschubert%2Ffeeder","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmirkoschubert%2Ffeeder/lists"}