{"id":37094165,"url":"https://github.com/dayzerosec/feedgen","last_synced_at":"2026-01-14T11:36:08.233Z","repository":{"id":48656876,"uuid":"323151844","full_name":"dayzerosec/feedgen","owner":"dayzerosec","description":"Generates RSS/ATOM/JSON feeds. Can be reasonably extended or create a feed using the CSS generator.","archived":false,"fork":false,"pushed_at":"2024-06-21T05:32:00.000Z","size":71,"stargazers_count":16,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"main","last_synced_at":"2024-06-22T14:28:05.164Z","etag":null,"topics":["feed-generator"],"latest_commit_sha":null,"homepage":"https://dayzerosec.com","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dayzerosec.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-12-20T19:45:46.000Z","updated_at":"2024-06-21T05:32:03.000Z","dependencies_parsed_at":"2024-06-02T09:49:04.184Z","dependency_job_id":"ad3bbf2f-8359-4d8f-829f-90a90d0df4eb","html_url":"https://github.com/dayzerosec/feedgen","commit_stats":null,"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/dayzerosec/feedgen","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dayzerosec%2Ffeedgen","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dayzerosec%2Ffeedgen/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dayzerosec%2Ffeedgen/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dayzerosec%2Ffeedgen/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dayzerosec","download_url":"https://codeload.github.com/dayzerosec/feedgen/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dayzerosec%2Ffeedgen/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28419209,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-14T10:47:48.104Z","status":"ssl_error","status_checked_at":"2026-01-14T10:46:19.031Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["feed-generator"],"created_at":"2026-01-14T11:36:07.582Z","updated_at":"2026-01-14T11:36:08.227Z","avatar_url":"https://github.com/dayzerosec.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# feedgen\n\nAs Part of the [DAY[0] Podcast](https://dayzerosec.com) I've found myself following a lot of feeds.\n\nUnfortunately, many solid blogs do not provide feeds. I attempted to use a variety of services to generate feeds but was not too happy with most. While all the features I needed existed across several programs, none provided all the customizability I wanted. Notably parsing dates is pretty important as something I never want is to add a feed and find myself with a ton of entries added to the top of my aggregator because the date wasn't supported.\n\nThis isn't necessarily easy to use, but if you're familiar with CSS it shouldn't be too painful.\n\nIf you're only interested in the feeds that this already outputs, I generate all these feeds and currently output them to https://little-canada.org/feeds/output/ \n\n### General Usage\n\n`./feedgen -f [feed generator type] -t [output type] -o [output file] -w [working directory] [-c config file]` \n\n**-f [feed generator type]**\n\nThere are currently five supported feed types:\n \n - `h1` which runs the Hackerone generator, which tracks the [latest disclosed Hacktivity](https://hackerone.com/hacktivity?querystring=\u0026filter=type:public\u0026order_direction=DESC\u0026order_field=latest_disclosable_activity_at\u0026followed_only=false) generator\n - `p0` which runs the ProjectZero generator, which tracks the [Project Zero issues list](https://bugs.chromium.org/p/project-zero/issues/list?q=\u0026can=1\u0026sort=-id). One important note about this one is that the feed does not grab dates so it is only accurate after it has been running. The first feed generated will be be based purely on ids.\n - `p0rca` which runs the Project Zero Root Cause Analysis generator, which tracks the [Project Zero Root Cause Analysis list](https://googleprojectzero.github.io/0days-in-the-wild/rca.html)\n - `pl` which runs the PentesterLand Writeups generator tracking the writeups published on [Pentester.Land](https://pentester.land/writeups/)\n - `css` is the more generic and useful option. It takes in a config file (json) which defines CSS selectors to match page elements that represent different parts of the feed.\n\n**-t [output type]**\n\nMultiple output formats are supported and can be selected:\n\n - `rss`\n - `atom`\n - `json`\n\n**-o [output file]**\n\nOutput file is pretty much what is sounds like. Specify the file the feed will be written to. There is one special case:\n\n - `-` as a output file will write to stdout.\n\n**-w [working directory]**\n\nThis just tells the program a specific folder to write any state-related files. At present only the ProjectZero generator uses this to track which issues it has seen.\n\n**-c [config file]**\n\nThe configuration file is only necessary when using the CSS generator. This is how you tell the CSS generator what config to use.\n\n### CSS Configuration\n\nAll CSS Configs must have three fields:\n\n - url - This defines the URL that will be requested\n - title - A title for the feed\n - item_selectors - This is a dictionary containing CSS selectors.\n\n##### Item Selectors\n\nAny of the following selectors can be provided.\n\n - container - This selector will basically be used as a prefix for all following selectors. It should match each individual item that will end up in the feed.\n - id\n - title\n - author\n - description \n - content - *Content and Description both perform the same job.*\n - updated\n - created\n\nIf you use updated or created you must also provide a `updated_format` or `created_format`. These are passed directly in [time.Parse](https://golangbyexample.com/parse-time-in-golang/)\n\nIf you don't want to read the docs, the basic idea if you just write out the date for `01/02 03:04:05PM '06 -0700` (or in a more readable form: `Mon Jan 2 15:04:05 MST 2006`)\n\nFor example if a blog used the format: January 09, 2021 @ 9:01 am you would write the `_format` date as. `January 02, 2006 @ 3:04 am`\n\n##### Writting Selectors\n\nCSS isn't the greatest tool for the job, but when all you have is a hammer, everything looks like a nail. CSS has been quite capable of matching precisely what I need. `:first-of-type` `:nth-of-type(n)` and `:not(...negative selection here...)` have been very useful to know about.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdayzerosec%2Ffeedgen","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdayzerosec%2Ffeedgen","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdayzerosec%2Ffeedgen/lists"}