{"id":13639936,"url":"https://github.com/minhhungit/github-action-rss-crawler","last_synced_at":"2025-07-15T16:31:25.202Z","repository":{"id":39408069,"uuid":"286283919","full_name":"minhhungit/github-action-rss-crawler","owner":"minhhungit","description":"Auto crawl RSS feeds using Github Action","archived":false,"fork":false,"pushed_at":"2025-06-28T04:06:01.000Z","size":6782874,"stargazers_count":33,"open_issues_count":0,"forks_count":12,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-06-28T05:21:46.408Z","etag":null,"topics":["crawler","csharp","github-actions","litedb","netcore","rss","rss-crawler","rss-items"],"latest_commit_sha":null,"homepage":"https://minhhungit.github.io/github-action-rss-crawler/","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/minhhungit.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2020-08-09T17:24:45.000Z","updated_at":"2025-06-28T04:06:05.000Z","dependencies_parsed_at":"2023-10-14T14:14:30.970Z","dependency_job_id":"ce931b7d-1c47-49d7-8e16-59d085bc118e","html_url":"https://github.com/minhhungit/github-action-rss-crawler","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/minhhungit/github-action-rss-crawler","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhhungit%2Fgithub-action-rss-crawler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhhungit%2Fgithub-action-rss-crawler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhhungit%2Fgithub-action-rss-crawler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhhungit%2Fgithub-action-rss-crawler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/minhhungit","download_url":"https://codeload.github.com/minhhungit/github-action-rss-crawler/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhhungit%2Fgithub-action-rss-crawler/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265445312,"owners_count":23766445,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","csharp","github-actions","litedb","netcore","rss","rss-crawler","rss-items"],"created_at":"2024-08-02T01:01:06.271Z","updated_at":"2025-07-15T16:31:23.925Z","avatar_url":"https://github.com/minhhungit.png","language":"HTML","funding_links":["https://ko-fi.com/I2I13GAGL'"],"categories":["HTML"],"sub_categories":[],"readme":"## Rss auto crawling using Github Action\n\n**Github Action does all these steps automatically, it run rss crawler every 4 hours**\n\nSteps:\n  - Github will pull repository, build and run crawler code (crawling code is C# (.net core), github will run it directly)\n  - Read channel urls from LiteDB\n  - Fetch rss feed items\n  - Insert feed items into LiteDB after checking blacklist and existing\n  - Generate all rss items to static page (index.html - https://minhhungit.github.io/github-action-rss-crawler/ )\n  - Commit change (litedb database \u0026 index.html page) and push to this repo\n\n  \n### Workflow\n```yml\non:\n  schedule:\n    # Runs every 4h\n    - cron: '0 */4 * * *'\n  workflow_dispatch:\n  \njobs:\n  update-readme-with-blog:\n    name: Crawl rss and generate static page\n    runs-on: windows-2019\n    steps:\n      - uses: actions/checkout@main\n        with:\n          repository: minhhungit/github-action-rss-crawler\n          token: ${{ secrets.GITHUB_TOKEN }}\n      - uses: actions/setup-dotnet@v1\n        with:\n          dotnet-version: 3.1.x\n      #- run: dotnet build DemoApp\\DemoApp.sln      \n      - run: dotnet run --project RssCrawler\\RssCrawler.csproj\n      - run: git config --local user.email \"it.minhhung@gmail.com\"\n      - run: git config --local user.name \"Jin\"\n      - run: git add .\n      - run: git commit -m \"Add changes\"\n      - run: git push\n```\n\n---\n\n### Demo\n\n\u003e https://minhhungit.github.io/github-action-rss-crawler/\n\n\u003cimg src=\"https://raw.githubusercontent.com/minhhungit/github-action-rss-crawler/master/images/demo.png\" /\u003e\n\n\n### Donate ^^\n**If you like my works and would like to support then you can buy me a coffee ☕️ anytime**\n\n\u003ca href='https://ko-fi.com/I2I13GAGL' target='_blank'\u003e\u003cimg height='36' style='border:0px;height:36px;' src='https://cdn.ko-fi.com/cdn/kofi4.png?v=2' border='0' alt='Buy Me a Coffee at ko-fi.com' /\u003e\u003c/a\u003e \n\n**I would appreciate it!!!**\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fminhhungit%2Fgithub-action-rss-crawler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fminhhungit%2Fgithub-action-rss-crawler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fminhhungit%2Fgithub-action-rss-crawler/lists"}