{"id":16434591,"url":"https://github.com/apertureless/whs-news-scrapper","last_synced_at":"2026-06-11T18:31:25.867Z","repository":{"id":66017228,"uuid":"44089982","full_name":"apertureless/whs-news-scrapper","owner":"apertureless","description":"A web scrapper for the w-hs.de news system that sends notifications to slack","archived":false,"fork":false,"pushed_at":"2020-05-01T05:42:24.000Z","size":7,"stargazers_count":0,"open_issues_count":2,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-11-18T18:07:14.264Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/apertureless.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2015-10-12T07:05:30.000Z","updated_at":"2020-07-30T12:30:51.000Z","dependencies_parsed_at":"2023-08-31T21:23:52.881Z","dependency_job_id":null,"html_url":"https://github.com/apertureless/whs-news-scrapper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/apertureless/whs-news-scrapper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apertureless%2Fwhs-news-scrapper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apertureless%2Fwhs-news-scrapper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apertureless%2Fwhs-news-scrapper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apertureless%2Fwhs-news-scrapper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/apertureless","download_url":"https://codeload.github.com/apertureless/whs-news-scrapper/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apertureless%2Fwhs-news-scrapper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34213180,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-11T02:00:06.485Z","response_time":57,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-11T08:49:37.029Z","updated_at":"2026-06-11T18:31:25.852Z","avatar_url":"https://github.com/apertureless.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Insider Scrapper\n\nA small scrapper for the news system of w-hs.de\nIt will scrap the messages and parse them. If new messages appear it sends a notification to slack.\n\n## Installation\nClone the repository\n\n```\ngit clone https://github.com/apertureless/whs-news-scrapper.git\n```\n\nInstall dependencies:\n\n```\nnpm install\n```\n\n## Configuration\n\nEdit the .env.example and rename it to .env\nGo to your slack team configuration and add antoher Incoming WebHook.\nCopy the url and paste it into the .env\nSet the channel, bot name and the refresh time in mins.\n\n```\nSLACK_HOOK_URL = https://hooks.slack.com/services/{key1}/{key2}/{key3}\nSLACK_CHANNEL = #News\nSLACK_BOT_NAME = Bot\nREFRESH_TIME = 60\n```\n\n## Run on server\n\nMake sure you have nodejs and npm on your server. You can install them via apt-get on your ubuntu server.\nThen you need to install pm2 which is a process manager for nodeapps.\n\n```\nnpm install pm2 -g\n```\n\nThen you can run\n\n```\npm2 start scrapper.js\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapertureless%2Fwhs-news-scrapper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fapertureless%2Fwhs-news-scrapper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapertureless%2Fwhs-news-scrapper/lists"}