https://github.com/apertureless/whs-news-scrapper
A web scrapper for the w-hs.de news system that sends notifications to slack
https://github.com/apertureless/whs-news-scrapper
Last synced: about 2 months ago
JSON representation
A web scrapper for the w-hs.de news system that sends notifications to slack
- Host: GitHub
- URL: https://github.com/apertureless/whs-news-scrapper
- Owner: apertureless
- License: mit
- Created: 2015-10-12T07:05:30.000Z (almost 11 years ago)
- Default Branch: master
- Last Pushed: 2020-05-01T05:42:24.000Z (over 6 years ago)
- Last Synced: 2025-11-18T18:07:14.264Z (9 months ago)
- Language: JavaScript
- Homepage:
- Size: 6.84 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Insider Scrapper
A small scrapper for the news system of w-hs.de
It will scrap the messages and parse them. If new messages appear it sends a notification to slack.
## Installation
Clone the repository
```
git clone https://github.com/apertureless/whs-news-scrapper.git
```
Install dependencies:
```
npm install
```
## Configuration
Edit the .env.example and rename it to .env
Go to your slack team configuration and add antoher Incoming WebHook.
Copy the url and paste it into the .env
Set the channel, bot name and the refresh time in mins.
```
SLACK_HOOK_URL = https://hooks.slack.com/services/{key1}/{key2}/{key3}
SLACK_CHANNEL = #News
SLACK_BOT_NAME = Bot
REFRESH_TIME = 60
```
## Run on server
Make sure you have nodejs and npm on your server. You can install them via apt-get on your ubuntu server.
Then you need to install pm2 which is a process manager for nodeapps.
```
npm install pm2 -g
```
Then you can run
```
pm2 start scrapper.js
```