Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/mikeizbicki/novichenkobot

Last synced: 6 days ago
JSON representation

Host: GitHub
URL: https://github.com/mikeizbicki/novichenkobot
Owner: mikeizbicki
Created: 2019-09-27T20:53:03.000Z (over 5 years ago)
Default Branch: master
Last Pushed: 2022-11-04T19:38:05.000Z (about 2 years ago)
Last Synced: 2024-11-08T22:36:56.523Z (2 months ago)
Language: Python
Size: 13 MB
Stars: 1
Watchers: 3
Forks: 1
Open Issues: 3
Metadata Files:
- Readme: README.md

Awesome Lists containing this project

README

        # NovichenkoBot ![](https://travis-ci.org/mikeizbicki/NovichenkoBot.png?branch=master)

FIXME: 

On 18 Nov, I noticed that the `USER_AGENT` parameter was incorrectly set to `Mozilla ...` rather than `NovichenkoBot`.  

This likely caused many websites with paywalls to return paywall error messages rather than displaying the content of their site.

This variable was probably set for at least 1-2 weeks, and so many urls likely need to be redownloaded.

FIXME:

At 0100 on Jan 1st, I added more languages to the keywords file.  These languages need to be rescanned for keywords.  Some key langauges like Russian,Chinese,Japanese,Korean are all missing.  We also need to continue to add more keywords.

Things to fix:

1. db system catalog locations

1. more separation of concerns with