https://github.com/dyslab/otglite

Online TXT Grabee Lite Edition :bee:
https://github.com/dyslab/otglite

crawler expressjs jquery nodejs sqlite3

Last synced: about 2 months ago
JSON representation

Online TXT Grabee Lite Edition :bee:

• Host: GitHub
• URL: https://github.com/dyslab/otglite
• Owner: dyslab
• License: mit
• Created: 2018-12-08T06:48:40.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2024-12-05T23:51:22.000Z (6 months ago)
• Last Synced: 2025-02-10T13:43:40.856Z (3 months ago)
• Topics: crawler, expressjs, jquery, nodejs, sqlite3
• Language: JavaScript
• Homepage:
• Size: 22.9 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# OTGLite = Online Txt Grabee(short for "Grab Bee"):bee: Lite Edition

[![os version badge](./public/img/deepin-os-v23.svg)](https://www.deepin.org/)   [![node.js version badge](./public/img/node.js-v20.svg)](https://nodejs.org/)

## Intro

Fetch content from web page, then save to SQLite3 database or save as TXT file(s), including a simple txt file management, db management and logging file. All of all, it is a **Page Crawler** 🔍 powered by node.js. 😊

- `OS`: **Deepin OS v15 ~ v23**

- `Node.js`: **v14 (lts/fermium) ~ v20 (lts/iron)** with `nvm` [Node Version Manager](https://github.com/nvm-sh/nvm)

> PS: Newer version of Node,js might be incompatible.

- `Express v4`

- `JQuery v3`

- SQLite3 management package: `better-sqlite3 v5 (Upgraded to v11)`

### Run, Dev and Node.js Version Mangement

#### Run and Dev

```shell

npm start          # Start web server with node

nvm run dev        # Start web server with nodemon, for development

```

#### Install Nodemon Globally

```shell

npm install -g nodemon

```

#### Node.js Version Mangement (Simple usgae of 'nvm')

```shell

nvm install 14          # Install node v14.21.3 (lts/fermium)

nvm use 14              # Change to node version v14.x.x

nvm use node            # Change to default node version

nvm ls                  # List installed (and current using) node versions on your personal computer

```

#### Tested on Node.js v20.18.0 (lts/iron)

[![nvm ls](./public/img/Screen-2024-10-08_00-21-09.png)](https://github.com/nvm-sh/nvm)

## Milestone

- Lastest Modified Date: 9 Oct 2024

- Release Date : 22 Dec 2018

- Project Start Date : 08 Dec 2018