https://github.com/jiahaoxiang2000/spider_web

https://github.com/jiahaoxiang2000/spider_web

Last synced: about 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/jiahaoxiang2000/spider_web
• Owner: jiahaoxiang2000
• Created: 2024-10-22T02:56:57.000Z (3 months ago)
• Default Branch: main
• Last Pushed: 2024-11-04T08:00:16.000Z (2 months ago)
• Last Synced: 2024-11-04T09:17:33.077Z (2 months ago)
• Language: Python
• Size: 35.2 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# Spider web

## Development

There we use the django framework to build the web for all-stack. Here is the development start cmd:

```shell

cd spider_project

python manage.py runserver 0.0.0.0:80

```

> This output the development server on the 80 port. is cause much security issue, so we should not use this in production.

docker start cmd:

```shell

pip install -r requirements.txt && cd spider_project && python manage.py makemigrations &&  python manage.py migrate && python manage.py runserver 0.0.0.0:8080

```

## Apply Migrations

Create and apply the initial migrations for your models, i.e. here use sqlite3 as the database. Detail run command:

```shell

python manage.py makemigrations 

python manage.py migrate

```

## Architecture Change Reason

Before the web version, the desktop version had several issues:

- **Version Updates:** Updating the version was not easy. Users needed to download and install the new version manually.

- **Error Logs:** Retrieving error logs was cumbersome. Users had to send the log files to us.

- **Network Issues:** The spider required an overseas network to fetch data. Some users had unstable networks, so we switched to using an overseas server to get the data.

Based on these issues, we decided to build a web version to provide the service.