https://github.com/r05323028/eyes

Public Opinion Mining System of Taiwanese Forums
https://github.com/r05323028/eyes

crawler data-engineering data-mining data-science graphql javascript natural-language-processing opinion-mining public-opinion python react redux tailwindcss task-queue

Last synced: 4 months ago
JSON representation

Public Opinion Mining System of Taiwanese Forums

• Host: GitHub
• URL: https://github.com/r05323028/eyes
• Owner: r05323028
• License: mit
• Created: 2021-08-04T05:17:30.000Z (almost 5 years ago)
• Default Branch: main
• Last Pushed: 2022-08-06T04:52:28.000Z (almost 4 years ago)
• Last Synced: 2025-09-05T04:43:47.927Z (9 months ago)
• Topics: crawler, data-engineering, data-mining, data-science, graphql, javascript, natural-language-processing, opinion-mining, public-opinion, python, react, redux, tailwindcss, task-queue
• Language: Python
• Homepage: https://r05323028.github.io/eyes
• Size: 8.17 MB
• Stars: 118
• Watchers: 3
• Forks: 18
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Citation: CITATION.cff
  • Authors: AUTHORS

Awesome Lists containing this project

README

          
# 

[![DOI](https://zenodo.org/badge/392558472.svg)](https://zenodo.org/badge/latestdoi/392558472)

![Release](https://img.shields.io/github/v/release/r05323028/eyes?include_prereleases)

![License](https://img.shields.io/github/license/r05323028/eyes)

![Testing](https://img.shields.io/github/workflow/status/r05323028/eyes/testing?label=testing)

![Coverage](https://img.shields.io/codecov/c/github/r05323028/eyes)

eyes is a **Public Opinion Mining System** focusing on taiwanese forums such as [PTT](https://www.ptt.cc/bbs/hotboards.html), [Dcard](https://www.dcard.tw/f).

## Features

- :fire: **Article monitor**: helps you capture the trend at a glance.

- :fire: **Entity monitor**: helps you spy on a specific entity.

- :fire: **Weak supervision**: let you generate & update model without human effort.

- :fire: **Well-integrated with spaCy**: let you train models by yourself or use trained models in [model hub](https://spacy.io/models) simply.

## Screenshots

![Articles Dashboard](./doc/static/images/articles_dashboard.png)

![Post Modal](./doc/static/images/post_modal.png)

![Entities Dashboard](./doc/static/images/entities_dashboard.png)

![Entity Dashboard](./doc/static/images/entity_dashboard.png)

![Entity Timeline](./doc/static/images/entity_timeline.png)

## Architecture

eyes system architecture

![Architecture](./doc/static/images/architecture.png)

## Tech Stack

### Infrastructure

- Argo Workflows

- Celery, Flower

- Kubernetes, Helm Charts

- MySQL

- Redis

### API

- FastAPI

- SQLAlchemy ORM

- GraphQL

### Web

- React + Redux-Saga

- Tailwindcss

### ML

- spaCy

- skweak

## License

[MIT](./LICENSE)