https://github.com/kerosiinikone/distributed-job-aggregation-service

Scrapes keyword-related job postings from a few job sites
https://github.com/kerosiinikone/distributed-job-aggregation-service

actors go webscraping

Last synced: about 1 month ago
JSON representation

Scrapes keyword-related job postings from a few job sites

• Host: GitHub
• URL: https://github.com/kerosiinikone/distributed-job-aggregation-service
• Owner: kerosiinikone
• Created: 2024-07-04T13:52:36.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-09-06T13:39:58.000Z (4 months ago)
• Last Synced: 2024-09-06T15:51:51.836Z (4 months ago)
• Topics: actors, go, webscraping
• Language: Go
• Homepage:
• Size: 43 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Distributed Job Scraper with Actors Model

A small project using the Go Actor Engine. Scrapes job sites for postings related to keywords and location. API has only one endpoint for **POST /find** which initiates the scraping job and the results are sent to the provided email address.

```

make run

```

![jobscr](https://github.com/kerosiinikone/distributed-job-aggregation-service/assets/100020686/cde67059-5860-460a-a315-d6f8cfb32c89)

### TODO

- Job site specific Visitor

Consider these:

- Reuse the same Manager, or spawn new per request ???

- Poison the Manager after job done