https://github.com/academic/harvester

https://github.com/academic/harvester

golang hacktoberfest harvester oai-harvester

Last synced: about 1 year ago
JSON representation

• Host: GitHub
• URL: https://github.com/academic/harvester
• Owner: academic
• License: agpl-3.0
• Created: 2020-10-21T17:53:56.000Z (almost 6 years ago)
• Default Branch: main
• Last Pushed: 2020-10-21T19:54:14.000Z (almost 6 years ago)
• Last Synced: 2025-04-20T20:35:41.141Z (over 1 year ago)
• Topics: golang, hacktoberfest, harvester, oai-harvester
• Language: Go
• Homepage:
• Size: 20.5 KB
• Stars: 5
• Watchers: 3
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Harvester

The correct software architecture for OAI harvesters

#### Objectives

###### tech:

- [ ] Golang

- [ ] PostgreSQL (Best Solid Open Source Database)

- [ ] ElasticSearch (Best search engine and storage)

- [ ] Cloud ready, scalable

- [ ] Non-blocking Async jobs.

###### workers:

- [ ] OAI Harvester

- [ ] Dublin Core Parser

- [ ] Elastic Indexer

###### endpoint:

- [ ] REST Search api

- [ ] Workers Triggers

- [ ] Cron job api

###### management:

- [ ] Admin UI

#### Roadmap

1.  [**MVP**](https://github.com/academic/harvester/milestone/1)

    

    Can do basic harvesting and REST API for search

    

2.  [**1.0.0**](https://github.com/academic/harvester/milestone/2)

    

    Admin UI, Docker, SaaS