{"id":20838419,"url":"https://github.com/reload/harvester","last_synced_at":"2025-08-02T20:34:27.454Z","repository":{"id":17593912,"uuid":"20397567","full_name":"reload/harvester","owner":"reload","description":"Welcome to Harvester, a service which fetch data from HarvestApp and have a simple API to get data out.","archived":false,"fork":false,"pushed_at":"2024-06-17T12:21:33.000Z","size":377,"stargazers_count":0,"open_issues_count":5,"forks_count":0,"subscribers_count":13,"default_branch":"main","last_synced_at":"2025-03-12T09:44:26.472Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"http://reload.harvester.dk","language":"PHP","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/reload.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2014-06-02T08:37:20.000Z","updated_at":"2024-06-17T12:17:18.000Z","dependencies_parsed_at":"2024-06-17T13:43:46.634Z","dependency_job_id":"621c39f5-f018-492e-9466-a1888b4c4cc2","html_url":"https://github.com/reload/harvester","commit_stats":null,"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"purl":"pkg:github/reload/harvester","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reload%2Fharvester","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reload%2Fharvester/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reload%2Fharvester/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reload%2Fharvester/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/reload","download_url":"https://codeload.github.com/reload/harvester/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reload%2Fharvester/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":268448362,"owners_count":24252019,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-02T02:00:12.353Z","response_time":74,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-18T01:10:13.106Z","updated_at":"2025-08-02T20:34:27.398Z","avatar_url":"https://github.com/reload.png","language":"PHP","funding_links":[],"categories":[],"sub_categories":[],"readme":"![https://i.imgur.com/jdTgyyI.png](https://i.imgur.com/jdTgyyI.png)\n\n# Harvester\n\nWelcome to Harvester, a service which fetch data from HarvestApp and\nhave a simple API to get data out.\n\n## Get started\n\n### 1. Create the config\n\n```shell\nmake create-config\n```\n\n### 2. Fill in envs in `docker-compose.override.yml`\n\n```shell\nHARVESTER_HARVEST_USER: harvest_account_email@email.com\nHARVESTER_HARVEST_PASSWORD: secretpassword\n# only use the actual name, e.g. \"reload\". *Not* the full url (reload.harvestapp.com)\nHARVESTER_HARVEST_ACCOUNT: harvestapp_account_name\n```\n\nThe credentials can be found in LastPass. Search for __\"Harvester API\"__.\n\n### 3. Get everything up and running. This takes ~30 minutes\n\n```shell\nmake up\n```\n\nWhen your terminal looks something likes this:\n\n```shell\nserver_1  | *** Running /etc/my_init.d/00_regen_ssh_host_keys.sh...\nserver_1  | *** Running /etc/my_init.d/harvester...\nserver_1  | *** Running /etc/rc.local...\nserver_1  | *** Booting runit daemon...\nserver_1  | *** Runit started as PID 10\nserver_1  | tail: unrecognized file system type 0x794c7630 for ‘/var/log/apache2/error.log’. please report this to bug-coreutils@gnu.org. reverting to polling\nserver_1  | tail: unrecognized file system type 0x794c7630 for ‘/var/log/syslog’. please report this to bug-coreutils@gnu.org. reverting to polling\nserver_1  | AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.28.0.2. Set the 'ServerName' directive globally to suppress this message\nserver_1  | AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.28.0.2. Set the 'ServerName' directive globally to suppress this message\nserver_1  | [Fri Apr 17 08:35:03.303829 2020] [mpm_prefork:notice] [pid 21] AH00163: Apache/2.4.7 (Ubuntu) PHP/5.5.9-1ubuntu4.29 configured -- resuming normal operations\nserver_1  | [Fri Apr 17 08:35:03.303888 2020] [core:notice] [pid 21] AH00094: Command line: 'apache2 -D FOREGROUND'\nserver_1  | Apr 17 08:35:03 d37b70b08786 syslog-ng[18]: syslog-ng starting up; version='3.5.3'\n```\n\n__The wait is over!__\n\n### 4. Create an admin user\n\n``` shell\nmake create-admin\n```\n\nFill in your password of choice and now you are ready to login with the user __harvest@reload.dk__ and your new password at [http://harvester.docker/login](http://harvester.docker/login).\n\n### 5. Harvester is now accessible at\n\n- Login: [http://harvester.docker/login](http://harvester.docker/login)\n- Admin: [http://harvester.docker/admin](http://harvester.docker/admin)\n- Docs: [http://harvester.docker/api/doc](http://harvester.docker/api/doc)\n\n## CLI\n\nFor fetching data from the HarvestApp API and managing users.\n\n### User management\n\nPrint the available configuration for the user command.\n\n```shell\ndocker-compose exec server app/console help harvester:user\n```\n\n\n### Data fetching\n\nPrint the available configuration for the fetch command.\n\n```shell\ndocker-compose exec server app/console help harvester:fetch\n```\n\nRun the fetch command without parameters. Will fetch everything from HarvestApp (~30 minutes).\n\n```shell\n  docker-compose exec server app/console harvester:fetch\n```\n\nData from this month\n\n```shell\ndocker-compose exec server app/console harvester:fetch `date \"+%Y%m01\"`\n```\n\nSince yesterday\n\n```shell\ndocker-compose exec server app/console harvester:fetch --updated-yesterday\n```\n\nDelete entries and repopulate within a given time span\n\n```shell\ndocker-compose exec server app/console harvester:refresh `date \"+%Y%m01\"`\n```\n\nDelete entries and repopulate within a static amount of days\n\n```shell\ndocker-compose exec server app/console harvester:refresh --days=30\n```\n## Hosting\nHarvester is currently hosted with Kubernetes at Google Cloud Platform in the project: `reload-internal-alpha`  \nIt is deployed using [helm](https://helm.sh/docs/topics/charts/)  \nFor more info, please see our [helm-chart](./helm-chart)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Freload%2Fharvester","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Freload%2Fharvester","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Freload%2Fharvester/lists"}