{"id":20446993,"url":"https://github.com/quix-labs/pg-el-sync","last_synced_at":"2026-01-24T14:03:49.059Z","repository":{"id":65678072,"uuid":"597155874","full_name":"quix-labs/pg-el-sync","owner":"quix-labs","description":"Synchronize yout PostgreSql Data into Elasticsearch in realtime","archived":false,"fork":false,"pushed_at":"2024-08-06T15:18:49.000Z","size":48117,"stargazers_count":3,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-24T06:34:23.428Z","etag":null,"topics":["elasticsearch","go","postgresql","realtime","synchronization"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/quix-labs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE.MD","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"github":"alancolant"}},"created_at":"2023-02-03T18:50:40.000Z","updated_at":"2025-01-24T00:02:37.000Z","dependencies_parsed_at":"2023-12-27T22:42:05.356Z","dependency_job_id":"af319b1f-e305-4bee-b116-bfeb91013b72","html_url":"https://github.com/quix-labs/pg-el-sync","commit_stats":null,"previous_names":["quix-labs/pg-el-sync"],"tags_count":10,"template":false,"template_full_name":null,"purl":"pkg:github/quix-labs/pg-el-sync","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quix-labs%2Fpg-el-sync","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quix-labs%2Fpg-el-sync/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quix-labs%2Fpg-el-sync/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quix-labs%2Fpg-el-sync/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/quix-labs","download_url":"https://codeload.github.com/quix-labs/pg-el-sync/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quix-labs%2Fpg-el-sync/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28729411,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-24T10:24:43.181Z","status":"ssl_error","status_checked_at":"2026-01-24T10:24:36.112Z","response_time":89,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["elasticsearch","go","postgresql","realtime","synchronization"],"created_at":"2024-11-15T10:24:05.057Z","updated_at":"2026-01-24T14:03:49.011Z","avatar_url":"https://github.com/quix-labs.png","language":"Go","funding_links":["https://github.com/sponsors/alancolant"],"categories":[],"sub_categories":[],"readme":"## Introduction\n\nThis tool is designed to synchronize data between a Postgresql database and Elasticsearch. It uses a trigger system with a pub/sub mechanism to monitor real-time changes in the database and index them in Elasticsearch.\n\n\n\n## Installation and Configuration\n\n### Using Docker\n\n- Pull the Docker image from the GitHub Container Registry:\n    ```bash\n    docker pull ghcr.io/quix-labs/pg-el-sync:latest\n    ```\n\n### Using Go\n\n- Install the tool using Go:\n    ```bash\n    go install github.com/quix-labs/pg-el-sync@latest\n    ```\n\n### Using prebuilt assets\n\nYou can also install the tool using release assets such as `.deb`, `.apk`, or others.\n\nDownload the appropriate package from the [Releases page](https://github.com/quix-labs/pg-el-sync/releases), and then follow the instructions provided for your specific platform.\n\n\n## Usage\n\nThe tool provides two main commands for usage:\n\n- `pg-el-sync listen`: Start listening to the PostgreSQL database for real-time changes and sync them with Elasticsearch.\n- `pg-el-sync index`: Index all tables from the PostgreSQL database into Elasticsearch.\n\n\n### Using Docker\n\n#### Listen Command\n```bash\ndocker run -v /path/to/config.yaml:/app/config.yaml ghcr.io/quix-labs/pg-el-sync:latest pg-el-sync listen\n```\n\n#### Index Command\n```bash\ndocker run --rm -v /path/to/config.yaml:/app/config.yaml ghcr.io/quix-labs/pg-el-sync:latest pg-el-sync index\n```\n\n### Configuration\n\n#### Configuration file\nBy default `pg-el-sync` load configuration file from `/app/config.yaml`, you can override using environment variable:\n  ```bash\n    export CONFIG_FILE=/path/to/config.yaml\n    # Or with docker: docker run -e CONFIG_FILE=/path/in/docker/config.yaml ...\n  ``` \n\n\n## Supervisord Configuration\n\nTo manage the `pg-el-sync listen` command with Supervisord, you can use the following configuration:\n\n```ini\n[program:pg-el-sync]\ncommand=/path/to/pg-el-sync listen \nautostart=true\nautorestart=true\nstartsecs=10\nstartretries=3\nstdout_logfile=/var/log/pg-el-sync-listen.log\nstderr_logfile=/var/log/pg-el-sync-listen.err.log\n```\n\nMake sure to replace `/path/to/pg-el-sync` with the absolute path to your `pg-el-sync` installation.\n\nYou can also adjust other settings according to your needs, such as log file paths and startup parameters.\n\n\n## Local Development\n\nTo set up the environment for local development, follow these steps:\n\n1. Clone this repository:\n    ```bash\n    git clone https://github.com/quix-labs/pg-el-sync\n    ```\n2. Navigate to the `pg-el-sync` directory:\n    ```bash\n    cd pg-el-sync\n    ```\n3. Copy the `config.example.yaml` file to `config.yaml` and configure it according to your environment:\n    ```bash\n    cp config.example.yaml config.yaml\n    ```\n\n4. Run the tool in development mode:\n    ```bash\n    go run .\n    ```\n\n\n## Credits\n\n- [COLANT Alan](https://github.com/alancolant)\n- [All Contributors](../../contributors)\n\n## License\n\nThis project is licensed under the [MIT License](LICENCE.md).","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquix-labs%2Fpg-el-sync","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fquix-labs%2Fpg-el-sync","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquix-labs%2Fpg-el-sync/lists"}