{"id":20801885,"url":"https://github.com/philips-software/rsdl","last_synced_at":"2025-05-11T16:32:17.576Z","repository":{"id":38466979,"uuid":"262371852","full_name":"philips-software/rsdl","owner":"philips-software","description":"Redshift/PostgreSQL real-time TSV downloader","archived":true,"fork":false,"pushed_at":"2025-03-11T10:40:53.000Z","size":532,"stargazers_count":4,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-05-11T05:44:24.192Z","etag":null,"topics":["cloud-foundry","postgresql","qlik","qliksense","redshift","tab-separated"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/philips-software.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":"CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-05-08T16:22:52.000Z","updated_at":"2025-03-11T10:41:10.000Z","dependencies_parsed_at":"2025-01-17T12:25:39.511Z","dependency_job_id":"695aa4bf-3e23-4830-864e-9b8f0e4a510f","html_url":"https://github.com/philips-software/rsdl","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philips-software%2Frsdl","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philips-software%2Frsdl/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philips-software%2Frsdl/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philips-software%2Frsdl/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/philips-software","download_url":"https://codeload.github.com/philips-software/rsdl/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253595730,"owners_count":21933442,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cloud-foundry","postgresql","qlik","qliksense","redshift","tab-separated"],"created_at":"2024-11-17T18:24:57.263Z","updated_at":"2025-05-11T16:32:17.566Z","avatar_url":"https://github.com/philips-software.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# This project is DEPRECATED\n\n# RSDL\nRedshift DownLoader is a small tool that allows one to stream\nRedshift or PostgreSQL tables and views as TAB Separated data. \n\n# Docker\nUse the included Dockerfile to build a docker image which can be deployed to CF directly.\n\n```bash\n$ git clone https://github.com/philips-labs/rsdl.git\n$ cd rsdl\n$ docker build -t rsdl .\n```\n\n# Deployment\nSee the below manifest.yml file as an example. \n\n```yaml\n---\napplications:\n- name: rsdl\n  docker:\n    image: loafoe/rsdl:latest\n  instances: 1\n  memory: 64M\n  disk_quota: 128M\n  routes:\n  - route: my-rsdl.eu-west.philips-healthsuite.com\n  env:\n    RSDL_PASSWORD: RandomPassw0rdHer3\n    RSDL_SCHEMA: default_schema\n  services:\n  - redshift\n```\n\n## Endpoints\nThe following endpoints are available\n\n| Endpoint | Description |\n|----------|-------------|\n| `/redshift/default_schema/:table/full.csv` | Dumps `:table` from `default_schema` |\n| `/redhsift/:schema/:table/full.csv` | Dumps `:table` from given `:schema`\n\n## Configuration\n\n| Environment variable | Description | Default value |\n|----------------------|-------------|---------|\n| RSDL_PASSWORD | The password to use. Hardcoded username is `redshift` |\n| RSDL_SCHEMA | The default schema to use ||\n| RSDL_GZIP | Enable or disable GZIP compression | true |\n \n# Usage\n \n ```shell script\ncurl -uredshift:RandomPassw0rdHer3 https://my-rsdl.eu-west.philips-healthsuite.com:4443/redshift/myschema/mytable/full.csv \u003e mytable_full.csv\n```\n# Tips for Cloud foundry deployments\n\n* Use port `4443` in your URL e.g. `https://my-rsdl.eu-west.philips-healthsuite.com:4443/redshift/mydb/mytable`\n\u003e Using port `4443` will allow the app to detect dropped connections. This ensures that streaming stops if the client connection is dropped. Otherwise the full request will continue to run potentially wasting resources and tying up a DB connection.\n\n* Try with and without GZIP compression enabled\n\u003e If you have a very fast connection then compressing the data might actually make tranfers slower. When testing on a `500Mbit` fiber connection we found streaming data rates were higher with compression *disabled*.\n\n  \n# Maintainers\nSee [MAINTAINERS.md](MAINTAINERS.md)\n\n# License\nLicense is MIT\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fphilips-software%2Frsdl","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fphilips-software%2Frsdl","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fphilips-software%2Frsdl/lists"}