{"id":37076254,"url":"https://github.com/mikethoun/redshift-auto-schema","last_synced_at":"2026-01-14T08:58:19.094Z","repository":{"id":52569613,"uuid":"193559409","full_name":"mikethoun/redshift-auto-schema","owner":"mikethoun","description":"Redshift Auto Schema is a Python library that takes a delimited flat file or parquet file as input, parses it, and provides a variety of functions that allow for the creation and validation of tables within Amazon Redshift.","archived":false,"fork":false,"pushed_at":"2021-06-21T16:35:44.000Z","size":34,"stargazers_count":29,"open_issues_count":0,"forks_count":5,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-08-28T17:53:14.726Z","etag":null,"topics":["python3","redshift"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mikethoun.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-06-24T18:36:47.000Z","updated_at":"2025-01-15T00:16:04.000Z","dependencies_parsed_at":"2022-09-26T16:31:16.394Z","dependency_job_id":null,"html_url":"https://github.com/mikethoun/redshift-auto-schema","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/mikethoun/redshift-auto-schema","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikethoun%2Fredshift-auto-schema","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikethoun%2Fredshift-auto-schema/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikethoun%2Fredshift-auto-schema/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikethoun%2Fredshift-auto-schema/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mikethoun","download_url":"https://codeload.github.com/mikethoun/redshift-auto-schema/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikethoun%2Fredshift-auto-schema/sbom","scorecard":{"id":646103,"data":{"date":"2025-08-11","repo":{"name":"github.com/mikethoun/redshift-auto-schema","commit":"517e46035cc687626f7522ac4be1d4783c46021d"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":3,"checks":[{"name":"Dangerous-Workflow","score":-1,"reason":"no workflows found","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Token-Permissions","score":-1,"reason":"No tokens found","details":null,"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Code-Review","score":0,"reason":"Found 1/18 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Pinned-Dependencies","score":-1,"reason":"no dependencies found","details":null,"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: Apache License 2.0: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 20 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}}]},"last_synced_at":"2025-08-21T12:11:40.833Z","repository_id":52569613,"created_at":"2025-08-21T12:11:40.834Z","updated_at":"2025-08-21T12:11:40.834Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28414729,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-14T08:38:59.149Z","status":"ssl_error","status_checked_at":"2026-01-14T08:38:43.588Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["python3","redshift"],"created_at":"2026-01-14T08:58:18.488Z","updated_at":"2026-01-14T08:58:19.087Z","avatar_url":"https://github.com/mikethoun.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Redshift Auto Schema\n\nRedshift Auto Schema is a Python library that takes a delimited flat file or parquet file as input, parses it, and provides a variety of functions that allow for the creation and validation of tables within Amazon Redshift. For each field, the appropriate Redshift data type is inferred from the contents of the file.\n\n## Installation\n\nUse the package manager [pip](https://pip.pypa.io/en/stable/) to install Redshift Auto Schema.\n\n```bash\npip install redshift-auto-schema\n```\n\n## Usage\n\n```python\nfrom redshift_auto_schema import RedshiftAutoSchema\nimport psycopg2 as pg\n\nredshift_conn = pg.connect()\n\nnew_table = RedshiftAutoSchema(file='sample_file.parquet',\n                               schema='test_schema',\n                               table='test_table',\n                               conn=redshift_conn)\n\nif not new_table.check_table_existence():\n    ddl = new_table.generate_table_ddl()\n\n    with redshift_conn as conn:\n    \twith conn.cursor() as cur:\n        \tcur.execute(ddl)\n```\n\n## Methods\n\n|NAME|DESCRIPTION|\n|---|---|\n|**get_column_list**|Returns column list based on header of file.|\n|**check_schema_existence**|Checks Redshift for the existence of a schema.|\n|**check_table_existence**|Checks Redshift for the existence of a table.|\n|**generate_schema_ddl**|Returns a SQL statement that creates a Redshift schema.|\n|**generate_schema_permissions**|Returns a SQL statement that grants schema usage to the default group.|\n|**generate_table_ddl**|Returns a SQL statement that creates a Redshift table.|\n|**generate_column_ddl**|Returns SQL statement(s) that adds missing column(s) a Redshift table.|\n|**generate_table_permissions**|Returns a SQL statement that grants table read access to the default group.|\n|**evaluate_table_ddl_diffs**|Returns a dataframe containing differences between generated and existing table DDL.|\n\n## Contributing\nPull requests are welcome.\n\n## License\n[Apache License 2.0](http://www.apache.org/licenses/LICENSE-2.0)","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikethoun%2Fredshift-auto-schema","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmikethoun%2Fredshift-auto-schema","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikethoun%2Fredshift-auto-schema/lists"}