{"id":13696779,"url":"https://github.com/sodadata/soda-sql","last_synced_at":"2025-05-03T17:32:17.235Z","repository":{"id":38189201,"uuid":"472677283","full_name":"sodadata/soda-sql","owner":"sodadata","description":"Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html","archived":true,"fork":false,"pushed_at":"2022-11-30T20:20:48.000Z","size":28283,"stargazers_count":61,"open_issues_count":126,"forks_count":16,"subscribers_count":8,"default_branch":"main","last_synced_at":"2024-11-07T23:54:18.376Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://docs.soda.io/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sodadata.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-03-22T08:33:35.000Z","updated_at":"2024-09-29T15:45:26.000Z","dependencies_parsed_at":"2023-01-21T08:05:16.331Z","dependency_job_id":null,"html_url":"https://github.com/sodadata/soda-sql","commit_stats":null,"previous_names":[],"tags_count":62,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sodadata%2Fsoda-sql","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sodadata%2Fsoda-sql/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sodadata%2Fsoda-sql/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sodadata%2Fsoda-sql/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sodadata","download_url":"https://codeload.github.com/sodadata/soda-sql/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":224369748,"owners_count":17299950,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-02T18:00:46.999Z","updated_at":"2024-11-13T00:31:01.287Z","avatar_url":"https://github.com/sodadata.png","language":"Python","readme":"\n# Soda SQL and Soda Spark have become Soda Core\nSoda SQL and Soda Spark are deprecated in favor of Soda Core and the Soda Checks Language. If you are new to Soda, start with \u003ca href=\"https://github.com/sodadata/soda-core\"\u003eSoda Core\u003c/a\u003e!\n\n\n\n\u003cp align=\"center\"\u003e\u003cimg src=\"https://github.com/sodadata/docs/blob/main/assets/images/soda-sql-logo.png\" alt=\"Soda logo\" width=\"300\" /\u003e\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\u003cb\u003eData testing, monitoring, and profiling for SQL-accessible data.\u003c/b\u003e\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/sodadata/soda-sql/blob/main/LICENSE\"\u003e\u003cimg src=\"https://img.shields.io/badge/license-Apache%202-blue.svg\" alt=\"License: Apache 2.0\"\u003e\u003c/a\u003e\n  \u003ca href=\"#contributors\"\u003e\u003cimg src=\"https://img.shields.io/badge/all_contributors-21-orange.svg?style=flat-square)\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://join.slack.com/t/soda-community/shared_invite/zt-m77gajo1-nXJF7JtbbRht2zwaiLb9pg\"\u003e\u003cimg alt=\"Slack\" src=\"https://img.shields.io/badge/chat-slack-green.svg\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://pypi.org/project/soda-sql/\"\u003e\u003cimg alt=\"Pypi Soda SQL\" src=\"https://img.shields.io/badge/pypi-soda%20sql-green.svg\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/sodadata/soda-sql/actions/workflows/build.yml\"\u003e\u003cimg alt=\"Build soda-sql\" src=\"https://github.com/sodadata/soda-sql/actions/workflows/build.yml/badge.svg\"\u003e\u003c/a\u003e\n\u003c/p\u003e\n \u003cbr /\u003e\n \u003cbr /\u003e\n\u003c/head\u003e\n\u003cbody\u003e\n\n\n\n\n\n\u0026#10004;  [Install Soda SQL](/docs/soda-sql/installation.md) from the command-line\u003cbr /\u003e\n\u0026#10004;  Access comprehensive [Soda SQL documentation](/docs/soda-sql/overview.md)\u003cbr /\u003e\n\u0026#10004;  Compatible with [Snowflake, Amazon Redshift, BigQuery](/docs/soda-sql/installation.md#compatibility), and more\u003c/a\u003e\u003cbr /\u003e\n\u0026#10004;  [Write tests](/docs/soda-sql/tests.md) in a YAML file\u003cbr /\u003e\n\u0026#10004;  [Run programmatic scans](/docs/soda-sql/programmatic_scan.md) to test data quality\u003cbr /\u003e\n\u003cbr /\u003e\n\n\n#### Example scan YAML file (Deprecated)\n```yaml\ntable_name: breakdowns\nmetrics:\n  - row_count\n  - missing_count\n  - missing_percentage\n...\n# Validates that a table has rows\ntests:\n  - row_count \u003e 0\n\n# Tests that numbers in the column are entered in a valid format as whole numbers\ncolumns:\n  incident_number:\n    valid_format: number_whole\n    tests:\n      - invalid_percentage == 0\n\n# Tests that no values in the column are missing\n  school_year:\n    tests:\n      - missing_count == 0\n\n# Tests for duplicates in a column\n  bus_no:\n    tests:\n      - duplicate_count == 0\n\n# Compares row count between datasets\nsql_metric: \n  sql: |\n    SELECT COUNT(*) as other_row_count\n    FROM other_table\n  tests:\n    - row_count == other_row_count\n```\n\n\n## Install (Deprecated)\n* [Install Soda SQL](/docs/soda-sql/installation.md)\n* [Quick start for Soda SQL](/docs/soda/quick-start-soda-sql.md)\n\n\n\n## Contributors ✨\n\nThanks goes to these wonderful people! ([emoji key](https://allcontributors.org/docs/en/emoji-key))\n\n\u003c!-- ALL-CONTRIBUTORS-LIST:START - Do not remove or modify this section --\u003e\n\u003c!-- prettier-ignore-start --\u003e\n\u003c!-- markdownlint-disable --\u003e\n\u003ctable\u003e\n  \u003ctr\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://www.vijaykiran.com\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/23506?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eVijay Kiran\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=vijaykiran\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://github.com/abhishek-khare\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/44169877?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eabhishek khare\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=abhishek-khare\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://github.com/jcshoekstra\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/6941860?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eJelte Hoekstra\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=jcshoekstra\" title=\"Code\"\u003e💻\u003c/a\u003e \u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=jcshoekstra\" title=\"Documentation\"\u003e📖\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://github.com/JCZuurmond\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/5946784?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eCor\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=JCZuurmond\" title=\"Code\"\u003e💻\u003c/a\u003e \u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=JCZuurmond\" title=\"Documentation\"\u003e📖\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://aleksic.dev\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/50055?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eMilan Aleksić\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#infra-milanaleksic\" title=\"Infrastructure (Hosting, Build-Tools, etc)\"\u003e🚇\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"http://www.fakir.dev\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/5069674?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eAyoub Fakir\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=fakirAyoub\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://tonkonozhenko.com\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/1307646?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eAlex Tonkonozhenko\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=Tonkonozhenko\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n  \u003c/tr\u003e\n  \u003ctr\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://toddy86.github.io/blog/\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/10559757?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eTodd de Quincey\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=toddy86\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://antoninjsn.netlify.app\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/18756890?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eAntonin Jousson\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=Antoninj\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"http://www.omeyocan.be\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/153805?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eJonas\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#infra-jmarien\" title=\"Infrastructure (Hosting, Build-Tools, etc)\"\u003e🚇\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"http://www.webunit.be\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/1439383?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003ecwouter\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=cwouter\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://github.com/janet-can\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/63879030?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eJanet R\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=janet-can\" title=\"Documentation\"\u003e📖\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"http://www.bastienboutonnet.com\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/4304794?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eBastien Boutonnet\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=bastienboutonnet\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://twitter.com/tombaeyens\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/944245?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eTom Baeyens\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=tombaeyens\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n  \u003c/tr\u003e\n  \u003ctr\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://github.com/AlessandroLollo\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/1206243?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eAlessandroLollo\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=AlessandroLollo\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://www.linkedin.com/in/migdisoglu/\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/4024345?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003emmigdiso\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=mmigdiso\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://github.com/ericmuijs\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/17954084?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eericmuijs\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=ericmuijs\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://www.elaidata.com\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/1313689?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eLieven Govaerts\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=lgov\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"http://justsomegeek.com\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/582933?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eMilan Lukac\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=m1n0\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://github.com/sebastianvillarroel\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/16538437?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eSebastián Villarroel\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=sebastianvillarroel\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://github.com/IIBenII\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/40873921?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eBenjamin Berriot\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=IIBenII\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n  \u003c/tr\u003e\n  \u003ctr\u003e\n    \u003ctd align=\"center\"\u003e\u003ca href=\"https://dataart.com\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/2989480?v=4?s=100\" width=\"100px;\" alt=\"\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eAlexey Minakov\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/sodadata/soda-sql/commits?author=sintezcs\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n  \u003c/tr\u003e\n\u003c/table\u003e\n\n\u003c!-- markdownlint-restore --\u003e\n\u003c!-- prettier-ignore-end --\u003e\n\n\u003c!-- ALL-CONTRIBUTORS-LIST:END --\u003e\n\nThis project followed the [all-contributors](https://github.com/all-contributors/all-contributors) specification. \n\n### Open Telemetry Tracking (Deprecated)\n\nSoda SQL collects statistical usage and performance information via the [Open Telemetry framework](https://opentelemetry.io). This information helps the Soda Core developer team proactively track performance issues and understand how users interact with the tool.\n\nThe collected information is strictly limited to usage and performance and does not contain Personal Identifying Information (PII). It is used for internal purposes only. Soda keeps the data in its raw form for a maximum of five years. If some information needs to be kept for longer, it will only be kept in aggregated form.\n\nRead more about the information Soda tracks, and learn how to opt-out of tracking by consulting the [Anonymous usage statistics](/docs/soda-sql/global-configuration.md) documentation.\n","funding_links":[],"categories":["10. Application Performance Monitoring Solutions (APM)","Data Quality","Python","4. Database","Not exhaustive and personnal list of \"modern\" Data Tools and Projects"],"sub_categories":["Anomalies Detection","Node.js"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsodadata%2Fsoda-sql","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsodadata%2Fsoda-sql","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsodadata%2Fsoda-sql/lists"}