{"id":14181744,"url":"https://github.com/THU-BPM/chatgpt-sql","last_synced_at":"2025-08-07T14:31:21.581Z","repository":{"id":175122014,"uuid":"612797794","full_name":"THU-BPM/chatgpt-sql","owner":"THU-BPM","description":"The prediction results of ChatGPT on various datasets of Text-to-SQL.","archived":false,"fork":false,"pushed_at":"2023-06-14T01:07:03.000Z","size":95059,"stargazers_count":96,"open_issues_count":3,"forks_count":7,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-08-18T11:13:38.364Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://arxiv.org/pdf/2303.13547.pdf","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/THU-BPM.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-03-12T02:02:08.000Z","updated_at":"2024-08-09T07:20:21.000Z","dependencies_parsed_at":null,"dependency_job_id":"0c89b2da-363a-4250-954e-5fc29ae1faf6","html_url":"https://github.com/THU-BPM/chatgpt-sql","commit_stats":null,"previous_names":["thu-bpm/chatgpt-sql"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/THU-BPM%2Fchatgpt-sql","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/THU-BPM%2Fchatgpt-sql/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/THU-BPM%2Fchatgpt-sql/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/THU-BPM%2Fchatgpt-sql/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/THU-BPM","download_url":"https://codeload.github.com/THU-BPM/chatgpt-sql/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":229045112,"owners_count":18011443,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-18T11:04:12.047Z","updated_at":"2024-12-10T10:31:15.542Z","avatar_url":"https://github.com/THU-BPM.png","language":"Python","funding_links":[],"categories":["💬 Classic Model"],"sub_categories":[],"readme":"# chatgpt-sql\n\nThe prediction results of ChatGPT on various datasets of Text-to-SQL.\n\nFor the specific evaluation methods and results, please refer to this paper \"A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capability\" (https://arxiv.org/pdf/2303.13547.pdf). \n\n## Download dataset\nYou can find the datasets in the following links: \n* Spider dataset: https://drive.google.com/uc?export=download\u0026id=1TqleXec_OykOYFREKKtschzY29dUcVAQ\n* Spider-SYN dataset: https://github.com/ygan/Spider-Syn\n* Spider-DK dataset: https://github.com/ygan/Spider-DK\n* Spider-Realistic dataset: https://zenodo.org/record/5205322\n* ADVETA: https://github.com/microsoft/ContextualSP\n* Spider-CG: https://github.com/ygan/SpiderSS-SpiderCG\n* Sparc: https://yale-lily.github.io/sparc\n* CoSQL: https://yale-lily.github.io/cosql\n* CSPIDER: https://taolusi.github.io/CSpider-explorer/\n* DuSQL: https://github.com/luge-ai/luge-ai/tree/master/semantic-parsing\n\n## Test example on spider dataset\n\n### generate data \n```python\npython generate_txt.py\n```\n\n### generate evaluation result (unzip the database.zip first)\n```python\npython evaluation.py --gold gold_example.txt --pred pred_example.txt --etype exec --db spider/database --table spider/tables.json\n```\n\nThe result should be following:\n\n![image](figure/result.png)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FTHU-BPM%2Fchatgpt-sql","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FTHU-BPM%2Fchatgpt-sql","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FTHU-BPM%2Fchatgpt-sql/lists"}