{"id":46350236,"url":"https://github.com/microsoft/opendatasheets-framework","last_synced_at":"2026-03-04T23:00:47.430Z","repository":{"id":152162612,"uuid":"606923399","full_name":"microsoft/opendatasheets-framework","owner":"microsoft","description":"This framework aims to assists in the documentation of datasets to promote transparency and help dataset creators and consumers make informed decisions about whether specific datasets meet their needs and what limitations they need to consider","archived":false,"fork":false,"pushed_at":"2024-06-23T18:08:57.000Z","size":12368,"stargazers_count":37,"open_issues_count":0,"forks_count":3,"subscribers_count":4,"default_branch":"main","last_synced_at":"2026-02-21T19:05:42.853Z","etag":null,"topics":["open-data","open-datasets","responsible-ai"],"latest_commit_sha":null,"homepage":"https://microsoft.github.io/opendatasheets/","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/microsoft.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":"SUPPORT.md","governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-02-26T23:44:22.000Z","updated_at":"2026-01-23T12:28:17.000Z","dependencies_parsed_at":"2024-06-23T19:35:09.314Z","dependency_job_id":null,"html_url":"https://github.com/microsoft/opendatasheets-framework","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/microsoft/opendatasheets-framework","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/microsoft%2Fopendatasheets-framework","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/microsoft%2Fopendatasheets-framework/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/microsoft%2Fopendatasheets-framework/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/microsoft%2Fopendatasheets-framework/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/microsoft","download_url":"https://codeload.github.com/microsoft/opendatasheets-framework/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/microsoft%2Fopendatasheets-framework/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30078806,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-04T08:01:56.766Z","status":"ssl_error","status_checked_at":"2026-03-04T08:00:42.919Z","response_time":59,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["open-data","open-datasets","responsible-ai"],"created_at":"2026-03-04T23:00:25.656Z","updated_at":"2026-03-04T23:00:47.424Z","avatar_url":"https://github.com/microsoft.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# Open Datasheets\n\nThe Open Datasheets framework is a simple, standardized no-code way to document datasets. It is inspired by the concept of [datasheets for datasets](https://arxiv.org/abs/1803.09010) and [Understanding Machine Learning Practitioners' Data Documentation Perceptions, Needs, Challenges, and Desiderata](https://dl.acm.org/doi/10.1145/3555760) research papers. The framework is designed to be both machine-readable and human-readable, serving as a tool for dataset creators to document their datasets and for dataset consumers to understand the datasets they are using.\n\nBy integrating directly with GitHub, the framework allows you to create, edit, and export your Open Datasheets directly to GitHub. It leverages the widely used [Data Package](https://specs.frictionlessdata.io/data-package/) standard to describe the dataset and its metadata, benefiting from the support of various tools and libraries. Additionally, it extends this standard to incorporate responsible AI aspects into the dataset documentation, derived from [Microsoft’s Aether data documentation](https://www.microsoft.com/en-us/research/uploads/prod/2022/07/aether-datadoc-082522.pdf). This includes information about the dataset's provenance, collection process, privacy and security considerations, and more.\n\nAdhering to good data documentation practices is crucial for responsible AI, as it helps assess how a dataset may impact machine learning models and other solutions derived from it.\n\nThe primary goal of this framework is to facilitate dataset documentation, promote transparency, and aid dataset creators and consumers in making informed decisions about the suitability of specific datasets and the limitations they may have. This framework achieves its goal by applying a no-code approach, making it accessible to both non-technical data producers and those with a technical background. For more detailed information, you can refer to our paper titled \"[Open Datasheets: Machine-readable Documentation for Open Datasets and Responsible AI Assessments](https://arxiv.org/abs/2312.06153)\".\n\n# Try the No-Code App\nWe have created a no-code web tool to help you create, edit, generate, and export an Open Datasheets `datapackage.json` file for your datasets directly to/from GitHub. You can also work with files located locally on your computer. \n\nYou can try it out here: [https://microsoft.github.io/opendatasheets](https://microsoft.github.io/opendatasheets).\n\nWith the no-code tool, you have the ability to:\n- Create a new Open Datasheets datapackage from scratch.\n- Generate a new Open Datasheets datapackage from data located on GitHub or a local file.\n- Modify an existing Open Datasheets datapackage file from GitHub or a local file.\n- Save an Open Datasheets datapackage file to GitHub or locally.\n\n\nDEMO:\n\n![demo](./assets/demo.gif)\n\n# Top level schema\n\n| Property | Description | Key Elements for Fostering Responsible AI |\n| --- | --- | --- |\n| name | The name of the data package. |  |\n| title | The title of the data package. | |\n| description | The description of the data package. |  |\n| version | The version of the data package. |  |\n| created | The date when the data package was created. |  |\n| licenses | The licenses under which the data package is distributed. |  |\n| sources | The sources from which the data package is derived. |  |\n| resources | The resources included in the data package. |  |\n| contributors | The contributors to the data package. | |\n| privacy | The privacy considerations for the data package. | \u0026#x2705; |\n| security | The security considerations for the data package. | \u0026#x2705; |\n| procedures | The collection, processing, and update procedures for the data package. | \u0026#x2705; |\n| use | The permitted use of the data package. | \u0026#x2705; |\n\nFor the complete schema, please refer to the [Open Datasheets schema](./examples/datapackage.json).\n\nFor more detailed information about the responsible AI properties, such as collection procedures, privacy, and security considerations, please refer to the [Open Datasheets paper](https://arxiv.org/pdf/2312.06153).\n\n## Contributing\n\nThis project welcomes contributions and suggestions.  Most contributions require you to agree to a\nContributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us\nthe rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.\n\nWhen you submit a pull request, a CLA bot will automatically determine whether you need to provide\na CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions\nprovided by the bot. You will only need to do this once across all repos using our CLA.\n\nThis project has adopted the [Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct/).\nFor more information see the [Code of Conduct FAQ](https://opensource.microsoft.com/codeofconduct/faq/) or\ncontact [opencode@microsoft.com](mailto:opencode@microsoft.com) with any additional questions or comments.\n\n## Trademarks\n\nThis project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft \ntrademarks or logos is subject to and must follow \n[Microsoft's Trademark \u0026 Brand Guidelines](https://www.microsoft.com/en-us/legal/intellectualproperty/trademarks/usage/general).\nUse of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship.\nAny use of third-party trademarks or logos are subject to those third-party's policies.\n\n# Citation\n\nIf you use the Open Datasheets framework in your research or project, please cite our paper:\n\n```\n@article{roman2023open,\n  title={Open Datasheets: Machine-readable Documentation for Open Datasets and Responsible AI Assessments},\n  author={Roman, Anthony Cintron and Vaughan, Jennifer Wortman and See, Valerie and Ballard, Steph and Schifano, Nicolas and Torres, Jehu and Robinson, Caleb and Ferres, Juan M Lavista},\n  journal={arXiv preprint arXiv:2312.06153},\n  year={2023}\n}\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmicrosoft%2Fopendatasheets-framework","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmicrosoft%2Fopendatasheets-framework","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmicrosoft%2Fopendatasheets-framework/lists"}