{"id":20104854,"url":"https://github.com/doccano/doccano-transformer","last_synced_at":"2025-05-07T08:21:38.636Z","repository":{"id":40959358,"uuid":"251006528","full_name":"doccano/doccano-transformer","owner":"doccano","description":"The official tool for transforming doccano format into common dataset formats.","archived":false,"fork":false,"pushed_at":"2023-04-18T15:54:11.000Z","size":124,"stargazers_count":106,"open_issues_count":19,"forks_count":33,"subscribers_count":9,"default_branch":"master","last_synced_at":"2025-04-14T19:15:22.803Z","etag":null,"topics":["annotation","conll","dataset","doccano","machine-learning","natural-language-processing"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/doccano.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-03-29T10:32:42.000Z","updated_at":"2025-04-09T05:27:29.000Z","dependencies_parsed_at":"2024-12-26T06:21:52.456Z","dependency_job_id":null,"html_url":"https://github.com/doccano/doccano-transformer","commit_stats":{"total_commits":83,"total_committers":6,"mean_commits":"13.833333333333334","dds":"0.28915662650602414","last_synced_commit":"19ad77c39faaece84adcea3c3cb0b282b7cbe131"},"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/doccano%2Fdoccano-transformer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/doccano%2Fdoccano-transformer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/doccano%2Fdoccano-transformer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/doccano%2Fdoccano-transformer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/doccano","download_url":"https://codeload.github.com/doccano/doccano-transformer/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252839685,"owners_count":21812149,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["annotation","conll","dataset","doccano","machine-learning","natural-language-processing"],"created_at":"2024-11-13T17:44:58.848Z","updated_at":"2025-05-07T08:21:38.607Z","avatar_url":"https://github.com/doccano.png","language":"Python","readme":"# doccano-transformer\n\n[![Codacy Badge](https://api.codacy.com/project/badge/Grade/9fe17d104b644a53a3fe189433d3c797)](https://app.codacy.com/gh/doccano/doccano-transformer?utm_source=github.com\u0026utm_medium=referral\u0026utm_content=doccano/doccano-transformer\u0026utm_campaign=Badge_Grade_Dashboard)\n[![Build Status](https://github.com/doccano/doccano-transformer/workflows/CI/badge.svg)](https://github.com/doccano/doccano-transformer/actions)\n\nDoccano Transformer helps you to transform an exported dataset into the format of your favorite machine learning library.\n\n## Supported formats\n\nDoccano Transformer supports the following formats:\n\n* CoNLL 2003\n* spaCy\n\n## Install\n\nTo install `doccano-transformer`, simply use `pip`:\n\n```bash\npip install doccano-transformer\n```\n\n## Examples\n\n### Named Entity Recognition\n\nThe following formats are supported:\n\n- CoNLL 2003\n- spaCy\n\n```python\nfrom doccano_transformer.datasets import NERDataset\nfrom doccano_transformer.utils import read_jsonl\n\ndataset = read_jsonl(filepath='example.jsonl', dataset=NERDataset, encoding='utf-8')\ndataset.to_conll2003(tokenizer=str.split)\ndataset.to_spacy(tokenizer=str.split)\n```\n\n## Contribution\n\nWe encourage you to contribute to doccano transformer! Please check out the [Contributing to doccano transformer guide](https://github.com/doccano/doccano-transformer/blob/master/CONTRIBUTING.md) for guidelines about how to proceed. \n\n## License\n\n[MIT](https://github.com/doccano/doccano-transformer/blob/master/LICENSE)\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdoccano%2Fdoccano-transformer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdoccano%2Fdoccano-transformer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdoccano%2Fdoccano-transformer/lists"}