{"id":24503977,"url":"https://github.com/hnthap/vietnamese-word-segment","last_synced_at":"2026-05-19T06:02:47.096Z","repository":{"id":273542624,"uuid":"920052937","full_name":"hnthap/vietnamese-word-segment","owner":"hnthap","description":"Vietnamese word segmentation package.","archived":false,"fork":false,"pushed_at":"2025-01-22T02:26:29.000Z","size":10,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-15T08:25:40.372Z","etag":null,"topics":["cuda","torch","transformers","vietnamese","vietnamese-nlp","vietnamese-tokenizer","word-segmentation"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"cc0-1.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hnthap.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-01-21T13:37:31.000Z","updated_at":"2025-01-22T02:25:21.000Z","dependencies_parsed_at":"2025-01-21T15:22:50.740Z","dependency_job_id":null,"html_url":"https://github.com/hnthap/vietnamese-word-segment","commit_stats":null,"previous_names":["hnthap/vietnamese-word-segment"],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/hnthap/vietnamese-word-segment","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hnthap%2Fvietnamese-word-segment","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hnthap%2Fvietnamese-word-segment/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hnthap%2Fvietnamese-word-segment/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hnthap%2Fvietnamese-word-segment/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hnthap","download_url":"https://codeload.github.com/hnthap/vietnamese-word-segment/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hnthap%2Fvietnamese-word-segment/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266039000,"owners_count":23867815,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cuda","torch","transformers","vietnamese","vietnamese-nlp","vietnamese-tokenizer","word-segmentation"],"created_at":"2025-01-21T23:19:20.163Z","updated_at":"2026-05-19T06:02:42.041Z","avatar_url":"https://github.com/hnthap.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Vietnamese Word Segmentation Wrapper\n\nThis is a word segmentation package for Vietnamese. The code basically wraps around the [Vietnamese Word Segmentation model](https://huggingface.co/NlpHUST/vi-word-segmentation).\n\nThe requirements are:\n\n- `python` \u003e= 3.10\n- `torch` \u003e= 2.0\n- `transformers`\n\nInstall with:\n\n```bash\npip install git+https://github.com/hnthap/vietnamese-word-segment\n```\n\nExample code:\n\n```python\nfrom vwsegment import WordSegments\n\n\nexamples = [\n    'Tất cả mọi người đều có quyền sống, quyền tự chủ và quyền an toàn cho cá nhân.',\n    'Không ai có thể bị bắt làm nô lệ hoặc nô dịch; chế độ nô lệ và việc buôn nô lệ bị cấm dưới mọi hình thức.',\n    'Không ai có thể bị tra tấn hoặc bạo hành, hoặc phải nhận sự đối xử hoặc trừng phạt một cách vô nhân tính và hèn hạ.',\n]\n\nsegments_list = WordSegments(examples, case=False, device='cuda', batch_size=128)\nfor segments in segments_list:\n    print(' '.join(segments))\n```\n\nThe output would be:\n\n```text\ntất_cả mọi người đều có quyền sống , quyền tự_chủ và quyền an_toàn cho cá_nhân .\nkhông ai có_thể bị bắt làm nô_lệ hoặc nô_dịch ; chế_độ nô_lệ và việc buôn nô_lệ bị cấm dưới mọi hình_thức .\nkhông ai có_thể bị tra_tấn hoặc bạo_hành , hoặc phải nhận sự đối_xử hoặc trừng_phạt một_cách vô_nhân_tính và hèn_hạ .\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhnthap%2Fvietnamese-word-segment","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhnthap%2Fvietnamese-word-segment","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhnthap%2Fvietnamese-word-segment/lists"}