{"id":13573228,"url":"https://github.com/nakagami/awabi","last_synced_at":"2026-04-05T17:38:50.151Z","repository":{"id":62438440,"uuid":"246946732","full_name":"nakagami/awabi","owner":"nakagami","description":" A morphological analyzer using mecab dictionary","archived":false,"fork":false,"pushed_at":"2025-11-16T23:14:03.000Z","size":74,"stargazers_count":11,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-12-13T19:26:08.255Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nakagami.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2020-03-12T23:10:27.000Z","updated_at":"2025-11-16T23:14:07.000Z","dependencies_parsed_at":"2025-10-18T14:22:06.086Z","dependency_job_id":"15886c4b-b362-49cc-a26c-6700f464988d","html_url":"https://github.com/nakagami/awabi","commit_stats":null,"previous_names":[],"tags_count":14,"template":false,"template_full_name":null,"purl":"pkg:github/nakagami/awabi","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nakagami%2Fawabi","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nakagami%2Fawabi/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nakagami%2Fawabi/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nakagami%2Fawabi/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nakagami","download_url":"https://codeload.github.com/nakagami/awabi/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nakagami%2Fawabi/sbom","scorecard":{"id":673306,"data":{"date":"2025-08-11","repo":{"name":"github.com/nakagami/awabi","commit":"b6d4cf2bbc93bb6d97fb1e78c797f3f5b517af30"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":3.4,"checks":[{"name":"Code-Review","score":0,"reason":"Found 0/30 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/rust.yml:18: update your workflow using https://app.stepsecurity.io/secureworkflow/nakagami/awabi/rust.yml/master?enable=pin","Info:   0 out of   1 GitHub-owned GitHubAction dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"SAST","score":0,"reason":"no SAST tool detected","details":["Warn: no pull requests merged into dev branch"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/rust.yml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: MIT License: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}}]},"last_synced_at":"2025-08-21T20:51:04.139Z","repository_id":62438440,"created_at":"2025-08-21T20:51:04.139Z","updated_at":"2025-08-21T20:51:04.139Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31444702,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-05T15:22:31.103Z","status":"ssl_error","status_checked_at":"2026-04-05T15:22:00.205Z","response_time":75,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-01T15:00:32.053Z","updated_at":"2026-04-05T17:38:50.106Z","avatar_url":"https://github.com/nakagami.png","language":"Rust","funding_links":[],"categories":["Natural Language Processing (preprocessing)"],"sub_categories":[],"readme":"# awabi\n\n`awabi` is a morphological analyzer using mecab dictionary, written in Rust.\n\n## Requirements and how to install\n\nMeCab https://taku910.github.io/mecab/ and related dictionary is required.\n\n### Debian/Ubuntu\n```\n$ sudo apt install mecab mecab-ipadic-utf8\n$ cargo install awabi\n```\n\n### macOS (homebrew)\n```\n$ brew install mecab\n$ brew install mecab-ipadic\n$ cargo install awabi\n```\n\n## How to use\n\n### use as library\n\n#### Best tokens\n\nexample\n```\nuse awabi::tokenizer;\nfn main() {\n    let tokenizer = tokenizer::Tokenizer::new(None).unwrap();\n    let tokens = tokenizer.tokenize(\"すもももももももものうち\");\n    for token in tokens.iter() {\n        println!(\"{}\\t{}\", token.0, token.1);\n    }\n}\n```\n\nresult\n```\nすもも\t名詞,一般,*,*,*,*,すもも,スモモ,スモモ\nも\t助詞,係助詞,*,*,*,*,も,モ,モ\nもも\t名詞,一般,*,*,*,*,もも,モモ,モモ\nも\t助詞,係助詞,*,*,*,*,も,モ,モ\nもも\t名詞,一般,*,*,*,*,もも,モモ,モモ\nの\t助詞,連体化,*,*,*,*,の,ノ,ノ\nうち\t名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ\n```\n\n#### N-best tokens\n\nexample\n```\nuse awabi::tokenizer;\nfn main() {\n    let tokenizer = tokenizer::Tokenizer::new(None).unwrap();\n    let tokens_list = tokenizer.tokenize_n_best(\"すもももももももものうち\", 3);\n    for tokens in tokens_list.iter() {\n        println!(\"------------------------------------------------------\");\n        for token in tokens.iter() {\n            println!(\"{}\\t{}\", token.0, token.1);\n        }\n    }\n}\n```\n\nresult\n```\n------------------------------------------------------\nすもも\t名詞,一般,*,*,*,*,すもも,スモモ,スモモ\nも\t助詞,係助詞,*,*,*,*,も,モ,モ\nもも\t名詞,一般,*,*,*,*,もも,モモ,モモ\nも\t助詞,係助詞,*,*,*,*,も,モ,モ\nもも\t名詞,一般,*,*,*,*,もも,モモ,モモ\nの\t助詞,連体化,*,*,*,*,の,ノ,ノ\nうち\t名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ\n------------------------------------------------------\nすもも\t名詞,一般,*,*,*,*,すもも,スモモ,スモモ\nも\t助詞,係助詞,*,*,*,*,も,モ,モ\nもも\t名詞,一般,*,*,*,*,もも,モモ,モモ\nもも\t名詞,一般,*,*,*,*,もも,モモ,モモ\nも\t助詞,係助詞,*,*,*,*,も,モ,モ\nの\t助詞,連体化,*,*,*,*,の,ノ,ノ\nうち\t名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ\n------------------------------------------------------\nすもも\t名詞,一般,*,*,*,*,すもも,スモモ,スモモ\nもも\t名詞,一般,*,*,*,*,もも,モモ,モモ\nも\t助詞,係助詞,*,*,*,*,も,モ,モ\nもも\t名詞,一般,*,*,*,*,もも,モモ,モモ\nも\t助詞,係助詞,*,*,*,*,も,モ,モ\nの\t助詞,連体化,*,*,*,*,の,ノ,ノ\nうち\t名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ\n```\n\n#### Use the specified mecabrc\n\nIf the Mecab dictionary is not in the usual location,\npass the Mecab dictionary path to tokenizer::Tokenizer::new().\n\nFor example, if you installed it using brew on macOS, you would specify it as follows:\n```\nuse awabi::tokenizer;\nfn main() {\n    let tokenizer = tokenizer::Tokenizer::new(Some(\"/opt/homebrew/etc/mecabrc\")).unwrap();\n    let tokens = tokenizer.tokenize(\"すもももももももものうち\");\n    for token in tokens.iter() {\n        println!(\"{}\\t{}\", token.0, token.1);\n    }\n}\n```\n\n### awabi command\n\n```\n$ echo 'すもももももももものうち'  | awabi\nすもも  名詞,一般,*,*,*,*,すもも,スモモ,スモモ\nも      助詞,係助詞,*,*,*,*,も,モ,モ\nもも    名詞,一般,*,*,*,*,もも,モモ,モモ\nも      助詞,係助詞,*,*,*,*,も,モ,モ\nもも    名詞,一般,*,*,*,*,もも,モモ,モモ\nの      助詞,連体化,*,*,*,*,の,ノ,ノ\nうち    名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ\nEOS\n```\n```\n$ echo 'すもももももももものうち'  | awabi -N 2\nすもも  名詞,一般,*,*,*,*,すもも,スモモ,スモモ\nも      助詞,係助詞,*,*,*,*,も,モ,モ\nもも    名詞,一般,*,*,*,*,もも,モモ,モモ\nも      助詞,係助詞,*,*,*,*,も,モ,モ\nもも    名詞,一般,*,*,*,*,もも,モモ,モモ\nの      助詞,連体化,*,*,*,*,の,ノ,ノ\nうち    名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ\nEOS\nすもも  名詞,一般,*,*,*,*,すもも,スモモ,スモモ\nも      助詞,係助詞,*,*,*,*,も,モ,モ\nもも    名詞,一般,*,*,*,*,もも,モモ,モモ\nもも    名詞,一般,*,*,*,*,もも,モモ,モモ\nも      助詞,係助詞,*,*,*,*,も,モ,モ\nの      助詞,連体化,*,*,*,*,の,ノ,ノ\nうち    名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ\nEOS\n```\n\n## See also\n\n- pyawabi https://github.com/nakagami/pyawabi Python wrapper\n- exawabi https://github.com/nakagami/exawabi Elixir wrapper\n- goawabi https://github.com/nakagami/goawabi Go implementation\n- pure-pyawabi https://github.com/nakagami/pure-pyawabi Python implementation\n- Awabi.jl https://github.com/nakagami/Awabi.jl Julia implementation\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnakagami%2Fawabi","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnakagami%2Fawabi","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnakagami%2Fawabi/lists"}