{"id":27250199,"url":"https://github.com/ahmad-mtr/string_tokenizer","last_synced_at":"2025-07-16T15:38:06.291Z","repository":{"id":217441760,"uuid":"743874441","full_name":"Ahmad-Mtr/string_tokenizer","owner":"Ahmad-Mtr","description":"A Dart package that separates a string to Tokens.","archived":false,"fork":false,"pushed_at":"2024-01-16T11:19:56.000Z","size":10,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2024-02-16T08:22:29.814Z","etag":null,"topics":["dart","string","string-manipulation","stringtokenizer","tokenizer"],"latest_commit_sha":null,"homepage":"https://pub.dev/packages/string_tokenizer_1","language":"Dart","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Ahmad-Mtr.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2024-01-16T07:08:32.000Z","updated_at":"2024-01-20T08:18:47.000Z","dependencies_parsed_at":"2024-01-16T13:24:05.023Z","dependency_job_id":"4ecb794f-e8cb-4ee3-af58-3c90e8955dcb","html_url":"https://github.com/Ahmad-Mtr/string_tokenizer","commit_stats":null,"previous_names":["ahmad-mtr/string_tokenizer"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ahmad-Mtr%2Fstring_tokenizer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ahmad-Mtr%2Fstring_tokenizer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ahmad-Mtr%2Fstring_tokenizer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ahmad-Mtr%2Fstring_tokenizer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Ahmad-Mtr","download_url":"https://codeload.github.com/Ahmad-Mtr/string_tokenizer/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248322750,"owners_count":21084336,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dart","string","string-manipulation","stringtokenizer","tokenizer"],"created_at":"2025-04-11T00:34:28.618Z","updated_at":"2025-04-11T00:34:29.213Z","avatar_url":"https://github.com/Ahmad-Mtr.png","language":"Dart","readme":"\u003c!-- \nThis README describes the package. If you publish this package to pub.dev,\nthis README's contents appear on the landing page for your package.\n\nFor information about how to write a good package README, see the guide for\n[writing package pages](https://dart.dev/guides/libraries/writing-package-pages). \n\nFor general information about developing packages, see the Dart guide for\n[creating packages](https://dart.dev/guides/libraries/create-library-packages)\nand the Flutter guide for\n[developing packages and plugins](https://flutter.dev/developing-packages). \n--\u003e\n\nA more advanced String Tokenizer than the available `split()` method in dart.\n\n## Features\n\n1. Splitting Strings into multiple chunks based on delimeters, and the ability to change those delimeters anytime.\n2. Checking if the String has more Tokens, `hasMoreTokens()`.\n3. Use every Token for any processing on the go, while still having the non-tokenized part of the Input String with `nextToken()`. \n4. Can Tokenize all Input String similarlly to `split()` method, by using `tokenizeAll()`. \n\n## Getting started\n\n```bash\ndart pub add string_tokenizer_1\n```\n\n## Usage\n\n\u003e Longer examples in `/example` folder. \n\n```dart\nimport 'package:string_tokenizer_1/string_tokenizer_1.dart';\n```\n```dart\n  final input2 =\n      \"package:string_tokenizer/...\";\n  final objkt2 = StringTokenizer(input2, [':']);\n\n  final res = objkt2.nextToken();\n  print(res); // package\n```\n## Additional information\n* All information, source code: [Github Repo](https://github.com/Ahmad-Mtr/string_tokenizer).\n* All Contributions are welcome via pull-requests, please make sure to submit cleaner code, with documenting changes or providing a basic info for other users of this Package.\n* Issues, suggestions, are all welcome via Github Issues.\n\u003e Please note that this package was intended only for a personal project of mine, there's a high chance of not contributing to this package later.","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fahmad-mtr%2Fstring_tokenizer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fahmad-mtr%2Fstring_tokenizer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fahmad-mtr%2Fstring_tokenizer/lists"}