{"id":26582934,"url":"https://github.com/flex-development/vfile-tokenizer","last_synced_at":"2025-03-23T08:18:57.212Z","repository":{"id":245332991,"uuid":"815760853","full_name":"flex-development/vfile-tokenizer","owner":"flex-development","description":"vfile utility to tokenize a file","archived":false,"fork":false,"pushed_at":"2025-03-17T04:56:56.000Z","size":2173,"stargazers_count":2,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-17T05:27:38.589Z","etag":null,"topics":["lexer","parse","tokenize","vfile","vfile-util"],"latest_commit_sha":null,"homepage":"https://github.com/flex-development/vfile-tokenizer","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/flex-development.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":".github/funding.yml","license":"LICENSE.md","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":["flex-development"]}},"created_at":"2024-06-16T04:21:59.000Z","updated_at":"2025-03-17T04:57:00.000Z","dependencies_parsed_at":"2025-03-10T05:21:05.101Z","dependency_job_id":"4ad6392a-a3f3-48e6-aef2-004eb69cad62","html_url":"https://github.com/flex-development/vfile-tokenizer","commit_stats":null,"previous_names":["flex-development/vfile-lexer","flex-development/vfile-tokenizer"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/flex-development%2Fvfile-tokenizer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/flex-development%2Fvfile-tokenizer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/flex-development%2Fvfile-tokenizer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/flex-development%2Fvfile-tokenizer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/flex-development","download_url":"https://codeload.github.com/flex-development/vfile-tokenizer/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245072760,"owners_count":20556432,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["lexer","parse","tokenize","vfile","vfile-util"],"created_at":"2025-03-23T08:18:56.603Z","updated_at":"2025-03-23T08:18:57.200Z","avatar_url":"https://github.com/flex-development.png","language":"TypeScript","funding_links":["https://github.com/sponsors/flex-development"],"categories":[],"sub_categories":[],"readme":"# vfile-tokenizer\n\n[![github release](https://img.shields.io/github/v/release/flex-development/vfile-tokenizer.svg?include_prereleases\\\u0026sort=semver)](https://github.com/flex-development/vfile-tokenizer/releases/latest)\n[![npm](https://img.shields.io/npm/v/@flex-development/vfile-tokenizer.svg)](https://npmjs.com/package/@flex-development/vfile-tokenizer)\n[![codecov](https://codecov.io/gh/flex-development/vfile-tokenizer/graph/badge.svg?token=iA1BvaucoZ)](https://codecov.io/gh/flex-development/vfile-tokenizer)\n[![module type: esm](https://img.shields.io/badge/module%20type-esm-brightgreen)](https://github.com/voxpelli/badges-cjs-esm)\n[![license](https://img.shields.io/github/license/flex-development/vfile-tokenizer.svg)](LICENSE.md)\n[![conventional commits](https://img.shields.io/badge/-conventional%20commits-fe5196?logo=conventional-commits\\\u0026logoColor=ffffff)](https://conventionalcommits.org)\n[![typescript](https://img.shields.io/badge/-typescript-3178c6?logo=typescript\\\u0026logoColor=ffffff)](https://typescriptlang.org)\n[![vitest](https://img.shields.io/badge/-vitest-6e9f18?style=flat\\\u0026logo=vitest\\\u0026logoColor=ffffff)](https://vitest.dev)\n[![yarn](https://img.shields.io/badge/-yarn-2c8ebb?style=flat\\\u0026logo=yarn\\\u0026logoColor=ffffff)](https://yarnpkg.com)\n\n[vfile][] utility to tokenize a file\n\n## Contents\n\n- [What is this?](#what-is-this)\n- [When should I use this?](#when-should-i-use-this)\n- [Install](#install)\n- [Use](#use)\n- [API](#api)\n- [Types](#types)\n- [Related](#related)\n- [Contribute](#contribute)\n\n## What is this?\n\n**TODO**: what is this?\n\n## When should I use this?\n\n**TODO**: when should I use this?\n\n## Install\n\nThis package is [ESM only][esm].\n\nIn Node.js with [yarn][]:\n\n```sh\nyarn add @flex-development/vfile-tokenizer\n```\n\n\u003cblockquote\u003e\n  \u003csmall\u003e\n    See \u003ca href='https://yarnpkg.com/protocol/git'\u003eGit - Protocols | Yarn\u003c/a\u003e\n    \u0026nbsp;for details regarding installing from Git.\n  \u003c/small\u003e\n\u003c/blockquote\u003e\n\nIn Deno with [`esm.sh`][esmsh]:\n\n```ts\nimport {} from 'https://esm.sh/@flex-development/vfile-tokenizer'\n```\n\nIn browsers with [`esm.sh`][esmsh]:\n\n```html\n\u003cscript type=\"module\"\u003e\n  import {} from 'https://esm.sh/@flex-development/vfile-tokenizer'\n\u003c/script\u003e\n```\n\n## Use\n\n**TODO**: use\n\n## API\n\n**TODO**: api\n\n## Types\n\nThis package is fully typed with [TypeScript][].\n\n## Related\n\n- [`vfile-location`][vfile-location] — [vfile][] utility to convert between point and offset based locations\n- [`vfile-reader`][vfile-reader] — [vfile][] utility to read from a file\n\n## Contribute\n\nSee [`CONTRIBUTING.md`](CONTRIBUTING.md).\n\nThis project has a [code of conduct](CODE_OF_CONDUCT.md). By interacting with this repository, organization, or\ncommunity you agree to abide by its terms.\n\n[esm]: https://gist.github.com/sindresorhus/a39789f98801d908bbc7ff3ecc99d99c\n\n[esmsh]: https://esm.sh\n\n[typescript]: https://www.typescriptlang.org\n\n[vfile-location]: https://github.com/flex-development/vfile-location\n\n[vfile-reader]: https://github.com/flex-development/vfile-reader\n\n[vfile]: https://github.com/vfile/vfile\n\n[yarn]: https://yarnpkg.com\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fflex-development%2Fvfile-tokenizer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fflex-development%2Fvfile-tokenizer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fflex-development%2Fvfile-tokenizer/lists"}