https://github.com/theseer/tokenizer

A small library for converting tokenized PHP source code into XML (and potentially other formats)
https://github.com/theseer/tokenizer

php tokenizer xml

Last synced: 6 months ago
JSON representation

A small library for converting tokenized PHP source code into XML (and potentially other formats)

• Host: GitHub
• URL: https://github.com/theseer/tokenizer
• Owner: theseer
• License: other
• Created: 2017-04-05T17:28:30.000Z (over 8 years ago)
• Default Branch: master
• Last Pushed: 2024-03-18T08:53:34.000Z (over 1 year ago)
• Last Synced: 2025-05-08T01:04:57.477Z (6 months ago)
• Topics: php, tokenizer, xml
• Language: PHP
• Size: 83 KB
• Stars: 5,190
• Watchers: 8
• Forks: 22
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE

Awesome Lists containing this project

README

          
# Tokenizer

A small library for converting tokenized PHP source code into XML.

[![Test](https://github.com/theseer/tokenizer/actions/workflows/ci.yml/badge.svg)](https://github.com/theseer/tokenizer/actions/workflows/ci.yml)

## Installation

You can add this library as a local, per-project dependency to your project using [Composer](https://getcomposer.org/):

    composer require theseer/tokenizer

If you only need this library during development, for instance to run your project's test suite, then you should add it as a development-time dependency:

    composer require --dev theseer/tokenizer

## Usage examples

```php

$tokenizer = new TheSeer\Tokenizer\Tokenizer();

$tokens = $tokenizer->parse(file_get_contents(__DIR__ . '/src/XMLSerializer.php'));

$serializer = new TheSeer\Tokenizer\XMLSerializer();

$xml = $serializer->toXML($tokens);

echo $xml;

```

The generated XML structure looks something like this:

```xml

 

  <?php 

  declare

  (

  strict_types

   

  =

   

  1

  )

  ;

 

```