https://javacc.github.io/javacc/
JavaCC - a parser generator for building parsers from grammars. It can generate code in Java, C++ and C#.
https://javacc.github.io/javacc/
Last synced: 18 days ago
JSON representation
JavaCC - a parser generator for building parsers from grammars. It can generate code in Java, C++ and C#.
- Host: GitHub
- URL: https://javacc.github.io/javacc/
- Owner: javacc
- License: bsd-3-clause
- Created: 2016-07-20T03:23:59.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2025-02-26T07:30:52.000Z (about 2 months ago)
- Last Synced: 2025-03-25T23:01:42.485Z (20 days ago)
- Language: Java
- Homepage: https://javacc.org
- Size: 7.48 MB
- Stars: 1,219
- Watchers: 39
- Forks: 251
- Open Issues: 42
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-java - JavaCC - Parser generator that generates top-down parsers. Allows lexical state switching and permits extended BNF specifications. (Projects / Compiler-compiler)
- awesome-java-zh - JavaCC - 生成自顶向下解析器的解析器生成器。允许词法状态切换，并允许扩展的BNF规范。 (项目 / 编译器-编译器)
- awesome-java - JavaCC - Parser generator that generates top-down parsers. Allows lexical state switching and permits extended BNF specifications. (Projects / Compiler-compiler)
README
# JavaCC
[](https://maven-badges.herokuapp.com/maven-central/net.java.dev.javacc/javacc)
[](https://www.javadoc.io/doc/net.java.dev.javacc/javacc)
Java Compiler Compiler (JavaCC) is the most popular parser generator for use with Java applications.
A parser generator is a tool that reads a grammar specification and converts it to a Java program that can recognize matches to the grammar.
In addition to the parser generator itself, JavaCC provides other standard capabilities related to parser generation such as tree building (via a tool called JJTree included with JavaCC), actions and debugging.
All you need to run a JavaCC parser, once generated, is a Java Runtime Environment (JRE).
This README is meant as a brief overview of the core features and how to set things up to get yourself started with JavaCC. For a fully detailed documentation, please see [https://javacc.github.io/javacc/](https://javacc.github.io/javacc/).
## Contents
- [Introduction](#introduction)
* [Features](#features)
* [An example](#an-example)
* [Tutorials](docs/tutorials/index.md)
* [FAQ](docs/faq.md)
- [Getting Started](#getting-started)
* [From the command line](#use-javacc-from-the-command-line)
* [Within an IDE](#use-javacc-within-an-ide)
* [Rebuilding JavaCC](#rebuilding-javacc)
- [Community](#community)
* [Support](#support)
* [Documentation](#documentation)
* [Resources](#resources)
* [Powered by JavaCC](#powered-by-javacc)
- [License](#license)
## Introduction
### Features
* JavaCC generates top-down ([recursive descent](https://en.wikipedia.org/wiki/Recursive_descent_parser)) parsers as opposed to bottom-up parsers generated by [YACC](https://en.wikipedia.org/wiki/Yacc)-like tools. This allows the use of more general grammars, although [left-recursion](https://en.wikipedia.org/wiki/Left_recursion) is disallowed. Top-down parsers have a number of other advantages (besides more general grammars) such as being easier to debug, having the ability to parse to any [non-terminal](https://en.wikipedia.org/wiki/Terminal_and_nonterminal_symbols) in the grammar, and also having the ability to pass values (attributes) both up and down the parse tree during parsing.
* By default, JavaCC generates an `LL(1)` parser. However, there may be portions of grammar that are not `LL(1)`. JavaCC offers the capabilities of syntactic and semantic lookahead to resolve shift-shift ambiguities locally at these points. For example, the parser is `LL(k)` only at such points, but remains `LL(1)` everywhere else for better performance. Shift-reduce and reduce-reduce conflicts are not an issue for top-down parsers.
* JavaCC generates parsers that are 100% pure Java, so there is no runtime dependency on JavaCC and no special porting effort required to run on different machine platforms.
* JavaCC allows [extended BNF](https://en.wikipedia.org/wiki/Extended_Backus%E2%80%93Naur_form) specifications - such as `(A)*`, `(A)+` etc - within the lexical and the grammar specifications. Extended BNF relieves the need for left-recursion to some extent. In fact, extended BNF is often easier to read as in `A ::= y(x)*` versus `A ::= Ax|y`.
* The lexical specifications (such as regular expressions, strings) and the grammar specifications (the BNF) are both written together in the same file. It makes grammars easier to read since it is possible to use regular expressions inline in the grammar specification, and also easier to maintain.
* The [lexical analyzer](https://en.wikipedia.org/wiki/Lexical_analysis) of JavaCC can handle full Unicode input, and lexical specifications may also include any Unicode character. This facilitates descriptions of language elements such as Java identifiers that allow certain Unicode characters (that are not ASCII), but not others.
* JavaCC offers [Lex](https://en.wikipedia.org/wiki/Lex_(software))-like lexical state and lexical action capabilities. Specific aspects in JavaCC that are superior to other tools are the first class status it offers concepts such as `TOKEN`, `MORE`, `SKIP` and state changes. This allows cleaner specifications as well as better error and warning messages from JavaCC.
* Tokens that are defined as *special tokens* in the lexical specification are ignored during parsing, but these tokens are available for processing by the tools. A useful application of this is in the processing of comments.
* Lexical specifications can define tokens not to be case-sensitive either at the global level for the entire lexical specification, or on an individual lexical specification basis.
* JavaCC comes with JJTree, an extremely powerful tree building pre-processor.
* JavaCC also includes JJDoc, a tool that converts grammar files to documentation files, optionally in HTML.
* JavaCC offers many options to customize its behavior and the behavior of the generated parsers. Examples of such options are the kinds of Unicode processing to perform on the input stream, the number of tokens of ambiguity checking to perform etc.
* JavaCC error reporting is among the best in parser generators. JavaCC generated parsers are able to clearly point out the location of parse errors with complete diagnostic information.
* Using options `DEBUG_PARSER`, `DEBUG_LOOKAHEAD`, and `DEBUG_TOKEN_MANAGER`, users can get in-depth analysis of the parsing and the token processing steps.
* The JavaCC release includes a wide range of examples including Java and HTML grammars. The examples, along with their documentation, are a great way to get acquainted with JavaCC.
### An example
The following JavaCC grammar example recognizes matching braces followed by zero or more line terminators and then an end of file.
Examples of legal strings in this grammar are:
`{}`, `{% raw %}{{{{{}}}}}{% endraw %}` // ... etc
Examples of illegal strings are:
`{}{}`, `}{}}`, `{ }`, `{x}` // ... etc
##### Its grammar
```java
PARSER_BEGIN(Example)
/** Simple brace matcher. */
public class Example {
/** Main entry point. */
public static void main(String args[]) throws ParseException {
Example parser = new Example(System.in);
parser.Input();
}
}
PARSER_END(Example)
/** Root production. */
void Input() :
{}
{
MatchedBraces() ("\n"|"\r")*
}
/** Brace matching production. */
void MatchedBraces() :
{}
{
"{" [ MatchedBraces() ] "}"
}
```
##### Some executions and outputs
###### {{}} gives no error
```java
$ java Example
{{}}
```
###### {x gives a Lexical error
```java
$ java Example
{x
Lexical error at line 1, column 2. Encountered: "x"
TokenMgrError: Lexical error at line 1, column 2. Encountered: "x" (120), after : ""
at ExampleTokenManager.getNextToken(ExampleTokenManager.java:146)
at Example.getToken(Example.java:140)
at Example.MatchedBraces(Example.java:51)
at Example.Input(Example.java:10)
at Example.main(Example.java:6)
```
###### {}} gives a ParseException
```java
$ java Example
{}}
ParseException: Encountered "}" at line 1, column 3.
Was expecting one of:
"\n" ...
"\r" ...
at Example.generateParseException(Example.java:184)
at Example.jj_consume_token(Example.java:126)
at Example.Input(Example.java:32)
at Example.main(Example.java:6)
```
## Versions
The RECOMMENDED version is version **8**: it separates the parser (the core) from the generators (for the different languages); development and maintenance effort will be mainly on this version.
This version lies on different Git repositories / java & maven projects / jars:
- the umbrella [javacc-8](https://github.com/javacc/javacc-8)
- the [core](https://github.com/javacc/javacc-8-core)
- the generators:
- [java](https://github.com/javacc/javacc-8-java)
- [C++](https://github.com/javacc/javacc-8-cpp)
- [C#](https://github.com/javacc/javacc-8-csharp)
The previous versions (4, 5, 6, 7) are widely spread; effort to migrate to version 8 should be minimum.
Their last version lies on a single Git repository / java & maven project / jar:
- [javacc](https://github.com/javacc/javacc)
Differences between v8 versus v7: very small at the grammar level, more important at the generated sources level:
- the javacc/jjtree grammar part is the same
- most of javacc/jjtree options should be the same, but some may be removed and others appear in v8
- the java grammar part should be nearly the same (may be some java 7 & java 8 features will appear in v8 and not in v7); in the future java 11..17..21.. features would appear only in v8)
- the C++ / C# grammar parts may be somewhat different
- some generated files are not much different, others are
If you read this README.md, you should be under the v7 code.
## Getting Started
You can use JavaCC either from the command line or through an IDE.
### Use JavaCC from the command line
#### Download
Download the latest stable release (at least the binaries and the sources) in a so called download directory:
##### Version 8
Download the core and the generator(s) you are going to use:
* JavaCC Core 8.0.1 - [Binaries](https://repo1.maven.org/maven2/org/javacc/core/8.0.1/core-8.0.1.jar), [Source (zip)](https://github.com/javacc/javacc-8-core/archive/core-8.0.1.zip), [Source (tar.gz)](https://github.com/javacc/javacc-8-core/archive/core-8.0.1.tar.gz), [Javadocs](https://repo1.maven.org/maven2/org/javacc/core/8.0.1/core-8.0.1-javadoc.jar)
* JavaCC C++ 8.0.1 - [Binaries](https://repo1.maven.org/maven2/org/javacc/generator/cpp/8.0.1/cpp-8.0.1.jar), [Source (zip)](https://github.com/javacc/javacc-8-cpp/archive/cpp-8.0.1.zip), [Source (tar.gz)](https://github.com/javacc/javacc-8-cpp/archive/cpp-8.0.1.tar.gz), [Javadocs](https://repo1.maven.org/maven2/org/javacc/generator/cpp/8.0.1/cpp-8.0.1-javadoc.jar)
* JavaCC C# 8.0.1 - [Binaries](https://repo1.maven.org/maven2/org/javacc/generator/csharp/8.0.1/csharp-8.0.1.jar), [Source (zip)](https://github.com/javacc/javacc-8-csharp/archive/csharp-8.0.1.zip), [Source (tar.gz)](https://github.com/javacc/javacc-8-csharp/archive/csharp-8.0.1.tar.gz), [Javadocs](https://repo1.maven.org/maven2/org/javacc/generator/csharp/8.0.1/csharp-8.0.1-javadoc.jar)
* JavaCC Java 8.0.1 - [Binaries](https://repo1.maven.org/maven2/org/javacc/generator/java/8.0.1/java-8.0.1.jar), [Source (zip)](https://github.com/javacc/javacc-8-java/archive/java-8.0.1.zip), [Source (tar.gz)](https://github.com/javacc/javacc-8-java/archive/java-8.0.1.tar.gz), [Javadocs](https://repo1.maven.org/maven2/org/javacc/generator/java/8.0.1/java-8.0.1-javadoc.jar)
All JavaCC v8 *releases* are available via [GitHub](https://github.com/javacc/javacc-8/releases) and [Maven](https://mvnrepository.com/artifact/org/javacc) including checksums and cryptographic signatures.
##### Version 7
* JavaCC 7.0.13 - [Binaries](https://repo1.maven.org/maven2/net/java/dev/javacc/javacc/7.0.13/javacc-7.0.13.jar), [Source (zip)](https://github.com/javacc/javacc/archive/javacc-7.0.13.zip), [Source (tar.gz)](https://github.com/javacc/javacc/archive/javacc-7.0.13.tar.gz), [Javadocs](https://repo1.maven.org/maven2/net/java/dev/javacc/javacc/7.0.13/javacc-7.0.13-javadoc.jar), [Release Notes](docs/release-notes.md)
All JavaCC v7 releases are available via [GitHub](https://github.com/javacc/javacc/releases) and [Maven](https://mvnrepository.com/artifact/net.java.dev.javacc/javacc) including checksums and cryptographic signatures.
For all previous releases, please see [stable releases](docs/downloads.md).
#### Install
##### Version 8
*To be written*. Help welcomed!
##### Version 7
Once you have downloaded the files, navigate to the download directory and unzip the sources file(s), this creating a so called JavaCC installation directory:
`$ unzip javacc-7.0.13.zip`
or
`$ tar xvf javacc-7.0.13.tar.gz`
Then create a new `target` directory under the installation directory, and copy or move the binary file `javacc-7.0.13.jar` under this `target` directory, and copy or rename it to `javacc.jar`.
Then add the `scripts/` directory under the JavaCC installation directory to your `PATH`. The JavaCC, JJTree, and JJDoc invocation scripts/executables reside in this directory.
On UNIX based systems, the scripts may not be executable immediately. This can be solved by using the command from the `javacc-7.0.13/` directory:
`chmod +x scripts/javacc`
#### Write your grammar and generate your parser
You can then create and edit a grammar file with your favorite text editor.
Then use the appropriate script for generating your parser from your grammar.
### Use JavaCC within an IDE
Minimal requirements for an IDE are:
* Support for Java, C++ or C#
* Support for Maven or Gradle
#### IntelliJ IDEA
The IntelliJ IDE supports Maven out of the box and offers a plugin for JavaCC development.
* IntelliJ download: [https://www.jetbrains.com/idea/](https://www.jetbrains.com/idea/)
* IntelliJ JavaCC Plugin: [https://plugins.jetbrains.com/plugin/11431-javacc/](https://plugins.jetbrains.com/plugin/11431-javacc/)
#### Eclipse IDE
* Eclipse download: [https://www.eclipse.org/ide/](https://www.eclipse.org/ide/)
* Eclipse JavaCC Plugin: [https://marketplace.eclipse.org/content/javacc-eclipse-plug](https://marketplace.eclipse.org/content/javacc-eclipse-plug)
#### Maven
Add the following plugin to your `pom.xml` file, under the build plugins, or under one or more profiles.
##### Version 8
(You must use the javacc-maven-plugin from the JavaCC organization.)
Adapt the versions, the execution(s) (goals `javacc` and/or `jjtree-javacc`) and the `codeGenerator` setting for the generator (`java`, `cpp`, `csharp`). Also add the configuration settings you want to override.
```
org.javacc.plugin
javacc-maven-plugin
3.0.3
javacc
generate-sources
jjtree-javacc
java
org.javacc.generator
java
8.0.1
org.javacc
core
8.0.1
```
##### Version 7
(You can use the [javacc-maven-plugin](https://www.mojohaus.org/javacc-maven-plugin/) from MojoHaus or te [javacc-maven-plugin](https://github.com/javacc/javacc-maven-plugin) from the JavaCC organization.)
Same as above, with a single different dependency, and without the `codeGenerator` setting.
```
net.java.dev.javacc
javacc
7.0.13
```
#### Gradle
##### Version 8
*To be tested / written*. Help welcomed!
##### Version 7
Add the following to your `build.gradle` file.
```
repositories {
mavenLocal()
maven {
url = 'https://mvnrepository.com/artifact/net.java.dev.javacc/javacc'
}
}
dependencies {
compile group: 'net.java.dev.javacc', name: 'javacc', version: '7.0.13'
}
```
### Rebuilding JavaCC
*To be verified / completed*. Help welcomed!
#### From the source installation directory
The source installation directory contains the JavaCC, JJTree and JJDoc sources, launcher scripts, example grammars and documentation, and also a bootstrap version of JavaCC needed to build JavaCC.
Prerequisites for building JavaCC with this method:
* Ant (we require version 1.5.3 or above - you can get ant from [http://ant.apache.org](http://ant.apache.org))
* Maven
* Java 8 (Java 9 and 10 are not yet supported)
Use the ant build script:
```
$ cd javacc
$ ant
```
This will build the `javacc.jar` file in the `target/` directory
#### After cloning the JavaCC GitHub repository
This is the preferred method for contributing to JavaCC.
Prerequisites for building JavaCC with this method:
* Git
* Ant (we require version 1.5.3 or above - you can get ant from [http://ant.apache.org](http://ant.apache.org))
* Maven
* Java 8 (Java 9 and 10 are not yet supported)
Just clone the repository and then use the ant build script:
```
$ git clone https://github.com/javacc/javacc.git
$ cd javacc
$ ant
```
This will build the `javacc.jar` file in the `target/` directory
## Community
JavaCC is by far the most popular parser generator used with Java applications with an estimated user base of over 1,000 users and more than 100,000 downloads to date.
It is maintained by the [developer community](https://github.com/javacc/javacc/graphs/contributors) which includes the original authors and [Chris Ainsley](https://github.com/ainslec), [Tim Pizney](https://github.com/timp) and [Francis Andre](https://github.com/zosrothko).
### Support
Open an issue if you found a bug in JavaCC.
If you use version 7, open it [here](https://github.com/javacc/javacc/issues);
if you use version 8 and you do not know to which part it is related (the core or a generator), open it [here](https://github.com/javacc/javacc-8/issues); if you are sure of the project it is related to, open it in the issues section of the project.
Don’t hesitate to ask!
Contact the developers and community on the [Google user group](https://groups.google.com/forum/#!forum/javacc-users) or email us at [JavaCC Support](mailto:[email protected]) if you need any help.
For questions relating to development please join our [Slack channel](https://javacc.slack.com/).
### Documentation
The documentation of JavaCC is located on the website [https://javacc.github.io/javacc/](https://javacc.github.io/javacc/) and in the `docs/` directory of the source code on [GitHub javacc](https://github.com/javacc/javacc) or [GitHub javacc-8](https://github.com/javacc/javacc-8).
It includes [detailed documentation](docs/documentation/index.md) for JavaCC, JJTree, and JJDoc.
### Resources
##### Books
* Dos Reis, Anthony J., Compiler Construction Using Java, JavaCC, and Yacc., Wiley-Blackwell 2012. ISBN 0-4709495-9-7 ([book](https://www.amazon.co.uk/Compiler-Construction-Using-Java-JavaCC/dp/0470949597), [pdf](https://spada.uns.ac.id/pluginfile.php/265072/mod_resource/content/1/Compiler%20Construction%20using%20Java%2C%20JavaCC%2C%20and%20YACC%20%5BReis%202011-12-20%5D.pdf)).
* Copeland, Tom, Generating Parsers with JavaCC., Centennial Books, 2007. ISBN 0-9762214-3-8 ([book](https://www.amazon.com/Generating-Parsers-JavaCC-Easy-Use/dp/0976221438)).
##### Tutorials
* JavaCC [tutorials](docs/tutorials/index.md).
* [Introduction to JavaCC](https://www.engr.mun.ca/~theo/JavaCC-Tutorial/javacc-tutorial.pdf) by Theodore S. Norvell.
* [Incorporating language processing into Java applications: a JavaCC tutorial](https://ieeexplore.ieee.org/document/1309649) by Viswanathan Kodaganallur.
##### Articles
* [Looking for lex and yacc for Java? You don't know Jack](https://www.infoworld.com/article/2170636/looking-for-lex-and-yacc-for-java-you-don-t-know-jack.html) by Chuck Mcmanis.
* [Build your own languages with JavaCC](https://www.infoworld.com/article/2162779/build-your-own-languages-with-javacc.html) by Oliver Enseling.
* [Writing an Interpreter Using JavaCC](https://anandsekar.github.io/writing-an-interpretter-using-javacc/) by Anand Rajasekar.
* [Building a lexical analyzer with JavaCC](http://kiwwito.com/build-a-lexical-analyzer-with-javacc/) by Keyvan Akbary.
##### Parsing theory
* Alfred V. Aho, Monica S. Lam, Ravi Sethi and Jeffrey D. Ullman, Compilers: Principles, Techniques, and Tools, 2nd Edition, Addison-Wesley, 2006, ISBN 0-3211314-3-6 ([book](https://www.amazon.co.uk/Compilers-Principles-Techniques-Tools-2nd/dp/0321131436), [pdf](https://github.com/germanoa/compiladores/blob/master/doc/ebook/Compilers%20Principles%2C%20Techniques%2C%20and%20Tools%20-%202nd%20Edition%20-%20Alfred%20V.%20Aho.pdf)).
* Charles N. Fischer and Richard J. Leblanc, Jr., Crafting a Compiler with C., Pearson, 1991. ISBN 0-8053216-6-7 ([book](https://www.amazon.co.uk/Crafting-Compiler-Charles-N-Fischer/dp/0805321667)).
### Powered by JavaCC
JavaCC is used in many commercial applications and open source projects.
The following list highlights a few notable JavaCC projects that run interesting use cases in production, with links to the relevant grammar specifications.
User | Use Case | Grammar File(s)
:--------------------------------------------------- |:-------------------------------------------------------------- | :-------------------------------------------------------------------------------------------------------------------------------------------------------:
[Apache ActiveMQ](https://activemq.apache.org/) | Parsing JMS selector statements | [SelectorParser.jj](https://github.com/apache/activemq/blob/master/activemq-client/src/main/grammar/SelectorParser.jj), [HyphenatedParser.jj](https://github.com/apache/activemq-artemis/blob/master/artemis-selector/src/main/javacc/HyphenatedParser.jj)
[Apache Avro](https://avro.apache.org/) | Parsing higher-level languages into Avro Schema | [idl.jj](https://github.com/apache/avro/blob/master/lang/java/compiler/src/main/javacc/org/apache/avro/compiler/idl/idl.jj)
[Apache Calcite](https://calcite.apache.org/) | Parsing SQL statements | [Parser.jj](https://github.com/apache/calcite/blob/master/core/src/main/codegen/templates/Parser.jj)
[Apache Camel](https://camel.apache.org/) | Parsing stored SQL templates | [sspt.jj](https://github.com/apache/camel/blob/master/components/camel-sql/src/main/java/org/apache/camel/component/sql/stored/template/grammar/sspt.jj)
[Apache Jena](https://jena.apache.org/) | Parsing queries written in SPARQL, ARQ, SSE, Turtle and JSON | [sparql_10](https://github.com/apache/jena/blob/master/jena-arq/Grammar/Final/sparql_10-final.jj), [sparql_11](https://github.com/apache/jena/blob/master/jena-arq/Grammar/Final/sparql_11-final.jj), [arq.jj](https://github.com/apache/jena/blob/master/jena-arq/Grammar/arq.jj), [sse.jj](https://github.com/apache/jena/blob/master/jena-arq/Grammar/sse/sse.jj), [turtle.jj](https://github.com/apache/jena/blob/main/jena-arq/Grammar/Turtle/turtle.jj), [json.jj](https://github.com/apache/jena/blob/master/jena-arq/Grammar/JSON/json.jj)
[Apache Lucene](https://lucene.apache.org/) | Parsing search queries | [QueryParser.jj](https://github.com/apache/lucene/blob/main/lucene/queryparser/src/java/org/apache/lucene/queryparser/classic/QueryParser.jj)
[Apache Tomcat](https://tomcat.apache.org/) | Parsing Expression Language (EL) and JSON | [ELParser.jjt](https://github.com/apache/tomcat/blob/master/java/org/apache/el/parser/ELParser.jjt), [JSONParser.jj](https://github.com/apache/tomcat/blob/main/java/org/apache/tomcat/util/json/JSONParser.jjt)
[Apache Zookeeper](https://zookeeper.apache.org/) | Optimising serialisation/deserialisation of Hadoop I/O records | [rcc.jj](https://github.com/apache/zookeeper/blob/master/zookeeper-jute/src/main/java/org/apache/jute/compiler/generated/rcc.jj)
[Java Parser](https://javaparser.org/) | Parsing Java language files | [java.jj](https://github.com/javaparser/javaparser/blob/master/javaparser-core/src/main/javacc/java.jj)
## License
JavaCC is an open source project released under the [BSD License 2.0](LICENSE). The JavaCC project was originally developed at Sun Microsystems Inc. by [Sreeni Viswanadha](https://github.com/kaikalur) and [Sriram Sankar](https://twitter.com/sankarsearch).
---
[Top](#javacc)