Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/giovaneiwamoto/lexical-analysis
🎠Lexical Analysis - Recognize and return tokens of the language specified in this document a subset of Java.
https://github.com/giovaneiwamoto/lexical-analysis
compiler lexical tokenizer
Last synced: 27 days ago
JSON representation
🎠Lexical Analysis - Recognize and return tokens of the language specified in this document a subset of Java.
- Host: GitHub
- URL: https://github.com/giovaneiwamoto/lexical-analysis
- Owner: GiovaneIwamoto
- License: mit
- Created: 2023-05-30T05:06:59.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-07-27T22:06:58.000Z (6 months ago)
- Last Synced: 2024-11-11T19:14:04.203Z (3 months ago)
- Topics: compiler, lexical, tokenizer
- Language: C++
- Homepage:
- Size: 88.9 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# LEXICAL ANALYSIS
### **OVERVIEW**
Implementation of the lexical analyzer for the MiniJava programming language with some extensions involves the development of a robust tool to recognize and categorize the various lexical elements of the language. This includes identifying keywords, operators, identifiers, literals, and other syntactic components, ensuring that each token is accurately classified for subsequent syntactic analysis. The lexical analyzer must handle these extensions seamlessly, maintaining the integrity and functionality of the MiniJava language while accommodating the new features.
> [!NOTE]
> MiniJava is a subset of Java, and its lexical analyzer should be able to recognize and return the tokens of the language specified in this document, which will later be terminal symbols of the grammar that specifies the language's accepted constructs.
[](https://skillicons.dev)
---
### **TOKENS**
> [!IMPORTANT]
> System.out.println should be treated as a single reserved word and not as a method call.
```ruby
[IDENTIFIERS] A sequence of letters, digits, and underscores, always starting with a letter.
[INTEGER LITERALS] A sequence of decimal digits representing an integer number.
[RESERVED WORDS] boolean, class, else, extends, false, if, int, length, main, new, public, return, static, String, System.out.println, this, true, void, and while.
[COMMENTS] Comments should be ignored. There are two types: line comments and block comments.
[WHITESPACE] Whitespace should be ignored. It includes \n \t \r \f.
[OPERATORS] and [SEPARATORS]
```
> [!WARNING]
> Reserved words are recognized as identifiers, with the notable exception of System.out.println, because it doesn't match the typical pattern of identifiers.
---
### **COMPILE AND EXECUTE**
```ruby
$ g++ -Wall \*.cpp -o mjc
$ ./mjc program.mj
```
---
### **AUTHOR**
- Giovane Hashinokuti Iwamoto - Computer Science student at UFMS - Brazil - MS
I am always open to receiving constructive criticism and suggestions for improvement in my developed code. I believe that feedback is an essential part of the learning and growth process, and I am eager to learn from others and make my code the best it can be. Whether it's a minor tweak or a major overhaul, I am willing to consider all suggestions and implement the changes that will benefit my code and its users.