https://github.com/nathancordeiro/unicode-to-utf-8
This is a code for converting a Unicode code point to a UTF-8 string.
https://github.com/nathancordeiro/unicode-to-utf-8
Last synced: 6 months ago
JSON representation
This is a code for converting a Unicode code point to a UTF-8 string.
- Host: GitHub
- URL: https://github.com/nathancordeiro/unicode-to-utf-8
- Owner: NathanCordeiro
- License: mit
- Created: 2024-09-16T11:59:39.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-09-16T12:18:35.000Z (about 1 year ago)
- Last Synced: 2025-02-07T00:20:19.152Z (8 months ago)
- Language: C++
- Size: 9.77 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
---
# Unicode-To-UTF-8
---
``This project demonstrates how to convert Unicode code points into their corresponding UTF-8 hexadecimal escape sequences using C++. The program can process an array of Unicode code points
and convert each one to UTF-8.``
## Introduction
This C++ program takes Unicode code points (such as `U+1F600`) and converts them into their corresponding UTF-8 hexadecimal escape sequences. UTF-8 is one of the most commonly used character encodings for web and text data, allowing for compact representation of characters from many languages, including emojis.
The code supports processing multiple Unicode code points through an array, making it flexible for handling various inputs.
## Unicode and UTF-8
### Unicode
Unicode is a standard designed to represent text from all the world's writing systems. Every character is assigned a unique code point, typically expressed in hexadecimal form. For example, the Unicode code point for the emoji 😀 is `U+1F600`.
### UTF-8
UTF-8 is a variable-length character encoding used for encoding Unicode characters. It uses 1 to 4 bytes to represent characters, depending on the code point. UTF-8 is widely used because of its backward compatibility with ASCII and efficiency in encoding.
### Conversion Process
When converting Unicode to UTF-8:
- Characters from `U+0000` to `U+007F` use 1 byte.
- Characters from `U+0080` to `U+07FF` use 2 bytes.
- Characters from `U+0800` to `U+FFFF` use 3 bytes.
- Characters from `U+10000` to `U+10FFFF` use 4 bytes.
## Code Explanation
| Code Component | Explanation |
|-------------------------------------|-------------|
| `unicodeToUTF8(const std::string&)` | Converts a single Unicode code point to its UTF-8 hexadecimal escape sequence. It first converts the hexadecimal Unicode string to an integer, then generates the corresponding UTF-8 bytes based on the value of the code point. |
| `processUnicodeArray(const std::vector&)` | This function takes a vector of Unicode code points as input and returns a vector of UTF-8 hexadecimal escape sequences for each code point by calling `unicodeToUTF8`. |
| `SetConsoleOutputCP(CP_UTF8)` | Ensures the console uses the UTF-8 character encoding for output. This is specific to Windows systems. |
| `std::vector unicodeArray` | Holds an array of Unicode code points, which are processed in the program. The default values include several emoji characters. |
| `std::cout << ...` | Prints out the original Unicode code point and the corresponding UTF-8 escape sequence for each value in the array. |
## License
[](./LICENSE)