Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ekrich/scala-unicode
Scala code to generate unicode tables for Scala
https://github.com/ekrich/scala-unicode
scala scala-js scala-native unicode
Last synced: 22 days ago
JSON representation
Scala code to generate unicode tables for Scala
- Host: GitHub
- URL: https://github.com/ekrich/scala-unicode
- Owner: ekrich
- License: apache-2.0
- Created: 2019-04-25T20:48:33.000Z (over 5 years ago)
- Default Branch: main
- Last Pushed: 2024-08-23T00:37:24.000Z (3 months ago)
- Last Synced: 2024-10-06T02:06:16.648Z (about 1 month ago)
- Topics: scala, scala-js, scala-native, unicode
- Language: HTML
- Homepage:
- Size: 116 MB
- Stars: 2
- Watchers: 3
- Forks: 1
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# scala-unicode
This project contains scripts to generate data tables used to support
[Unicode](https://unicode.org/) for the **Scala Native** and **Scala.js**
platforms.
The tables or sequences generated are used to support `java.lang.Character`
and also `re2s` in Scala Native which is used to support regular
expressions (regex) including `java.util.regex._`.
Scala Native currently tracks JDK8 which uses Unicode 6.2.0. The starting
point for this project was Unicode 7.0.0 which was somewhat arbitrarily
used for the first `uppercase/lowercase` implementation. JDK11 which is
the next production release of Java tracks Unicode 10.0.0. The
disadvantage to the newer standards is that they contain more code
points which translates to more data and larger binary sizes. This runs
in a detrimental direction to goal **#4** below but has added
fonts and emojis.
The overall goals of this project are as follows:
1. Codify existing algothims used to generate tables used in **Scala Native**
and **Scala.js**.
2. Provide access to the Unicode database reusing code used in transforming
the data as needed.
3. Allow an easy path to upgrade the Unicode data and regenerate
the new data needed.
4. Assess whether the data needed for `regex` and `Character` can be shared
to reduce the code size of **Scala Native** applications.
The documentation and databases can be found on the
[Unicode Server](https://www.unicode.org/Public/). Some Data and docs are
added to this project in the `docs` directory for easy access. Most of the
written documentation is located at the Unicode sit and linked to from
this README.
The code charts and other docs are highly useful. Links are provided to
there version specified below from the original location. The following
are from Unicode 7.0.0. The Code Charts can be found on the **Unicode
Server** above and the other documents can be found on the main site for
[Unicode 7.0.0](https://www.unicode.org/versions/Unicode7.0.0/).
* [CodeCharts.pdf](https://www.unicode.org/Public/7.0.0/charts/CodeCharts.pdf)
97.7 MB
* [UnicodeStandard-7.0.pdf](http://www.unicode.org/versions/Unicode7.0.0/UnicodeStandard-7.0.pdf)
12.8 MB
* [Unicode Implementation (ch05)](http://www.unicode.org/versions/Unicode7.0.0/ch05.pdf)
The Unicode Consortium also provides *Locale* data which could be used in
a similar manner if needed in the future.
Unicode 10.0.0 has been added to the resources of the project. Applications
take an optional argument for the Unicode version. In order to run from `sbt`
with a command line argument see the following:
```console
sbt> run 10.0.0
```
Then select the application you want to run by the number listed.
```console
[warn] Multiple main classes detected. Run 'show discoveredMainClasses' to see the list
Multiple main classes detected, select one to run:
[1] org.ekrich.unicode.BinarySearchTest
[2] org.ekrich.unicode.CaseFolding
[3] org.ekrich.unicode.CaseFoldingTest
[4] org.ekrich.unicode.UnicodeData
Enter number: 4
```
The default without an argument uses Unicode 6.3.0. This version was used since
it was a minor update from JDK8's 6.2.0 whereas 7.0.0 added many new codes.