{"id":13482094,"url":"https://github.com/apache/datasketches-java","last_synced_at":"2025-05-12T15:32:56.486Z","repository":{"id":34357517,"uuid":"38279790","full_name":"apache/datasketches-java","owner":"apache","description":"A software library of stochastic streaming algorithms, a.k.a. sketches.","archived":false,"fork":false,"pushed_at":"2025-05-07T22:52:50.000Z","size":28940,"stargazers_count":911,"open_issues_count":7,"forks_count":212,"subscribers_count":58,"default_branch":"main","last_synced_at":"2025-05-07T23:29:37.082Z","etag":null,"topics":["datasketches"],"latest_commit_sha":null,"homepage":"https://datasketches.apache.org","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/apache.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2015-06-30T01:05:21.000Z","updated_at":"2025-05-05T16:16:40.000Z","dependencies_parsed_at":"2023-12-25T01:30:54.840Z","dependency_job_id":"ec09a03d-efe9-4245-96ce-99f68d854b2e","html_url":"https://github.com/apache/datasketches-java","commit_stats":null,"previous_names":["datasketches/sketches-core"],"tags_count":92,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fdatasketches-java","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fdatasketches-java/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fdatasketches-java/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fdatasketches-java/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/apache","download_url":"https://codeload.github.com/apache/datasketches-java/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253273404,"owners_count":21881973,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["datasketches"],"created_at":"2024-07-31T17:00:58.898Z","updated_at":"2025-05-12T15:32:56.441Z","avatar_url":"https://github.com/apache.png","language":"Java","funding_links":[],"categories":["Table of Contents","Java"],"sub_categories":["Online Machine Learning"],"readme":"\u003c!--\n    Licensed to the Apache Software Foundation (ASF) under one\n    or more contributor license agreements.  See the NOTICE file\n    distributed with this work for additional information\n    regarding copyright ownership.  The ASF licenses this file\n    to you under the Apache License, Version 2.0 (the\n    \"License\"); you may not use this file except in compliance\n    with the License.  You may obtain a copy of the License at\n\n      http://www.apache.org/licenses/LICENSE-2.0\n\n    Unless required by applicable law or agreed to in writing,\n    software distributed under the License is distributed on an\n    \"AS IS\" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY\n    KIND, either express or implied.  See the License for the\n    specific language governing permissions and limitations\n    under the License.\n--\u003e\n\n[![Maven Central](https://maven-badges.herokuapp.com/maven-central/org.apache.datasketches/datasketches-java/badge.svg)](https://maven-badges.herokuapp.com/maven-central/org.apache.datasketches/datasketches-java)\n[![Coverage Status](https://coveralls.io/repos/github/apache/datasketches-java/badge.svg)](https://coveralls.io/github/apache/datasketches-java)\n\n=================\n\n# Apache\u003csup\u003e\u0026reg;\u003c/sup\u003e DataSketches\u0026trade; Core Java Library Component\nThis is the core Java component of the DataSketches library.  It contains all of the sketching algorithms and can be accessed directly from user applications. \n\nThis component is also a dependency of other components of the library that create adaptors for target systems, such as the [Apache Pig adaptor](https://github.com/apache/datasketches-pig), the [Apache Hive adaptor](https://github.com/apache/datasketches-hive), and others.\n\nNote that we have a parallel core component for C++ and Python implementations of many of the same sketch algorithms, \n[datasketches-cpp](https://github.com/apache/datasketches-cpp) and [datasketches-python](https://github.com/apache/datasketches-python)\n\nPlease visit the main [DataSketches website](https://datasketches.apache.org) for more information.\n\nIf you are interested in making contributions to this site please see our [Community](https://datasketches.apache.org/docs/Community/) page for how to contact us.\n\n---\n\n## Build \u0026 Runtime Dependencies\n\n### Installation Directory Path\n**NOTE:** This component accesses resource files for testing. As a result, the directory elements of the full absolute path of the target installation directory must qualify as Java identifiers. In other words, the directory elements must not have any space characters (or non-Java identifier characters) in any of the path elements. This is required by the Oracle Java Specification in order to ensure location-independent access to resources: [See Oracle Location-Independent Access to Resources](https://docs.oracle.com/javase/8/docs/technotes/guides/lang/resources.html)\n\n### OpenJDK Version 21\nAn OpenJDK-compatible build of Java 21, provided by one of the Open-Source providers, such as Azul Systems, Red Hat, SAP, Eclipse Temurin, etc, is required.\nAll of the testing of this release has been performed with an Eclipse Temurin build.\n\nThis release uses the new Java Foreign Function \u0026 Memory (FFM) features that are in \"preview\" in Java 21.\nAs a result, the JVM flag \u003cnobr\u003e**--enable-preview**\u003c/nobr\u003e must be set at compile and at runtime.\n\n**NOTE:** OpenJDK versions greater than 21 do not support running Java 21 class files (Class ID 65) with preview code. The runtime JVM version must be 21.\n\n**NOTE:** The Eclipse Compiler for Java (ECJ) version 21, used by default in both the Eclipse JDT IDE and the VScode IDE, will not allow compilation of preview code for Java version 21. Both Eclipse and VScode can be configured to use an OpenJDK compiler instead, but you will loose the incremental build capability of the ECJ.\n\n### DataSketches Memory 6.0.0\n\nThis component depends on the [datasketches-memory-6.0.0](https://github.com/apache/datasketches-memory/tree/6.0.0) component, \n\n## Compilation and Test using Maven\nThis DataSketches component is structured as a Maven project and Maven is the recommended tool for compile and test.\n\n#### A Toolchain is required\n\n* You must have a JDK type toolchain defined in location *~/.m2/toolchains.xml* that specifies where to find a locally installed OpenJDK-compatible version 21.\n* Your default \\$JAVA\\_HOME compiler must be OpenJDK compatible, specified in the toolchain, and may be a version greater than 21. Note that if your \\$JAVA\\_HOME is set to a Java version greater than 21, Maven will automatically use the Java 21 version specified in the toolchain instead. The included pom.xml specifies the necessary JVM flags, so no further action should be required.\n* Note that the paths specified in the toolchain must be fully qualified direct paths to the OpenJDK version locations. Using environment variables will not work.\n\n#### To run normal unit tests:\n\n    $ mvn clean test\n\n#### To install jars built from the downloaded source:\n\n    $ mvn clean install -DskipTests=true\n\nThis will create the following jars:\n\n* datasketches-java-X.Y.Z.jar The compiled main class files.\n* datasketches-java-X.Y.Z-tests.jar The compiled test class files.\n* datasketches-java-X.Y.Z-sources.jar The main source files.\n* datasketches-java-X.Y.Z-test-sources.jar The test source files\n* datasketches-java-X.Y.Z-javadoc.jar  The compressed Javadocs.\n\n## Known Issues\n\n### SpotBugs\n\n* Make sure you configure SpotBugs with the /tools/FindBugsExcludeFilter.xml file. Otherwise, you may get a lot of false positive or low risk issues that we have examined and eliminated with this exclusion file.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapache%2Fdatasketches-java","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fapache%2Fdatasketches-java","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapache%2Fdatasketches-java/lists"}