{"id":19301631,"url":"https://github.com/isarn/isarn-sketches","last_synced_at":"2025-04-22T10:32:40.748Z","repository":{"id":47230903,"uuid":"75235396","full_name":"isarn/isarn-sketches","owner":"isarn","description":"Sketching data structures for scala, including t-digest","archived":false,"fork":false,"pushed_at":"2021-09-07T21:07:09.000Z","size":1381,"stargazers_count":14,"open_issues_count":6,"forks_count":5,"subscribers_count":4,"default_branch":"develop","last_synced_at":"2024-06-11T20:20:40.718Z","etag":null,"topics":["algebird","data-sketching","numeric","probability-distribution","scala","sketching","t-digest"],"latest_commit_sha":null,"homepage":"","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/isarn.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-11-30T23:10:02.000Z","updated_at":"2023-09-08T17:17:46.000Z","dependencies_parsed_at":"2022-09-22T17:02:50.529Z","dependency_job_id":null,"html_url":"https://github.com/isarn/isarn-sketches","commit_stats":null,"previous_names":[],"tags_count":9,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/isarn%2Fisarn-sketches","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/isarn%2Fisarn-sketches/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/isarn%2Fisarn-sketches/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/isarn%2Fisarn-sketches/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/isarn","download_url":"https://codeload.github.com/isarn/isarn-sketches/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":223893577,"owners_count":17220915,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["algebird","data-sketching","numeric","probability-distribution","scala","sketching","t-digest"],"created_at":"2024-11-09T23:18:34.317Z","updated_at":"2024-11-09T23:18:34.834Z","avatar_url":"https://github.com/isarn.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"# isarn-sketches\nSketching data structures\n\n### API documentation\n- https://isarn.github.io/isarn-sketches/scala/api/\n- https://isarn.github.io/isarn-sketches/java/api/\n\n### Compatibility\nisarn-sketches can operate with [Algebird](https://twitter.github.io/algebird/) via the\n[isarn-sketches-algebird-api](https://github.com/isarn/isarn-sketches-algebird-api)\n\nisarn-sketches can also operate with [Apache Spark](https://github.com/apache/spark) via the [isarn-sketches-spark](https://github.com/isarn/isarn-sketches-spark) library\n\n### How to use in your project\n\n``` scala\n// isarn-sketches\nlibraryDependencies += \"org.isarnproject\" %% \"isarn-sketches\" % \"0.3.0\"\n\n// isarn-sketches-java\nlibraryDependencies += \"org.isarnproject\" % \"isarn-sketches-java\" % \"0.3.0\"\n```\n\n### t-digest\n``` scala\nscala\u003e import org.isarnproject.sketches.TDigest\nimport org.isarnproject.sketches.TDigest\n\nscala\u003e val data = Vector.fill(10000) { scala.util.Random.nextGaussian() }\ndata: scala.collection.immutable.Vector[Double] = Vector(1.6046163970051968, 0.44151418924289004, ...\n\nscala\u003e val sketch = TDigest.sketch(data)\nsketch: org.isarnproject.sketches.TDigest = TDigest(0.5,0,74,TDigestMap(-3.819069044174932 -\u003e (1.0, 1.0), ...\n\nscala\u003e sketch.cdf(0)\nres0: Double = 0.4984362744530557\n\nscala\u003e sketch.cdfInverse(0.5)\nres1: Double = 0.0038481195948969205\n```\n\n#### t-digest resources\n* Original paper: [Computing Extremely Accurate Quantiles Using t-Digests](https://github.com/tdunning/t-digest/blob/master/docs/t-digest-paper/histo.pdf)\n* Video Talk: [Sketching Data with T-Digest In Apache Spark](https://youtu.be/ETUYhEZRtWE)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fisarn%2Fisarn-sketches","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fisarn%2Fisarn-sketches","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fisarn%2Fisarn-sketches/lists"}