{"id":17047644,"url":"https://github.com/residentmario/streaming-algos","last_synced_at":"2025-03-23T03:44:40.727Z","repository":{"id":66134404,"uuid":"136063527","full_name":"ResidentMario/streaming-algos","owner":"ResidentMario","description":"Notebooks implementing a selection of streaming quantile algorithms.","archived":false,"fork":false,"pushed_at":"2018-06-04T18:03:24.000Z","size":21,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-01-28T10:25:13.507Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ResidentMario.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-06-04T17:59:42.000Z","updated_at":"2022-10-19T11:03:15.000Z","dependencies_parsed_at":null,"dependency_job_id":"f97000e5-22c1-44d4-aee8-5535bac7df90","html_url":"https://github.com/ResidentMario/streaming-algos","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ResidentMario%2Fstreaming-algos","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ResidentMario%2Fstreaming-algos/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ResidentMario%2Fstreaming-algos/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ResidentMario%2Fstreaming-algos/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ResidentMario","download_url":"https://codeload.github.com/ResidentMario/streaming-algos/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245052652,"owners_count":20553163,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-14T09:49:54.258Z","updated_at":"2025-03-23T03:44:40.680Z","avatar_url":"https://github.com/ResidentMario.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# streaming-algos\n\nThese handful of notebooks implement three different quantile estimation algorithms. These algorithms are meant to be used to accurately estimate quantiles in large streaming data whilst using fewer computational and memory resources than simple histograms.\n\nReferences:\n\n* GK --- https://stevenengelhardt.com/2018/03/07/calculating-percentiles-on-streaming-data-part-2-notes-on-implementing-greenwald-khanna/\n* Q-digest --- https://graphics.stanford.edu/courses/cs468-05-winter/Papers/Information_Aggregation/Suri_sensys04.pdf\n* T-digest --- file:///Users/alex/Downloads/histo.pdf\n\nTODOs:\n- [ ] Implement forward decay (http://dimacs.rutgers.edu/~graham/pubs/papers/fwddecay.pdf)\n- [ ] Browse through and implement more things from https://gist.github.com/debasishg/8172796\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fresidentmario%2Fstreaming-algos","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fresidentmario%2Fstreaming-algos","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fresidentmario%2Fstreaming-algos/lists"}