{"id":27918770,"url":"https://github.com/juliaparallel/dtables.jl","last_synced_at":"2025-05-06T18:25:28.379Z","repository":{"id":37012136,"uuid":"504918289","full_name":"JuliaParallel/DTables.jl","owner":"JuliaParallel","description":"Distributed table structures and data manipulation operations built on top of Dagger.jl","archived":false,"fork":false,"pushed_at":"2024-04-08T12:57:36.000Z","size":428,"stargazers_count":76,"open_issues_count":28,"forks_count":4,"subscribers_count":11,"default_branch":"main","last_synced_at":"2025-04-21T18:05:52.934Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Julia","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/JuliaParallel.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2022-06-18T18:14:44.000Z","updated_at":"2025-04-09T07:56:59.000Z","dependencies_parsed_at":"2023-11-17T19:43:33.152Z","dependency_job_id":"0d666f5d-6feb-405d-a31e-5b3f40acddd5","html_url":"https://github.com/JuliaParallel/DTables.jl","commit_stats":null,"previous_names":[],"tags_count":12,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JuliaParallel%2FDTables.jl","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JuliaParallel%2FDTables.jl/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JuliaParallel%2FDTables.jl/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JuliaParallel%2FDTables.jl/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/JuliaParallel","download_url":"https://codeload.github.com/JuliaParallel/DTables.jl/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252742689,"owners_count":21797293,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-05-06T18:25:27.770Z","updated_at":"2025-05-06T18:25:28.369Z","avatar_url":"https://github.com/JuliaParallel.png","language":"Julia","funding_links":[],"categories":[],"sub_categories":[],"readme":"# DTables\n\nDistributed table structures and data manipulation operations built on top of [Dagger.jl](https://github.com/JuliaParallel/Dagger.jl)\n\n[![Dev](https://img.shields.io/badge/docs-dev-blue.svg)](https://juliaparallel.github.io/DTables.jl/dev/)\n[![Build Status](https://github.com/juliaparallel/DTables.jl/actions/workflows/CI.yml/badge.svg?branch=main)](https://github.com/juliaparallel/DTables.jl/actions/workflows/CI.yml?query=branch%3Amain)\n[![Coverage](https://codecov.io/gh/juliaparallel/DTables.jl/branch/main/graph/badge.svg)](https://codecov.io/gh/juliaparallel/DTables.jl)\n[![Code Style: Blue](https://img.shields.io/badge/code%20style-blue-4495d1.svg)](https://github.com/invenia/BlueStyle)\n\n# Installation\n\nThe package registered in the general repository, so you can add it by typing:\n\n```julia\njulia\u003e ]add DTables\n```\n\n# Usage\n\nBelow you can find a quick example on how to get started with DTables.\n\nThere's a lot more you can do though, so please refer to the documentation!\n\n\n```julia\n# launch a Julia session with threads/workers\n\njulia\u003e using DTables\n\njulia\u003e dt = DTable((a=rand(100), b=rand(100)), 10)\nDTable with 10 partitions\nTabletype: NamedTuple\n\njulia\u003e m = map(r -\u003e (x=sum(r), id=Threads.threadid(),), dt)\nDTable with 10 partitions\nTabletype: NamedTuple\n\njulia\u003e xsum = reduce((x, y) -\u003e x + y, m, init=0, cols=[:x])\nEagerThunk (running)\n\njulia\u003e threads_used = reduce((acc, el) -\u003e union(acc, el), m, init=Set(), cols=[:id])\nEagerThunk (running)\n\njulia\u003e fetch(xsum)\n(x = 95.71209812014976,)\n\njulia\u003e fetch(threads_used)\n(id = Set(Any[5, 4, 6, 13, 2, 10, 9, 12, 8, 3]),)\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjuliaparallel%2Fdtables.jl","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjuliaparallel%2Fdtables.jl","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjuliaparallel%2Fdtables.jl/lists"}