{"id":18994582,"url":"https://github.com/timelessnesses/1brc-timeless","last_synced_at":"2025-07-23T17:33:04.600Z","repository":{"id":245528512,"uuid":"818521186","full_name":"timelessnesses/1brc-timeless","owner":"timelessnesses","description":"one billion row challenge in rust by a shitty coder (me)","archived":false,"fork":false,"pushed_at":"2025-03-25T15:48:17.000Z","size":3545,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-25T16:43:51.681Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"wtfpl","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/timelessnesses.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-22T04:19:45.000Z","updated_at":"2025-03-25T15:48:21.000Z","dependencies_parsed_at":"2024-06-25T02:38:57.798Z","dependency_job_id":"a3209e8a-6142-4053-bd97-303391fb0013","html_url":"https://github.com/timelessnesses/1brc-timeless","commit_stats":null,"previous_names":["timelessnesses/1brc-timeless"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/timelessnesses/1brc-timeless","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timelessnesses%2F1brc-timeless","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timelessnesses%2F1brc-timeless/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timelessnesses%2F1brc-timeless/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timelessnesses%2F1brc-timeless/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/timelessnesses","download_url":"https://codeload.github.com/timelessnesses/1brc-timeless/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timelessnesses%2F1brc-timeless/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266720004,"owners_count":23973875,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-23T02:00:09.312Z","response_time":66,"last_error":null,"robots_txt_status":null,"robots_txt_updated_at":null,"robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-08T17:26:06.941Z","updated_at":"2025-07-23T17:33:04.590Z","avatar_url":"https://github.com/timelessnesses.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 1brc-timeless\n\nThis repository contains rust code that can be used with 1brc (One Billion Row Challenge) dataset. *how the fuck did java #1 did it in 1 seconds*\n\n## Running\n\nGet yourself a `measurements.txt` and just run `cargo run -r`. It will spit out progress on reading file and time it take to parse file and do computation and a `out.json` file\n\n## Getting yourself a `measurements.txt`\n\nInside `scripts/` folders contains 2 versions of `create_measurements` scripts that you can use. Python implementation is stolen from [`1brc`](https://github.com/gunnarmorling/1brc) repository and there is Rust's port of the Python implementation with multi-threading for fast speeds.  \nExecuting them is simply just\n\n```sh\npython scripts/create_measurements.py 1000000000\n# or\ncd scripts/create_measurements\ncargo run -r -- 1000000000\n```\n\n## Perf\n\nran on my laptop (AMD Ryzen 7 7730U with 16 Gigabytes of RAM with 8 Cores and 16 Logical Processors) on Windows\n| stuff                \t| my implementation in rust \t| #1 java 1brc                 \t|\n|----------------------\t|---------------------------\t|------------------------------\t|\n| RAM Usage (Peak)     \t| 7 Megabytes            \t| 80+ Megabytes         \t|\n| Time to process      \t| 32 seconds (pretty close)          \t| 56 seconds                   \t|\n| Peak Disk Activities \t| 460+ MB/s                 \t| 280+ MB/s \t|\n| Avg Disk Activites    | 230-420+ MB/S                            | 230-280+ MB/S\n\n![](./perf.png)\n\n## Special Thanks\n\n- [0/0](https://github.com/tazz4843)\n- acrimon (discord)\n- erk (discord)\n- and everyone else in Serenity Discord Bot Library Guild!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftimelessnesses%2F1brc-timeless","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftimelessnesses%2F1brc-timeless","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftimelessnesses%2F1brc-timeless/lists"}