https://github.com/bertrand31/one-billion-rows-challenge
🌪️ Pushing Scala to its limits to aggregate a billion rows' worth of data in 2.42 seconds
https://github.com/bertrand31/one-billion-rows-challenge
competitive-programming competitive-programming-contests data data-engineering data-processing performance scala
Last synced: 10 months ago
JSON representation
🌪️ Pushing Scala to its limits to aggregate a billion rows' worth of data in 2.42 seconds
- Host: GitHub
- URL: https://github.com/bertrand31/one-billion-rows-challenge
- Owner: Bertrand31
- Created: 2024-06-10T20:26:57.000Z (about 2 years ago)
- Default Branch: master
- Last Pushed: 2025-01-24T12:27:18.000Z (over 1 year ago)
- Last Synced: 2025-03-24T05:44:49.893Z (over 1 year ago)
- Topics: competitive-programming, competitive-programming-contests, data, data-engineering, data-processing, performance, scala
- Language: Scala
- Homepage:
- Size: 8.24 MB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## The One Billion Row Challenge (1BRC)
### Overview
My stab at the [1brc challenge](https://github.com/gunnarmorling/1brc/blob/main/README.md).
The original challenge is in Java, but my submission uses Scala.
### Current state
The current solution runs in 2.42 seconds on an Intel i7-13700H.
### How-to
Build: `sbt 'show GraalVMNativeImage/packageBin'`
Profile: `hyperfine -w 1 --runs 3 ./target/graalvm-native-image/onebrc`