https://github.com/bertrand31/one-billion-rows-challenge

🌪️ Pushing Scala to its limits to aggregate a billion rows' worth of data in 2.42 seconds
https://github.com/bertrand31/one-billion-rows-challenge

competitive-programming competitive-programming-contests data data-engineering data-processing performance scala

Last synced: 24 days ago
JSON representation

🌪️ Pushing Scala to its limits to aggregate a billion rows' worth of data in 2.42 seconds

• Host: GitHub
• URL: https://github.com/bertrand31/one-billion-rows-challenge
• Owner: Bertrand31
• Created: 2024-06-10T20:26:57.000Z (5 months ago)
• Default Branch: master
• Last Pushed: 2024-09-24T18:43:37.000Z (about 1 month ago)
• Last Synced: 2024-10-01T15:59:19.390Z (about 1 month ago)
• Topics: competitive-programming, competitive-programming-contests, data, data-engineering, data-processing, performance, scala
• Language: Scala
• Homepage:
• Size: 6.28 MB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
## The One Billion Row Challenge (1BRC)

### Overview

My stab at the [1brc challenge](https://github.com/gunnarmorling/1brc/blob/main/README.md).

The original challenge is in Java, but my submission uses Scala.

### Current state

The current solution runs in 2.42 seconds on an Intel i7-13700H.

### How-to

Build: `sbt 'show GraalVMNativeImage/packageBin'`

Profile: `hyperfine -w 1 --runs 3 ./target/graalvm-native-image/onebrc`