https://github.com/spotify/big-data-rosetta-code

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code
https://github.com/spotify/big-data-rosetta-code

bigdata scala scalding scio spark

Last synced: about 10 hours ago
JSON representation

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

• Host: GitHub
• URL: https://github.com/spotify/big-data-rosetta-code
• Owner: spotify
• License: apache-2.0
• Created: 2016-02-18T22:29:36.000Z (over 8 years ago)
• Default Branch: main
• Last Pushed: 2024-04-25T04:18:48.000Z (7 months ago)
• Last Synced: 2024-04-25T05:25:50.940Z (7 months ago)
• Topics: bigdata, scala, scalding, scio, spark
• Language: Scala
• Homepage: http://spotify.github.io/big-data-rosetta-code/
• Size: 341 KB
• Stars: 287
• Watchers: 31
• Forks: 33
• Open Issues: 13
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
big-data-rosetta-code

=====================

[![Build Status](https://img.shields.io/github/actions/workflow/status/spotify/big-data-rosetta-code/.github/workflows/ci.yml)](https://github.com/spotify/big-data-rosetta-code/actions?query=workflow%3ACI)

[![GitHub license](https://img.shields.io/github/license/spotify/big-data-rosetta-code.svg)](./LICENSE)

Code snippets for solving common big data problems on various platforms. Inspired by [Rosetta Code](http://rosettacode.org/).

For examples rended side by side with comments see:

http://spotify.github.io/big-data-rosetta-code/

Currently the following are covered:

- [Scalding](https://github.com/twitter/scalding)

- [Scio](https://github.com/spotify/scio)

- [Spark](https://github.com/apache/spark)

# Topics

- [src/main/scala/com/spotify/bdrc/scala](./src/main/scala/com/spotify/bdrc/scala) Scala tricks for data processing

- [src/main/scala/com/spotify/bdrc/pipeline](./src/main/scala/com/spotify/bdrc/pipeline) Data pipeline snippets

- [src/test/scala/com/spotify/bdrc/testing](./src/test/scala/com/spotify/bdrc/testing) Examples for pipeline testing

# License

Copyright 2016 Spotify AB.

Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0