https://github.com/ytsaurus/ytsaurus-spyt

YTsaurus SPYT provides an integration with Apache Spark
https://github.com/ytsaurus/ytsaurus-spyt

Last synced: 3 months ago
JSON representation

YTsaurus SPYT provides an integration with Apache Spark

• Host: GitHub
• URL: https://github.com/ytsaurus/ytsaurus-spyt
• Owner: ytsaurus
• License: apache-2.0
• Created: 2024-05-13T17:03:50.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2026-03-31T14:33:07.000Z (3 months ago)
• Last Synced: 2026-03-31T14:41:24.736Z (3 months ago)
• Language: Scala
• Size: 15.2 MB
• Stars: 19
• Watchers: 26
• Forks: 6
• Open Issues: 11
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Security: SECURITY.md
  • Roadmap: ROADMAP.md
  • Authors: AUTHORS

Awesome Lists containing this project

README

          



[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://github.com/ytsaurus/spyt/blob/main/LICENSE)

[![Telegram](https://img.shields.io/badge/chat-on%20Telegram-2ba2d9.svg)](https://t.me/ytsaurus)

# YTsaurus

[Website](https://ytsaurus.tech) |

[Documentation](https://ytsaurus.tech/docs) |

[YouTube](https://www.youtube.com/@ytsaurus) 

YTsaurus is a distributed storage and processing platform for big data with support for MapReduce model, a distributed file system and a NoSQL key-value database.

You can read [post about YTsaurus](https://medium.com/p/42e7f5fa5fc6) or check video:

[![video about YTsaurus](https://raw.githubusercontent.com/ytsaurus/ytsaurus/main/yt/docs/images/ytsaurus-promo-video.png)](https://youtu.be/4Q2EB_uimLs)

## What is YTsaurus SPYT powered by Apache Spark

YTsaurus SPYT is a tool that allows you to run Apache Spark applications on the YTsaurus platform. It provides:

* A set of popular tools for writing ETL processes

* Launch and support for multiple mini SPYT clusters 

* Easy migration for ready-made solutions

## Getting Started

### Installation

1. Make sure you have YTsaurus installed.

2. To install YTsaurus SPYT, follow [the installation guide](https://ytsaurus.tech/docs/en/admin-guide/install-spyt).

### Quick Start

Follow the instructions from [this page](https://ytsaurus.tech/docs/en/user-guide/data-processing/spyt/launch) to launch your first Spark application on YTsaurus platform.

## Contributing

### How to Build from Source Code

* Build [from source code](BUILD.md).

### How to Contribute

We are glad to welcome new contributors!

Please read the [contributor's guide](CONTRIBUTING.md) and the [styleguide](https://github.com/ytsaurus/ytsaurus/blob/main/yt/styleguide/styleguide.md) for more details.