Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/WeBankFinTech/Scriptis

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.
https://github.com/WeBankFinTech/Scriptis

errorcode hive hive-table hql hue ide linkis pyspark resouce-management scala spark sql udf zeppelin

Last synced: 3 months ago
JSON representation

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

Host: GitHub
URL: https://github.com/WeBankFinTech/Scriptis
Owner: WeBankFinTech
License: apache-2.0
Created: 2019-07-23T06:42:19.000Z (over 5 years ago)
Default Branch: master
Last Pushed: 2024-03-14T02:41:25.000Z (8 months ago)
Last Synced: 2024-05-03T06:42:47.010Z (6 months ago)
Topics: errorcode, hive, hive-table, hql, hue, ide, linkis, pyspark, resouce-management, scala, spark, sql, udf, zeppelin
Language: Vue
Homepage:
Size: 50.3 MB
Stars: 797
Watchers: 74
Forks: 265
Open Issues: 25
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

        Scriptis

============

[![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html)

English | [Chinese](docs/zh_CN/README.md)

### !This project has been merged into [DataSphereStudio](https://github.com/WeBankFinTech/DataSphereStudio)

## Introduction

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

![running](docs/en_US/images/readme/running.gif)

## Features

* Script editor: Support multi-language, auto-completion, syntax highlighting and SQL syntax error-correction.

* Computation engines: Based on Linkis, Scriptis connects with multiple computation engines such as Spark, Hive, Python, etc.

* Runtime functionality: Complete job life cycle display and intelligent diagnosis.

* Result set: Multiple result sets support, customized result set alias and one-click visualization. 

* Database Services: Functionalities for database management and files(CVS, Excel) import/export to/from tables.

* Context: UDFs, custom variables and functions management and sharing.

* Console: Customized settings for engine parameters, task/engine management and resource isolation/display.

## QuickStart

Read the Quick Start [Quick Start](docs/en_US/ch1/Front-end_deployment_documentation.md)

## Comparison with similar scheduler systems

![Comparison](/docs/en_US/images/readme/Comparison.png)

## Documentations

[Quick Start](docs/en_US/ch1/Front-end_deployment_documentation.md)

[Quick Use](docs/en_US/ch3/Scriptis_Quick_Start.md)

[User Manual](docs/en_US/ch4/Scriptis_Manual.md)

[Compilation](docs/en_US/ch2/Compilation.md)

## Community

If you desire immediate response, please kindly raise issues to us or scan the below QR code by WeChat and QQ to join our group:

![WeChatQQ](https://github.com/WeBankFinTech/WeDataSphere/assets/11496700/853e2b68-109f-42ba-a1b7-5e42d01b2865)

## License

Scriptis is under the Apache 2.0 license. See the [LICENSE]((http://www.apache.org/licenses/LICENSE-2.0)) file for details