https://github.com/bayudwiyansatria/library-java-apache-spark
Apache Spark Libraries. Apache Spark has as its architectural foundation the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. The Dataframe API was released as an abstraction on top of the RDD, followed by the Dataset API. In Spark 1.x, the RDD was the primary application programming interface (API), but as of Spark 2.x use of the Dataset API is encouraged even though the RDD API is not deprecated. The RDD technology still underlies the Dataset API.
https://github.com/bayudwiyansatria/library-java-apache-spark
apache-spark apache-spark-framework apache-spark-library bayudwiyansatria java-library libraries library
Last synced: 10 months ago
JSON representation
Apache Spark Libraries. Apache Spark has as its architectural foundation the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. The Dataframe API was released as an abstraction on top of the RDD, followed by the Dataset API. In Spark 1.x, the RDD was the primary application programming interface (API), but as of Spark 2.x use of the Dataset API is encouraged even though the RDD API is not deprecated. The RDD technology still underlies the Dataset API.
- Host: GitHub
- URL: https://github.com/bayudwiyansatria/library-java-apache-spark
- Owner: bayudwiyansatria
- License: mit
- Created: 2019-06-29T13:31:25.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2020-08-03T03:29:34.000Z (over 5 years ago)
- Last Synced: 2024-11-15T12:37:01.734Z (about 1 year ago)
- Topics: apache-spark, apache-spark-framework, apache-spark-library, bayudwiyansatria, java-library, libraries, library
- Language: Java
- Homepage: https://dev.bayudwiyansatria.com/apache-spark
- Size: 70.2 MB
- Stars: 0
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Awesome Lists containing this project
README
# Bayu Dwiyan Satria - Apache Spark Libraries
[](CODE_OF_CONDUCT.md)
[](https://dev.azure.com/bayudwiyansatria/Bayu%20Dwiyan%20Satria%20-%20Programming%20Library/_build/latest?definitionId=20&branchName=master)
[](https://www.codacy.com/manual/bayudwiyansatria/Library-Apache-Spark?utm_source=github.com&utm_medium=referral&utm_content=bayudwiyansatria/Library-Apache-Spark&utm_campaign=Badge_Grade)
[](https://codecov.io/gh/bayudwiyansatria/Library-Apache-Spark)
Apache Spark has as its architectural foundation the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. The Dataframe API was released as an abstraction on top of the RDD, followed by the Dataset API. In Spark 1.x, the RDD was the primary application programming interface (API), but as of Spark 2.x use of the Dataset API is encouraged even though the RDD API is not deprecated. The RDD technology still underlies the Dataset API.
| Key | Description |
| ------ | ------ |
| Name | Bayu Dwiyan Satria - Apache Spark Libraries |
| Description | Bayu Dwiyan Satria For Apache Spark Environment. |
| Site | [Site Page](https://bayudwiyansatria.github.io/Library-Apache-Spark) |
## Table of Contents
* [Dependencies](#dependencies)
* [Installation](#installation)
* [Development](#development)
* [Contributing](#contributing)
* [License](#license)
## Dependencies
For more information see : [The Central Repository](https://search.maven.org/artifact/com.bayudwiyansatria/env-apache-spark/).
**Maven Central :**
| Name | Group | Artifact | Version |
| ----- | ----- | ----- | ----- |
| [JUnit](https://search.maven.org/artifact/junit/junit) | junit | junit | 4.12
| [SLF4j](https://search.maven.org/) | org.slf4j | slf4j-simple | 1.7.25
| [SLF4j](https://search.maven.org/) | org.slf4j | slf4j-api | 1.7.25
| [HamCrest](https://search.maven.org/) | org.hamcrest | hamcrest-core | 1.3
| [HamCrest](https://search.maven.org/) | org.hamcrest | hamcrest-library | 1.3
| [BayuDwiyanSatria](https://search.maven.org/artifact/com.bayudwiyansatria/core) | com.bayudwiyansatria | core | 1.1.8
| [BayuDwiyanSatria](https://search.maven.org/artifact/com.bayudwiyansatria/core) | com.bayudwiyansatria | ml | 1.0
| [Scala](https://search.maven.org/) | org.scala | scala-library | 2.11.12
| [Log4j](https://search.maven.org/) | org.apache.logging.log4j | log4j-api | 2.11.12
| [ApacheSpark](https://search.maven.org/) | org.apache.spark | spark-network-common_2.11 | 2.6.5
| [ApacheSpark](https://search.maven.org/) | org.apache.spark | spark-catalyst_2.11 | 2.6.5
| [ApacheSpark](https://search.maven.org/) | org.apache.spark | spark-launcher_2.11 | 2.6.5
| [ApacheSpark](https://search.maven.org/) | org.apache.spark | spark-mllib_2.11 | 2.6.5
| [ApacheSpark](https://search.maven.org/) | org.apache.spark | spark-yarn_2.11 | 2.6.5
## Installation
Install the dependencies :
**Maven** :
Configure the following dependency in the pom file:
```xml
com.bayudwiyansatria
apache-spark
${bayudwiyansatria.apache-spark.version}
```
**Gradle** :
Configure the following dependency in the build.gradle file:
```properties
implementation='com.bayudwiyansatria:apache-spark:${bayudwiyansatria.apache-spark.version}'
```
SBT
```sbt
libraryDependencies += "com.bayudwiyansatria" % "apache-spark" % "${bayudwiyansatria.apache-spark.version}"
```
**Important** ! This will update from to your local repository . Be sure to swap out `${bayudwiyansatria.apache-spark.version}` with the actual version of Spark Libraries.
For more information see : [The Central Repository](https://search.maven.org/artifact/com.bayudwiyansatria/apache-spark/).
## Development
-*Release 1.0* : **2019, Sept**.
-*Release 1.1* : **2019, Nov**.
## Contributing
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
Please make sure to update tests as appropriate.
Looking to contribute to our code but need some help? There's a few ways to get information:
* Connect with us on [Twitter](https://twitter.com/bayudsatria)
* Like us on [Facebook](https://facebook.com/PBayuDSatria)
* Follow us on [LinkedIn](https://linkedin.com/in/bayudwiyansatria)
* Subscribe us on [Youtube](https://youtube.com/channel/UCihxWj1rtheK73mGdrf0OiA)
* Log an issue here on github
## License
[MIT](https://github.com/bayudwiyansatria/Development-And-Operations/blob/master/LICENSE) | [BAYU DWIYAN SATRIA](https://www.bayudwiyansatria.com)
Copyright © 2017 - 2019 Bayu Dwiyan Satria. All Rights Reserved.