https://github.com/Victrid/CS236-Cloud-Experiment

Experiment for CS236: Cloud Computing
https://github.com/Victrid/CS236-Cloud-Experiment

Last synced: about 1 month ago
JSON representation

Experiment for CS236: Cloud Computing

• Host: GitHub
• URL: https://github.com/Victrid/CS236-Cloud-Experiment
• Owner: Victrid
• License: mit
• Created: 2022-01-25T14:37:28.000Z (almost 3 years ago)
• Default Branch: master
• Last Pushed: 2022-01-25T14:39:35.000Z (almost 3 years ago)
• Last Synced: 2024-06-11T07:35:02.847Z (6 months ago)
• Language: Shell
• Size: 3.84 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-cs - @Victrid, 2021 Fall

README

        
# Cloud Computing 2021 Experiment

This folder contains Cloud Computing 2021 Experiment submission files. Please check `Report.pdf` for details.

## File Structure

-   `image-buildscript`:  For building custom mirror

-   `HuaweiCloud-openAPI`: For Creating Virtual Machines

-   `WordCount`: WordCount source file and results

-   `GraphX`: Connected Component sources

-   `PageRank`: Page Rank sources

-   `Report.pdf`: The report PDF file

## Run GraphX Connected Components

-   Copy the entire dir `GraphX` on to VM

-   run under `GraphX` : `sbt package`

-   upload two txt files onto HDFS `data/graphx` folder

-   run `spark-submit --class "org.apache.spark.examples.graphx.ConnectedComponentsExample"  target/scala-2.12/graphx-connected-component_2.12-1.0.jar`

-   See the results in STDOUT.

## Run PageRank

-   Copy the entire dir `PageRank` on to VM

-   run under `PageRank` : `sbt package`

-   upload three txt files onto HDFS `data` folder

-   run `spark-submit --class "PageRankWiki"  target/scala-2.12/graphx-pagerank-wiki-users_2.12-1.0.jar`

-   See the results in STDOUT.