https://github.com/rstudio/bigdataclass

Two-day workshop that covers how to use R to interact databases and Spark
https://github.com/rstudio/bigdataclass

big-data db dbi dbplyr r spark

Last synced: 2 months ago
JSON representation

Two-day workshop that covers how to use R to interact databases and Spark

• Host: GitHub
• URL: https://github.com/rstudio/bigdataclass
• Owner: rstudio
• Created: 2017-12-13T17:09:10.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2019-06-16T13:22:55.000Z (over 5 years ago)
• Last Synced: 2024-10-02T03:03:32.181Z (3 months ago)
• Topics: big-data, db, dbi, dbplyr, r, spark
• Language: R
• Homepage: https://rstudio.github.io/bigdataclass/
• Size: 29.4 MB
• Stars: 114
• Watchers: 15
• Forks: 55
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-sparklyr - **rstudio: bigdataclass**

README

        
Big Data class 

-------------------------

## Abstract

A two-day workshop. We will cover how to connect to and analyze data that exists outside of R. For databases, we will focus on the dplyr, DBI and odbc packages. For Big Data clusters, we will also learn how to use the sparklyr package to run models inside Spark and return the results to R. These packages enable us to use the same dplyr verbs inside R but are translated to SQL queries. We also will review recommendations for connection settings, security best practices and deployment options. Throughout the workshop, we will take advantage of RStudio’s professional tools such as RStudio Server Pro, the new professional data connectors, and RStudio Connect.

You should take this workshop if you want to learn how to use R with databases, such as SQL Server, Oracle, or PostgreSQL, and/or other scalable external data sources, such as Hadoop clusters with Hive and Spark.

## Contents

- **Workbook R Notebooks** - RMarkdown files at the top of the repository. They contain scaffold exercises for the students to practice during the class.

- **Full workbook** - A version of the exercise chapters with all of the code completed is available under the `book` folder.  They are available as html files created by the `bookdown` package.

- **Presentation deck** - The PDF version of the deck that compliments the exercises. It is under `assets/presentation_deck`.