https://github.com/prneidhardt/data-modeling

Sparkify Project
https://github.com/prneidhardt/data-modeling

apache-cassandra data-modeling etl-pipeline

Last synced: 3 months ago
JSON representation

Sparkify Project

• Host: GitHub
• URL: https://github.com/prneidhardt/data-modeling
• Owner: prneidhardt
• License: gpl-3.0
• Created: 2023-05-06T23:30:42.000Z (about 3 years ago)
• Default Branch: master
• Last Pushed: 2024-11-11T21:18:46.000Z (over 1 year ago)
• Last Synced: 2025-03-14T07:45:48.335Z (over 1 year ago)
• Topics: apache-cassandra, data-modeling, etl-pipeline
• Language: Jupyter Notebook
• Homepage:
• Size: 581 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Data-Modeling

Sparkify Project

- Project delivered in May 2023

- Repository includes three files:

  - Jupyter notebook with Python code

  - CSV file resulting from pre-processing pipeline

  - Image denormalized table in final CSV file

## Problem Statement

- A startup called Sparkify wants to analyze the data they've been collecting on songs and user activity on their new music streaming app. The analysis team is particularly interested in understanding what songs users are listening to. Currently, there is no easy way to query the data to generate the results, since the data reside in a directory of CSV files on user activity on the app.

- They'd like a data engineer to create an Apache Cassandra database which can create queries on song play data to answer the questions. You'll be able to test your database by running queries given to you by the analytics team from Sparkify to create the results.

## Skills and Tools

- Data preprocessing

- ETL (Extract, Transform, Load)

- Apache Cassandra

- Data modeling