https://github.com/rainaarya/dscd_assignments
All the assignments related to the Distributed Systems Course (DSCD, CSE-530) at IIIT-Delhi, Winter 2024 taught by Prof. Dhruv Kumar
https://github.com/rainaarya/dscd_assignments
Last synced: 3 months ago
JSON representation
All the assignments related to the Distributed Systems Course (DSCD, CSE-530) at IIIT-Delhi, Winter 2024 taught by Prof. Dhruv Kumar
- Host: GitHub
- URL: https://github.com/rainaarya/dscd_assignments
- Owner: rainaarya
- Created: 2024-01-30T10:52:42.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-22T15:29:27.000Z (about 1 year ago)
- Last Synced: 2025-02-13T08:22:23.106Z (4 months ago)
- Language: Python
- Homepage:
- Size: 743 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# 🌐 DSCD Assignments, W24 📚
This repository contains assignments related to the **Distributed Systems course at IIIT-Delhi, Winter 2024** 🎓
## 🛍️ Assignment 1: Distributed Messaging Frameworks
The first assignment focuses on usage of distributed messaging frameworks (gRPC, ZeroMQ, RabbitMQ). It consists of 3 parts:
1. 🏪 [Online Shopping Platform](Assignment_1/gRPC): Uses gRPC for communication between a central marketplace, sellers, and buyers. It demonstrates the practical application of gRPC in a distributed system.
2. 💬 [WhatsApp Messaging System](Assignment_1/ZeroMQ): Utilizes ZeroMQ for messaging patterns, providing a simple and efficient way to implement messaging functionalities including group registration, message sending, and retrieval.
3. 📹 [YouTube Application](Assignment_1/RabbitMQ): Implements a YouTube-like application using RabbitMQ. It allows YouTubers to publish videos and users to subscribe to their favorite YouTubers, facilitating communication through the YouTube server.
## 🤝 Assignment 2: Modified Raft Consensus Algorithm
The [second assignment](Assignment_2/) focuses on implementing a modified version of the Raft consensus algorithm, similar to those used by geo-distributed database clusters such as CockroachDB or YugabyteDB. It aims to build a distributed key-value store that ensures fault tolerance and strong consistency.
The concept of [leader lease](https://www.yugabyte.com/blog/low-latency-reads-in-geo-distributed-sql-with-raft-leader-leases/) is used to address the issue of high read latencies in the traditional Raft algorithm.
## 📊 Assignment 3: K-Means Clustering using MapReduce
The [third assignment](Assignment_3/) focuses on implementing the K-means clustering algorithm using the MapReduce framework from scratch in a distributed manner. The implementation is done in Python and uses gRPC for communication between the master, mappers, and reducers.
The MapReduce implementation consists of the master, input split, map, partition, shuffle and sort, reduce, and centroid compilation components.
---