https://github.com/aashrafh/bigtable

A simulation of a distributed system to apply the BigTable concepts
https://github.com/aashrafh/bigtable

bigtable distributed-systems gfs google-file-system imdb-dataset

Last synced: 27 days ago
JSON representation

A simulation of a distributed system to apply the BigTable concepts

• Host: GitHub
• URL: https://github.com/aashrafh/bigtable
• Owner: aashrafh
• License: mit
• Created: 2021-06-04T16:24:37.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2021-06-14T03:09:35.000Z (almost 4 years ago)
• Last Synced: 2025-02-06T11:54:02.721Z (3 months ago)
• Topics: bigtable, distributed-systems, gfs, google-file-system, imdb-dataset
• Language: JavaScript
• Homepage:
• Size: 83 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# About

A simulation of a distributed system to apply the BigTable concepts which has three major components: 

- One Master Server

- Two Tablet Servers

- Many Clients

## One Master Server

- Responsible for dividing data tables into tablets

    - Checks locality requirements for better efficiency

- Responsible for assigning tablets to tablet servers

    - Ensures load balance

- Has Metadata table indicating the row key range (start key-end key) for each tablet server

## Two Tablet Servers

- Each tablet server is responsible for a group of data tablets

- The exact number of tablets in each tablet server is according to the data size

- Performs the operations requested by the client

- Periodically each tablet server writes its tablets to the original data tables

## Many Clients

- Each client caches Metadata table (tablet locations).

- Requesting queries on data, these queries include:

    - ```Set()```: write cells in a row

    - ```DeleteCells()```: delete certain cells in a row

    - ```DeleteRow()```: delete a row

    - ```AddRow()```: add a new row

    - ```ReadRows()```: read a whole row

## Tools

- [Nodejs](https://nodejs.org/)

- [MongoDB](https://www.mongodb.com/)

- [Socket.IO](https://socket.io/)

- [IMDb Movies](https://www.kaggle.com/trentpark/imdb-data?select=IMDb+movies.csv)