https://github.com/ryandotsmith/fish

POC for distributed database built on BDB
https://github.com/ryandotsmith/fish

Last synced: 2 months ago
JSON representation

POC for distributed database built on BDB

• Host: GitHub
• URL: https://github.com/ryandotsmith/fish
• Owner: ryandotsmith
• Created: 2012-11-15T03:41:40.000Z (about 12 years ago)
• Default Branch: master
• Last Pushed: 2012-11-15T08:10:47.000Z (about 12 years ago)
• Last Synced: 2024-10-13T17:47:40.475Z (3 months ago)
• Language: Python
• Size: 133 KB
• Stars: 0
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# Fish

## The Problem

We wish to provide a transactional data store that offers distributed replication and automatic fail-over.

## A Solution

A proof of concept. Fish offers a service layer on top of BerkeleyDB. Fish explicity uses BDB's replication manager to create a fault-tolerant, distributed system.

The idea is to have a fleet of front-end services that receive PUT/GET requests via HTTP. The front-ends will remain uncoordinated. Furthermore each front-end will have a local, read-only BDB that is a part of the Fish replication group. To service an HTTP request, the front-end will use it's local BDB to resolve the back-end who is currently elected master. The front-end will connect directly to the master back-end and issue the request.

## Why Fish Matters

Fish leverages BerkelyDB which is a stable, mature & feature-full database. BDB offers a single Writer topology with a paxos implemented leader election manager. Furthermore, BDB offers granular control over data consistency. Transaction can be committed to a quorum, all-eligible-leaders, or all sites.

## Usage

```bash

$ git clone git://github.com/ryandotsmith/fish.git

$ cd fish

$ pip install -r requirements.txt

$ source venv/bin/active

```

Start a back-end master:

```bash

$ bin/setup b0

$ export PORT=5000

$ bin/back --dir b0 --address localhost:9000 --want-master --priority 10

```

Start a back-end client:

```bash

$ bin/setup b1

$ export PORT=5001

$ bin/back --dir b1 --address localhost:9001 --buddy localhost:9000

```

Start a front-end:

```bash

$ bin/setup r0

$ export PORT=8000

$ bin/front --dir r0 --address localhost:9002 --buddy localhost:9000

```