An open API service indexing awesome lists of open source software.

https://github.com/ashwanthkumar/distributed-rocksdb-talk

References to Distributed RocksDB
https://github.com/ashwanthkumar/distributed-rocksdb-talk

Last synced: 6 months ago
JSON representation

References to Distributed RocksDB

Awesome Lists containing this project

README

          

## Abstract
At Indix, all systems deal with huge volumes of data, which means, they need to be distributed. We started out with using open source distributed systems (like Hadoop, HBase, Solr, Spark, etc) to help accomplish some of our needs. Along the way, we’ve also had some problems where existing solutions wouldn’t really work for the use cases that we had or there was a large operation overheard associated with them. This pushed us to build a couple of “simple” distributed systems.We built most of these using RocksDB as the backend store. This talk contains learnings from our discussion.

Slides - http://bit.ly/distributed-rocksdb

Video - https://www.youtube.com/watch?v=PSCa9_Avne0

## About Author
Ashwanth Kumar is a Principal Engineer at Indix. His major interest lies in building and operating large data systems. When not dealing with data, he spends his time reading research papers in similar topics.

## References
- https://speakerdeck.com/caitiem20/building-scalable-stateful-services-1
- http://www.i-programmer.info/news/136-open-source/8220-microsoft-puts-orleans-code-on-github.html
- http://www.slideshare.net/HiveData/tech-talk-rocksdb-slides-by-dhruba-borthakur-haobo-xu-of-facebook
- http://www.slideshare.net/IgorCanadi/rocksdb-storage-engine-for-mysql-and-mongodb
- http://www.slideshare.net/meeeejin/rocksdb-compaction
- [Write Amplification](https://en.wikipedia.org/wiki/Write_amplification#Basic_SSD_operation)
- [Read Amplification Factor](http://mysqlha.blogspot.in/2011/08/read-amplification-factor.html)
- [The Chubby Lock Service for Loosely-Coupled Distributed Systems](http://research.google.com/archive/chubby.html)

## Tools
- [RocksDB](http://rocksdb.org/)
- [Suuchi](https://github.com/ashwanthkumar/suuchi) - Toolkit for Building Distributed Data systems

## Image Credits
- [Twitter by aguycalledgary](https://thenounproject.com/search/?q=twitter+bird&i=23267) from the Noun Project
- [team by Wilson Joseph](https://thenounproject.com/term/team/717083/) from the Noun Project
- [Earth by To Uyen](https://thenounproject.com/search/?q=internet+globe&i=318309) from the Noun Project
- [database by Kevin Woodland](https://thenounproject.com/search/?q=database&i=282705) from the Noun Project
- [options by Mert Güler](https://thenounproject.com/search/?q=toolkit&i=638516) from the Noun Project
- [SQL File by Viktor Vorobyev](https://thenounproject.com/search/?q=sql&i=342070) from the Noun Project
- [database by ✦ Shmidt Sergey ✦](https://thenounproject.com/search/?q=database&i=691819) from the Noun Project
- [sigma by Davo Sime from the Noun Project](https://thenounproject.com/search/?q=sigma&i=607382)
- [tools by Viktor Vorobyev from the Noun Project](https://thenounproject.com/search/?q=hammer&i=561830)
- [Info by Lance Weisser from the Noun Project](https://thenounproject.com/search/?q=info&i=91723)
- C++ Logo - https://worldvectorlogo.com/logo/c
- Scala Logo - https://github.com/OlegIlyenko/scala-icon

## License
[![Creative Commons License](https://i.creativecommons.org/l/by/4.0/88x31.png)](http://creativecommons.org/licenses/by/4.0/)
Building Distributed RocksDB by [Ashwanth Kumar](http://bit.ly/distributed-rocksdb) is licensed under a [Creative Commons Attribution 4.0 International License](http://creativecommons.org/licenses/by/4.0/).