{"id":18649867,"url":"https://github.com/ashwanthkumar/distributed-rocksdb-talk","last_synced_at":"2026-01-21T08:39:04.459Z","repository":{"id":140449940,"uuid":"74665616","full_name":"ashwanthkumar/distributed-rocksdb-talk","owner":"ashwanthkumar","description":"References to Distributed RocksDB","archived":false,"fork":false,"pushed_at":"2016-11-24T13:52:23.000Z","size":6,"stargazers_count":8,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2024-12-27T12:44:50.890Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ashwanthkumar.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-11-24T11:08:39.000Z","updated_at":"2023-02-25T03:28:10.000Z","dependencies_parsed_at":null,"dependency_job_id":"0f18360e-06cf-4588-92c7-9b5e265304d0","html_url":"https://github.com/ashwanthkumar/distributed-rocksdb-talk","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ashwanthkumar%2Fdistributed-rocksdb-talk","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ashwanthkumar%2Fdistributed-rocksdb-talk/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ashwanthkumar%2Fdistributed-rocksdb-talk/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ashwanthkumar%2Fdistributed-rocksdb-talk/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ashwanthkumar","download_url":"https://codeload.github.com/ashwanthkumar/distributed-rocksdb-talk/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":239456411,"owners_count":19641843,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-07T06:40:56.032Z","updated_at":"2025-11-05T10:30:32.855Z","avatar_url":"https://github.com/ashwanthkumar.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"## Abstract\nAt Indix, all systems deal with huge volumes of data, which means, they need to be distributed. We started out with using open source distributed systems (like Hadoop, HBase, Solr, Spark, etc) to help accomplish some of our needs. Along the way, we’ve also had some problems where existing solutions wouldn’t really work for the use cases that we had or there was a large operation overheard associated with them. This pushed us to build a couple of “simple” distributed systems.We built most of these using RocksDB as the backend store. This talk contains learnings from our discussion.\n\nSlides - http://bit.ly/distributed-rocksdb\n\nVideo - https://www.youtube.com/watch?v=PSCa9_Avne0\n\n## About Author\nAshwanth Kumar is a Principal Engineer at Indix. His major interest lies in building and operating large data systems. When not dealing with data, he spends his time reading research papers in similar topics. \n\n## References\n- https://speakerdeck.com/caitiem20/building-scalable-stateful-services-1\n- http://www.i-programmer.info/news/136-open-source/8220-microsoft-puts-orleans-code-on-github.html\n- http://www.slideshare.net/HiveData/tech-talk-rocksdb-slides-by-dhruba-borthakur-haobo-xu-of-facebook\n- http://www.slideshare.net/IgorCanadi/rocksdb-storage-engine-for-mysql-and-mongodb\n- http://www.slideshare.net/meeeejin/rocksdb-compaction\n- [Write Amplification](https://en.wikipedia.org/wiki/Write_amplification#Basic_SSD_operation)\n- [Read Amplification Factor](http://mysqlha.blogspot.in/2011/08/read-amplification-factor.html)\n- [The Chubby Lock Service for Loosely-Coupled Distributed Systems](http://research.google.com/archive/chubby.html)\n\n## Tools\n- [RocksDB](http://rocksdb.org/)\n- [Suuchi](https://github.com/ashwanthkumar/suuchi) - Toolkit for Building Distributed Data systems\n\n## Image Credits\n- [Twitter by aguycalledgary](https://thenounproject.com/search/?q=twitter+bird\u0026i=23267) from the Noun Project\n- [team by Wilson Joseph](https://thenounproject.com/term/team/717083/) from the Noun Project\n- [Earth by To Uyen](https://thenounproject.com/search/?q=internet+globe\u0026i=318309) from the Noun Project\n- [database by Kevin Woodland](https://thenounproject.com/search/?q=database\u0026i=282705) from the Noun Project\n- [options by Mert Güler](https://thenounproject.com/search/?q=toolkit\u0026i=638516) from the Noun Project\n- [SQL File by Viktor Vorobyev](https://thenounproject.com/search/?q=sql\u0026i=342070) from the Noun Project\n- [database by ✦ Shmidt Sergey ✦](https://thenounproject.com/search/?q=database\u0026i=691819) from the Noun Project\n- [sigma by Davo Sime from the Noun Project](https://thenounproject.com/search/?q=sigma\u0026i=607382)\n- [tools by Viktor Vorobyev from the Noun Project](https://thenounproject.com/search/?q=hammer\u0026i=561830)\n- [Info by Lance Weisser from the Noun Project](https://thenounproject.com/search/?q=info\u0026i=91723)\n- C++ Logo - https://worldvectorlogo.com/logo/c\n- Scala Logo - https://github.com/OlegIlyenko/scala-icon\n\n\n## License\n[![Creative Commons License](https://i.creativecommons.org/l/by/4.0/88x31.png)](http://creativecommons.org/licenses/by/4.0/)  \n\u003cspan xmlns:dct=\"http://purl.org/dc/terms/\" property=\"dct:title\"\u003eBuilding Distributed RocksDB\u003c/span\u003e by [Ashwanth Kumar](http://bit.ly/distributed-rocksdb) is licensed under a [Creative Commons Attribution 4.0 International License](http://creativecommons.org/licenses/by/4.0/).  \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fashwanthkumar%2Fdistributed-rocksdb-talk","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fashwanthkumar%2Fdistributed-rocksdb-talk","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fashwanthkumar%2Fdistributed-rocksdb-talk/lists"}