{"id":13471701,"url":"https://github.com/zhenlohuang/awesome-distributed-systems","last_synced_at":"2026-03-05T11:13:07.449Z","repository":{"id":44702204,"uuid":"46649050","full_name":"zhenlohuang/awesome-distributed-systems","owner":"zhenlohuang","description":"A curated list of awesome distributed systems books, papers, resources and shiny things.","archived":false,"fork":false,"pushed_at":"2023-01-11T10:39:41.000Z","size":12,"stargazers_count":939,"open_issues_count":1,"forks_count":146,"subscribers_count":75,"default_branch":"master","last_synced_at":"2024-10-30T02:59:53.236Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/zhenlohuang.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-11-22T06:16:47.000Z","updated_at":"2024-10-11T12:37:16.000Z","dependencies_parsed_at":"2023-02-09T02:46:20.213Z","dependency_job_id":null,"html_url":"https://github.com/zhenlohuang/awesome-distributed-systems","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zhenlohuang%2Fawesome-distributed-systems","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zhenlohuang%2Fawesome-distributed-systems/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zhenlohuang%2Fawesome-distributed-systems/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zhenlohuang%2Fawesome-distributed-systems/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/zhenlohuang","download_url":"https://codeload.github.com/zhenlohuang/awesome-distributed-systems/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245662876,"owners_count":20652099,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T16:00:48.405Z","updated_at":"2026-03-05T11:13:07.400Z","avatar_url":"https://github.com/zhenlohuang.png","language":null,"funding_links":[],"categories":["Misc","Others","Related projects","Other Lists"],"sub_categories":["TeX Lists"],"readme":"# awesome-distributed-systems\nA curated list of awesome distributed systems books, papers, resources and shiny things.\n\n## Bootcamp\n* [CAP Theorem](http://en.wikipedia.org/wiki/CAP_theorem)\n* [Fallacies of Distributed Computing](https://en.wikipedia.org/wiki/Fallacies_of_distributed_computing)\n* [Distributed systems theory for the distributed engineer](http://the-paper-trail.org/blog/distributed-systems-theory-for-the-distributed-systems-engineer/)   \nChinese version: [面向分布式系统工程师的分布式系统理论](http://blog.xiayf.cn/2014/08/10/Distributed-systems-theory-for-the-distributed-systems-engineer/)\n\n## Books\n* [Distributed Systems for fun and profit](http://book.mixu.net/distsys/single-page.html)\n* [Distributed Systems Concepts and Design(Fifth Edition) - George Coulouris](https://azmuri.files.wordpress.com/2013/09/george-coulouris-distributed-systems-concepts-and-design-5th-edition.pdf)\n* [Distributed Systems Principles and Paradigms - Andrew Tanenbaum](http://sist.sysu.edu.cn/~wuweig/DCC/DistributedSystemsPrinciplesandParadigms\\(2nd%20edition\\)-2007-Tanenbaum.pdf)\n* [走向分布式](http://dcaoyuan.github.io/papers/pdfs/Scalability.pdf)\n* [Distributed Machine Learning Patterns - Yuan Tang](https://github.com/terrytangyuan/distributed-ml-patterns), Practical patterns for scaling machine learning from your laptop to a distributed cluster.\n\n## Courses\n* [Cloud Computing Concepts](https://class.coursera.org/cloudcomputing-001), University of Illinois\n* [CMU: Distributed Systems](http://www.cs.cmu.edu/%7Edga/15-440/F12/syllabus.html) in Go Programming Language\n* [Principles of Distributed Computing](http://dcg.ethz.ch/lectures/podc_allstars/)\n* [Distributed Systems Fall 2015](http://www.andrew.cmu.edu/course/95-702/)\n* [Distributed Systems - MIT](http://nil.csail.mit.edu/6.824/2015/)\n* [Introduction to Distributed System Design - Google Code University](http://www.hpcs.cs.tsukuba.ac.jp/%7Etatebe/lecture/h23/dsys/dsd-tutorial.html)\n\n## Papers\n\n### Storage\n* [Dynamo: Amazon's Highly Available Key Value Store](http://bnrg.eecs.berkeley.edu/%7Erandy/Courses/CS294.F07/Dynamo.pdf)\n* [Bigtable: A Distributed Storage System for Structured Data](http://static.googleusercontent.com/media/research.google.com/en//archive/bigtable-osdi06.pdf)\n* [The Google File System](http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en/us/archive/gfs-sosp2003.pdf)\n* [Cassandra: A Decentralized Structured Storage System](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.161.6751\u0026rep=rep1\u0026type=pdf)\n* [Availability in Globally Distributed Storage Systems](http://static.googleusercontent.com/media/research.google.com/en/us/pubs/archive/36737.pdf)\n* [Sheepdog: Distributed Storage System for KVM](https://github.com/ty4z2008/Qix/blob/master/ds.md)\n* [PacificA: Replication in Log-Based Distributed Storage Systems](http://research.microsoft.com:8082/pubs/66814/tr-2008-25.pdf)\n* [Finding a needle in Haystack: Facebook’s photo storage](https://www.usenix.org/legacy/event/osdi10/tech/full_papers/Beaver.pdf)\n* [Windows Azure Storage: A Highly Available Cloud Storage Service with Strong Consistency](http://www-bcf.usc.edu/%7Eminlanyu/teach/csci599-fall12/papers/11-calder.pdf)\n\n### Databases\n* [Spanner: Google’s Globally-Distributed Database](http://static.googleusercontent.com/media/research.google.com/zh-CN//archive/spanner-osdi2012.pdf)\n* [Tera - 高性能、可伸缩的结构化数据库](https://github.com/ty4z2008/Qix/blob/master/ds.md)\n\n### Resource Management\n* [Apache Hadoop YARN: Yet Another Resource Negotiator](https://www.sics.se/~amir/files/download/dic/2013%20-%20Apache%20Hadoop%20YARN:%20Yet%20Another%20Resource%20Negotiator%20\\(SoCC\\).pdf)\n* [Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center\n](https://www.cs.berkeley.edu/~alig/papers/mesos.pdf)\n\n### Data Processing\n* [MapReduce: Simplified Data Processing on Large Clusters](https://static.googleusercontent.com/media/research.google.com/zh-CN//archive/mapreduce-osdi04.pdf)\n* [Pregel: A System for Large-Scale Graph Processing](http://www.dcs.bbk.ac.uk/~dell/teaching/cc/paper/sigmod10/p135-malewicz.pdf)\n\n### Query Processing\n* [Design and Implementation of a Query Processor for a Trusted Distributed Data Base Management System](http://www.utdallas.edu/%7Ebxt043000/Publications/Journal-Papers/DAS/J16_Design_and_Implementation_of_a_Distributed_Query_Processor.pdf)\n\n### Messaging Systems\n* [The Log: What every software engineer should know about real-time data's unifying abstraction](https://engineering.linkedin.com/distributed-systems/log-what-every-software-engineer-should-know-about-real-time-datas-unifying)   \nChinese version [日志：每个软件工程师都应该知道的有关实时数据的统一概念](http://www.oschina.net/translate/log-what-every-software-engineer-should-know-about-real-time-datas-unifying?lang=chs\u0026page=1#)\n* [Kafka: a Distributed Messaging System for Log Processin](http://notes.stephenholiday.com/Kafka.pdf)\n\n### Distributed Consensus\n* [The Part Time Parliament](http://research.microsoft.com/en-us/um/people/lamport/pubs/lamport-paxos.pdf), Lamport's original Paxos paper, but it's a bit difficult to understand.\n* [Paxos Made Simple](http://research.microsoft.com/en-us/um/people/lamport/pubs/paxos-simple.pdf), a more terse readable Paxos paper by Lamport himself.\n* [The Chubby Lock Service for loosely coupled distributed systems](http://static.googleusercontent.com/media/research.google.com/en//archive/chubby-osdi06.pdf)\n* [Paxos made live - An engineering perspective](http://research.google.com/archive/paxos_made_live.html)\n* [Raft Consensus Algorithm](https://raftconsensus.github.io/)\n* [Paxos vs Raft](https://ramcloud.stanford.edu/%7Eongaro/userstudy/)\n\n### Others\n* [Time, Clocks, and the Ordering of Events in a Distributed System](http://research.microsoft.com/en-us/um/people/lamport/pubs/time-clocks.pdf)\n\n## Blogs and other reading links\n* [What are some good resources for learning about distributed computing? Why?](https://www.quora.com/What-are-some-good-resources-for-learning-about-distributed-computing-Why)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzhenlohuang%2Fawesome-distributed-systems","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fzhenlohuang%2Fawesome-distributed-systems","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzhenlohuang%2Fawesome-distributed-systems/lists"}