https://github.com/stevana/armstrong-distributed-systems

Notes on how we potentially could build reliable, scalable and maintainable computer systems.
https://github.com/stevana/armstrong-distributed-systems

Last synced: 9 days ago
JSON representation

Notes on how we potentially could build reliable, scalable and maintainable computer systems.

• Host: GitHub
• URL: https://github.com/stevana/armstrong-distributed-systems
• Owner: stevana
• Created: 2022-12-30T10:27:42.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2023-09-09T07:11:44.000Z (about 1 year ago)
• Last Synced: 2024-02-17T14:37:40.804Z (9 months ago)
• Language: Makefile
• Homepage:
• Size: 400 KB
• Stars: 312
• Watchers: 14
• Forks: 13
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Armstrong distributed systems

How do we build reliable, scalable and maintainable computer systems?

This repository contains notes on how, I think, we can improve on the state of

development, documentation, testing, deployment, observability, debugging, and

upgrading of distributed systems. Most of the ideas are stolen from others, many

from Erlang and Joe Armstrong. Over time I hope to turn this into a more

coherent text, for now think of it a crude blog or some basic scaffolding for me

to hang my thoughts on.

If any of this interests you as well, please do get in touch -- one of the

reasons I'm writing this down is to find people to collaborate with.

## Development

* [Erlang's not about lightweight processes and message

  passing...](docs/erlang-is-not-about.md)

* [Implementing

  behaviours](https://github.com/stevana/armstrong-distributed-systems/blob/implementing-behaviours/docs/implementing-behaviours.md)

* [Modular state machines](docs/modular-state-machines.md)

* Implementing `gen_event` using the LMAX disruptor

  - https://github.com/stevana/pipelined-state-machines

  - Shard on: "people, stuff or deals",

    [says](https://youtu.be/1KRYH75wgy4?t=2781) Martin Thompson.

* [State machines with of async I/O](https://github.com/stevana/coroutine-state-machines)

* Persisted/`mmap`ped lock-free concurrent data structures

  - [Working with binary data](https://github.com/stevana/bits-and-bobs)

  - bytebuffer

  - journal

  - hashmap

  - arena allocator

  - buffered actions

  - [Efficient Tree-Traversals: Reconciling Parallelism and

    Dense](https://arxiv.org/pdf/2107.00522.pdf)

* [On the role of practice in programming](docs/practice-in-programming.md)

## Documentation

* [Specification language](docs/specification-language.md)

  - Interfaces

  - Messages

  - Compression

  - Protocols

  - Usage model or operational profile

* Joe's idea of ["the bigger picture"](https://youtu.be/h8nmzPh5Npg?t=1220) in

  particular the "research" part, not just the end result (code) but how you got

  to the result.

## Testing

* [Simulation testing using state

  machines](https://github.com/stevana/property-based-testing-stateful-systems-tutorial)

* Usage model or operational profile

* Load/soak testing

## Deployment

* [Deploying and restarting state machines using supervisor

  trees](https://github.com/stevana/supervised-state-machines)

* [Elastically scalable thread

  pools](https://github.com/stevana/elastically-scalable-thread-pools)

## Observability

* [Visualising datastructures over time using

  SVG](https://github.com/stevana/svg-viewer-in-svg)

## Debugging

* [Domains-specific debuggers](docs/domain-specific-debuggers.md)

## Upgrading

* [Hot-code swapping à la Erlang with `Arrow`-based state

  machines](https://github.com/stevana/hot-swapping-state-machines)

* [`smarrow-lang`](https://github.com/stevana/smarrow-lang) an experimental

  programming language where programs are state machines expressed in arrow

  notation to allow easy hot-code swapping

* Version everything