https://github.com/lastmjs/browser-based-super-grid
https://github.com/lastmjs/browser-based-super-grid
Last synced: 4 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/lastmjs/browser-based-super-grid
- Owner: lastmjs
- License: mit
- Created: 2017-04-04T13:28:55.000Z (about 8 years ago)
- Default Branch: master
- Last Pushed: 2017-07-28T18:50:44.000Z (almost 8 years ago)
- Last Synced: 2025-01-19T22:50:37.590Z (5 months ago)
- Language: TypeScript
- Size: 79.1 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Browser-based Super Grid Proposal
# What will it do?
The system will parallelize a JavaScript program across an arbitrary number of browser peers. Peers may join other peers at will to help in the computation. Once a peer joins another peer, it will start receiving computation jobs. Peer-to-peer connections can scale arbitrarily. All computation will be completely client-side, no server will be necessary. This should allow for extremely easy on-the-fly distributed computing.
The source code of the jobs that will run will be stored on GitHub, and will be dynamically loaded through the GitHub API. Before the code is executed, it will be cryptographically verified with a public key stored on the MIT PGP Key Server, as an additional security check.
# What problem does it solve?
Currently parallel computing is complicated. It takes technical expertise and potentially expensive equipment. This project is one step in the direction of crowd-sourcing parallel computing, and using the idle resources of the world's computers better. We want to open parallel computing to the masses, and lower the costs of parallel computing infrastructure.
# Event architecture
* Publish work to be done
* Request to be a worker
* Work completed (job or batch)
* Intermediate result rumor (best result so far for a job or batch)
# APIs
* GitHub to pull down code from an open source repository
* MIT PGP Key Server
# Who
John Grosh
Jordan Last
# Work plan
## John
* UI
* WebRTC communication
* Algorithm
## Jordan
* GitHub integration
* PGP integration
* Code execution
* Project architecure, state management, and data flow
# Diagrams
# README
## Installation
## Use
* Upload script
* Upload script signature
To sign the script, install gpg, create a private and public key pair, and then run the following command in the same directory as the script to be signed:
```
gpg --clearsign --output [script name].sig --sign [script name]
```
Upload your public key to the MIT PGP Key Server.
## Experiments
Product | Number of browser instances | Connection type | Time elapsed
--- | --- | --- | ---
5010940919 | 1 | 1 | ~300 seconds
5010940919 | 2 | 1 -> * | ~160 seconds
5010940919 | 3 | 1 -> * | ~140 seconds
5010940919 | 4 | 1 -> * | ~75 seconds
5010940919 | 5 | 1 -> * | ~60 seconds
5010940919 | 4 | 1-> * -> * | ~70 seconds
5010940919 | 5 | 1 -> * -> * | ~67 seconds
5010940919 | 7 | 1 -> * -> * | ~52 seconds
80978377453 | 1 | 1 | ~1178 seconds
80978377453 | 8 | 1 -> * | ~150
80978377453 | 15 | 1-> * | ~95 seconds