https://github.com/learning-at-home/hivemind

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

asynchronous-programming asyncio deep-learning dht distributed-systems distributed-training hivemind machine-learning mixture-of-experts neural-networks pytorch volunteer-computing

Last synced: 13 May 2025

https://github.com/learning-at-home/dalle-hivemind

Training a model similar to OpenAI DALL-E with volunteers from all over the Internet using hivemind and dalle-pytorch (NeurIPS 2021 demo)

Last synced: 13 May 2025

https://github.com/learning-at-home/lean_transformer

Memory-efficient transformer. Work in progress.

Last synced: 13 May 2025

https://github.com/learning-at-home/collaborative-latent-diffusion

Collaborative inference of latent diffusion via hivemind

Last synced: 13 May 2025

https://github.com/learning-at-home/clip_hivemind

This is an early in-development version of training CLIP models with hivemind.

Last synced: 13 May 2025

https://github.com/learning-at-home/learning-at-home.github.io

https://learning-at-home.github.io/

Last synced: 13 May 2025