Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/nexusgpu/tensor-fusion-site

TensorFusion landing page and product docs
https://github.com/nexusgpu/tensor-fusion-site

ai cuda gpu gpu-acceleration gpu-management gpu-monitoring gpu-pooling gpu-sharing gpu-usage gpu-virtualization nvidia nvidia-cuda pytorch rcuda tensorflow

Last synced: 15 days ago
JSON representation

TensorFusion landing page and product docs

Host: GitHub
URL: https://github.com/nexusgpu/tensor-fusion-site
Owner: NexusGPU
Created: 2024-11-12T23:43:54.000Z (3 months ago)
Default Branch: main
Last Pushed: 2025-01-24T05:10:59.000Z (17 days ago)
Last Synced: 2025-01-24T06:19:48.036Z (17 days ago)
Topics: ai, cuda, gpu, gpu-acceleration, gpu-management, gpu-monitoring, gpu-pooling, gpu-sharing, gpu-usage, gpu-virtualization, nvidia, nvidia-cuda, pytorch, rcuda, tensorflow
Language: CSS
Homepage: https://tensor-fusion.ai
Size: 1.56 MB
Stars: 1
Watchers: 0
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md

Awesome Lists containing this project

README

        


# Tensor Fusion

Tensor Fusion is a AI infra solution focusing on maximizing GPU usage with pooling and intelligent scheduling. It's based on a cutting-edge API-remoting GPU virtualization.

**Less GPUs, More AI Apps**. 

## Documents



[![Contributors][contributors-shield]][contributors-url]

[![Forks][forks-shield]][forks-url]

[![Stargazers][stars-shield]][stars-url]

[![Issues][issues-shield]][issues-url]

[![MIT License][license-shield]][license-url]

[![LinkedIn][linkedin-shield]][linkedin-url]




  Table of Contents

  


    

      About The Project

      

        Built With

      

    

    

      Getting Started

      

        Installation

      

    

    Usage

    Roadmap

    Contributing

    License

    Contact

    Acknowledgments

  


## About The Project

[Tensor Fusion Docs](https://tensor-fusion.ai/guide/overview)

## Getting Started

::warn:: **This project is currently in heavy development.**

Onboard your GPU cluster to Tensor Fusion in minutes.

### Installation

- [Installation on Kubernetes](https://docs.tensor-fusion.ai/guide/deployment-k8s)

- [Installation on Kubernetes](https://docs.tensor-fusion.ai/guide/deployment-k8s)

## Roadmap

### Core Features

- [x] NVIDIA GPU pooling

- [x] Pytorch support

- [ ] Seamless CUDA Context migration

- [ ] QoS levels

- [ ] Autoscaling policies

- [ ] TensorFlow and other framework support

- [ ] Compression, multiplexing & RDMA

- [ ] Support multiple GPU/NPU vendors based on [ZLUDA](https://github.com/vosen/ZLUDA)

### Scheduling & Management

- [ ] Metrics & tracing of CUDA calls

- [ ] Advanced scheduling, super burst mode

- [ ] Hybrid scheduling, auto move communication intensive models schedule to local GPU

- [ ] Management dashboard

### Platform Support

- [x] Run on VM/BareMetal

- [x] Run on Kubernetes clusters

- [ ] Run on ARM chips

See the [open issues](https://github.com/NexusGPU/tensor-fusion-site/issues) for a full list of proposed features (and known issues).

## Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are **greatly appreciated**.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement".

Don't forget to give the project a star! Thanks again!

1. Fork the Project

2. Create your Feature Branch (`git checkout -b feature/AmazingFeature`)

3. Commit your Changes (`git commit -m 'Add some AmazingFeature'`)

4. Push to the Branch (`git push origin feature/AmazingFeature`)

5. Open a Pull Request

### Top contributors



  



(back to top)


## License

TensorFusion is not open sourced as of now. It will be open after GA with BSL license.

## Support & Contact

- Discord channel: [https://discord.gg/2bybv9yQNk](https://discord.gg/2bybv9yQNk)

- Email address: [@[email protected]](mailto:[email protected])

- Project link: [https://github.com/NexsusGPU/TensorFusion](https://github.com/NexsusGPU/TensorFusion)

## Acknowledgments

* [GPU Less](https://choosealicense.com)

* [rCUDA](https://www.webpagefx.com/tools/emoji-cheat-sheet)

(back to top)


[contributors-shield]: https://img.shields.io/github/contributors/NexusGPU/tensor-fusion-site.svg?style=for-the-badge

[contributors-url]: https://github.com/NexusGPU/tensor-fusion-site/graphs/contributors

[forks-shield]: https://img.shields.io/github/forks/NexusGPU/tensor-fusion-site.svg?style=for-the-badge

[forks-url]: https://github.com/NexusGPU/tensor-fusion-site/network/members

[stars-shield]: https://img.shields.io/github/stars/NexusGPU/tensor-fusion-site.svg?style=for-the-badge

[stars-url]: https://github.com/NexusGPU/tensor-fusion-site/stargazers

[issues-shield]: https://img.shields.io/github/issues/NexusGPU/tensor-fusion-site.svg?style=for-the-badge

[issues-url]: https://github.com/NexusGPU/tensor-fusion-site/issues

[license-shield]: https://img.shields.io/github/license/NexusGPU/tensor-fusion-site.svg?style=for-the-badge

[license-url]: https://github.com/NexusGPU/tensor-fusion-site/blob/master/LICENSE.txt

[linkedin-shield]: https://img.shields.io/badge/-LinkedIn-black.svg?style=for-the-badge&logo=linkedin&colorB=555

[linkedin-url]: https://www.linkedin.com/company/tensor-fusion/about

[product-screenshot]: images/screenshot.png