https://github.com/roryclear/tinygrad-cloud-ios

https://github.com/roryclear/tinygrad-cloud-ios

Last synced: 15 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/roryclear/tinygrad-cloud-ios
• Owner: roryclear
• License: mit
• Created: 2024-12-03T21:48:18.000Z (about 1 month ago)
• Default Branch: main
• Last Pushed: 2024-12-10T23:16:40.000Z (24 days ago)
• Last Synced: 2024-12-11T00:24:22.554Z (24 days ago)
• Language: Objective-C
• Size: 50.8 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# [tinygrad](https://github.com/tinygrad/tinygrad) host for iOS

Run tinygrad code using your iPhone or iPad's GPU

## steps

1. install and open this app on your iPhone or iPad

2. install [tinygrad](https://github.com/tinygrad/tinygrad) on a computer connected to the same wifi network

3. run any tinygrad code

```sh

CLOUD=1 HOST={your iphone/ipad IP address}:6667 python3 examples/gpt2.py --model_size=gpt2

```

Also try [YOLOv8 on tinygrad](https://github.com/roryclear/yolov8-tinygrad-ios), by caching tinygrad cloud batches, models can be easily ran locally.

## notes

- Max allowed app RAM < total RAM. An iPhone 13 (4GB RAM) cannot use over 2GB in a single app for example, it will crash. Each device has its own limit.

- Metal cannot be ran in the background on iOS, the app must be open to run.

- Modifying one line in tinygrad to send batches on copyin() can increase the amount of memory that can be used, depending on the situation. This needs to be fixed within this app.