https://github.com/muna-ai/muna-py
Run AI models anywhere. https://muna.ai/explore
https://github.com/muna-ai/muna-py
ai deep-learning machine-learning numpy pytorch serverless serverless-gpu
Last synced: 10 days ago
JSON representation
Run AI models anywhere. https://muna.ai/explore
- Host: GitHub
- URL: https://github.com/muna-ai/muna-py
- Owner: muna-ai
- License: apache-2.0
- Created: 2023-05-15T15:10:22.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2026-03-03T17:14:12.000Z (23 days ago)
- Last Synced: 2026-03-03T21:37:22.228Z (23 days ago)
- Topics: ai, deep-learning, machine-learning, numpy, pytorch, serverless, serverless-gpu
- Language: Python
- Homepage: https://docs.muna.ai
- Size: 7.61 MB
- Stars: 84
- Watchers: 2
- Forks: 6
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: Changelog.md
- License: LICENSE
Awesome Lists containing this project
README
# Muna for Python
Compile and run AI models locally & in the cloud.
## Installing Muna
Muna is distributed on PyPi. This distribution contains both the Python client and the command line interface (CLI). Run the following command in terminal:
```sh
# Install Muna
$ pip install --upgrade muna
```
> [!NOTE]
> Muna requires Python 3.11+
## Running a Model
First, create a Muna client, specifying your access key ([create one here](https://muna.ai/settings/developer)):
```py
from muna import Muna
# 💥 Create an OpenAI client
openai = Muna("").beta.openai
```
Next, run a model:
```py
# 🔥 Create a chat completion
completion = openai.chat.completions.create(
model="@openai/gpt-oss-20b",
messages=[
{ "role": "user", "content": "What is the capital of France?" }
],
acceleration="local_gpu"
)
```
Finally, use the results:
```py
# 🚀 Use the results
print(completion.choices[0].message)
```
___
## Useful Links
- [Check out several AI models we've compiled](https://github.com/muna-ai/muna-predictors).
- [Join our Slack community](https://muna.ai/slack).
- [Check out our docs](https://docs.muna.ai).
- [Read our blog](https://muna.ai/blog).
- Reach out to us at [hi@muna.ai](mailto:hi@muna.ai).
Muna is a product of [NatML Inc](https://github.com/natmlx).