Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/hypermodeinc/modus
Modus: an open source, serverless framework for building intelligent functions and APIs, powered by WebAssembly
https://github.com/hypermodeinc/modus
ai api go javascript serverless webassembly
Last synced: 7 days ago
JSON representation
Modus: an open source, serverless framework for building intelligent functions and APIs, powered by WebAssembly
- Host: GitHub
- URL: https://github.com/hypermodeinc/modus
- Owner: hypermodeinc
- License: apache-2.0
- Created: 2023-10-28T04:31:08.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-11-06T05:50:06.000Z (8 days ago)
- Last Synced: 2024-11-06T09:06:09.975Z (8 days ago)
- Topics: ai, api, go, javascript, serverless, webassembly
- Language: Go
- Homepage: https://docs.hypermode.com/modus
- Size: 4.45 MB
- Stars: 131
- Watchers: 3
- Forks: 4
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Codeowners: .github/CODEOWNERS
- Security: SECURITY.md
Awesome Lists containing this project
README
[](https://github.com/hypermodeinc/modus)
[](https://github.com/hypermodeinc/modus?tab=Apache-2.0-1-ov-file#readme)
[](https://discord.gg/NJQ4bJpffF)
[](https://github.com/hypermodeinc/modus/stargazers)
[](https://github.com/hypermodeinc/modus/commits/main/)
Get Started ·
Docs ·
Discord
**Modus is an open-source, serverless framework for building APIs powered by WebAssembly.** It simplifies integrating AI models, data, and business logic with sandboxed execution. And, it's really fast.
We built Modus to put code back at the heart of development.
You write a function.
```ts
export function sayHello(name: string): string {
return `Hello, ${name}!`;
}
```
Then, Modus:
- extracts the metadata of your functions
- compiles your code with optimizations based on the host environment
- caches the compiled module in memory for fast retrieval
- prepares an invocation plan for each function
- extracts connections, models, and other configuration details from the app’s manifest
- generates an API schema and activates the endpoint
You query the endpoint
```graphql
query SayHello {
sayHello(name: "World")
}
```
In a few milliseconds, Modus:
- loads your compiled code into a sandboxed execution environment with a dedicated memory space
- runs your code, aided by host functions that power the Modus APIs
- securely queries data and AI models as needed, without exposing credentials to your code
- responds via the API result and releases the execution environment
**Now you have a production ready scalable endpoint for your AI-enabled app. AI-ready when you’re ready. Launch and iterate.**
## Quickstart
Install the Modus CLI
```bash
npm install -g @hypermode/modus-cli
```
Initialize your Modus app
```bash
modus new
```
Run your app locally with fast refresh
```bash
modus dev
```
## Demo
[](https://www.youtube.com/watch?v=3CcJTXTmz88)
## What's it good for?
We designed Modus primarily as a general-purpose framework, it just happens to treat models as a first-class component. With Modus you can use models, as appropriate, without additional complexity.
Modus is optimized for applications that require sub-second response times. We’ve made trade-offs to prioritize speed and simplicity.
## Programming Languages
Since Modus is based on WebAssembly, you can write Modus apps in various programming languages.
Each language offers the full capabilities of the Modus framework.
Currently, the supported languages you may choose from are:
- [AssemblyScript](https://www.assemblyscript.org/) - A TypeScript-like language designed for WebAssembly.
- If you are primarily used to writing front-end web apps, you'll feel at home with AssemblyScript.
- [Go](https://go.dev/) - A general-purpose programming language originally designed by Google.
- If you are primarily used to writing back-end apps, you'll likely prefer to use Go.
Additional programming languages may be supported in the future.
## Hosting
We have designed Hypermode to be the best place to run your Modus app.
Hypermode hosting plans include features you might expect, such as support, telemetry, and high availability.
They also include specialty features such as model hosting that are purposefully designed to work in tandem with Modus apps.
As Modus is a free, open-source framework, you’re welcome to run your Modus apps on your own hardware or on any
hosting platform that meets your needs.
## Open Source
Modus is developed by [Hypermode](https://hypermode.com/) as an open-source project, integral but independent from Hypermode.
We welcome external contributions. See the [CONTRIBUTING.md](./CONTRIBUTING.md) file if you would like to get involved.
## Acknowledgements
It's taken a lot of hard work to bring Modus to life, but we couldn't have done it alone. Modus is built upon _many_ open source components and projects. We'd especially like to express our gratitude to the authors and teams of our core dependencies:
- Takeshi Yoneda, author of [Wazero](https://wazero.io/), and other contributors to the Wazero project - and to [Tetrate](https://tetrate.io/) for continuing its support of Wazero. Modus uses Wazero to execute WebAssembly modules.
- Jens Neuse, Stefan Avram, and the rest of the team at [Wundergraph](https://wundergraph.com/). Modus uses Wundergraph's [GraphQL Go Tools](https://github.com/wundergraph/graphql-go-tools) library to process incoming GraphQL API requests.
- Max Graey, Daniel Wirtz, and other contributors to the [AssemblyScript](https://www.assemblyscript.org/) project. Modus chose AssemblyScript as one of its core languages because it is ideal for web developers getting started with Web Assembly.
- The [Go language](https://go.dev/) team, and also the maintainers of [TinyGo](https://tinygo.org/). The Modus Runtime is written in Go, and the Modus Go SDK uses TinyGo.
## License
Modus and its components are Copyright 2024 Hypermode Inc., and licensed under the terms of the Apache License, Version 2.0.
See the [LICENSE](./LICENSE) file for a complete copy of the license.
If you have any questions about Modus licensing, or need an alternate license or other arrangement, please contact us at [email protected].