An open API service indexing awesome lists of open source software.

https://github.com/alphasecio/fireworks

A Streamlit app for running open-source text and image models on Fireworks AI.
https://github.com/alphasecio/fireworks

fireworksai gemma llama3 llm mistral open-source python stable-diffusion streamlit

Last synced: about 1 year ago
JSON representation

A Streamlit app for running open-source text and image models on Fireworks AI.

Awesome Lists containing this project

README

          

# fireworks-ai
[Fireworks AI](https://fireworks.ai) is a platform for hosting and running machine learning (ML) models with a cloud API, without having to manage your own infrastructure. Sign up for an account at Fireworks and get an [API key](https://fireworks.ai/api-keys), which you'll need for this project.

This repository showcases a simple Streamlit app for running the following open-source text and image generation models on Fireworks AI:
* Text: Meta Llama 3.3 70B Instruct
* Text: Google Gemma 2 9B Instruct *(currently unavailable in serverless mode)*
* Text: Mixtral MoE 8x7B Instruct
* Text: DeepSeek V3 *(new)*
* Text: 01 Yi Large
* Image: Stable Diffusion XL

![fireworks-sdxl](./fireworks-sdxl.png)

For a detailed guide, see [this](https://alphasec.io/running-open-source-generative-ai-models-on-fireworks-ai/) post. To deploy on [Railway](https://railway.app/?referralCode=alphasec) using a one-click template, click the button below.

[![Deploy on Railway](https://railway.app/button.svg)](https://railway.app/new/template/dYYPjx?referralCode=alphasec)