Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/instill-ai/instill-core
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
https://github.com/instill-ai/instill-core
ai api cli developer-tools etl generative-ai golang gpt hacktoberfest llm low-code no-code open-source pipeline python stable-diffusion typescript unstructured-data
Last synced: 6 days ago
JSON representation
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
- Host: GitHub
- URL: https://github.com/instill-ai/instill-core
- Owner: instill-ai
- License: other
- Created: 2022-01-13T13:27:40.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2024-10-29T13:46:00.000Z (7 days ago)
- Last Synced: 2024-10-30T11:28:14.883Z (6 days ago)
- Topics: ai, api, cli, developer-tools, etl, generative-ai, golang, gpt, hacktoberfest, llm, low-code, no-code, open-source, pipeline, python, stable-diffusion, typescript, unstructured-data
- Language: Makefile
- Homepage: https://www.instill.tech
- Size: 9.57 MB
- Stars: 2,110
- Watchers: 30
- Forks: 102
- Open Issues: 36
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Awesome Lists containing this project
- StarryDivineSky - instill-ai/instill-core - core 存储库进行自托管。 (其他_机器学习与深度学习)
- awesome-production-machine-learning - Instill VDP - ai/instill-core.svg?style=social) - Instill VDP (Versatile Data Pipeline) aims to streamline the data processing pipelines from inception to completion. (Data Pipeline)
README
# instill-core
[](https://github.com/instill-ai/instill-core/actions/workflows/integration-test-latest.yml?branch=main&event=push)
[](https://github.com/instill-ai/instill-core/releases)
[](https://artifacthub.io/packages/helm/instill-ai/core)
[](https://discord.gg/sevxWsqpGh)
[](#contributors-)
Explore **🔮 [Instill Core](https://github.com/instill-ai/instill-core)**, a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications. Accessing **🔮 Instill Core** is straightforward, whether you opt for **☁️ Instill Cloud** or self-hosting via the [instill-core](https://github.com/instill-ai/instill-core) repository. Please consult the [documentation](https://www.instill.tech/docs/latest/core/deployment/?utm_source=github&utm_medium=readme&utm_campaign=org_readme) for more details.
💧 Instill VDP - Pipeline orchestration for unstructured data ETL
**💧 Instill VDP**, also known as **VDP (Versatile Data Pipeline)**, serves as a powerful pipeline orchestration tool tailored to address unstructured data ETL challenges.
**⚙️ Instill Component** is an extensible integration framework that enhances **💧 Instill VDP**, unlocking limitless possibilities. Please visit the [component](https://github.com/instill-ai/pipeline-backend/blob/main/pkg/component) package for details.
⚗️ Instill Model - Model orchestration for MLOps/LLMOps
**⚗️ Instill Model** is an advanced MLOps/LLMOps platform focused on seamlessly model serving, fine-tuning, and monitoring for persistent performance for unstructured data ETL.
💾 Instill Artifact - Data orchestration for unified unstructured data representation
**💾 Instill Artifact** orchestrates unstructured data to transform documents (e.g., HTML, PDF, CSV, PPTX, DOC), images (e.g., JPG, PNG, TIFF), audio (e.g., WAV, MP3 ) and video (e.g., MP4, MOV) into a unified AI-ready format. It ensures your data is clean, curated, and ready for extracting insights and building your Knowledge Base.
### ☁️ Instill Cloud
Not quite into self-hosting? We've got you covered with **☁️ [Instill Cloud](https://instill.tech/?utm_source=github&utm_medium=readme&utm_campaign=instill-core)**. It's a fully managed public cloud service, providing you with access to all the features of **🔮 Instill Core** without the burden of infrastructure management. All you need to do is to one-click sign up to start building your AI-first applications.
## Prerequisites
- **macOS or Linux** - **🔮 Instill Core** works on macOS or Linux
- **Windows** - **🔮 Instill Core** works on Windows through Windows Linux Subsystem (WSL2)
- Install the lastest version of `yq` from the GitHub [Repository](https://github.com/mikefarah/yq), as the package `yq` is not installed on Ubuntu WSL2 by default
- Install the latest version of Docker Desktop on Windows and enable the WSL2 integration following the [tutorial](https://docs.docker.com/desktop/wsl) by Docker
- (optional) Install `cuda-toolkit` on WSL2 following the [tutorial](https://docs.nvidia.com/cuda/wsl-user-guide/index.html#getting-started-with-cuda-on-wsl-2) by NVIDIA
- **Docker and Docker Compose** - **🔮 Instill Core** requires Docker Engine `v25` or later and Docker Compose `v2` or later to run all services locally. Please install the latest stable [Docker](https://docs.docker.com/get-docker/) and [Docker Compose](https://docs.docker.com/compose/install/).
## Quick Start
**Use stable release version**
Execute the following commands to pull pre-built images with all the dependencies to launch:
```bash
$ git clone -b v0.44.1-beta https://github.com/instill-ai/instill-core.git && cd instill-core
# Launch all services
$ make all
```
> [!NOTE]
> We have restructured our project repositories. If you need to access **🔮 Instill Core** projects up to version `v0.13.0-beta`, please refer to the [instill-ai/deprecated-core](https://github.com/instill-ai/deprecated-core) repository.
**Use the latest version for local development**
Execute the following commands to build images with all the dependencies to launch:
```bash
$ git clone https://github.com/instill-ai/instill-core.git && cd instill-core
# Launch all services
$ make latest PROFILE=all
```
> [!IMPORTANT]
> Code in the main branch tracks under-development progress towards the next release and may not work as expected. If you are looking for a stable alpha version, please use [latest release](https://github.com/instill-ai/instill-core/releases).
🚀 That's it! Once all the services are up with health status, the UI is ready to go at http://localhost:3000. Please find the default login credentials in the [documentation](https://www.instill.tech/docs/latest/quickstart#self-hosted-instill-core).
To shut down all running services:
```
$ make down
```
Explore the [documentation](https://www.instill.tech/docs/latest/core/deployment) to discover all available deployment options.
## Client Access
To access **🔮 Instill Core** and **☁️ Instill Cloud**, you have a few options:
- 📺 Instill Console
- ⌨️ Instill CLI
- 📦 Instill SDK:
- [Python SDK](https://github.com/instill-ai/python-sdk)
- [TypeScript SDK](https://github.com/instill-ai/typescript-sdk)
- Stay tuned, as more SDKs are on the way!
## Documentation
For comprehensive guidance and resources, explore our [documentation website](https://www.instill.tech/docs?utm_source=github&utm_medium=link&utm_campaign=instill-core) and delve into our [API reference](https://openapi.instill.tech).
## Contributing
We welcome contributions from the community! Whether you're a developer, designer, writer, or user, there are multiple ways to contribute:
### Issue Guidelines
We foster a friendly and inclusive environment for issue reporting. Before creating an issue, check if it already exists. Use clear language and provide reproducible steps for bugs. Accurately tag the issue (bug, improvement, question, etc.).
### Code Contributions
Please refer to the [Contributing Guidelines](./.github/CONTRIBUTING.md) for more details. Your code-driven innovations are more than welcome!
## Community
We are committed to providing a respectful and welcoming atmosphere for all contributors. Please review our [Code of Conduct](https://github.com/instill-ai/.github/blob/main/.github/CODE_OF_CONDUCT.md) to understand our standards.
### Efficient Triage Process
We have implemented a streamlined [Issues Triage Process](.github/triage.md) aimed at swiftly categorizing new issues and pull requests (PRs), allowing us to take prompt and appropriate actions.
### Engage in Dynamic Discussions and Seek Support
Head over to our [Discussions](https://github.com/orgs/instill-ai/discussions) for engaging conversations:
- [General](https://github.com/orgs/instill-ai/discussions/categories/general): Chat about anything related to our projects.
- [Polls](https://github.com/orgs/instill-ai/discussions/categories/polls): Participate in community polls.
- [Q&A](https://github.com/orgs/instill-ai/discussions/categories/q-a): Seek help or ask questions; our community members and maintainers are here to assist.
- [Show and Tell](https://github.com/orgs/instill-ai/discussions/categories/show-and-tell): Showcase projects you've created using our tools.
Alternatively, you can also join our vibrant [Discord](https://discord.gg/sevxWsqpGh) community and direct your queries to the #ask-for-help channel. We're dedicated to supporting you every step of the way.
## Contributors ✨
Thanks goes to these wonderful people ([emoji key](https://allcontributors.org/docs/en/emoji-key)):
Vibhor Bhatt
Miguel Ortiz
Sajda Kabir
Henry Chen
Hari Bhandari
Shiva Gaire
Zubeen
ShihChun-H
Ikko Eltociear Ashimine
Farookh Zaheer Siddiqui
Brian Gallagher
hairyputtar
David Marx
Deniz Parlak
Po-Yu Chen
Po Chun Chiu
Sarthak
HR Wu
phelan
Chang, Hui-Tang
Xiaofei Du
Ping-Lin Chang
Tony Wang
Pratik date
Juan Vallés
Naman Anand
totuslink
Praharsh Jain
Utsav Paul
CaCaBlocker
Rafael Melo
This project follows the [all-contributors](https://github.com/all-contributors/all-contributors) specification. Contributions of any kind welcome!
## License
See the [LICENSE](./LICENSE) file for licensing information.