https://github.com/instill-ai/instill-core
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
https://github.com/instill-ai/instill-core
ai api cli developer-tools etl generative-ai golang gpt hacktoberfest llm low-code no-code open-source pipeline python stable-diffusion typescript unstructured-data
Last synced: about 2 months ago
JSON representation
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
- Host: GitHub
- URL: https://github.com/instill-ai/instill-core
- Owner: instill-ai
- License: other
- Created: 2022-01-13T13:27:40.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2025-05-07T09:43:45.000Z (10 months ago)
- Last Synced: 2025-05-07T10:45:05.145Z (10 months ago)
- Topics: ai, api, cli, developer-tools, etl, generative-ai, golang, gpt, hacktoberfest, llm, low-code, no-code, open-source, pipeline, python, stable-diffusion, typescript, unstructured-data
- Language: Makefile
- Homepage: https://www.instill-ai.dev
- Size: 10.8 MB
- Stars: 2,243
- Watchers: 29
- Forks: 112
- Open Issues: 36
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Awesome Lists containing this project
- StarryDivineSky - instill-ai/instill-core - core 存储库进行自托管。 (其他_机器学习与深度学习)
- awesome-production-machine-learning - Instill VDP - ai/instill-core.svg?style=social) - Instill VDP (Versatile Data Pipeline) aims to streamline the data processing pipelines from inception to completion. (Data Pipeline)
README
# 🔮 **Instill Core**
[](https://github.com/instill-ai/instill-core/actions/workflows/integration-test-latest.yml?branch=main&event=push)
[](https://github.com/instill-ai/instill-core/releases)
[](https://artifacthub.io/packages/helm/instill-ai/core)
[](https://discord.gg/sevxWsqpGh)
A complete unstructured data solution: ETL processing, AI-readiness, open-source LLM hosting, and RAG capabilities in one powerful platform.
## Quick start
Follow the [installation](#installation) steps below or [documentation](https://docs.instill-ai.com/docs/deployment/?utm_source=github&utm_medium=readme&utm_campaign=org_readme) for more details to build versatile AI applications locally.
## What is Instill Core?
[**Instill Core**](https://github.com/instill-ai/instill-core) is an end-to-end AI platform for data, pipeline and model orchestration.
🔮 **Instill Core** simplifies infrastructure hassle and encompasses these core features:
- 💧 [**Pipeline**](https://docs.instill-ai.com/docs/pipeline-introduction/?utm_source=github&utm_medium=readme&utm_campaign=org_readme): Quickly build versatile AI-first APIs or automated workflows.
- ⚙️ [**Component**](https://docs.instill-ai.com/docs/component-introduction/?utm_source=github&utm_medium=readme&utm_campaign=org_readme): Connect essential building blocks to construct powerful pipelines.
- 💾 [**Artifact**](https://docs.instill-ai.com/docs/artifact-introduction/?utm_source=github&utm_medium=readme&utm_campaign=org_readme): Transform unstructured data (e.g., documents, images, audio, video) into AI-ready formats.
- ⚗️ [**Model**](https://docs.instill-ai.com/docs/model-introduction/?utm_source=github&utm_medium=readme&utm_campaign=org_readme): Deploy and monitor AI models without GPU infrastructure hassles.
## What can you build?
- 📖 Parsing PDF Files to Markdown: [Cookbook](https://github.com/instill-ai/cookbook/blob/main/examples/Parsing_pdf_files.ipynb)
- 🧱 Generating Structured Outputs from LLMs: [Cookbook](https://github.com/instill-ai/cookbook/blob/main/examples/Generating_structured_outputs.ipynb) & [Tutorial](https://www.instill-ai.com/blog/llm-structured-outputs)
- 🕸️ Web scraping & Google Search with Structured Insights
- 🌱 Instance segmentation on microscopic plant stomata images: [Cookbook](https://github.com/instill-ai/cookbook/blob/main/examples/Instance_segmentation_stomavision.ipynb)
See [Examples](https://docs.instill-ai.com/docs/examples) for more!
## Installation
### Prerequisites
| Operating System | Requirements and Instructions |
| ---------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| macOS or Linux | Instill Core works natively |
| Windows | • Use Windows Subsystem for Linux (WSL2)
• Install latest `yq` from [GitHub Repository](https://github.com/mikefarah/yq)
• Install latest Docker Desktop and enable WSL2 integration ([tutorial](https://docs.docker.com/desktop/wsl))
• (Optional) Install `cuda-toolkit` on WSL2 ([NVIDIA tutorial](https://docs.nvidia.com/cuda/wsl-user-guide/index.html#getting-started-with-cuda-on-wsl-2)) |
| All Systems | • Docker Engine v25 or later
• Docker Compose v2 or later
• Install latest stable [Docker](https://docs.docker.com/get-docker/) and [Docker Compose](https://docs.docker.com/compose/install/) |
### Spin up Instill Core
Execute the following commands to pull pre-built images with all the dependencies to launch:
```bash
git clone -b v0.58.1 https://github.com/instill-ai/instill-core.git && cd instill-core
# Launch all services
make run
```
That's it! Once all the services are up with health status, the UI is ready to go at . Please find the default login credentials in the [documentation](https://docs.instill-ai.com/docs/quickstart#instill-core-ce-self-hosted).
To shut down all running services:
```shell
make down
```
## Deployment
Visit the [Deployment Overview](https://docs.instill-ai.com/docs/deployment/?utm_source=github&utm_medium=readme&utm_campaign=org_readme) for more details.
## Client Access
- 📺 Console
- ⌨️ CLI
- 📦 SDK:
- [Python SDK](https://github.com/instill-ai/python-sdk)
- [TypeScript SDK](https://github.com/instill-ai/typescript-sdk)
- Stay tuned, as more SDKs are on the way!
## Documentation
Please visit our [official documentation](https://docs.instill-ai.com/docs?utm_source=github&utm_medium=link&utm_campaign=instill-core) for more.
Additional resources:
- [API Reference](https://docs.instill-ai.com/reference)
- [Cookbooks](https://github.com/instill-ai/cookbook)
- [Tutorials](https://www.instill-ai.com/blog)
- [Examples](https://docs.instill-ai.com/docs/examples)
## Contributing
We welcome contributions from our community! Checkout the methods below:
1. **Cookbooks**: Help us create helpful pipelines and guides for the community. Visit our [Cookbook repository](https://github.com/instill-ai/cookbook) to get started.
2. **Issues**: Contribute to improvements by raising tickets using [templates here](https://github.com/instill-ai/instill-core/issues/new/choose) or discuss in existing ones you think you can help with.
### Community Standards
We are committed to maintaining a respectful and welcoming atmosphere for all contributors. Before contributing, please read:
- [Contributing Guidelines](./.github/CONTRIBUTING.md)
- [Code of Conduct](https://github.com/instill-ai/.github/blob/main/.github/CODE_OF_CONDUCT.md)
### Support
Get help by joining our [Discord community](https://discord.gg/sevxWsqpGh) where you can post any questions on our `#ask-for-help` channel.
## License
See the [LICENSE](./LICENSE) file for licensing information.