Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/Multiwoven/multiwoven
🔥🔥🔥 Open Source Alternative to Hightouch, Census, and RudderStack - Reverse ETL & Data Activation
https://github.com/Multiwoven/multiwoven
bigquery cdp customer-data-platform data-activation data-engineering data-pipeline data-warehouse databricks dbt etl hacktoberfest open-source postresql react redshift reverse-etl ruby self-hosted snowflake typescript
Last synced: 6 days ago
JSON representation
🔥🔥🔥 Open Source Alternative to Hightouch, Census, and RudderStack - Reverse ETL & Data Activation
- Host: GitHub
- URL: https://github.com/Multiwoven/multiwoven
- Owner: Multiwoven
- License: agpl-3.0
- Created: 2023-10-20T15:21:26.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-10-29T04:16:06.000Z (10 days ago)
- Last Synced: 2024-10-29T15:47:50.911Z (10 days ago)
- Topics: bigquery, cdp, customer-data-platform, data-activation, data-engineering, data-pipeline, data-warehouse, databricks, dbt, etl, hacktoberfest, open-source, postresql, react, redshift, reverse-etl, ruby, self-hosted, snowflake, typescript
- Language: Ruby
- Homepage: https://squared.ai/multiwoven-reverse-etl
- Size: 5.65 MB
- Stars: 1,528
- Watchers: 18
- Forks: 62
- Open Issues: 27
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Security: SECURITY.md
Awesome Lists containing this project
- awesome-data-engineering - Multiwoven - The open-source reverse ETL, data activation platform for modern data teams. (Workflow)
- trackawesomelist - multiwoven (⭐1.1k) - first-issue)* <br> The open-source reverse ETL, data activation platform for modern data teams. (Recently Updated / [Oct 20, 2024](/content/2024/10/20/README.md))
- awesome-for-beginners - multiwoven - source reverse ETL, data activation platform for modern data teams. (Ruby)
- fucking-awesome-for-beginners - multiwoven - source reverse ETL, data activation platform for modern data teams. (Ruby)
- awesome-data-activation - Multiwoven - An open-source Reverse ETL platform that enables real-time data synchronization between data warehouses and business tools. (Reverse ETL (rETL) / Open Source rETL Tools)
README
Open Source Reverse ETL & Data Activation Platform
Multiwoven is an open-source alternative to HighTouch, Census, and RudderStack. It lets you easily sync data from your warehouse to any business tool, unlocking the full potential of your data.
multiwoven-integrations
multiwoven-server
multiwoven-ui
Explore the docs »
Slack
•
Website
•
Blog
•
Roadmap
## Why Multiwoven?
Multiwoven simplifies self-hosting a secure, scalable Reverse ETL platform on your cloud infrastructure like AWS, Azure, or GCP. With one-click deployment and customizable connectors, you can easily sync data from your warehouse to business tools.
⭐ *Consider giving us a star! Your support helps us continue innovating and adding new, exciting features.*
### Connect to sources
Connect to your data sources like Databricks, Redshift, BigQuery, and more.
### Prepare your data
Create models to transform and prepare your data for syncing.
### Sync with destinations
Sync your data with destinations like Salesforce, HubSpot, Slack, and more.
## Table of Contents
- [Getting Started](#getting-started)
- [Local Setup](#local-setup)
- [Self-hosted Options](#self-hosted-options)
- [Connectors](#connectors)
- [Sources](#sources)
- [Destinations](#destinations)
- [CRM](#crm)
- [Marketing Automation](#marketing-automation)
- [Customer Support](#customer-support)
- [Advertising](#advertising)
- [Collaboration](#collaboration)
- [Analytics](#analytics)
- [Others](#others)
- [Contributing](#contributing)
- [Need Help?](#need-help)
- [Development Status: Under Active Development](#️-development-status-under-active-development)
- [License](#license)
- [Contributors](#contributors)
## Getting Started
Multiwoven is a monorepo that consists of three main services:
- server - The backend service that acts as a control plane for managing data sources, models, and syncs.
- ui - The frontend react application that provides a user interface to manage data sources, destinations, and confgure syncs.
- integrations - A Ruby Gem that provides a framework to build connectors to support a wide range of data sources and destinations.
### Local Setup
To get started with Multiwoven, you can deploy the entire stack using Docker Compose.
1. **Clone the repository:**
```bash
git clone [email protected]:Multiwoven/multiwoven.git
```
2. **Go inside multiwoven folder:**
```bash
cd multiwoven
```
3. **Initialize .env file:**
```bash
mv .env.example .env
```
4. **Copy .env file to ui folder:**
```bash
cp .env ui/.env
```
5. **Setup git hooks:**
```bash
./git-hooks/setup-hooks.sh
```
6. **Start the services:**
```bash
docker-compose build && docker-compose up
```
UI can be accessed at the PORT 8000 :
```bash
http://localhost:8000
```
For more details, check out the local [deployment guide](https://docs.squared.ai/open-source/guides/setup/docker-compose-dev) in the documentation.
### Self-hosted Options
Multiwoven can be deployed in a variety of environments, from fully managed cloud services to self-hosted solutions. Refer to the deployment guides below to deploy Multiwoven on your preferred cloud provider.
| Provider | Documentation |
| :-------------------------------- | :-------------------------------------------------------------------------- |
| **Docker** | [Deployment Guide](https://docs.squared.ai/open-source/guides/setup/docker-compose) |
| **Helm Charts** | [Deployment Guide](https://docs.squared.ai/open-source/guides/setup/helm) |
| **AWS EC2** | [Deployment Guide](https://docs.squared.ai/open-source/guides/setup/ec2) |
| **AWS ECS** | Coming soon. |
| **AWS EKS (Kubernetes)** | Coming soon. |
| **Azure VMs** | [Deployment Guide](https://docs.squared.ai/open-source/guides/setup/avm) |
| **Azure AKS (Kubernetes)** | [Deployment Guide](https://docs.squared.ai/open-source/guides/setup/aks) |
| **Google Cloud GKE (Kubernetes)** | Coming soon. |
| **Google Cloud Compute Engine** | [Deployment Guide](https://docs.squared.ai/open-source/guides/setup/gce) |
| **Digital Ocean Droplets** | Coming soon. |
| **Digital Ocean Kubernetes** | Coming soon. |
| **OpenShift** | Coming soon. |
## Connectors
🔥 Multiwoven is rapidly expanding its list of connectors to support a wide range of data sources and destinations. Head over to the [Integrations](https://github.com/Multiwoven/multiwoven/tree/main/integrations) directory to explore the available connectors. If you don't see the connector you need, please [open an issue](https://github.com/Multiwoven/multiwoven/issues) to request it.
### Sources
- [x] [Amazon Redshift](https://docs.squared.ai/guides/data-integration/sources/redshift)
- [x] [Google BigQuery](https://docs.squared.ai/guides/data-integration/sources/bquery)
- [x] [Snowflake](https://docs.squared.ai/guides/data-integration/sources/snowflake)
- [x] [Databricks](https://docs.squared.ai/guides/data-integration/sources/databricks)
- [x] [PostgreSQL](https://docs.squared.ai/guides/data-integration/sources/postgresql)
### Destinations
#### CRM
- [x] [Salesforce](https://docs.squared.ai/guides/data-integration/destinations/crm/salesforce)
- [ ] Zoho CRM
- [x] [HubSpot](https://docs.squared.ai/guides/data-integration/destinations/crm/hubspot)
#### Marketing Automation
- [x] [Klaviyo](https://docs.squared.ai/guides/data-integration/destinations/marketing-automation/klaviyo)
- [ ] Braze
- [ ] Salesforce Marketing Cloud
#### Customer Support
- [x] [Zendesk](https://docs.squared.ai/guides/data-integration/destinations/customer-support/zendesk)
- [ ] Freshdesk
- [ ] Intercom
#### Advertising
- [ ] Google Ads
- [x] [Facebook Ads](https://docs.squared.ai/guides/data-integration/destinations/adtech/facebook-ads)
#### Collaboration
- [x] [Slack](https://docs.squared.ai/guides/data-integration/destinations/team-collaboration/slack)
- [x] [Google Sheets](https://docs.squared.ai/guides/data-integration/destinations/productivity-tools/google-sheets)
- [x] [Airtable](https://docs.squared.ai/guides/data-integration/destinations/productivity-tools/airtable)
#### Analytics
- [x] Google Analytics
- [ ] Mixpanel
- [ ] Amplitude
#### Others
🧵...Weaving in more connectors to support a wide range of destinations.
## Contributing
We ❤️ contributions and feedback! Help make Multiwoven better for everyone!
Before contributing to Multiwoven, please read our [Code of Conduct](https://github.com/Multiwoven/multiwoven/blob/main/CODE_OF_CONDUCT.md) and [Contributing Guidelines](https://github.com/Multiwoven/multiwoven/blob/main/CONTRIBUTING.md). As a contributor, you are expected to adhere to these guidelines and follow the best practices.
## Need Help?
If you have any questions or need help with Multiwoven, please feel free to reach out to us on [Slack](https://join.slack.com/t/multiwoven/shared_invite/zt-2bnjye26u-~lu_FFOMLpChOYxvovep7g). We are open to discuss new ideas, features, and improvements.
### ⚠️ Development Status: Under Active Development
This project is under active development, As we work towards stabilizing the project, you might encounter some bugs or incomplete features. We greatly value your contributions and patience during this phase. Thank you for your support!
## Contributors
## License
Multiwoven is licensed under the AGPLv3 License. See the [LICENSE](https://github.com/Multiwoven/multiwoven/blob/main/LICENSE) file for details.