{"id":13513953,"url":"https://github.com/turbot/flowpipe","last_synced_at":"2025-05-15T23:03:32.132Z","repository":{"id":212255247,"uuid":"639580679","full_name":"turbot/flowpipe","owner":"turbot","description":"Flowpipe is a cloud scripting engine. Automation and workflow to connect your clouds to the people, systems and data that matters.","archived":false,"fork":false,"pushed_at":"2025-04-29T14:54:55.000Z","size":12644,"stargazers_count":416,"open_issues_count":8,"forks_count":18,"subscribers_count":10,"default_branch":"develop","last_synced_at":"2025-05-15T23:03:18.798Z","etag":null,"topics":["automation","cloud","devops","flowpipe","golang","hacktoberfest","low-code","orchestration","security","workflow","workflow-automation"],"latest_commit_sha":null,"homepage":"https://flowpipe.io","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"agpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/turbot.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2023-05-11T18:58:54.000Z","updated_at":"2025-05-11T20:44:16.000Z","dependencies_parsed_at":"2024-03-22T02:41:21.458Z","dependency_job_id":"87c2e54c-7d14-4042-bc71-e582ea234ac3","html_url":"https://github.com/turbot/flowpipe","commit_stats":null,"previous_names":["turbot/flowpipe"],"tags_count":274,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/turbot%2Fflowpipe","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/turbot%2Fflowpipe/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/turbot%2Fflowpipe/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/turbot%2Fflowpipe/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/turbot","download_url":"https://codeload.github.com/turbot/flowpipe/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254436944,"owners_count":22070946,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["automation","cloud","devops","flowpipe","golang","hacktoberfest","low-code","orchestration","security","workflow","workflow-automation"],"created_at":"2024-08-01T05:00:40.898Z","updated_at":"2025-05-15T23:03:32.101Z","avatar_url":"https://github.com/turbot.png","language":"Go","readme":"\u003ca href=\"https://flowpipe.io\"\u003e\u003cimg width=\"67%\" src=\"https://flowpipe.io/images/flowpipe_wordmark_outline.png\"\u003e\u003c/a\u003e\n\n[![libraries](https://img.shields.io/badge/mods-76-blue)](https://hub.flowpipe.io) \u0026nbsp;\n[![pipelines](https://img.shields.io/badge/pipelines-1041-blue)](https://hub.flowpipe.io/mods) \u0026nbsp;\n[![slack](https://img.shields.io/badge/slack-2695-blue)](https://turbot.com/community/join) \u0026nbsp;\n[![maintained by](https://img.shields.io/badge/maintained%20by-Turbot-blue)](https://turbot.com)\n\n## Workflow for DevOps\n\n[Flowpipe](https://flowpipe.io) enables automation and workflow to connect your clouds to the people, systems and data that matter.\n\n**Pipelines**. A [pipeline](https://flowpipe.io/docs/flowpipe-hcl/pipeline) is a sequence of [steps](https://flowpipe.io/docs/flowpipe-hcl/pipeline) to do work.\n\n**Steps**. A step can [make an HTTP call](https://flowpipe.io/docs/flowpipe-hcl/step/http), [gather human input](https://flowpipe.io/docs/flowpipe-hcl/step/input), [send a message](https://flowpipe.io/docs/flowpipe-hcl/step/message), [run a query](https://flowpipe.io/docs/flowpipe-hcl/step/query), or [run a pipeline](https://flowpipe.io/docs/flowpipe-hcl/step/pipeline).\n\n**Triggers**. A [trigger](https://flowpipe.io/docs/flowpipe-hcl/trigger) runs a pipeline when an event occurs, via a [webhook](https://flowpipe.io/docs/flowpipe-hcl/trigger/http), [query](https://flowpipe.io/docs/flowpipe-hcl/trigger/query), or [schedule](https://flowpipe.io/docs/flowpipe-hcl/trigger/schedule).\n\n**Code, not clicks**. Our pipelines are [code](https://flowpipe.io/docs/build): version-controlled, composable, shareable, easy to edit — designed for the way you work.\n\n## Demo time!\n\n**[Watch on YouTube →](https://www.youtube.com/watch?v=h4mWhMzaS7Y)**\n\n\u003ca href=\"https://www.youtube.com/watch?v=h4mWhMzaS7Y\"\u003e\u003cimg width=\"500\" alt=\"flowpipe demo\" src=\"https://flowpipe.io/images/flowpipe_hero_video_thumbnail.png\" /\u003e\u003c/a\u003e\n\n## Documentation\n\nSee the [documentation](https://flowpipe.io/docs) for:\n\n- [Running Flowpipe](https://flowpipe.io/docs/run)\n- [CLI commands](https://flowpipe.io/docs/reference/cli)\n- [HCL reference](https://flowpipe.io/docs/flowpipe-hcl)\n- [Configuration](https://flowpipe.io/docs/reference/config-files)\n- [Building mods](https://flowpipe.io/docs/build)\n\n\n## Install Flowpipe\n\nInstall Flowpipe from the [downloads](https://flowpipe.io/downloads) page:\n\n```sh\n# MacOS\nbrew install turbot/tap/flowpipe\n```\n\n```sh\n# Linux or Windows (WSL)\nsudo /bin/sh -c \"$(curl -fsSL https://flowpipe.io/install/flowpipe.sh)\"\n```\n\nNow, [create and run your first pipeline →](https://flowpipe.io/docs).\n\n## Flowpipe mods: libraries and samples\n\nFlowpipe [library mods](https://hub.flowpipe.io/?type=library) are available for services including\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/aws\"\u003eAWS\u003c/a\u003e,\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/azure\"\u003eAzure\u003c/a\u003e,\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/gcp\"\u003eGCP\u003c/a\u003e,\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/github\"\u003eGitHub\u003c/a\u003e,\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/jira\"\u003eJira\u003c/a\u003e,\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/okta\"\u003eOkta\u003c/a\u003e,\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/pagerduty\"\u003ePagerDuty\u003c/a\u003e,\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/sendgrid\"\u003eSendGrid\u003c/a\u003e,\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/slack\"\u003eSlack\u003c/a\u003e,\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/teams\"\u003eTeams\u003c/a\u003e,\n  \u003ca href=\"https://hub.flowpipe.io/mods/turbot/zendesk\"\u003eZendesk\u003c/a\u003e ... and many more!\n\nCheck out [Flowpipe samples](https://hub.flowpipe.io/?type=sample) for ready-to-run samples that use various library mods.\n\n## Developing\n\nIf you want to help develop the Flowpipe binary, these are the steps to build it.\n\n\u003cdetails\u003e\n\u003csummary\u003eClone\u003c/summary\u003e\n\nClone [github.com/flowpipe](https://github.com/turbot/flowpipe) and [github.com/turbot/pipe-fittings](https://github.com/turbot/pipe-fittings).\n\n```sh\ngit clone git@github.com:turbot/flowpipe\ngit clone git@github.com:turbot/pipe-fittings\n```\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003eBuild\u003c/summary\u003e\n\n```sh\ncd flowpipe\nmake\n```\n\nThe Flowpipe binary lands in the current directory.\n\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003eCheck the install\u003c/summary\u003e\n\n```sh\n./flowpipe --version\n\n./flowpipe --help\n```\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003eTry it!\u003c/summary\u003e\n\n\n```sh\n./flowpipe pipeline list --mod-location ./internal/es/estest/test_suite_mod/\n```\n```\nMOD                   NAME                                                                                                        DESCRIPTION\nmod.mod_depend_a      mod_depend_a.pipeline.echo_one_depend_a\nmod.test_suite_mod    test_suite_mod.pipeline.any_param\nmod.test_suite_mod    test_suite_mod.pipeline.bad_email_with_expr\nmod.test_suite_mod    test_suite_mod.pipeline.bad_http_ignored                                                                    Ignored bad HTTP step.\nmod.test_suite_mod    test_suite_mod.pipeline.bad_http_not_ignored                                                                Pipeline with a HTTP step that will fail. Error is not ignored.\n\u003c/snip\u003e\n```\n\nNow run a simple pipeline:\n\n```sh\n./flowpipe pipeline run --mod-location ./internal/es/estest/test_suite_mod/ simple\n```\n```\n[flowpipe] Execution ID: exec_clsm62ko47mjp5f74730\n[simple] Starting pipeline\n[simple.echo] Starting transform\n[simple.echo] Output echo_1 = echo 1\n[simple.echo] Output echo_2 = echo 2\n[simple.echo] Complete 2ms\n[simple] Output val = Hello World\n[simple] Complete 12ms exec_clsm62ko47mjp5f74730\n```\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003eDevContainer\u003c/summary\u003e\n\nThere are other third party tools that are required for the full suite that are not required for initial development tasks. We have built a [DevContainer](https://containers.dev/) that has all the required tools installed.\n\n1. Install [Docker](https://docs.docker.com/get-docker/)\n\n1. Install [VS Code](https://code.visualstudio.com/)\n\n1. Pull the Dev Container: `docker pull ghcr.io/turbot/flowpipe-devcontainer:latest`\n\n1. In VS Code install `devcontainer` extension.\n\n1. Open `flowpipe` in `Dev Containers: Open Folder in Container...` option.\n\n1. Run `make` to build the Flowpipe binary.\n\n[Flowpipe DevContainer](https://github.com/turbot/flowpipe/pkgs/container/flowpipe-devcontainer) bundles the following:\n\n* [Java](https://openjdk.org/)\n* [Apache Maven](https://maven.apache.org/)\n* [Swag](https://github.com/swaggo/swag)\n* [MailHog](https://github.com/mailhog/MailHog)\n* [OpenAPI Generator](https://github.com/OpenAPITools/openapi-generator)\n\n\u003c/details\u003e\n\n\nIf you're interested in developing [Flowpipe mods](https://hub.flowpipe.io), see our [documentation for mod developers](https://flowpipe.io/docs/build).\n\n## Turbot Pipes\n\nBring your team to [Turbot Pipes](https://turbot.com/pipes) to use Flowpipe together in the cloud. In a Pipes workspace you can use [Steampipe](https://github.com/turbot/steampipe) for data access, [Powerpipe](https://github.com/turbot/powerpipe) to visualize query results, and Flowpipe to automate workflow.\n\n\n## Open source and contributing\nThis repository is published under the [AGPL 3.0](https://www.gnu.org/licenses/agpl-3.0.html) license. Please see our [code of conduct](https://github.com/turbot/.github/blob/main/CODE_OF_CONDUCT.md). Contributors must sign our [Contributor License Agreement](https://turbot.com/open-source#cla) as part of their first pull request. We look forward to collaborating with you!\n\n[Flowpipe](https://flowpipe.io) is a product produced from this open source software, exclusively by [Turbot HQ, Inc](https://turbot.com). It is distributed under our commercial terms. Others are allowed to make their own distribution of the software, but cannot use any of the Turbot trademarks, cloud services, etc. You can learn more in our [Open Source FAQ](https://turbot.com/open-source).\n\n\n## Get involved\n\n**[Join #flowpipe on Slack →](https://turbot.com/community/join)**\n\n\n","funding_links":[],"categories":["Go","cloud","\u003ca name=\"Go\"\u003e\u003c/a\u003eGo"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fturbot%2Fflowpipe","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fturbot%2Fflowpipe","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fturbot%2Fflowpipe/lists"}