{"id":49998548,"url":"https://github.com/runprism/prism","last_synced_at":"2026-05-19T09:01:20.724Z","repository":{"id":49036090,"uuid":"516361900","full_name":"runprism/prism","owner":"runprism","description":"Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.","archived":false,"fork":false,"pushed_at":"2024-11-25T16:15:29.000Z","size":2541,"stargazers_count":86,"open_issues_count":1,"forks_count":2,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-09-22T21:41:45.564Z","etag":null,"topics":["bigquery","data","data-analysis","data-engineering","data-integration","data-orc","data-science","dbt","etl","etl-pipeline","machine-learning","orchestration","pipeline","postgres","python","redshift","snowflake","trino"],"latest_commit_sha":null,"homepage":"https://runprism.com","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/runprism.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-07-21T12:27:19.000Z","updated_at":"2025-07-10T11:14:21.000Z","dependencies_parsed_at":"2023-10-01T20:49:30.886Z","dependency_job_id":"45e687f9-5664-44bf-ae00-26baeb33050c","html_url":"https://github.com/runprism/prism","commit_stats":null,"previous_names":[],"tags_count":29,"template":false,"template_full_name":null,"purl":"pkg:github/runprism/prism","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/runprism%2Fprism","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/runprism%2Fprism/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/runprism%2Fprism/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/runprism%2Fprism/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/runprism","download_url":"https://codeload.github.com/runprism/prism/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/runprism%2Fprism/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33209393,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-19T07:54:09.561Z","status":"ssl_error","status_checked_at":"2026-05-19T07:54:08.508Z","response_time":58,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bigquery","data","data-analysis","data-engineering","data-integration","data-orc","data-science","dbt","etl","etl-pipeline","machine-learning","orchestration","pipeline","postgres","python","redshift","snowflake","trino"],"created_at":"2026-05-19T09:00:53.693Z","updated_at":"2026-05-19T09:01:20.709Z","avatar_url":"https://github.com/runprism.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://github.com/runprism/prism/raw/main/.github/Logo.png\" alt=\"prism logo\" height=\"100\"/\u003e\n\u003c/p\u003e\n\u003cp align=\"center\"\u003e\n    \u003ca href=\"https://pypi.python.org/pypi/prism-ds/\" alt=\"PyPI version\"\u003e\n        \u003cimg alt=\"PyPI\" src=\"https://img.shields.io/pypi/v/prism-ds?color=2081c1\u0026labelColor=090422\"\u003e\u003c/a\u003e\n    \u003ca href=\"https://pepy.tech/badge/prism-ds/\" alt=\"Downloads\"\u003e\n        \u003cimg src=\"https://static.pepy.tech/personalized-badge/prism-ds?period=total\u0026units=international_system\u0026left_color=black\u0026right_color=blue\u0026left_text=Downloads\"/\u003e\n    \u003c/a\u003e\n    \u003ca href=\"https://python.org\" alt=\"Python version\"\u003e\n        \u003cimg src=\"https://img.shields.io/badge/python-3.8%20%7C%203.9%20%7C%203.10%20%7C%203.11-blue?labelColor=black\"/\u003e\n    \u003c/a\u003e\n\u003c/p\u003e\n\u003cdiv align=\"center\"\u003e\n\n[![CI Linux](https://github.com/runprism/prism/actions/workflows/ci-linux.yml/badge.svg)](https://github.com/runprism/prism/actions/workflows/ci-linux.yml)\n[![CI MacOS](https://github.com/runprism/prism/actions/workflows/ci-macos.yml/badge.svg)](https://github.com/runprism/prism/actions/workflows/ci-macos.yml)\n[![Checked with mypy](http://www.mypy-lang.org/static/mypy_badge.svg)](http://mypy-lang.org/)\n[![Checked with flake8](https://img.shields.io/badge/flake8-checked-blueviolet)](https://flake8.pycqa.org/en/latest/)\n\n\n\u003c/div\u003e\n\n# :wave: Welcome to Prism!\n[Prism](https://www.runprism.com/) is the easiest way to create data pipelines in Python.\n\n## Introduction\nData projects often require multiple steps that need to be executed in sequence (think extract-transform-load, data wrangling, etc.). With Prism, users can break down their project into modular tasks, manage dependencies, and execute complex computations in sequence.\n\nHere are some of Prism's main features:\n- **Real-time dependency declaration**: With Prism, analysts can declare dependencies using a simple function call. No need to explicitly keep track of the pipeline order — at runtime, Prism automatically parses the function calls and builds the dependency graph.\n- **Intuitive logging**: Prism automatically logs events for parsing the configuration files, compiling the tasks and creating the DAG, and executing the tasks. No configuration is required.\n- **Flexible CLI**: Users can instantiate, compile, and run projects using a simple, but powerful command-line interface.\n- **“Batteries included”**: Prism comes with all the essentials needed to get up and running quickly. Users can create and run their first DAG in less than 2 minutes.\n- **Integrations**: Prism integrates with several tools that are popular in the data community, including Snowflake, Google BigQuery, Redshift, PySpark, and dbt. We're adding more integrations every day, so let us know what you'd like to see!\n\n\n## Getting Started\n\nPrism can be installed via ```pip```. Prism requires Python \u003e= 3.7.\n\n```\npip install --upgrade pip\npip install prism-ds\n```\n\nStart your first Prism project with the `prism init` command:\n```\n$ prism init --project-name my_first_project\n━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\nRunning with Prism v0.3.0...\nCreating template project at ./my_first_project...\n\n      ______\n   ____  __ \\_____(_)________ _______\n _____  /_/ / ___/ / ___/ __ `__ \\ ____\n____ / ____/ /  / (__  ) / / / / / _____\n ___/_/   /_/  /_/____/_/ /_/ /_/  ___\n\nWelcome to Prism, the easiest way to create clean, modular data pipelines\nusing Python!\n\nTo get started, navigate to your newly created project \"my_first_project\" and try\nrunning the following commands:\n    \u003e python main.py\n    \u003e prism run\n    \u003e prism graph\n\nConsult the documentation here for more information on how to get started.\n    docs.runprism.com\n\nHappy building!\n\nDone!\n━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\n```\n\nRun your project by navigating to your project directory and running `prism run`:\n```\n$ cd my_first_project\n$ prism run\n━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\n[HH:MM:SS] INFO     | Running with Prism v0.3.0...\n[HH:MM:SS] INFO     | Creating run magnetic-pony-BBDYfwdDzH for client my_first_project-1.0...\n[HH:MM:SS] INFO     | Found 2 task(s) in 2 module(s) in job magnetic-pony-BBDYfwdDzH...\n\n[HH:MM:SS] INFO     | Parsing task dependencies............................................... [RUN]\n[HH:MM:SS] INFO     | FINISHED parsing task dependencies...................................... [DONE in 0.01s]\n\n────────────────────────────────────────────── Tasks ──────────────────────────────────────────────\n[HH:MM:SS] INFO     | 1 of 2 RUNNING TASK example-decorated-task.............................. [RUN]\n[HH:MM:SS] INFO     | 1 of 2 FINISHED TASK example-decorated-task............................. [DONE in 0.02s]\n[HH:MM:SS] INFO     | 2 of 2 RUNNING TASK example-class-task.................................. [RUN]\n[HH:MM:SS] INFO     | 2 of 2 FINISHED TASK example-class-task................................. [DONE in 0.02s]\n\nDone!\n━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\n```\n\n## Documentation\nTo get started with Prism projects, check out our [documentation](https://docs.runprism.com). Some sections of interest include:\n\n- :key: [Fundamentals](https://docs.runprism.com/fundamentals)\n- :seedling: [CLI](https://docs.runprism.com/cli)\n- :electric_plug: [Integrations](https://docs.runprism.com/integrations)\n- :bulb: [Use Cases](https://docs.runprism.com/use-cases)\n\nIn addition, check out some [example projects](https://github.com/runprism/prism_examples).\n\n\n## Integrations\nPrism integrates with a wide variety of third-party developer tools There are two kinds of integrations that Prism supports: adapters, and agents.\n\n### Adapters\nAdapters allow users to connect to data warehouses or analytics engines. Prism currently supports the following adapters:\n| Adapter      | Command |\n| ------------ | ----------- |\n| **Google BigQuery** | ```pip install \"prism-ds[bigquery]\"``` |\n| **Postgres** | ```pip install \"prism-ds[postgres]\"``` |\n| **Presto** | ```pip install \"prism-ds[presto]\"``` |\n| **Redshift** | ```pip install \"prism-ds[redshift]\"``` |\n| **Snowflake** | ```pip install \"prism-ds[snowflake]\"``` |\n| **Trino** | ```pip install \"prism-ds[trino]\"``` |\n\n\n## Product Roadmap\n\nWe're always looking to improve our product. Here's what we're working on at the moment:\n\n- **Compatibility with Alto agents**: Docker containers, EC2 clusters, EMR clusters, Databricks clusters, and more!\n- **Additional adapters**: Celery, Dask, MySQL, Presto, and more!\n- **Cloud deployment**: Managed orchestration platform to deploy Prism projects in the cloud\n\nLet us know if you'd like to see another feature!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frunprism%2Fprism","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frunprism%2Fprism","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frunprism%2Fprism/lists"}