{"id":18512948,"url":"https://github.com/vmware/database-stream-processor-compiler","last_synced_at":"2026-04-04T15:27:04.309Z","repository":{"id":76000694,"uuid":"404791862","full_name":"vmware/database-stream-processor-compiler","owner":"vmware","description":"Infrastructure to run programs written in high-level languages on top of the Database Stream Processor (DBSP) runtime.","archived":false,"fork":false,"pushed_at":"2022-06-17T17:22:43.000Z","size":349,"stargazers_count":16,"open_issues_count":11,"forks_count":2,"subscribers_count":9,"default_branch":"main","last_synced_at":"2025-06-23T10:50:51.488Z","etag":null,"topics":["database","datalog","incremental","programming-language","streaming"],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/vmware.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-09-09T16:21:41.000Z","updated_at":"2024-09-20T05:34:48.000Z","dependencies_parsed_at":null,"dependency_job_id":"71ca4d3f-443e-4a75-b540-35b91b8e3275","html_url":"https://github.com/vmware/database-stream-processor-compiler","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/vmware/database-stream-processor-compiler","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vmware%2Fdatabase-stream-processor-compiler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vmware%2Fdatabase-stream-processor-compiler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vmware%2Fdatabase-stream-processor-compiler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vmware%2Fdatabase-stream-processor-compiler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/vmware","download_url":"https://codeload.github.com/vmware/database-stream-processor-compiler/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vmware%2Fdatabase-stream-processor-compiler/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31403958,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-04T10:20:44.708Z","status":"ssl_error","status_checked_at":"2026-04-04T10:20:06.846Z","response_time":60,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["database","datalog","incremental","programming-language","streaming"],"created_at":"2024-11-06T15:36:00.277Z","updated_at":"2026-04-04T15:27:03.567Z","avatar_url":"https://github.com/vmware.png","language":"Rust","readme":"# Frontend Compiler for DBSP\n\n[Database Stream Processor (DBSP)](https://github.com/vmware/database-stream-processor) is a high-performance runtime for streaming computations.\nDBSP provides a low-level Rust API to transform, filter, join, aggregate, etc., streams of data in real time.  This repository contains an infrastructure to run programs written in high-level languages on top of DBSP.  We aim to support several such languages:\n\n- SQL (lives in a separate repository, will be open sourced soon)\n- [Differential Datalog v2 (DDlog-2)](crates/ddlog-syntax) - an evolution of [DDlog](https://github.com/vmware/differential-datalog), a Datalog-inspired declarative language\n- Functional languages like Scala (part of a future plan)\n\nIn particular, this repository will define:\n\n- An intermediate representation (IR) of a DBSP program\n- A frontend compiler from DDlog-2 syntax to the IR\n- A language server infrastructure to enable DDlog-2 support in modern IDEs like Visual Studio Code\n- A query optimizer and compiler backend to execute IR on top of the DBSP runtime in either compiled or interpreted mode.\n\n## Developing\n\n### Prerequisites\n\n- `rustc` and `cargo` for building the language server and compiler, it's recommended to install them via [`rustup`](https://rustup.rs/)\n- [`rustfmt`](https://github.com/rust-lang/rustfmt#quick-start) and [`clippy`](https://github.com/rust-lang/rust-clippy#as-a-cargo-subcommand-cargo-clippy) for formatting and linting the language server and compiler\n- [`npm`](https://www.npmjs.com/) for building the language server extension\n\n### Running, Building and Testing\n\nWe use `cargo` for the majority of our building and testing infrastructure\n\n```bash\n# Run all tests\n$ cargo test\n\n# Build the language server (add the `--release` flag for a release build)\n$ cargo build --bin ddlog-driver\n\n# Run the language server (add the `--release` flag for a release build)\n$ cargo run --bin ddlog-driver\n```\n\nTo enable logging while running tests or binaries, set the `DDLOG_LOG` flag to a\n[logging directive](https://docs.rs/tracing-subscriber/latest/tracing_subscriber/filter/struct.EnvFilter.html#directives),\na good starting point would be `DDLOG_LOG=info`.\nThe five supported error levels are `error`, `warn`, `info`, `trace` and `debug`. Setting the log level will enable all logs\nthat occur at that level or higher, e.g. setting the log level to `info` will also enable all logs with the `error` or `warn`\nlevels.\n\n### Tooling\n\nDeveloper tooling is provided by the `xtask` crate\n\n```bash\n# See all available xtask commands\n$ cargo xtask help\n\n# Set up the repo for development\n$ cargo xtask setup\n\n# Run code generation\n$ cargo xtask codegen\n\n# Format all rust code\n$ cargo fmt\n\n# Lint all rust code\n$ cargo clippy\n```\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvmware%2Fdatabase-stream-processor-compiler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvmware%2Fdatabase-stream-processor-compiler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvmware%2Fdatabase-stream-processor-compiler/lists"}