{"id":27143235,"url":"https://github.com/mablr/trace2e","last_synced_at":"2025-06-12T00:33:45.592Z","repository":{"id":284794171,"uuid":"785206695","full_name":"mablr/trace2e","owner":"mablr","description":"TracE2E: A distributed traceability framework that provides provenance recording and compliance enforcement for processes' I/O operations. Track data flows across your distributed infrastructure with seamless middleware integration, enabling explainability, and policy enforcement for sensitive data handling.","archived":false,"fork":false,"pushed_at":"2025-06-03T09:55:29.000Z","size":398,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-06-03T20:53:01.604Z","etag":null,"topics":["decentralized","io","middleware","rust","traceability"],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mablr.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-04-11T12:19:40.000Z","updated_at":"2025-06-03T09:55:30.000Z","dependencies_parsed_at":"2025-05-02T15:22:02.420Z","dependency_job_id":"450571e0-1fda-46db-b173-f43b7eb669a6","html_url":"https://github.com/mablr/trace2e","commit_stats":null,"previous_names":["mablr/trace2e"],"tags_count":3,"template":false,"template_full_name":null,"purl":"pkg:github/mablr/trace2e","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mablr%2Ftrace2e","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mablr%2Ftrace2e/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mablr%2Ftrace2e/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mablr%2Ftrace2e/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mablr","download_url":"https://codeload.github.com/mablr/trace2e/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mablr%2Ftrace2e/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259370767,"owners_count":22847417,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["decentralized","io","middleware","rust","traceability"],"created_at":"2025-04-08T08:33:02.652Z","updated_at":"2025-06-12T00:33:45.567Z","avatar_url":"https://github.com/mablr.png","language":"Rust","readme":"# TracE2E - Distributed Traceability Middleware\n\nA distributed traceability framework that provides provenance recording and compliance enforcement for processes' I/O operations in distributed systems.\n\n## Overview\n\nTracE2E framework is composed of several key components:\n\n- **trace2e_middleware**: The core middleware service that handles provenance recording and compliance enforcement\n- **trace2e_client**: Client library to interact with the middleware\n- **stde2e**: Standard library wrapper providing TracE2E integration using `trace2e_client`\n- **tokioe2e**: We propose a patch for `tokio` library providing TracE2E integration using `trace2e_client` like for `stde2e`\n\n\n## Key Features\n\nTracE2E provides a comprehensive suite of capabilities to enable end-to-end provenance recording and compliance enforcement for I/O operations in distributed systems:\n\n- Process Observation: Track and Mediate file and network I/O operations seamlessly at the process level.\n- Distributed Provenance Tracking: Provide explainability and accountability across distributed systems with a unified data flow model.\n- Compliance Enforcement: policies can be applied to resources taking into account the provenance, the type, and the location of the resource.\n\n## Architecture\n\nThe system works through three main components:\n\n1. **Middleware Service**: Runs on each node where traceability is enforced, providing:\n   - Process-to-Middleware (P2M) communication\n   - Middleware-to-Middleware (M2M) communication\n   - Traceability enforcement\n\n2. **Client Library**: Wraps standard I/O operations to:\n   - Process-to-Middleware (P2M) communication\n   - Register files and network streams opened by the process\n   - Request authorization for I/O operations\n   - Report operation results\n\n3. **I/O Library Wrapper and Patches**: to provide TracE2E integration using `trace2e_client`:\n   - `stde2e`: Standard library wrapper\n   - `tokioe2e`: Patch for `tokio` library\n\n## Getting Started\n\n### Prerequisites\n\n- Rust\n- Protocol Buffers compiler\n\n### Building from Source\n\n1. Clone the repository:\n   ```bash\n   git clone https://github.com/mablr/trace2e\n   cd trace2e\n   ```\n\n2. Build the middleware in release mode to enable optimizations:\n   ```bash\n   cargo build -r\n   ./target/release/trace2e_middleware\n   ```\nThe middleware will listen on `[::]:8080` by default.\n\n### Benchmarking\n\nTo benchmark the middleware internal traceability server, run the following command:\n```bash\ncargo bench -p trace2e_middleware\n```\n\nTo benchmark the `trace2e_client` and the `stde2e` wrapper, run the following commands:\n```bash\n./target/release/trace2e_middleware \u0026\ncargo bench -p trace2e_client\ncargo bench -p stde2e\n```\n## Project Structure\n\n- **/proto**: Protocol buffer definitions for communication between components\n- **/trace2e_middleware**: Core middleware implementation\n- **/trace2e_client**: Middleware client communication library implementation\n- **/stde2e**: Standard library wrapper providing TracE2E integration using `trace2e_client`\n- **/patches**: TracE2E integration patches for various frameworks\n\n\n## License\n\nThis project is licensed under the terms found in the LICENSE file in the root directory.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmablr%2Ftrace2e","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmablr%2Ftrace2e","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmablr%2Ftrace2e/lists"}