{"id":29908788,"url":"https://github.com/engineering-research-and-development/bridge-mqtt-pulsar","last_synced_at":"2025-08-02T00:44:24.105Z","repository":{"id":300232348,"uuid":"1003051117","full_name":"Engineering-Research-and-Development/bridge-MQTT-Pulsar","owner":"Engineering-Research-and-Development","description":null,"archived":false,"fork":false,"pushed_at":"2025-07-22T13:04:01.000Z","size":38,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-07-22T15:10:32.904Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Engineering-Research-and-Development.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-06-16T14:45:15.000Z","updated_at":"2025-06-24T12:22:04.000Z","dependencies_parsed_at":"2025-06-20T15:21:11.831Z","dependency_job_id":"933f3eed-b3b8-4791-9f48-f7ac3a0499b2","html_url":"https://github.com/Engineering-Research-and-Development/bridge-MQTT-Pulsar","commit_stats":null,"previous_names":["engineering-research-and-development/bridge-mqtt-pulsar"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Engineering-Research-and-Development/bridge-MQTT-Pulsar","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Engineering-Research-and-Development%2Fbridge-MQTT-Pulsar","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Engineering-Research-and-Development%2Fbridge-MQTT-Pulsar/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Engineering-Research-and-Development%2Fbridge-MQTT-Pulsar/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Engineering-Research-and-Development%2Fbridge-MQTT-Pulsar/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Engineering-Research-and-Development","download_url":"https://codeload.github.com/Engineering-Research-and-Development/bridge-MQTT-Pulsar/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Engineering-Research-and-Development%2Fbridge-MQTT-Pulsar/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":268320375,"owners_count":24231801,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-01T02:00:08.611Z","response_time":67,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-08-02T00:44:04.172Z","updated_at":"2025-08-02T00:44:24.072Z","avatar_url":"https://github.com/Engineering-Research-and-Development.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# MQTT to Apache Pulsar Bridge\n\nA configuration-driven bridge to forward messages from an MQTT broker to specific Apache Pulsar topics based on routing rules.\n\nAll settings (brokers, topics, routing rules) are managed via the `config.yaml` file.\n\n## Prerequisites\n\n- Python 3.13+\n- [uv](https://github.com/astral-sh/uv) (for local development)\n- Docker \u0026 Docker Compose (for running the full environment)\n\n## Getting Started (Local Development)\n\nFollow these steps to run the bridge on your local machine for development.\n\n1.  **Clone the repository:**\n    ```bash\n    git clone https://github.com/Engineering-Research-and-Development/bridge-MQTT-Pulsar.git\n    cd bridge-MQTT-Pulsar\n    ```\n\n2.  **Set up the virtual environment:**\n    Create and activate a local virtual environment using `uv`.\n    ```bash\n    uv venv\n    ```\n\n3.  **Install dependencies in editable mode:**\n    Install the project using `pyproject.toml`.\n    ```bash\n    uv pip install -e .\n    ```\n\n4.  **Configure the bridge:**\n    Edit the `config.yaml` file to match your local setup.\n\n5.  **Run the application:**\n    Now run the script using `uv`.\n    ```bash\n    uv run bridge\n    ```\n\n## Running with Docker\n\nThe provided `Dockerfile` builds a production-ready image. This is the recommended way to run the bridge in a deployed environment.\n\n1.  **Build the Docker image:**\n    From the project root directory, run:\n    ```bash\n    docker build -t bridge-mqtt-pulsar:latest .\n    ```\n\n2.  **Prepare the configuration for Docker:**\n    Remember that your `config.yaml` will need to use Docker service names instead of `localhost` (e.g., `mosquitto`, `pulsar`).\n\n3.  **Run the container:**\n    Ensure the bridge container is on the same Docker network as your other services.\n    ```bash\n    docker run --rm --name my-bridge --network your-network-name \\\n      -v \"$(pwd)/config.yaml:/app/config.yaml\" \\\n      bridge-mqtt-pulsar:latest\n    ```\n    - `--network`: Connects the bridge to your services.\n    - `-v`: Mounts your Docker-specific config file into the container.\n\n## Configuration\n\nAll behavior is controlled via `config.yaml`.\n\n-   **`mqtt`**: Connection details for the MQTT broker (`broker_host`, `broker_port`, etc.).\n-   **`pulsar`**: Connection details for the Pulsar service (`service_url`).\n-   **`routing`**: Defines the rules for the topic router.\n    -   `match_prefix`: The MQTT topic prefix to match (e.g., `test/data`).\n    -   `device_index`: The zero-based index of the topic segment that contains the dynamic device name.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fengineering-research-and-development%2Fbridge-mqtt-pulsar","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fengineering-research-and-development%2Fbridge-mqtt-pulsar","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fengineering-research-and-development%2Fbridge-mqtt-pulsar/lists"}