{"id":13703818,"url":"https://github.com/Senzing/rabbitmq-performance","last_synced_at":"2025-05-05T07:31:52.540Z","repository":{"id":40299262,"uuid":"450118508","full_name":"Senzing/rabbitmq-performance","owner":"Senzing","description":"Tweeks to RabbitMQ","archived":false,"fork":false,"pushed_at":"2025-04-16T18:08:17.000Z","size":158,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-04-17T02:57:26.843Z","etag":null,"topics":["documentation","senzing-gdev"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Senzing.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2022-01-20T13:57:25.000Z","updated_at":"2025-04-16T18:08:19.000Z","dependencies_parsed_at":"2024-01-22T22:14:57.742Z","dependency_job_id":"9e9aaac0-b790-4198-b6c9-93e346896b9d","html_url":"https://github.com/Senzing/rabbitmq-performance","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Senzing%2Frabbitmq-performance","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Senzing%2Frabbitmq-performance/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Senzing%2Frabbitmq-performance/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Senzing%2Frabbitmq-performance/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Senzing","download_url":"https://codeload.github.com/Senzing/rabbitmq-performance/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252458489,"owners_count":21751048,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["documentation","senzing-gdev"],"created_at":"2024-08-02T21:01:00.412Z","updated_at":"2025-05-05T07:31:50.833Z","avatar_url":"https://github.com/Senzing.png","language":null,"funding_links":[],"categories":["Documentation"],"sub_categories":[],"readme":"# rabbitmq-performance\n\nA couple of things to keep in mind with RabbitMQ is that it performs better when it is smaller.  I've let Qs grow to 40M+ records in it and RabbitMQ ends up being a severe bottleneck as it tries to manage it.  Also, RabbitMQ has a consumer_timeout which will cause connections to get closed if a record takes too long to process (like might happen in huge entities or PostgreSQL XID pauses).\n\n## Setup the dead letter exchange\nThis is a place for rejected messages to go during processing.  Messages responded to with pika.basic_reject() go here.  You don't want to size limit this.\n```\nQueue Name: senzing-dlx-queue\ndurable: yes\n\nExchange Name: senzing-dlx-exchange\nRouting Key: senzing.deadletter\n```\n\n## Setup the main input data exchange\n```\nQueue Name: senzing-rabbitmq-queue\nmax-length: 50000\noverflow: reject-publish\nDLX Exchange Name: senzing-dlx-exchange\nDLX Routing Key: senzing.deadletter\n\nExchange Name: senzing-rabbitmq-exchange\nRouting Key: senzing.records\n```\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FSenzing%2Frabbitmq-performance","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FSenzing%2Frabbitmq-performance","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FSenzing%2Frabbitmq-performance/lists"}