{"id":49251575,"url":"https://github.com/not-empty/hydra-publisher","last_synced_at":"2026-04-25T00:41:32.519Z","repository":{"id":246877784,"uuid":"823300166","full_name":"not-empty/hydra-publisher","owner":"not-empty","description":"High Availability Concurrency Publisher","archived":false,"fork":false,"pushed_at":"2024-07-17T17:48:17.000Z","size":87,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-12T05:36:55.043Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/not-empty.png","metadata":{"files":{"readme":"README.MD","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-07-02T19:10:57.000Z","updated_at":"2024-07-17T17:47:47.000Z","dependencies_parsed_at":"2024-07-17T21:46:30.546Z","dependency_job_id":null,"html_url":"https://github.com/not-empty/hydra-publisher","commit_stats":null,"previous_names":["not-empty/hydra-publisher"],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/not-empty/hydra-publisher","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/not-empty%2Fhydra-publisher","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/not-empty%2Fhydra-publisher/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/not-empty%2Fhydra-publisher/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/not-empty%2Fhydra-publisher/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/not-empty","download_url":"https://codeload.github.com/not-empty/hydra-publisher/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/not-empty%2Fhydra-publisher/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32246405,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-24T13:21:15.438Z","status":"ssl_error","status_checked_at":"2026-04-24T13:21:15.005Z","response_time":64,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-04-25T00:41:32.028Z","updated_at":"2026-04-25T00:41:32.506Z","avatar_url":"https://github.com/not-empty.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Hydra Async Pool Pulisher\n[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg?style=flat-square)](http://makeapullrequest.com)\n\n![Architecture sample](https://github.com/not-empty/hydra-publisher/blob/main/hydra.png)\n\n**Hydra Async Pool** is an open-source project designed to manage and limit asynchronous concurrency in high availability and high resource-demanding environments. This tool is essential for applications that need to restrict the number of simultaneous executions of certain tasks due to rate limits or resource constraints.\n\n## Introduction\n\nIn high-demand environments, managing the execution of asynchronous concurrent tasks is crucial and hard. Whether dealing with services that impose rate limits, databases with connection limits, or systems with constrained resources, you need a solution that can handle asynchronous concurrency gracefully. **Hydra Async Pool** provides a robust and flexible way to manage and limit the number of concurrent asynchronous jobs, ensuring your system remains stable and performs optimally.\n\n## Features\n\n- **Concurrency Limiting**: Define the maximum number of asynchronous concurrent jobs to prevent brake rate limits or resource exhaustion.\n- **Redis Integration**: Uses Redis for efficient and reliable job queue management.\n- **Job States Management**: Track and manage job states, including pending, executing, and finished jobs.\n- **Real-time Updates**: Subscribe to job updates for real-time monitoring and control.\n- **Scalability**: Designed to scale with your application's needs, making it suitable for both small and large deployments.\n\n## Hydra Async Pool\n\nYou will need to setup and install the **Hydra Async Pool** from [here](https://github.com/not-empty/hydra. \n\n## instalation\n\nInstall the publisher in all your projects that need to publish and finish jobs\n\n```sh\nnpm install hydra-publisher\n```\n\n## Publish/Finish\n\nNow just publish and finish jobs as you want to, The **Hydra Async Pool** will manage the concurrence and assures that you always have your maximum limit respected.\n\nThe Hydra Publisher handles the communication between job publishers, worker nodes, and the job manager. By publishing new jobs and reporting finished jobs, the manager can effectively orchestrate job pooling and ensure that concurrency limits are respected\n\n## Usage\n\n## Publishing\n```javascript\nimport { HydraPublisher } from 'hydra-publisher';\n\nconst publisher = new HydraPublisher({ redisOptions: { url: 'redis://localhost:6379' } });\n\nconst jobId = await publisher.addJob({ task: 'exampleTask' });\nconsole.log(`Job added with ID: ${jobId}`);\n```\n\n## Finishing\n```javascript\nimport { HydraPublisher } from 'hydra-publisher';\n\nconst publisher = new HydraPublisher({ redisOptions: { url: 'redis://localhost:6379' } });\n\n// After completing the job\nawait publisher.finishJob(jobId);\nconsole.log(`Job ${jobId} finished`);\n```\nBy following this setup, the Hydra Async Pool will be able to orchestrate the job pooling, manage concurrency, and ensure efficient job execution across your system.\n\n**Not Empty Foundation - Free codes, full minds**","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnot-empty%2Fhydra-publisher","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnot-empty%2Fhydra-publisher","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnot-empty%2Fhydra-publisher/lists"}