{"id":35114413,"url":"https://github.com/automoto/curly-queue","last_synced_at":"2026-04-20T23:32:04.575Z","repository":{"id":201719699,"uuid":"433232843","full_name":"automoto/curly-queue","owner":"automoto","description":"Container for running a curl script that is scheudled via sqs.","archived":false,"fork":false,"pushed_at":"2021-11-30T09:11:20.000Z","size":14,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2023-10-20T00:51:12.681Z","etag":null,"topics":["curl","sqs-queue"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/automoto.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2021-11-29T23:50:14.000Z","updated_at":"2023-10-20T03:12:02.160Z","dependencies_parsed_at":null,"dependency_job_id":"58385425-4301-47ac-9b28-540bc0cf3704","html_url":"https://github.com/automoto/curly-queue","commit_stats":null,"previous_names":["automoto/curly-queue"],"tags_count":null,"template":null,"template_full_name":null,"purl":"pkg:github/automoto/curly-queue","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/automoto%2Fcurly-queue","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/automoto%2Fcurly-queue/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/automoto%2Fcurly-queue/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/automoto%2Fcurly-queue/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/automoto","download_url":"https://codeload.github.com/automoto/curly-queue/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/automoto%2Fcurly-queue/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32070628,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-20T21:26:33.338Z","status":"ssl_error","status_checked_at":"2026-04-20T21:26:22.081Z","response_time":94,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["curl","sqs-queue"],"created_at":"2025-12-27T20:38:23.435Z","updated_at":"2026-04-20T23:32:04.570Z","avatar_url":"https://github.com/automoto.png","language":"Shell","readme":"# curly-queue\nSchedule an http request to be run with cURL and coordinate via an sqs queue. Allows you to make long running http requests to any endpoint reachable from your container. Can be run as a background process(just run start.sh), a standalone container or as a sidecar container.\n\n## Requirements\n- docker\n- aws cli installed locally\n- docker-compose(for local testing)\n\n### Docker\n\nThe dockerfile has most of the utilities needed to run the script but will need some configuration to be able to connect to a localstack sqs queue instead of a real one. It's fairly close but a WIP. \n\n\n### Local Testing\n\nstart local stack:\n```\ndocker-compose up\n```\n\ncreate queue named myqueue\n```\naws --endpoint-url=http://localhost:4566 sqs create-queue --queue-name myqueue\n```\n\nAdd a message to the queue\n\n```\naws sqs send-message --endpoint-url http://localhost:4566 --queue-url 'http://localhost:4566/000000000000/myqueue' --message-body \"start\" | cat\n```\n\nin another terminal tab, run the start script\n```\nsh start.sh 'https://google.com'\n\n```\n\nYou can start up multiple instances of `start.sh` and each instance will coordinate executing the curl commands through SQS and clearing the queue once its done.\n\nTo try it out with a slow running HTTP request, try to forward the URL through a time delay proxy(in milliseconds), with the command below. Note: its useful for testing out time delays but anything beyond a minute you will need to run your own slow running proxy the service rate limits.\n```\nsh start.sh 'https://deelay.me/3000/https://google.com'\n```\n\nModify the variables at the top of the script in the start.sh to customize the options further. Will likely be switched to environment variables in some places since this would make it easier to run and customize with container scheduling  or as a script.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fautomoto%2Fcurly-queue","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fautomoto%2Fcurly-queue","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fautomoto%2Fcurly-queue/lists"}