{"id":32639775,"url":"https://github.com/dmarkham/nsq_testing","last_synced_at":"2026-02-27T13:04:14.599Z","repository":{"id":7354141,"uuid":"8678432","full_name":"dmarkham/nsq_testing","owner":"dmarkham","description":"nsq_testing","archived":false,"fork":false,"pushed_at":"2013-03-10T00:45:41.000Z","size":112,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-10-31T02:24:23.479Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dmarkham.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2013-03-10T00:27:41.000Z","updated_at":"2014-01-18T06:10:35.000Z","dependencies_parsed_at":"2022-08-29T15:33:59.195Z","dependency_job_id":null,"html_url":"https://github.com/dmarkham/nsq_testing","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/dmarkham/nsq_testing","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dmarkham%2Fnsq_testing","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dmarkham%2Fnsq_testing/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dmarkham%2Fnsq_testing/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dmarkham%2Fnsq_testing/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dmarkham","download_url":"https://codeload.github.com/dmarkham/nsq_testing/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dmarkham%2Fnsq_testing/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29896314,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-27T12:09:13.686Z","status":"ssl_error","status_checked_at":"2026-02-27T12:09:13.282Z","response_time":57,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-10-31T02:15:10.074Z","updated_at":"2026-02-27T13:04:14.591Z","avatar_url":"https://github.com/dmarkham.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"nsq_testing\n===========\n\nnsq_testing\n\n\n    Notes:\n    \n    Ok as we all know doing benchmarks are hard and loaded with caveats and mistakes.\n     \n    My take away: \n    Both were using 1 persistant connection.\n    HTTP: had to move ~ 30% more data\n    HTTP:  was about 4 times slower\n    I'm convenced some of the slowdown is the byte size difference between the two. \n    The rest is the overhead of building and parsing HTTP.\n     \n     \n     \n    Few Notes:\n    CentOS 5 on a 2  older 4core Xeon\n    nsqd v0.2.18-alpha @ sha: 2555d091de\n    go version go1.0.3\n    perl v5.10.0\n    LWP::UserAgent @ 5.835\n    AnyEvent @ 5.31 using EV @ 4.03\n     \n    Here is how the nsqd is being run for these tests.\n    ./nsqd  -lookupd-tcp-address=192.168.1.39:4160  -sync-every=10000 -mem-queue-size=1000\n     \n     \n     \n     \n    The byte numbers:\n    Publishing a 400byte message over http:\n    write  573 bytes\n    read  118 bytes\n     \n    Publishing over TCP:\n    write: 413 bytes\n    read:  10 bytes\n     \n     \n    These results  are within the avg time after running it 5 times each. \n    The topic was droped between each run. \n    No channels were being created or consumed just pure queueing.\n    The times:\n     \n  \n    dmarkham@www01:~/dev/nsq (master) $ time perl_ev  sample.pl  db05.dev.myhost.com\n    Time: 25.9672000 seconds to add 100000 items\n    Rate: 0.0002597/sec\n     \n    real  0m26.018s\n    user  0m7.949s\n    sys\t0m2.722s\n     \n     \n    dmarkham@www01:~/dev/nsq (master) $ time perl_ev  http_sample.pl  db05.dev.myhost.com\n    Time: 105.9750021 seconds to add 100000 items\n    Rate: 0.0010598/sec\n     \n    real\t1m46.029s\n    user\t1m7.270s\n    sys\t0m3.943s\n     \n  \n     \n    Sample  read/writes from each from my test script:\n     \n    HTTP Write:\n    write : \"POST /put?topic=test HTTP/1.1\\r\\nTE: deflate,gzip;q=0.3\\r\\nConnection: TE\\r\\nHost: my.host.com:4151\\r\\nContent-Length: 400\\r\\nContent-Type: application/x-www-form-urlencoded\\r\\n\\r\\nXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\" , 573)\n     \n    read:  \"HTTP/1.1 200 OK\\r\\nContent-Length: 2\\r\\nDate: Sat, 09 Mar 2013 23:19:07 GMT\\r\\nContent-Type: text/plain; charset=utf-8\\r\\n\\r\\nOK\", 1024) = 118\n     \n     \n     \n     \n    TCP Write:\n    write(8, \"PUB test\\n\", 9)               = 9\n    write(8, \"\\0\\0\\1\\220XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\", 404) = 404\n     \n    read(8, \"\\0\\0\\0\\6\\0\\0\\0\\0OK\", 2048)     = 10\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdmarkham%2Fnsq_testing","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdmarkham%2Fnsq_testing","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdmarkham%2Fnsq_testing/lists"}