{"id":15462723,"url":"https://github.com/devidw/e11-bench","last_synced_at":"2025-03-28T11:20:32.578Z","repository":{"id":197057516,"uuid":"697910906","full_name":"devidw/e11-bench","owner":"devidw","description":null,"archived":false,"fork":false,"pushed_at":"2023-09-28T21:44:14.000Z","size":10,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-10-18T21:04:32.766Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/devidw.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-09-28T18:17:11.000Z","updated_at":"2023-09-28T18:17:17.000Z","dependencies_parsed_at":null,"dependency_job_id":"27fadf9f-64fe-43c9-a585-af2410529f6e","html_url":"https://github.com/devidw/e11-bench","commit_stats":null,"previous_names":["devidw/e11-bench"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devidw%2Fe11-bench","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devidw%2Fe11-bench/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devidw%2Fe11-bench/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devidw%2Fe11-bench/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/devidw","download_url":"https://codeload.github.com/devidw/e11-bench/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246017725,"owners_count":20710240,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-02T00:03:55.642Z","updated_at":"2025-03-28T11:20:32.554Z","avatar_url":"https://github.com/devidw.png","language":"TypeScript","readme":"# eleven labs api bench of `optimizeStreamingLatency`\n\nwas doing benchs of `optimizeStreamingLatency` with `0` up to `4` (5 in total) for `eleven_multilingual_v2`\n\n\u003e You can turn on latency optimizations at some cost of quality. The best possible final latency varies by model. Possible values: 0 - default mode (no latency optimizations) 1 - normal latency optimizations (about 50% of possible latency improvement of option 3) 2 - strong latency optimizations (about 75% of possible latency improvement of option 3) 3 - max latency optimizations 4 - max latency optimizations, but also with text normalizer turned off for even more latency savings (best latency, but can mispronounce eg numbers and dates). Defaults to 0.\n\nnot seeing any significant difference in the mean response time of the api using the differnt param values\n\nsometimes the fastest even the slowest, or all 5 configs roughly the same for a ~10 word input around 2-2.1 seconds\n\nfor example in [./report1.json](./report1.json) the 0 optimization is at `2337ms` for 2 calls mean and the 4\noptimization is at `2955ms` mean for 2 calls\n\nin [./report2.json](./report2.json) there is barely a dif between the 5, more optimization even tends to take longer:\n\n- opt=0 mean=2196ms\n- opt=1 mean=2031ms\n- opt=2 mean=2022ms\n- opt=3 mean=2117ms\n- opt=4 mean=2212ms\n\nwas only doing a set of 2 calls per config - so not sure how this will look at for example 100 or 1000 calls per config - don't wanted to waste paid tokens just for this =D\n\n## reproduce\n\nneed to have deno installed\n\n```\nELEVEN_LABS_API_KEY=... deno run --allow-all ./e11.ts\n```\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdevidw%2Fe11-bench","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdevidw%2Fe11-bench","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdevidw%2Fe11-bench/lists"}