{"id":46095419,"url":"https://github.com/browserless/benchmarks","last_synced_at":"2026-03-01T18:35:28.240Z","repository":{"id":328371942,"uuid":"1104048746","full_name":"browserless/benchmarks","owner":"browserless","description":"Benchmarks for various providers and competitors","archived":false,"fork":false,"pushed_at":"2025-12-12T17:23:58.000Z","size":20,"stargazers_count":14,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-01-04T00:33:06.463Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/browserless.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-11-25T17:21:38.000Z","updated_at":"2025-12-15T21:04:22.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/browserless/benchmarks","commit_stats":null,"previous_names":["browserless/benchmarks"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/browserless/benchmarks","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/browserless%2Fbenchmarks","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/browserless%2Fbenchmarks/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/browserless%2Fbenchmarks/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/browserless%2Fbenchmarks/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/browserless","download_url":"https://codeload.github.com/browserless/benchmarks/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/browserless%2Fbenchmarks/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29978923,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-01T16:35:47.903Z","status":"ssl_error","status_checked_at":"2026-03-01T16:35:44.899Z","response_time":124,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-03-01T18:35:27.241Z","updated_at":"2026-03-01T18:35:28.220Z","avatar_url":"https://github.com/browserless.png","language":"JavaScript","readme":"# Browser Provider Benchmark\n\nA benchmarking tool for comparing performance across multiple browser automation providers (Browserbase, Hyperbrowser, Browserless, and Anchorbrowser).\n\n## Overview\n\nThis tool dynamically loads provider configurations and runs performance benchmarks to measure:\n- **Connection Time**: Time to connect to the browser WebSocket endpoint\n- **Page Creation**: Time to create a new browser page\n- **Navigation**: Time to navigate to a target URL\n\n## Installation\n\n1. **Clone the repository** (if not already done):\n   ```bash\n   git clone \u003crepository-url\u003e\n   cd browserbase\n   ```\n\n2. **Install dependencies**:\n   ```bash\n   npm install\n   ```\n\n3. **Configure environment variables**:\n   ```bash\n   cp .env.example .env\n   ```\n   \n   Then edit `.env` with your actual API keys and configuration.\n\n## Environment Variables\n\n### Required Configuration\n\nCreate a `.env` file in the project root with the following variables:\n\n#### Benchmark Settings\n```bash\n# Number of benchmark iterations to run\nTOTAL=10\n\n# Target URL to navigate to during benchmarks\nURL=https://www.example.com/\n```\n\n#### Provider API Keys\n\n**Hyperbrowser**\n```bash\nHYPERBROWSER_API_KEY=your_hyperbrowser_api_key_here\n```\n\n**Browserless**\n```bash\nBROWSERLESS_API_KEY=your_browserless_api_key_here\n```\n\n**Anchorbrowser**\n```bash\nANCHORBROWSER_API_KEY=your_anchorbrowser_api_key_here\n```\n\n**Browserbase**\n```bash\nBROWSERBASE_API_KEY=your_browserbase_api_key_here\nBROWSERBASE_PROJECT_ID=your_browserbase_project_id_here\n```\n\n\u003e **Note**: You only need to configure API keys for the providers you want to benchmark. Providers without valid credentials will be skipped automatically.\n\n## Usage\n\nRun the benchmark suite:\n\n```bash\nnode index.js\n```\n\nThe tool will:\n1. Automatically discover all provider modules in the `providers/` directory\n2. Load and validate each provider\n3. Run benchmarks sequentially for each configured provider\n4. Display performance metrics in a formatted table\n\n### Sample Output\n\n```\n🔍 Loading providers...\n\n✓ Loaded provider: browserbase\n✓ Loaded provider: hyperbrowser\n✓ Loaded provider: browserless\n✓ Loaded provider: anchorbrowser\n\n📊 Found 4 provider(s)\n\n==================================================\n\n[1/4] Running benchmark for: browserbase\n==================================================\n\n=== Test Configuration ===\nProvider: Browserbase\nBrowser Version: Chrome/120.0.6099.109\nTotal Executions : 10\nURL: \"https://www.example.com/\"\n==========================\n\n┌─────────────────┬────────────┬─────────┬─────────┐\n│ Metrics         │ Average    │ Fastest │ Slowest │\n├─────────────────┼────────────┼─────────┼─────────┤\n│ Connection      │ 1234.5     │ 1100    │ 1450    │\n│ Page Creation   │ 234.2      │ 200     │ 280     │\n│ Navigation      │ 567.8      │ 520     │ 620     │\n└─────────────────┴────────────┴─────────┴─────────┘\n```\n\n## Project Structure\n\n```\n.\n├── index.js              # Main entry point, dynamic provider loader\n├── runner.js             # Benchmark execution logic\n├── providers/            # Provider-specific implementations\n│   ├── browserbase.js\n│   ├── hyperbrowser.js\n│   ├── browserless.js\n│   └── anchorbrowser.js\n├── .env                  # Your local configuration (not committed)\n├── .env.example          # Template for environment variables\n└── package.json          # Project dependencies\n```\n\n## Adding New Providers\n\nTo add a new provider:\n\n1. Create a new file in `providers/` (e.g., `providers/newprovider.js`)\n2. Export `setup` and optionally `teardown` functions:\n\n```javascript\nexport const setup = async () =\u003e {\n  // Initialize your provider and return:\n  return {\n    browserWSEndpoint: 'ws://your-endpoint',\n    provider: 'Your Provider Name'\n  };\n};\n\nexport const teardown = async (setupResult) =\u003e {\n  // Optional cleanup\n};\n```\n\n3. Add any required environment variables to `.env`\n4. The provider will be automatically discovered and loaded on next run\n\n## Dependencies\n\n- `@browserbasehq/sdk` - Browserbase SDK\n- `@hyperbrowser/sdk` - Hyperbrowser SDK\n- `puppeteer-core` - Puppeteer without bundled Chromium\n- `dotenv` - Environment variable management\n\n## License\n\nSee LICENSE file for details.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrowserless%2Fbenchmarks","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbrowserless%2Fbenchmarks","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrowserless%2Fbenchmarks/lists"}