{"id":20531227,"url":"https://github.com/robstradling/certsearch","last_synced_at":"2025-04-14T05:40:51.764Z","repository":{"id":48186666,"uuid":"478732943","full_name":"robstradling/CeRTSearcH","owner":"robstradling","description":null,"archived":false,"fork":false,"pushed_at":"2023-07-05T17:49:40.000Z","size":37,"stargazers_count":9,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-03-27T19:23:28.255Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/robstradling.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-04-06T21:29:58.000Z","updated_at":"2025-03-13T16:39:20.000Z","dependencies_parsed_at":"2024-06-19T11:30:47.075Z","dependency_job_id":"ce625187-37a9-43c7-b4ed-e72df5528e4a","html_url":"https://github.com/robstradling/CeRTSearcH","commit_stats":{"total_commits":9,"total_committers":1,"mean_commits":9.0,"dds":0.0,"last_synced_commit":"d581e6cf77341efe66fa4eb3b73ff093c7b5f394"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/robstradling%2FCeRTSearcH","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/robstradling%2FCeRTSearcH/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/robstradling%2FCeRTSearcH/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/robstradling%2FCeRTSearcH/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/robstradling","download_url":"https://codeload.github.com/robstradling/CeRTSearcH/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248830416,"owners_count":21168271,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-15T23:43:20.544Z","updated_at":"2025-04-14T05:40:51.742Z","avatar_url":"https://github.com/robstradling.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cimg src=\"certsearch.svg\" width=\"200\"\u003e\n\n# Overview\n\nCeRTSearcH uses the crt.sh database to handle two use cases for which the https://crt.sh/ web interface is not well suited:\n1. Very large result sets. e.g., all dNSName values that match %.com\n2. Delta searches. i.e., what's new since I last searched?\n\nThe https://crt.sh/ web interface relies on [Full Text Search](https://www.postgresql.org/docs/current/textsearch.html) indexes to perform a single SQL query over the entire corpus of certificates; in contrast, CeRTSearcH performs multiple sequential SQL queries over adjacent and relatively small ranges of crt.sh IDs.\n\nGiven the huge number of certificates known to crt.sh, CeRTSearcH can be expected to take a minimum of several days to search the entire database starting at `-startID 1`. Parallel processing of multiple ranges of crt.sh IDs would be faster, but since it would work the database harder it is deliberately not supported by CeRTSearcH; this is because crt.sh:5432 is a finite resource that is shared between many users.\n\n# Build\n\n```bash\ngo build\n```\n\n# Usage\n\n```\n\u003e ./CeRTSearcH -h\nUsage of ./CeRTSearcH:\n  -batchSize int\n        Number of certificate records to process per batch (default 100000)\n  -deduplicate\n        Report first crt.sh record only for (pre)certificate pairs [note: ~4x slower]\n  -endID int\n        crt.sh ID to stop at (default 9223372036854775807)\n  -logLevel string\n        Logging verbosity [debug, info, error, fatal] (default \"debug\")\n  -q string\n        Search term [use % for wildcard matching] (default \"%\")\n  -sanType string\n        Subject Alternative Name attributes to search [NONE, ANY, rfc822Name, dNSName, iPAddress] (default \"dNSName\")\n  -showSQLOnly\n        Show the SQL query that would be used, then exit\n  -sort\n        Guarantee results are ordered by crt.sh ID\n  -startID int\n        crt.sh ID to start from [-1 = stream new records, starting at max(ID)+1] (default -1)\n  -subjectType string\n        Subject DN attributes to search [NONE, ANY, \u003cOID\u003e] (default \"NONE\")\n  -unexpiredOnly\n        Ignore expired certificates\n  -uniq\n        Remove duplicate results (e.g., identical CN and dNSName in the same certificate)\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frobstradling%2Fcertsearch","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frobstradling%2Fcertsearch","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frobstradling%2Fcertsearch/lists"}