{"id":20122846,"url":"https://github.com/freaky/title_fetcher","last_synced_at":"2026-06-04T13:31:10.446Z","repository":{"id":142942572,"uuid":"42416477","full_name":"Freaky/title_fetcher","owner":"Freaky","description":"(Hopefully) robust website \u003ctitle\u003e extractor","archived":false,"fork":false,"pushed_at":"2015-09-13T23:16:22.000Z","size":144,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-03-02T20:30:41.712Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Ruby","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Freaky.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-09-13T23:11:31.000Z","updated_at":"2015-09-13T23:11:43.000Z","dependencies_parsed_at":"2023-03-23T15:18:37.359Z","dependency_job_id":null,"html_url":"https://github.com/Freaky/title_fetcher","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Freaky/title_fetcher","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Freaky%2Ftitle_fetcher","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Freaky%2Ftitle_fetcher/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Freaky%2Ftitle_fetcher/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Freaky%2Ftitle_fetcher/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Freaky","download_url":"https://codeload.github.com/Freaky/title_fetcher/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Freaky%2Ftitle_fetcher/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33907693,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-04T02:00:06.755Z","response_time":64,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-13T19:41:28.028Z","updated_at":"2026-06-04T13:31:10.427Z","avatar_url":"https://github.com/Freaky.png","language":"Ruby","funding_links":[],"categories":[],"sub_categories":[],"readme":"# TitleFetcher - Robust web title tag fetcher\n\nTitleFetcher fetches title elements from websites.\n\n    require 'titlefetcher'\n    \n    tf = TitleFetcher.new\n    tf.fetch \"http://freshbsd.org\" # =\u003e \"FreshBSD - The latest BSD Commits\"\n\nIt tries to guess charset and converts/scrubs to UTF-8, making some effort\nto correct common Mojibake issues.\n\nDefault timeouts for socket operations are 10 seconds, and it gives up\nsearching a document for title tags after the first 128KiB.  Documents\nwith content-types other than `text/*` and `application/{xml,xhtml}` are\nnot scanned.\n\nTitleFetcher objects are expected to be safe to share across threads.\n\n## Dependencies\n\n * Ruby 2.0+\n * charlock_holmes(-jruby)\n * mojibake\n * http.rb\n * oga\n\n## TODO\n\n * Stricter per-request timeout.\n * Factor in HTTP and HTML headers to charset detection.\n * HEAD request to check Content-Type without inviting a bunch of other data.\n * Fall back to searching for h1 tags or so.\n * Tests.\n * Documentation.\n * Release as a gem.\n * Use it in something.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffreaky%2Ftitle_fetcher","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffreaky%2Ftitle_fetcher","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffreaky%2Ftitle_fetcher/lists"}