{"id":20288006,"url":"https://github.com/dopecodez/open-graph-scraper","last_synced_at":"2026-04-30T08:37:33.264Z","repository":{"id":117103031,"uuid":"215202011","full_name":"dopecodez/open-graph-scraper","owner":"dopecodez","description":"Open graph protocol metadata scraper made with ExpressJS and Cheerio","archived":false,"fork":false,"pushed_at":"2019-12-04T13:46:25.000Z","size":19,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-10-30T11:46:27.973Z","etag":null,"topics":["chai","cheerio","mocha","nodejs","open-gr","open-graph-protocol","open-graph-scraper"],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"unlicense","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dopecodez.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-10-15T03:51:39.000Z","updated_at":"2019-12-04T13:46:24.000Z","dependencies_parsed_at":null,"dependency_job_id":"0fd7f40f-35be-41cc-8525-fcfeec3b4ddd","html_url":"https://github.com/dopecodez/open-graph-scraper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/dopecodez/open-graph-scraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dopecodez%2Fopen-graph-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dopecodez%2Fopen-graph-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dopecodez%2Fopen-graph-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dopecodez%2Fopen-graph-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dopecodez","download_url":"https://codeload.github.com/dopecodez/open-graph-scraper/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dopecodez%2Fopen-graph-scraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32459420,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-29T22:27:22.272Z","status":"online","status_checked_at":"2026-04-30T02:00:05.929Z","response_time":57,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["chai","cheerio","mocha","nodejs","open-gr","open-graph-protocol","open-graph-scraper"],"created_at":"2024-11-14T14:43:41.154Z","updated_at":"2026-04-30T08:37:33.244Z","avatar_url":"https://github.com/dopecodez.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# open-graph-scraper\n\nAn open graph protocol scraper made with ExpressJS on top of NodeJS and Cheerio. Will get ogTags like title, image, description etc.If Open Graph Protocol tags are not available, searches for other metadata. Implements caching internally using node-cache so that the same requests if cached can be served quicker. Also has unit tests on top of this with Mocha and Chai. For more information on Open Graph Protocol, please check out https://ogp.me/.\n\nIf you have any doubts or clarifications on this code, hit me up and I'll try to help you guys out!\n\n## Getting Started\n\nThese instructions will get you a copy of the project up and running on your local machine for development and testing purposes. \n\n### Prerequisites\n\nYou'll need to install NodeJS for running this application. I'm on Node v10.5.3, you can find it at:\n```\nhttps://nodejs.org/en/download/\n```\nYou'll also need a code editor to see how the code goes. Use whichever editor which has JS support, I use Visual Studio Code on \nWindows 10.\n\n### Installing\n\nSimple steps to get the application running. Open the terminal to the folder containing og-scraper-express and just type:\n```\nnpm install\n```\nThis should install all the dependencies within package.json and create your package-lock.json and node modules.\n\nAfter the previous command completes successfully, open the terminal and type:\n```\nnpm start\n```\nThis should get the program up and running on the default port.\n\nTo run the tests, all you need to do is, type:\n\n```\nnpm run test\n```\n\n## Usage\n\nOnce program is up and running, you can call the endpoint with server_ip/ogScrap. By default, the port should be 3000. On your local machine, server_ip would be http://localhost:3000 (if you haven't specified any port). This is a post request which expects a JSON post body as such:\n```\n{\n  \"url\" : \"https://duckduckgo.com/?t=hk\"\n}\n```\nI also hosted the same app on heroku. So you guys can run the api by calling a post request to https://arcane-spire-12570.herokuapp.com/ogScrap with the same body as above and see the magic happen.\n\n## Built With\n\n* [NodeJS](https://nodejs.org/en/) - The language used\n* [Express](https://expressjs.com/) - Framework used on top of node.\n* [Cheerio](https://cheerio.js.org/) - Package used for parsing OG tags.\n* [Node-Cache](https://www.npmjs.com/package/node-cache) - Simple NodeJS caching module.\n* [Mocha](https://mochajs.org/) - Test framework for JS.\n* [Chai](https://www.chaijs.com/) - Assertion library for JS.\n\n## Contributing\n\nAnybody with ideas to genuinely improve the project are welcome. We use git flow, so just pull the repo, cut a branch on develop and put a pull request back to us. We will look through the PR as soon as possible. We suggest you make sure your PR passes all unit tests, and add further unit tests for any new functionalities introduced.\n\n## Versioning\nCurrently, no versions are available. Will update soon\n\n## Authors\n\n* **Govind S** - *Initial work* - [dopecodez](https://github.com/dopecodez)\n\n## License\n\nThis project is free. Use it in whichever way you please.\n\n## Acknowledgments\n\n* Hat tip to anyone whose code was used\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdopecodez%2Fopen-graph-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdopecodez%2Fopen-graph-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdopecodez%2Fopen-graph-scraper/lists"}