{"id":13583691,"url":"https://github.com/strugee/fulldom-server","last_synced_at":"2026-03-12T17:40:12.716Z","repository":{"id":11475654,"uuid":"69762360","full_name":"strugee/fulldom-server","owner":"strugee","description":"Proxy-like server that will show you the DOM of a page after JS runs","archived":false,"fork":false,"pushed_at":"2023-06-21T15:50:39.000Z","size":108,"stargazers_count":38,"open_issues_count":17,"forks_count":6,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-04-14T05:56:09.446Z","etag":null,"topics":["daemon","dom","hacktoberfest","nodejs","scraping","scraping-websites","server"],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"agpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/strugee.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2016-10-01T20:35:42.000Z","updated_at":"2024-02-07T11:17:50.000Z","dependencies_parsed_at":"2024-01-24T13:06:30.776Z","dependency_job_id":null,"html_url":"https://github.com/strugee/fulldom-server","commit_stats":{"total_commits":34,"total_committers":1,"mean_commits":34.0,"dds":0.0,"last_synced_commit":"9c42f01defb6d6335f21075bef2267656a908de8"},"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/strugee%2Ffulldom-server","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/strugee%2Ffulldom-server/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/strugee%2Ffulldom-server/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/strugee%2Ffulldom-server/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/strugee","download_url":"https://codeload.github.com/strugee/fulldom-server/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248918265,"owners_count":21183154,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["daemon","dom","hacktoberfest","nodejs","scraping","scraping-websites","server"],"created_at":"2024-08-01T15:03:42.169Z","updated_at":"2026-03-12T17:40:07.665Z","avatar_url":"https://github.com/strugee.png","language":"JavaScript","funding_links":[],"categories":["JavaScript"],"sub_categories":[],"readme":"# fulldom-server\n\n[![Build Status](https://travis-ci.org/strugee/fulldom-server.svg?branch=master)](https://travis-ci.org/strugee/fulldom-server)\n[![Coverage Status](https://coveralls.io/repos/github/strugee/fulldom-server/badge.svg?branch=master)](https://coveralls.io/github/strugee/fulldom-server?branch=master)\n\nProxy-like server that will show you the DOM of a page after JS runs\n\nEspecially useful when combined with [Huginn][1]'s `WebsiteAgent`. See [cantino/huginn#888][2]\n\n## Installing\n\n    $ [sudo] npm install -g fulldom\n\n## Running\n\nSimple usage:\n\n    $ fulldom-server\n\nThis will give you a fulldom server running on port 8000, bound to `0.0.0.0`. You can override these defaults with CLI options:\n\n    $ fulldom-server -p 1337 -a localhost\n\nThis tells fulldom to bind to port 1337 on localhost only.\n\nYou can also do the same thing with environment variables, if that's your cup of tea:\n\n    $ FULLDOM_PORT=1337 FULLDOM_ADDRESS=localhost fulldom-server\n\nAnd last but not least, you can configure fulldom with a JSON configuration file at `/etc/fulldom.json` (or whatever is specified with `--config` or `-c`):\n\n    $ cat /etc/fulldom.json\n\t{\n\t\t\"port: 1337,\n\t\t\"address: \"localhost\"\n\t}\n\t$ fulldom-server\n\nThe configuration keys are the same as the long-form CLI options (e.g. `--port` on the CLI corresponds to `port` in JSON).\n\nSee `fulldom-server --help` for details.\n\n## Warning\n\nfulldom relies on [PhantomJS][3] and thus has to spawn a new process for each and every incoming request.\n\nPlease keep this in mind if you plan to publicly deploy fulldom or use it in production.\n\n## Usage\n\ntl;dr: do an HTTP GET on `/\u003curl\u003e?selector=\u003cselector\u003e` to get the serialized DOM of `\u003curl\u003e` as soon as `\u003cselector\u003e` appears in the document.\n\nfulldom exposes a single endpoint at `/\u003curl\u003e` which, when sent an HTTP GET request, will give you back the serialized DOM of the page at `\u003curl\u003e` when the page's JS has \"finished running\". As it is essentially impossible to determine when that happens you need to specify a CSS selector, the presence of which will be used as a heuristic for when the page is \"loaded\". For example, if you are trying to scrape an image gallery, but the gallery is filled in via JS, you might use `img` as your selector. In this case fulldom will load the gallery and wait until there is at least one match for the `img` selector, then serialize the gallery's DOM and return it to you in an HTTP response.\n\nNote that both `\u003curl\u003e` and `\u003cselector\u003e` should be percent-encoded - you need to be particularly careful to encode `/`s. ProTip™: `:` is `%3A`, and `/` is `%2F`.\n\n## Author\n\nAJ Jordan \u003calex@strugee.net\u003e\n\n## License\n\nAGPL 3.0+\n\n [1]: https://github.com/cantino/huginn\n [2]: https://github.com/cantino/huginn/issues/888\n [3]: http://phantomjs.org/\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstrugee%2Ffulldom-server","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fstrugee%2Ffulldom-server","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstrugee%2Ffulldom-server/lists"}