https://github.com/craigsdennis/snappy

Sometimes you need to get the HTML of a page after it is fully loaded
https://github.com/craigsdennis/snappy

html javascript playwright scrape

Last synced: about 3 hours ago
JSON representation

Sometimes you need to get the HTML of a page after it is fully loaded

• Host: GitHub
• URL: https://github.com/craigsdennis/snappy
• Owner: craigsdennis
• Created: 2022-08-21T05:45:57.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2024-01-17T05:49:02.000Z (10 months ago)
• Last Synced: 2024-10-30T15:58:18.065Z (8 days ago)
• Topics: html, javascript, playwright, scrape
• Language: JavaScript
• Homepage:
• Size: 9.77 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Snappy

Simple little helper to access the HTML of a page after any dynamic JavaScript rendering has happened. It does this in a dorky way of waiting for requests to finish (therefore if no web requests are made this won't work. Sorry, but you should just right click and View Source at that point.)

This uses [Playwright](https://playwright.dev/)

## Installation

Copy [.env.example](./.env.example) to `.env` and modify parameters

```bash

npm install

npx playwright install

npm install -g .

```

## Usage

```bash

snappy --url https://www.google.com

```

This will output the HTML to stdout to pipe to other applications or files

```bash

snappy --url https://spacejam.com > static.html

```

*Optionally*

You can create a CSV file with each row containing `filename,url` and pass it in using the `--file` option.

```bash

snappy --file example.csv

```

Files will be stored in the [snaps](./snaps) directory.