https://github.com/jellydn/playwright-crawler-demo

This template is a production ready boilerplate for developing with `PlaywrightCrawler`. Use this to bootstrap your projects using the most up-to-date code.
https://github.com/jellydn/playwright-crawler-demo

crawlee playwright-typescript

Last synced: 3 months ago
JSON representation

This template is a production ready boilerplate for developing with `PlaywrightCrawler`. Use this to bootstrap your projects using the most up-to-date code.

• Host: GitHub
• URL: https://github.com/jellydn/playwright-crawler-demo
• Owner: jellydn
• Created: 2022-10-23T08:57:22.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2024-04-29T03:08:52.000Z (7 months ago)
• Last Synced: 2024-05-02T02:28:56.906Z (7 months ago)
• Topics: crawlee, playwright-typescript
• Language: Dockerfile
• Homepage:
• Size: 775 KB
• Stars: 10
• Watchers: 2
• Forks: 3
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Welcome to my-crawler 👋

![Version](https://img.shields.io/badge/version-0.0.1-blue.svg?cacheSeconds=2592000)

[![License: ISC](https://img.shields.io/badge/License-ISC-yellow.svg)](#)

[![Twitter: jellydn](https://img.shields.io/twitter/follow/jellydn.svg?style=social)](https://twitter.com/jellydn)

> This is an example of a Crawlee project.

[![IT Man - Tech #27 - Crawlee is a web scraping and browser automation library [Vietnamese]](https://i.ytimg.com/vi/nrgiOh5HfnU/hqdefault.jpg)](https://www.youtube.com/watch?v=nrgiOh5HfnU)

## Install

```sh

yarn install

```

## Usage

```sh

yarn start

```

## [Running headful browsers](https://crawlee.dev/docs/introduction/setting-up)

Default is running with headless browser so you can uncomment the following on development phase.

```typescript

// src/main.ts

// Uncomment this option to see the browser window.

headless: false;

```

## Run tests

```sh

yarn test

```

## Crawlee + PlaywrightCrawler + TypeScript project

This template is a production ready boilerplate for developing with `PlaywrightCrawler`. Use this to bootstrap your projects using the most up-to-date code.

If you're looking for examples or want to learn more visit:

- [Documentation](https://crawlee.dev/api/playwright-crawler/class/PlaywrightCrawler)

- [Examples](https://crawlee.dev/docs/examples/playwright-crawler)

## Useful references

- [Running in Docker](https://crawlee.dev/docs/guides/docker-images)

- [Avoid getting blocked](https://crawlee.dev/docs/guides/avoid-blocking)

- [Proxy Management](https://crawlee.dev/docs/guides/proxy-management)

- [Getting some real-world data](https://crawlee.dev/docs/introduction/real-world-project)

## Author

- Website: https://productsway.com/

- Twitter: [@jellydn](https://twitter.com/jellydn)

- Github: [@jellydn](https://github.com/jellydn)

## Show your support

Give a ⭐️ if this project helped you!

---

_This README was generated with ❤️ by [readme-md-generator](https://github.com/kefranabg/readme-md-generator)_