https://github.com/stephlaf/puppeteer-airtable-tutorial

Tutorial to scrape the web using Puppeteer and store to Airtable
https://github.com/stephlaf/puppeteer-airtable-tutorial

airtable-api javascript puppeteer scraping

Last synced: 27 days ago
JSON representation

Tutorial to scrape the web using Puppeteer and store to Airtable

• Host: GitHub
• URL: https://github.com/stephlaf/puppeteer-airtable-tutorial
• Owner: stephlaf
• Created: 2022-09-02T01:58:17.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2022-09-15T14:24:27.000Z (about 2 years ago)
• Last Synced: 2024-10-02T11:41:12.354Z (about 1 month ago)
• Topics: airtable-api, javascript, puppeteer, scraping
• Language: JavaScript
• Homepage:
• Size: 32.2 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Tutorial to scrape the web using Puppeteer and store to Airtable #

## Setup ##

```

yarn add puppeteer

yarn add airtable

yarn add dotenv

touch .env

```

Store your airtable API key and Board key in `.env`

```

AIRTABLE_API_KEY='your_api_key'

AIRTABLE_BOARD_KEY='your_board_key'

```

The table name `Table 1` used in the `base('Table 1').create` command on line 10 of `dieuduciel.js` refers to the name of the table you want to write to.\

Adjust accordingly.



The board columns (all as Single text line, except for `description`, which is `Long text`, and `image_url`, which is `URL`).

The columns must be defined as:

```

name

description

image_url

category

type

alcohol

```

## Usage ##

Run the program with `node dieuduciel.js`\

See all the imported data appear in your Airtable board 😃

Big thanks to [@jeremiebardon](https://github.com/jeremiebardon) for his help 🙏🏻