https://github.com/mikahanninen/robot-awsreinvent-sessions

https://github.com/mikahanninen/robot-awsreinvent-sessions

Last synced: 2 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/mikahanninen/robot-awsreinvent-sessions
• Owner: mikahanninen
• Created: 2020-11-27T17:15:57.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2020-11-28T18:21:31.000Z (about 4 years ago)
• Last Synced: 2024-11-11T04:36:56.509Z (2 months ago)
• Language: HTML
• Size: 1010 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Web scraping AWS re:Invent sessions

Robot for parsing AWS [re:Invent](https://reinvent.awsevents.com/) sessions.

## To run

1. Install rcc. See instructions at https://github.com/robocorp/rcc

2. rcc pull github.com/mikahanninen/robot-awsreinvent-sessions

3. rcc run

Result is saved into `sessions.csv` file.

## Configuration

Configure following environment variables:

#### AWS_SESSION_TAG (optional)

List only sessions with this tag

```

AWS_SESSION_TAG=databases

```

#### AWS_SESSION_DATE (optional)

List sessions only on this date

```

AWS_SESSION_DATE="Dec 17, 2020"

```

#### AWS_SESSION_STATS (optional)

Set to any value if you want to see session tag statistics in the console output

```

AWS_SESSION_STATS=1

```

#### AWS_SESSION_DESC (optional)

Set to any value if you want to see session description in the console output

```

AWS_SESSION_DESC=1

```

### Language Filter (optional)

By default only English language sessions are shown. Modify the `task.robot` variable `@{LANGUAGE_FILTER}` to change what languages are shown.

### Robocloud Vault (REQUIRED)

Required secrets need to be stored into `Robocorp Vault` with key `aws-reinvent` which

should hold variables `email` and `password` for the user accessing AWS re:Invent website.

For instructions to set the `Robocorp Vault` see https://robocorp.com/docs/development-howtos/variables-and-secrets/vault.

#### How it works

1. Initialize process variables

2. If file `aws_sessions.html` is missing from the current directory then AWS re:Invent site will be scraped for HTML content. **Note.** This opens a browser window which should be left untouched during the scraping process. Also **note that the process might take quite a long time (10+ minutes)**, because browsing for the sessions if a slow process.

3. Once we have `aws_sessions.html` file then the sessions are extracted from the HTML.

4. Output sessions to the console according to set variables.