https://github.com/jonfairbanks/bert-scraper

Scrape website content and extract topics
https://github.com/jonfairbanks/bert-scraper

bertopic webscraper

Last synced: 8 months ago
JSON representation

Scrape website content and extract topics

• Host: GitHub
• URL: https://github.com/jonfairbanks/bert-scraper
• Owner: jonfairbanks
• Created: 2023-04-12T18:53:39.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2023-04-12T18:53:42.000Z (over 2 years ago)
• Last Synced: 2025-01-11T01:40:58.350Z (9 months ago)
• Topics: bertopic, webscraper
• Language: Python
• Homepage:
• Size: 57.6 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# bert-scraper

 

![bert-scraper](sample.png)

Scrape website content and extract topics

- Visualize topic distributions

- View extracted topic definitions

#### Usage

```

pipenv shell

pipenv install

python index.py https://mycoolsite.com

```