https://github.com/metalwarrior665/actor-keywords-extractor
Extract list of all keywords fro many website
https://github.com/metalwarrior665/actor-keywords-extractor
apify keywords-extraction
Last synced: 2 months ago
JSON representation
Extract list of all keywords fro many website
- Host: GitHub
- URL: https://github.com/metalwarrior665/actor-keywords-extractor
- Owner: metalwarrior665
- Created: 2020-03-04T23:58:41.000Z (about 5 years ago)
- Default Branch: master
- Last Pushed: 2020-09-07T11:16:12.000Z (over 4 years ago)
- Last Synced: 2024-12-30T18:11:29.008Z (4 months ago)
- Topics: apify, keywords-extraction
- Language: JavaScript
- Homepage: https://apify.com/lukaskrivka/keywords-extractor
- Size: 33.2 KB
- Stars: 2
- Watchers: 2
- Forks: 2
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## Keyword Extractor
Can deeply crawl a website and counts how many times are provided keywords found on the page.
### How to use
- You can pass in any number of keywords that you want to count.
- You can combine Start URLs, Pseudo Urls and link selector to traverse any number of pages accross websites. Check our [scraping tutorial](https://docs.apify.com/scraping) on how to use these.
- You can specify `maxDepth` and `maxPagesPerCrawl` to limit the scope of the scrape. Start URLs have depth 0. So if you want just the start URLs, set `maxDepth` to 0, etc.
- You can pick case sensitive search and search through scripts.
- You can choose to scrape with or without browser. Browser is more expensive but allows JavaScript rendering and waiting.
- For browser, you can use many additional features
### How are keywords determined
The text is split into words by [word boundaries](https://www.regular-expressions.info/wordboundaries.html). Each word is then compared with each keyword. In the future, we may add other types of boundaries to choose from.
### Example Output
For `keywords`:
```
["watch", "watches", "rolex"]
```
starting on `https://www.chrono24.com/watches/mens-watches--62.htm`
```
[
{
"url": "https://www.chrono24.com/watches/mens-watches--62.htm",
"depth": 0,
"result": {
"watch": 63,
"watches": 81,
"rolex": 57
}
},
{
"url": "https://www.chrono24.com/user/index.htm",
"depth": 1,
"result": {
"watch": 9,
"watches": 13,
"rolex": 1
}
},
{
"url": "https://www.chrono24.com/info/watch-collection.htm",
"depth": 1,
"result": {
"watch": 56,
"watches": 23,
"rolex": 1
}
},
...
]
```