https://github.com/ryoichi-obara/scrape-jsr
Web scraping for JSR (Java Specification Request) JSON.
https://github.com/ryoichi-obara/scrape-jsr
aws aws-lambda aws-lambda-node aws-s3 java javascript jsr lambda node node-js nodejs s3 scraper webscraper webscraping
Last synced: 3 months ago
JSON representation
Web scraping for JSR (Java Specification Request) JSON.
- Host: GitHub
- URL: https://github.com/ryoichi-obara/scrape-jsr
- Owner: ryoichi-obara
- License: mit
- Created: 2018-08-01T03:07:19.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2018-09-22T10:53:36.000Z (almost 7 years ago)
- Last Synced: 2025-01-25T08:24:55.521Z (5 months ago)
- Topics: aws, aws-lambda, aws-lambda-node, aws-s3, java, javascript, jsr, lambda, node, node-js, nodejs, s3, scraper, webscraper, webscraping
- Language: JavaScript
- Homepage:
- Size: 4.88 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# scrape-jsr
Web scraping for JSR (Java Specification Request) JSON.
GET https://www.jcp.org/en/jsr/all and put JSON.
## Environment
* REGION: Target region for S3 bucket.
* BUCKET: Target bucket for JSR jsons.
Optional (profile)
* PROFILE
Optional (Access key)
* AWS_ACCESS_KEY_ID
* AWS_SECRET_ACCESS_KEY
## You will get json in your S3 bucket
```json
{"no":"1","title":"Real-time Specification for Java","desc":"The Real-Time Specification for Java extends the Java platform to support both current practice and advanced real-time systems application programming."}
```
## Execution
For your local computer
```
node handle.js
```
For your lambda function.
```
npm run make
aws s3 cp ./build/Release/scrape-jsr.zip s3://[YOUR_S3_BUCKET]/
aws lambda update-function-code --function-name [YOUR_LAMBDA_FUNCTION_NAME] --s3-bucket [YOUR_S3_BUCKET] --s3-key scrape-jsr.zip --publish
```