Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/huksley/serverless-multicloud-update-addresses
Multicloud serverless Javascript function (AWS and Azure)
https://github.com/huksley/serverless-multicloud-update-addresses
Last synced: 16 days ago
JSON representation
Multicloud serverless Javascript function (AWS and Azure)
- Host: GitHub
- URL: https://github.com/huksley/serverless-multicloud-update-addresses
- Owner: huksley
- Created: 2019-01-21T08:29:53.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2019-07-22T03:31:32.000Z (over 5 years ago)
- Last Synced: 2024-04-14T08:55:55.261Z (9 months ago)
- Language: TypeScript
- Homepage:
- Size: 480 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 8
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Serverless function to update address coordinates in sample database
This example NodeJS Javascript function is compatible with both Azure Functions and AWS Lambda.
To deploy it I am using [Serverless Framework](https://serverless.com).
Due to https://github.com/serverless/serverless/pull/5589 you need to copy `serverless-.yml` config to serverless.yml before doing the deploy.
## Regarding "We found potential security vulnerabilities in your dependencies."
This message is generated using [GitHub Vulnerability alerts](https://help.github.com/articles/about-security-alerts-for-vulnerable-dependencies) feature. I am keeping it here, but in a nutshell it is a problem with [serverless-azure-functions](https://github.com/serverless/serverless-azure-functions), see https://github.com/serverless/serverless-azure-functions/issues/131.
```bash
review hoek moderate > 4.2.0 < 5.0.0 || >= 5.0.3 Prototype pollution https://npmjs.com/advisories/566 serverless-azure-functions>request>hawk>boom>hoek
review hoek moderate > 4.2.0 < 5.0.0 || >= 5.0.3 Prototype pollution https://npmjs.com/advisories/566 serverless-azure-functions>request>hawk>cryptiles>boom>hoek
review hoek moderate > 4.2.0 < 5.0.0 || >= 5.0.3 Prototype pollution https://npmjs.com/advisories/566 serverless-azure-functions>request>hawk>hoek
review hoek moderate > 4.2.0 < 5.0.0 || >= 5.0.3 Prototype pollution https://npmjs.com/advisories/566 serverless-azure-functions>request>hawk>sntp>hoek
review static-eval moderate >=2.0.0 Sandbox Breakout / Arbitrary Code Execution https://npmjs.com/advisories/548 serverless-azure-functions>jsonpath>static-eval
review sync-exec moderate No patch available Tmp files readable by other users https://npmjs.com/advisories/310 serverless-azure-functions>az-login>copy-paste>sync-exec
```
## Features
* Uses MS-SQL NodeJS all-js driver
* Makes geocoding calls to Google Maps API
* Deploys to Azure Functions
* Deploys to AWS Lambda
* Limit on simultaneous requests to Google Maps API (10 concurrent requests)
## Configure local
1. Start SQL server + sample DB (https://docs.microsoft.com/en-us/azure/sql-database/sql-database-get-started-portal)
2. Get Google key which can query Geocoding API
3. Save to AWS SSM Parameter store secrets using chamber-template (see http://bit.ly/2Bd049c)
4. Run (`npm run local`)
5. Copy `serverless-.yml` config to `serverless.yml`
5. deploy (`npm run deploy`)
## Running locally
* `npm install`
* `npm run local`
## Developing Typescript azure function locally
During development, run this in terminal 1. This will start local function at http://localhost:7071/api/updateAddresses
```bash
languageWorkers__node__arguments="--inspect=5858" func host start"
```
Run this in terminal 2. This will compile TypeScript into Javascript and watch for file changes.
```bash
tsc --watch
```
If you are using **VS Code**, you can add to debugger launch configuration `restart: true` so it will restart after every recompilation/node restart.
## Links
* https://docs.microsoft.com/en-us/azure/azure-functions/set-runtime-version
* https://docs.microsoft.com/en-us/azure/azure-functions/functions-reference-node
* https://docs.microsoft.com/en-us/azure/azure-functions/functions-create-first-azure-function-azure-cli-linux
* https://github.com/Azure/azure-functions-core-tools
## Container with Metabase
You can run dashboard and analyze MS-SQL db in one click:
```bash
az container create --resource-group testg1 --name testnginx217219 --image metabase/metabase --cpu 2 --memory 4 --dns-name-label testnginx217219 --ports 3000
```
Will result in http://testnginx217219.northeurope.azurecontainer.io:3000 URL with [Metabase](https://metabase.com) dashboard running.
## FaaS deploy errors
These are various error I encountered debugging and launching Azure FaaS function. They are here for historical purposes only.
```
The function runtime is unable to start. Microsoft.Azure.WebJobs.Script.WebHost: Host thresholds exceeded: [Threads, Processes]. For more information, see https://aka.ms/functions-thresholds.
Session Id: e12a0d8240b746dd9cba81bbae1ad9e9
```
```
2019-01-21T08:12:21.959 [Error] Timeout value of 00:05:00 exceeded by function 'Functions.updateAddresses' (Id: '684ff9b9-43cd-4390-893d-5ffbc23bc4b5'). Initiating cancellation.
2019-01-21T08:12:41.063 [Error] Timeout value of 00:05:00 exceeded by function 'Functions.updateAddresses' (Id: '72aa1ac0-eb7a-44c1-9635-44222cc46c6c'). Initiating cancellation.
2019-01-21T08:12:41.287 [Error] Executed 'Functions.updateAddresses' (Failed, Id=72aa1ac0-eb7a-44c1-9635-44222cc46c6c)
Timeout value of 00:05:00 was exceeded by function: Functions.updateAddresses
2019-01-21T08:14:18 No new trace in the past 1 min(s).
2019-01-21T08:14:41.489 [Information] Executing 'Functions.updateAddresses' (Reason='This function was programmatically called via the host APIs.', Id=0ab320ff-0b54-4705-96eb-12f146bfb3f4)
2019-01-21T08:15:07.459 [Information] Executing 'Functions.updateAddresses' (Reason='This function was programmatically called via the host APIs.', Id=15646a5b-0ef4-4d88-9ca0-24d8f282ca85)
2019-01-21T08:15:14.588 [Information] JavaScript HTTP trigger function processed a request.
2019-01-21T08:15:14.784 [Information] Executed 'Functions.updateAddresses' (Succeeded, Id=0ab320ff-0b54-4705-96eb-12f146bfb3f4)
2019-01-21T08:15:15.838 [Information] Executing 'Functions.updateAddresses' (Reason='This function was programmatically called via the host APIs.', Id=247f8e3d-43fc-4eb4-97b1-d451a41979a6)
```
```
Function host is not running.
```
### Serverless invoke error
Invoking `serverless invoke -f updateAddresses` gives following error. Probably corellates with this issue https://github.com/serverless/serverless-azure-functions/issues/128.
```
Error: [object Object]
at module.exports.logError (/home/user/update-addr/node_modules/serverless/lib/classes/Error.js:92:11)
at initializeErrorReporter.then.catch.e (/home/user/update-addr/node_modules/serverless/bin/serverless:65:3)
at runCallback (timers.js:794:20)
at tryOnImmediate (timers.js:752:5)
at processImmediate [as _immediateCallback] (timers.js:729:5)
From previous event:
at /home/user/update-addr/node_modules/serverless/bin/serverless:63:9
at Object. (/home/user/update-addr/node_modules/serverless/bin/serverless:66:4)
at Module._compile (module.js:652:30)
at Object.Module._extensions..js (module.js:663:10)
at Module.load (module.js:565:32)
at tryModuleLoad (module.js:505:12)
at Function.Module._load (module.js:497:3)
at Function.Module.runMain (module.js:693:10)
at findNodeScript.then.existing (/home/rgai/usr/node-v8.11.1-linux-x64/lib/node_modules/npm/node_modules/libnpx/index.js:268:14)
at
```
### After deploy errors
```
Error:
Function (updateAddresses) Error: Failed to start language worker process for: node. node exited with code -1 . Failed to start language worker process for: node. node exited with code -1 . Failed to start language worker process for: node. node exited with code -1 .
Session Id: 8509d91e09ca492e8d2a8295115003cf
Timestamp: 2019-01-24T14:42:36.026Z
```