https://github.com/dudeperf3ct/12-serverless-deploy
https://github.com/dudeperf3ct/12-serverless-deploy
aws-lambda docker fastapi mlops model-serving serverless-framework transformers
Last synced: 3 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/dudeperf3ct/12-serverless-deploy
- Owner: dudeperf3ct
- Created: 2022-01-29T05:45:07.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2022-02-02T17:48:52.000Z (over 3 years ago)
- Last Synced: 2024-12-31T10:17:49.860Z (5 months ago)
- Topics: aws-lambda, docker, fastapi, mlops, model-serving, serverless-framework, transformers
- Language: Python
- Homepage:
- Size: 14.6 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: Readme.md
Awesome Lists containing this project
README
# Serverless
In this exercise, transformers sentiment classifier fastapi application is deployed using [Serverless Framework](https://www.serverless.com/framework/docs)
Serverless Version
```bash
sls --version
Framework Core: 3.1.0 (standalone)
Plugin: 6.0.0
SDK: 4.3.0
```
## Serverless Framework
[Serverless Framework](https://www.serverless.com/framework/docs) provides hassle free develop, deploy, troubleshoot and secure serverless applications.
Under the hood, the Serverless Framework is deploying your code to a cloud provider like AWS, Microsoft Azure, Google Cloud Platform, Apache OpenWhisk, Cloudflare Workers, or a Kubernetes-based solution like Kubeless.
Pre-requisites
- AWS CLI
- Serverless Framework installed and [AWS configured](https://www.serverless.com/framework/docs/providers/aws/cli-reference/config-credentials)
## Run
### Locally
Test the sentiment classifier model
```bash
docker build -t sentiment -f project/sentiment/Dockerfile.sentiment project/sentiment/
docker run --rm -it sentiment
```
Run tests using `pytest`
```bash
docker build -t sentiment -f Dockerfile.test .
docker run -p 8000:8000 -it -v $(pwd):/app --entrypoint bash sentiment
pytest --cov
```
Build a docker image and test the application that will be used to deploy as AWS Lambda function.
```bash
docker build -t sentiment -f Dockerfile.prod .
docker run -p 8000:8000 sentiment
```
```bash
curl -X 'POST' \
'http://0.0.0.0:8000/classify?input_text=i%20like%20you' \
-H 'accept: application/json' \
-d ''
```
### Deploy using serverless framework
Reference: [Serverless Docker deploy](https://www.serverless.com/blog/container-support-for-lambda)
We will now deploy this application using serverless. This will add the application to Monitor on serverless dashboard.
```bash
# add monitoring to serverless dashboard
serverless
```
Deploy the application using Serverless Framework.
```bash
serverless deploy --stage dev --verbose
```
Once application is deployed, get information about deployment.
```bash
serverless info
```
Test application
Vist `/docs` to see if Swagger UI is available.
```bash
curl -i
```
Test the classification endpoint
```bash
curl -X 'POST' \
'/classify?input_text=i%20like%20you' \
-H 'accept: application/json' \
-d ''
```
Fetch logs
```bash
serverless logs -f sentimentapi
```
Remove service
```bash
sls remove --stage dev
```
Additional: CI/CD can be [integrated](https://www.serverless.com/framework/docs/guides/cicd) using Serverless Dashboard.