https://github.com/orangain/scrapy-s3pipeline

Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.

aws pipeline s3 scrapy

Last synced: 03 Aug 2024

https://github.com/awskrug/handson-labs-2018

AWSKRUG Hands-on Lab 2018

aws awskrug hands-on usergroup

Last synced: 04 Aug 2024

https://github.com/ml-archive/aws

Swift wrapper around AWS API

aws brto s3 server-side-swift swift vapor vapor-2

Last synced: 07 Nov 2024

https://github.com/svtslv/nestjs-s3

S3 module for Nest

aws minio nest nestjs s3 storage

Last synced: 09 Nov 2024

https://github.com/serverless/serverless-local-schedule

⚡️🗺️⏰ Schedule AWS CloudWatch Event based invocations in local time(with DST support!)

aws cloudwatch crontab schedule serverless

Last synced: 08 Nov 2024

https://github.com/miztiik/my-first-cdk-project

A hands on repo with multiple demonstrations on CDK: Used by Udemy Course🎓

aws cdk cloud-development-kit miztiik udemy-course-project

Last synced: 05 Nov 2024

https://github.com/slauth-io/slauth-cli

CLI that scans directories for Cloud Provider SDK usage generates the IAM Policies/Permissions needed

aws cli gcp iam llm openai permissions policies

Last synced: 07 Nov 2024

https://github.com/balavenkatesh3322/model_deployment

A collection of model deployment library and technique.

aws azure caffe data-science deep-learning keras machine-learning model model-deployment model-server model-serving mxnet neural-network pytorch serving serving-pytorch-models serving-recommendation serving-tensors tensorflow

Last synced: 10 Nov 2024

https://github.com/JimLynchCodes/Titanium-Lambda

A guide for building easy to maintain, blazingly fast, and thoroughly tested Lambda functions! 🙌 🚀

aws aws-lambda node nodejs serverless serverless-framework serverless-function serverless-functions

Last synced: 01 Nov 2024

https://github.com/hashicorp/packer-plugin-amazon

Packer plugin for Amazon AMI Builder

aws packer packer-plugin

Last synced: 07 Oct 2024

https://github.com/cloudposse/terraform-aws-cloudwatch-logs

Terraform Module to Provide a CloudWatch Logs Endpoint

aws cloudwatch cloudwatch-logs terraform terraform-module

Last synced: 10 Oct 2024

https://github.com/michaelaquilina/s4

:arrows_counterclockwise: Fast and cheap synchronisation of files using Amazon S3

aws python3 s3 sync synchronization

Last synced: 01 Nov 2024

https://github.com/zoph-io/subnet-watcher

AWS VPC Subnets Watcher

aws ipv4 subnet vpc

Last synced: 04 Aug 2024

https://github.com/terraform-aws-modules/terraform-aws-step-functions

Terraform module to create AWS Step Functions 🇺🇦

aws aws-lambda aws-step-functions serverless terraform-module terraform-serverless

Last synced: 10 Oct 2024

https://github.com/structurely/ecs-autoscale

A framework that runs on AWS Lambda for autoscaling ECS clusters and services

autoscaling aws aws-ec2 aws-ecs aws-lambda ec2 ecs python

Last synced: 08 Nov 2024

https://github.com/cloudposse/terraform-aws-kms-key

Terraform module to provision a KMS key with alias

aws chamber hcl2 kms kms-key parameter-store provision ssm systems-management terraform-modules terrafrom

Last synced: 10 Oct 2024

https://github.com/DevopsArtFactory/goployer

AWS Deployer with Go

aws cicd deployer deployment goployer

Last synced: 04 Aug 2024

https://github.com/cloudposse/terraform-aws-iam-user

Terraform Module to provision a basic IAM user suitable for humans.

aws groups iam keybase password pgp terraform terraform-module user

Last synced: 10 Oct 2024

https://github.com/marbot-io/monitoring-jump-start

Monitor AWS resources with ease

alerting amazon-cloudwatch amazon-cloudwatch-events amazon-web-services aws aws-cloudformation cloudformation cloudformation-template cloudformation-templates cloudformation-yaml cloudwatch cloudwatch-alarms cloudwatch-events incident-management monitoring

Last synced: 04 Aug 2024

https://github.com/4dn-dcic/tibanna

Tibanna helps you run your genomic pipelines on Amazon cloud (AWS). It is used by the 4DN DCIC (4D Nucleome Data Coordination and Integration Center) to process data. Tibanna supports CWL/WDL (w/ docker), Snakemake (w/ conda) and custom Docker/shell command.

aws aws-lambda aws-step-function bioinformatics conda cwl cwl-workflow docker pipelines snakemake snakemake-workflow wdl wdl-workflow

Last synced: 08 Nov 2024

https://github.com/Qovery/qovery-cli

Qovery Command Line Interface

aws cli cloud qovery

Last synced: 09 Nov 2024

https://github.com/mssrinivas/linkedin-clone

Developed user profile, connections, job listing and application modules using MERN Stack and Kafka. Implemented Redis for data caching, containerized the application services and hosted on AWS. Implemented MongoDB replication and tested the performance on JMeter and Mocha.

agile aws bootstrap connection-pool css event-tracking expressjs html5 javascript jmeter jwt-authentication kafka mocha mongodb-cluster mongoose mysql-database nodejs reactjs redis-cache redux

Last synced: 11 Oct 2024

https://github.com/doitintl/gtoken

Securely access AWS services from GKE cluster

aws gcp gke google-cloud iam kubernetes service-account workload-identity

Last synced: 04 Aug 2024

https://github.com/miguelgrinberg/slam

Serverless deployment of Python APIs

aws aws-apigateway aws-lambda cloud cloudformation python serverless-deployments

Last synced: 27 Oct 2024

https://github.com/MichaelAquilina/S4

:arrows_counterclockwise: Fast and cheap synchronisation of files using Amazon S3

aws python3 s3 sync synchronization

Last synced: 13 Aug 2024

https://github.com/awslabs/aws-config-to-elasticsearch

Generates an AWS Config Snapshot and ingests it into ElasticSearch for further analysis using Kibana

amazon analysis aws aws-config aws-s3 config elasticsearch elasticsearch-node ingests kibana

Last synced: 03 Nov 2024

https://github.com/AvraamMavridis/berlin-apartments-lambda-public

Send application forms to Landlords every time a new apartment is listed on Immobilien Scout

apartments-for-rent aws berlin bot cloudwatch lambda rent wohnung

Last synced: 05 Sep 2024

https://github.com/sebastian-mora/AWS-Loot

Pull secrets from an AWS environment

aws pentest-tool pentesting red-team security security-tools

Last synced: 04 Aug 2024

https://github.com/Baseline-JS/core

Baseline Core - Serverless First Framework

aws framework serverless typescript

Last synced: 13 Aug 2024

https://github.com/aertslab/SCope

Fast visualization tool for large-scale and high dimensional single-cell data

aws cloud gene-expression gene-regulatory-network grpc large-scale-data-visualization loom reactjs single-cell

Last synced: 06 Nov 2024

https://github.com/amanpathak-devops/terraform-for-aws

aws infrastructure-as-code terraform terraform-modules

Last synced: 10 Oct 2024

https://github.com/nisaacson/aws-lambda-xvfb

builds Xvfb binary to run on AWS lambda

aws aws-lambda lambda serverless

Last synced: 07 Nov 2024

https://github.com/mrusme/planor

The Cloud Aviator: TUI client for cloud services (AWS, Vultr, Heroku, Render.com, Fleek, ...)

aws aws-cloudwatch-logs aws-codepipeline charm cloud command-line command-line-tool fleek fleek-hosting heroku render render-com text-user-interface tui vultr

Last synced: 31 Oct 2024

https://github.com/qonto/prometheus-rds-exporter

Prometheus exporter for AWS RDS

aws prometheus-exporter rds

Last synced: 09 Nov 2024

https://github.com/stacktape/stacktape

The next-generation, DevOps-free cloud development framework.

aws aws-cloudformation cloud cloud-infrastructure cloud-native containers devops-automation serverless

Last synced: 30 Oct 2024

https://github.com/yanfengliu/turkey

Easily create a web UI on Amazon Mechanical Turk to crowd-source instance segmentation data

amazon amazon-mturk annotation-modes annotations aws bbox bounding-box computer-vision deep-learning html image-annotation image-segmentation instance-segmentation javascript mechanical-turk mturk python turk

Last synced: 03 Aug 2024

https://github.com/rpidanny/gm-lambda-layer

AWS Lambda layer with GraphicsMagick binaries.

aws aws-lambda aws-lambda-graphicsmagick gm-lambda-layer graphicsmagick lambda-layer

Last synced: 27 Oct 2024

https://github.com/tungbq/awshub

📚 Collection of AWS Services documentation and learning resources ☁️

aws aws-saa certification cloud cloud-computing devops documentation learning

Last synced: 26 Oct 2024

https://github.com/kislyuk/aegea

Amazon Web Services Operator Interface

aws aws-batch aws-console cli cloud-init docker ec2 fargate genomics iam mlops

Last synced: 01 Nov 2024

https://github.com/aws/amazon-vpc-cni-plugins

VPC CNI plugins for Amazon ECS and EKS.

amazon-ecs amazon-eks aws cni-plugin containers

Last synced: 07 Oct 2024

https://github.com/floydspace/aws-lambda-nodejs-esbuild

λ💨 AWS CDK Construct to bundle JavaScript and TypeScript AWS lambdas using extremely fast esbuild.

aws aws-cdk aws-lambda aws-lambda-node builder bundler cdk-construct construct esbuild lambda typescript

Last synced: 01 Nov 2024

https://github.com/numblr/glaciertools

Command line (bash) scripts to upload large files to AWS glacier using multipart upload and to calculate the required tree hash

amazon-glacier aws aws-cli aws-glacier bash-script command-line command-line-tool glacier hash-functions merkel-tree script shell-scripts treehash

Last synced: 16 Oct 2024

https://github.com/philips-labs/terraform-aws-github-oidc

Terraform module to setup OIDC with AWS and GH Actions

aws github-actions hacktoberfest iac oidc terraform

Last synced: 09 Nov 2024

https://github.com/bytebase/dbcost

The simple pricing calculator and comparison tool for the cloud databases.

aws aws-rds billing cloud cloudsql database finops gcp gcp-cloudsql instance mysql postgres postgresql pricing pricing-table rds

Last synced: 07 Nov 2024

https://github.com/msfidelis/aws-turn-off-my-account

:package: :rocket: :package: Lambda stack to turn off and destroy all resources from your personal AWS Account to avoid billing surprises

aws aws-lambda lambda serverless

Last synced: 15 Oct 2024

https://github.com/InsightDataScience/ansible-playbook

Ansible playbook to deploy distributed technologies

ansible ansible-playbooks aws data-engineering devops ec2-instance infrastructure-management kafka zookeeper

Last synced: 03 Aug 2024

https://github.com/miztiik/aws-real-time-use-cases

Repo of quick starts for real time AWS use cases 🎓

aws real-time use-cases

Last synced: 04 Aug 2024

https://github.com/jb55/s3-blob-store

:cloud: Amazon S3 blob-store

aws blob-store s3

Last synced: 09 Nov 2024

https://github.com/aws/homebrew-aws

Homebrew is a package manager for macOS which provides easy installation and update management of additional software. This Tap (repository) contains the Formulae that are used in the macOS AMI that AWS offers.

aws ec2 homebrew macos

Last synced: 07 Oct 2024

https://github.com/codacy/helm-ssm

Injects values from AWS SSM parameters on the values.yaml file

amazon-web-services aws codacy hacktoberfest helm helm-plugin helm-ssm helm3 injects-values kubernetes ssm

Last synced: 10 Nov 2024

https://github.com/brunsgaard/eks-nvme-ssd-provisioner

EKS NVMe SSD provisioner for Amazon EC2 Instance Stores

aws eks kubernetes nvme storage

Last synced: 08 Nov 2024

https://github.com/awslabs/backstage-plugins-for-aws

AWS plugins for Backstage

aws backstage backstage-plugin

Last synced: 07 Nov 2024

https://github.com/jwplayer/sparksteps

:star: CLI tool to launch Spark jobs on AWS EMR

aws aws-emr python spark

Last synced: 05 Nov 2024

https://github.com/idealo/terraform-aws-opensearch

Terraform module to provision an OpenSearch cluster with SAML authentication.

aws opensearch terraform terraform-module

Last synced: 10 Oct 2024

https://github.com/dabit3/speakerchat

SpeakerChat - Real-time Event Q&A Platform with Markdown Support

amplify appsync aws aws-amplify aws-appsync graphql serverless

Last synced: 09 Nov 2024

https://github.com/goldfiglabs/introspector

A schema and set of tools for using SQL to query cloud infrastructure.

aws aws-security cloud-infrastructure cloud-security cloudsecurity cmdb compliance-as-code compliance-automation cspm database-schema devsecops iam infosec infrastructure-as-deployed postgres secops security security-groups security-tools sql

Last synced: 03 Aug 2024

https://github.com/kolomied/cdk-stepfunctions-patterns

A set of Step Functions high-level resiliency patterns.

aws cdk pattern pattern-library patterns resiliency resiliency-patterns stepfunctions

Last synced: 27 Oct 2024

https://github.com/iamsk/cloudping

This site allows you to perform an HTTP ping to measure the network latency from your browser to the various cloud data centers around the world.

aliyun aws azure cloud google-cloud huawei-cloud mtyun ping qiniu speed tencent-cloud ucloud yun

Last synced: 06 Nov 2024

https://github.com/spring-media/terraform-aws-lambda

A Terraform module to create AWS Lambda ressources.

aws aws-lambda cloudwatch-events dynamodb kinesis lambda s3 serverless sns sqs terraform terraform-modules

Last synced: 26 Sep 2024

https://github.com/iann0036/aws-pagination-rules

The rules for pagination in AWS SDKs

aws aws-sdk pagination

Last synced: 22 Oct 2024

https://github.com/bcongdon/bpy_lambda

🎥 A compiled binary of Blender-as-a-Python-Module (bpy) for use in AWS Lambda

aws aws-lambda blender blender-python python

Last synced: 05 Nov 2024

https://github.com/awslabs/green-boost

Build Full Stack Cloud Native Web Apps on AWS Fast

aws cdk cloud cloudnative full-stack lambda nodejs react serverless trpc typescript

Last synced: 31 Oct 2024

https://github.com/nicolaslopezj/react-deploy-s3

Deploy create react app's in AWS S3

aws cloudfront create-react-app deploy react s3 ssl

Last synced: 08 Nov 2024

https://github.com/derBroBro/TerraDepot

A terraform http backend written in python, deployed on aws lambda.

aws terraform userinterface webui

Last synced: 01 Nov 2024

https://github.com/sirrend/terrap-cli

Terrap - a powerful CLI tool that scans your infrastructure and identifies any required changes.

aws ci cli cli-tools cloud devops devops-tools gcp github hashicorp-terraform iac infrastracture maintanance providers terraform upgrades

Last synced: 10 Oct 2024

https://github.com/docker-production-aws/microtrader

A fictitious stock trading microtrader application

aws docker docker-compose java microservices pluralsight service-discovery vertx workflow

Last synced: 09 Oct 2024

https://github.com/SeisoLLC/easy_infra

A docker container to simplify and secure the use of Infrastructure as Code (IaC)

aws azure cloud docker docker-container docker-image iac infrastructure infrastructure-as-code security seiso

Last synced: 01 Nov 2024

https://github.com/orasik/aws_lambda_ftp_function

AWS Lambda Function to connect to FTP, download files and save them to S3 bucket

api-gateway aws ftp lambda python s3-bucket

Last synced: 31 Oct 2024

https://github.com/HariSekhon/Jenkins

Jenkins CI/CD - Advanced Jenkinsfile & Groovy Shared Library of reusable functions and pipelines - AWS, GCP, Docker, Kubernetes, ArgoCD, Slack notifications, Git Merge, Terraform, Cloudflare, Jenkins Job Backups, most major Docker registries, DockerHub, GHCR, ECR, GCR, GAR, ACR, GitLab, Quay

argocd aws ci ci-cd ci-cd-pipeline cicd cloudflare devops docker gcp gi gitops groovy hacktoberfest jenkins jenkins-ci jenkinsfile kubernetes library terraform

Last synced: 07 Nov 2024

https://github.com/cdktf/docker-on-aws-ecs-with-terraform-cdk-using-typescript

End to End example for deploying a docker container and a static frontend to AWS ECS and AWS Cloudfront

aws cdk cdk-examples cdktf ecs example terraform terraform-cdk

Last synced: 30 Oct 2024

https://github.com/rehanvdm/cdk-multi-environment

In this post I will explore 4 different methods that can be used to pass configuration values to the AWS CDK. We will first look at using the context variables in the cdk.json file, then move those same variables out to YAML files. The third method will read the exact same config via SDK(API) call from AWS SSM Parameter Store. The fourth and my favourite is a combination of two and three in conjunction with using GULP.js as a build tool.

aws cdk config environment multiple

Last synced: 07 Nov 2024

https://github.com/scholzj/terraform-aws-minikube

Terraform module for single node Kubernetes instance bootstrapped using kubeadm

aws kubeadm kubernetes kubernetes-setup minikube minikube-setup terraform terraform-modules

Last synced: 10 Oct 2024

https://github.com/aws-samples/aws-hpc-recipes

Contains example recipes that demonstrate how to build HPC systems using AWS services and solutions.

aws batch cloudformation fsx-lustre parallelcluster res slurm

Last synced: 03 Nov 2024

https://github.com/anthonycorletti/astrobase

Create kubernetes clusters quickly on GCP, AWS, or Azure.

astrobase aws azure fastapi google-cloud kubernetes multi-cloud python3 typer

Last synced: 08 Nov 2024

https://github.com/stac-utils/stac-server

A Node-based STAC API, AWS Serverless, OpenSearch

aws opensearch serverless

Last synced: 03 Aug 2024

https://github.com/anna-geller/prefect-deployment-patterns

Code examples showing flow deployment to various types of infrastructure

automation aws data data-engineering data-engineering-infrastructure data-engineering-pipeline data-engineering-team data-products data-science dataflow dataflow-ops orchestration pipeline prefect python serverless serverless-framework

Last synced: 28 Oct 2024

https://github.com/rajiska/terraform-aws-fck-nat

Terraform module for fck-nat

aws fck-nat nat nat-gateway terraform terraform-modules

Last synced: 10 Oct 2024

https://github.com/sugam-arora/unicollab

UniCollab is more than just a platform; it's a gateway to a world where students from different universities/colleges converge to collaborate, innovate, and elevate their projects. Imagine a space where ideas flow freely, where knowledge is shared effortlessly, and where learning transcends classrooms. That's UniCollab for you.

aws azure docker firebase firebase-auth firebase-authentication firebase-hosting good-first-contribution hacktoberfest hacktoberfest-2024 hacktoberfest-accepted hacktoberfest2024 hacktoberfest2024-accepted javascript kubernetes open-source python reactjs shell-script

Last synced: 05 Nov 2024

https://github.com/harisekhon/jenkins

Jenkins CI/CD - Advanced Jenkinsfile & Groovy Shared Library of reusable functions and pipelines - AWS, GCP, Docker, Kubernetes, ArgoCD, Slack notifications, Git Merge, Terraform, Cloudflare, Jenkins Job Backups, most major Docker registries, DockerHub, GHCR, ECR, GCR, GAR, ACR, GitLab, Quay

argocd aws ci ci-cd ci-cd-pipeline cicd cloudflare devops docker gcp gi gitops groovy hacktoberfest jenkins jenkins-ci jenkinsfile kubernetes library terraform

Last synced: 13 Oct 2024

https://github.com/jch254/terraform-ecs-autoscale-alb

ECS cluster with instance and service autoscaling configured and running behind an ALB with path based routing set up

alb autoscaling aws bitbucket-pipelines docker ecs ecs-cluster terraform

Last synced: 16 Oct 2024

https://github.com/aws/porting-assistant-dotnet-ui

Porting Assistant for .NET is an analysis tool that scans .NET Framework applications and generates a .NET Core compatibility assessment, helping customers port their applications to Linux faster.

aws dotnet dotnet-core

Last synced: 07 Oct 2024

https://github.com/provectus/sak-kubeflow

🚀 Deploy Kubeflow on AWS EKS with Terraform 🤖

ai argocd artificial-intelligence automation aws cluster data-science deep-learning devops eks gitops iac infrastructure infrastructure-as-code kubeflow machine-learning ml open-source terraform

Last synced: 08 Nov 2024

https://github.com/managedcode/Storage

Storage library provides a universal interface for accessing and manipulating data in different cloud blob storage providers

aws aws-s3 azure azure-storage blob blob-storage gcp google-cloud-storage s3 s3-bucket storage

Last synced: 04 Aug 2024

https://github.com/terraform-aws-modules/terraform-aws-dms

Terraform module to create AWS DMS (Database Migration Service) resources 🇺🇦

aws aws-dms database-migration-service terraform terraform-module

Last synced: 10 Oct 2024

https://github.com/loomly/s3_asset_deploy

Deploy & manage static assets on S3 with rolling deploys & rollbacks in mind.

aws devops rails ruby ruby-on-rails s3

Last synced: 11 Oct 2024

https://github.com/aws/aws-sdk-js-codemod

Codemod scripts to update AWS SDK for JavaScript APIs.

ast aws aws-sdk aws-sdk-js javascript jscodeshift jscodeshift-codemod nodejs recast

Last synced: 01 Nov 2024

https://github.com/claranet/aws-inventory-graph

Explore your AWS platform with, Dgraph, a graph database.

aws dgraph golang graphdb inventory

Last synced: 08 Nov 2024

https://github.com/feydan/satisfactory-server-aws

Automated Satisfactory Dedicated Server management on AWS

aws cdk satisfactory

Last synced: 06 Nov 2024

https://github.com/yoheimuta/hubot-aws

Hubot masters aws commands

aws coffeescript hubot

Last synced: 27 Oct 2024

https://github.com/lgallard/terraform-aws-secrets-manager

Terraform module to create Amazon Secrets Manager resources.

amazon-secrets-manager aws secret-management secrets terraform terraform-module

Last synced: 31 Oct 2024

https://github.com/sbstjn/appsync-resolvers-example

Example project for AppSync, GraphQL, and AWS Lambda resolvers using Go.

appsync appsync-resolvers aws example go golang graphql lambda resolvers

Last synced: 09 Nov 2024

https://github.com/raelga/kubernetes-talks

Repo for slides, demo apps and other talk resources about kubernetes.

aws azure gcp golang hacktoberfest kubernetes talks

Last synced: 31 Oct 2024

https://github.com/banjtheman/chataws

A ChatGPT plugin that allows users to create websites and Lambda functions using ChatGPT

aws chatgpt chatgpt-plugin chatgpt-plugins openai

Last synced: 28 Oct 2024

https://github.com/say8425/aws-secrets-manager-actions

🔒 GitHub Action for AWS Secrets Manager

aws aws-secretsmanager github-action

Last synced: 07 Nov 2024

https://github.com/turnerlabs/terraform-ecs-fargate-nlb

A Terraform template used for provisioning network application stacks on AWS ECS Fargate

aws containers ecs fargate nlb template terraform

Last synced: 08 Nov 2024

https://github.com/kazhala/fzf.aws

:cyclone: Using fuzzy finder to perform AWS operations on the command line

aws fzf fzf-scripts python

Last synced: 06 Aug 2024

https://github.com/erickwendel/testing-serverless-apps

Code samples of how to make unit and e2e tests in serverless applications

aws aws-lambda aws-s3 continuous-integration debugging docker e2e-testing github-actions javascript jest localstack nodejs serverless serverless-framework unit-testing vscode

Last synced: 11 Nov 2024

https://github.com/opstower-ai/llm-opstower

DevOps AI Assistant CLI. Ask questions about your AWS services, cloudwatch metrics, and billing.

ai aws cli devops

Last synced: 06 Aug 2024

https://github.com/blazejkustra/dynamode

Dynamode is a modeling tool for Amazon's DynamoDB

amazon aws data database datastore db document dynamo dynamodb model nosql schema

Last synced: 30 Oct 2024

https://github.com/mineiros-io/terraform-aws-s3-bucket

A Terraform module to create a Simple Storage Service (S3) Bucket on Amazon Web Services (AWS). https://aws.amazon.com/s3/

amazon-web-services aws iac mineiros s3 s3-bucket terraform terraform-aws terraform-modules

Last synced: 10 Oct 2024