https://github.com/cevoaustralia/glue-vscode

Local Development of AWS Glue with Docker and Visual Studio Code
https://github.com/cevoaustralia/glue-vscode

aws docker glue pyspark visual-studio-code vscode-extension

Last synced: about 1 month ago
JSON representation

Local Development of AWS Glue with Docker and Visual Studio Code

• Host: GitHub
• URL: https://github.com/cevoaustralia/glue-vscode
• Owner: cevoaustralia
• Created: 2021-08-09T07:14:17.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2021-11-29T05:16:57.000Z (about 3 years ago)
• Last Synced: 2024-08-14T07:09:20.682Z (5 months ago)
• Topics: aws, docker, glue, pyspark, visual-studio-code, vscode-extension
• Language: Python
• Homepage:
• Size: 25.4 KB
• Stars: 14
• Watchers: 6
• Forks: 8
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• jimsghstars - cevoaustralia/glue-vscode - Local Development of AWS Glue with Docker and Visual Studio Code (Python)

README

        
# Glue Local Development Environment

This repository provides source for developing Glue with Docker and Visual Studio Code. For Glue 1.0 and Glue 2.0, the [Docker image that was published by AWS Glue team](https://aws.amazon.com/blogs/big-data/developing-aws-glue-etl-jobs-locally-using-a-container/) is used while a custom image is published to [CEVO Australia's public image repository](https://gallery.ecr.aws/i0m5p1b5/glue-base) for Glue 3.0. For later versions of Glue, it is planned to publish relevant images. These can be used as a base image for Local Development.

[Visual Studio Code Remote - Containers](https://code.visualstudio.com/docs/remote/containers) extension is recommended for actual development where you can run your workspace inside a container. See [Local Development of AWS Glue with Docker and Visual Studio Code](https://cevo.com.au/post/aws-glue-local-development/) for details. This post covers Glue 1.0 and 2.0 and the associating branch is [v1.0-and-v2.0](https://github.com/cevoaustralia/glue-vscode/tree/v1.0-and-v2.0).

The source for later versions of Glue will be kept in a dedicated branch. For example, Glue 3.0 can be found in the [v3.0](https://github.com/cevoaustralia/glue-vscode/tree/v3.0) branch. See [Local Development of AWS Glue 3.0 and Later](https://cevo.com.au/post/local-development-of-aws-glue-3-0-and-later/) for details.