https://github.com/schubergphilis/terraform-aws-mcaf-glue-job
A Terraform module that creates a Glue job
https://github.com/schubergphilis/terraform-aws-mcaf-glue-job
aws aws-glue terraform terraform-module
Last synced: 6 months ago
JSON representation
A Terraform module that creates a Glue job
- Host: GitHub
- URL: https://github.com/schubergphilis/terraform-aws-mcaf-glue-job
- Owner: schubergphilis
- License: apache-2.0
- Created: 2020-01-23T11:53:47.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2025-03-17T10:42:50.000Z (7 months ago)
- Last Synced: 2025-03-17T11:37:40.084Z (7 months ago)
- Topics: aws, aws-glue, terraform, terraform-module
- Language: HCL
- Homepage: https://registry.terraform.io/modules/schubergphilis/mcaf-glue-job/aws/latest
- Size: 33.2 KB
- Stars: 0
- Watchers: 31
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
README
# terraform-aws-mcaf-glue-job
A Terraform module that creates a Glue job.
## Requirements
| Name | Version |
|------|---------|
| [terraform](#requirement\_terraform) | >= 1.3 |
| [aws](#requirement\_aws) | >= 4.0.0 |
## Providers
| Name | Version |
|------|---------|
| [aws](#provider\_aws) | >= 4.0.0 |
## Modules
| Name | Source | Version |
|------|--------|---------|
| [job\_execution\_role](#module\_job\_execution\_role) | github.com/schubergphilis/terraform-aws-mcaf-role | v0.4.0 |
## Resources
| Name | Type |
|------|------|
| [aws_cloudwatch_log_group.default](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/cloudwatch_log_group) | resource |
| [aws_glue_job.default](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/glue_job) | resource |
| [aws_glue_trigger.default](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/glue_trigger) | resource |
## Inputs
| Name | Description | Type | Default | Required |
|------|-------------|------|---------|:--------:|
| [name](#input\_name) | The name of the Glue job | `string` | n/a | yes |
| [script\_location](#input\_script\_location) | Specifies the S3 path to the script that is executed by this job | `string` | n/a | yes |
| [tags](#input\_tags) | A mapping of tags to assign to all resources | `map(string)` | n/a | yes |
| [command\_name](#input\_command\_name) | The name of the job command. Defaults to glueetl | `string` | `"glueetl"` | no |
| [connections](#input\_connections) | A list with connections for this job | `list(string)` | `[]` | no |
| [continuous\_logging](#input\_continuous\_logging) | Whether to enable continuous logging for this job |
object({
enabled = optional(bool, true)
log_group_name = optional(string, null)
}) | {
"enabled": true,
"log_group_name": null
} | no |
| [default\_arguments](#input\_default\_arguments) | A map with default arguments for this job | `map(string)` | `{}` | no |
| [glue\_version](#input\_glue\_version) | The Glue version to use | `string` | `"4.0"` | no |
| [kms\_key\_id](#input\_kms\_key\_id) | The kms key id of the AWS KMS Customer Managed Key to be used to encrypt the log data | `string` | `null` | no |
| [log\_retention\_days](#input\_log\_retention\_days) | The cloudwatch log group retention in days | `number` | `365` | no |
| [max\_capacity](#input\_max\_capacity) | The maximum number of data processing units that can be allocated | `number` | `null` | no |
| [max\_retries](#input\_max\_retries) | The maximum number of times to retry a failing job | `number` | `null` | no |
| [number\_of\_workers](#input\_number\_of\_workers) | The number of workers that are allocated when the job runs | `string` | `null` | no |
| [python\_version](#input\_python\_version) | The Python version (2, 3 or 3.9) being used to execute a Python shell job | `string` | `"3"` | no |
| [role\_arn](#input\_role\_arn) | An optional Glue execution role | `string` | `null` | no |
| [role\_policy](#input\_role\_policy) | A valid Glue IAM policy JSON document | `string` | `null` | no |
| [schedule](#input\_schedule) | A cron expression used to specify the schedule for the glue job | `string` | `null` | no |
| [schedule\_active](#input\_schedule\_active) | Whether the glue trigger should be active | `bool` | `true` | no |
| [security\_configuration](#input\_security\_configuration) | The name of the Security Configuration to be associated with the job | `string` | `null` | no |
| [timeout](#input\_timeout) | The job timeout in minutes | `number` | `2880` | no |
| [trigger\_type](#input\_trigger\_type) | The type ('ON\_DEMAND' or 'SCHEDULED') of the trigger | `string` | `null` | no |
| [worker\_type](#input\_worker\_type) | The type ('Standard' or 'G.1X' or 'G.2X') of predefined worker that is allocated when the job runs | `string` | `null` | no |
## Outputs
| Name | Description |
|------|-------------|
| [arn](#output\_arn) | ARN of the Glue job |
| [id](#output\_id) | The Glue job name |