Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/devatherock/utilities
Utility scripts to perform common, repetitive tasks
https://github.com/devatherock/utilities
consumer google groovy kafka repetitive-tasks
Last synced: about 2 months ago
JSON representation
Utility scripts to perform common, repetitive tasks
- Host: GitHub
- URL: https://github.com/devatherock/utilities
- Owner: devatherock
- Created: 2020-03-01T16:27:57.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2024-09-24T10:43:16.000Z (3 months ago)
- Last Synced: 2024-10-31T10:51:30.943Z (about 2 months ago)
- Topics: consumer, google, groovy, kafka, repetitive-tasks
- Language: Groovy
- Homepage:
- Size: 187 KB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
Awesome Lists containing this project
README
# utilities
Utility scripts to perform common, repetitive tasks
## Google
### GoogleAccessToken.groovy
- To generate an access token for Firebase cloud messaging
```
groovy GoogleAccessToken.groovy -c "path/to/service-accounts.json" -s "https://www.googleapis.com/auth/firebase.messaging"
```
## Github
When using these scripts with github enterprise, an API URL including the `/api/v3` path would need to be supplied
### AddLabelToIssues.groovy
Adds a supplied label to issues with a specific string in title
- To use with a repo in an org
```shell
groovy github/AddLabelToIssues.groovy -t -n -o -r \
-s -l
```
- To use with a repo under a username
```shell
groovy github/AddLabelToIssues.groovy -t -n -r -s -l
```
### CloseIssues.groovy
Closes issues that have a specific label
- To use with a repo in an org
```shell
groovy github/CloseIssues.groovy -t -n -o -r -l
```
- To use with a repo under a username
```shell
groovy github/CloseIssues.groovy -t -n -r -l
```
### CreateTag.groovy
Creates a git tag with commit comments as message and pushes to remote. Needs to be executed with the git repo as the working directory
**Sample:**
```shell
groovy /absolute/path/to/utilities/scripts/Groovy/github/CreateTag.groovy
```
**Parameters:**
```
--help Displays script usage instructions
-nd,--not-dry-run Flag to test changes without committing to git
```
## Other scripts
### Base64.groovy
- To encode a string
```
groovy Base64.groovy -i hello
```
- To encode contents of a file
```
groovy Base64.groovy -f /path/to/file
```
- To decode a string
```
groovy Base64.groovy -D -i aGVsbG8=
```
### Deduplicater.groovy
```
groovy file/Deduplicater.groovy -i /path/to/input/file -o /path/to/output/file
```
### CsvQuery.groovy
Queries a CSV file and outputs the results to console or to a file
**Sample:**
```
groovy CsvQuery.groovy -i /path/to/input.csv -q /path/to/query.yml -o /path/to/output.csv
```
**Parameters:**
```
-i,--input Input CSV file
-o,--output Output CSV file
-q,--query Yaml file containing the query
-t,--threads Number of threads to use for processing
```
**query.yml sample:**
```yaml
select:
- full_name
- birthday
- age
- country
reductions:
- distinct
transformations:
- name: concat
fields:
- full_name
parameters:
right: ';'
- name: convert_date
fields:
- birthday
parameters:
input_format: MM/dd/yyyy
output_format: yyyy-MM-dd
where:
operator: and
filters:
- operator: or
filters:
- field: first_name
condition: in
values:
- John
- Jack
- field: last_name
condition: in
values:
- Smith
- field: last_name
condition: nin
values:
- Snow
- field: country
condition: like
values:
- ^Canada$|^Mexico$
```
### BackupCreator.groovy
Backs up specific files/folders within a source folder into a target folder. Files/folders to be backed up need to be specified in a config file
**Sample:**
```
groovy BackupCreator.groovy -s /path/to/source -t /path/to/target -c backup-config.yml
```
**Parameters:**
```
-c,--config File containing the config to use for the backup
-l,--log-level Log level to use. Defaults to INFO
-s,--source-path Path from which to backup the files
-t,--target-path Path to which to backup the files
```
**Config file sample:**
```yaml
inclusions:
- .gradle/gradle.properties
- .circleci/cli.yml
- .docker/config.json
- .jenkins/init.groovy.d
- .jenkins/secrets
- .kube/config
- .minikube/ca.crt
- .minikube/certs
- .minikube/config
- .minikube/machines
- .minikube/profiles
- .ssh
- .gitconfig
- .bashrc
- .bash_history
- .dbshell
- .netrc
- .zshrc
```