Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/google/starthinker

Reference framework for building data workflows provided by Google. Accelerates authentication, logging, scheduling, and deployment of solutions using GCP. To borrow a tagline.. "The framework for professionals with deadlines."
https://github.com/google/starthinker

airflow app-engine automation bigquery cloud-functions cm360 colab-notebook data-science django dv360 google-ads google-analytics logger python scheduler ui workflows

Last synced: 4 months ago
JSON representation

Host: GitHub
URL: https://github.com/google/starthinker
Owner: google
License: apache-2.0
Archived: true
Created: 2018-02-26T19:15:09.000Z (almost 7 years ago)
Default Branch: master
Last Pushed: 2024-04-25T17:43:41.000Z (9 months ago)
Last Synced: 2024-09-25T23:03:23.106Z (4 months ago)
Topics: airflow, app-engine, automation, bigquery, cloud-functions, cm360, colab-notebook, data-science, django, dv360, google-ads, google-analytics, logger, python, scheduler, ui, workflows
Language: Python
Homepage:
Size: 30.7 MB
Stars: 164
Watchers: 21
Forks: 49
Open Issues: 22
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Authors: AUTHORS

Awesome Lists containing this project

README

        **End of Google Support:** The StarThinker project will no longer receive new

solution contributions from the Google team.  Please read the full

[StarThinker Open Source Support Ends At Google](https://medium.com/starthinker/starthinker-open-source-support-ends-at-google-a7041f2b0970)

article for more details.

**Disclaimer:** This is not an officially supported Google product. It is a reference implementation.

There is absolutely NO WARRANTY provided for using this code. **The code is Apache Licensed

and CAN BE fully modified, white labeled, and disassembled by your team.**

# Scaled Automation Application For Ad Operations Teams

At gTech, we believe every ad operations team should be faster, nimbler, and able to use all their data sources

to drive client impact. To that end, we've created StarThinker, a simple and intuitive web UI that allows users

to create, edit, run, and schedule data pipelines consisting of data transfer and data processing jobs.

StarThinker deploys on Google Cloud in minutes without engineering or coding required. [Read the WhitePaper](tutorials/images/StarThinker_Whitepaper.pdf).

![StarThinker Screen Shots](tutorials/images/splash.png)

## For Ad Operations Teams...

Sheets only go so far, with a StarThinker running, the ad operations team can operate on larger data sets, scale

solutions across clients fast, and even automate campaign controls. All using a drag and drop UI.

- Start building solutions immediately by leveraging [dozens of existing workflow tasks](https://google.github.io/starthinker/).

- Scale solutions across clients [without coding](https://google.github.io/starthinker/help/#help_recipe).

- Pull repository [updates anytime](tutorials/deploy_enterprise.md).

- Empower your team with simple [UI documentation](https://google.github.io/starthinker/help/).

- Bill [clients for data usage](https://google.github.io/starthinker/help/#help_setup).

- Monitor all workflows from [one UI](https://google.github.io/starthinker/help/#help_status).

- Build enterprise solutions in hours not weeks.

Steps From [Tutorial](tutorials/README.md):

- [ ] [Deploy UI on GCP.](tutorials/deploy_enterprise.md)

- [ ] [Configure a GCP Project for client data warehousing.](https://google.github.io/starthinker/help/#help_setup)

- [ ] [Run a recipe workflow.](https://google.github.io/starthinker/help/#help_recipe)

## For Ad Engineering Teams....

No one enjoys building boiler plate code, it's slow, error prone, tedious, and honestly drains the energy out of

any project. At best StarThinker lets you skip all that, at worst it's working code you can strip down for your needs.

Take what you need.

- Out of the box [authentication](tutorials/deploy_enterprise.md).

- Out of the box [scaling](tutorials/architecture.md).

- Out of the box [logging](tutorials/logging.md).

- Out of the box [testing](tutorials/testing.md).

- All Apache Licensed to give you a head start and complete development control.

Steps From [Tutorial](tutorials/README.md):

- [ ] [Deploy developer.](tutorials/deploy_developer.md)

- [ ] [Run hello world.](tutorials/running.md)

- [ ] [Develop a new task or recipe workflow.](tutorials/README.md#development)

- [ ] [Optional: Get your own private copy of the code.](CONTRIBUTING.md)

- [ ] [Optional: Make contributions to an open source Google project.](CONTRIBUTING.md)

## Where Do I Get Help?

- The [StarThinker Solution Gallery](https://google.github.io/starthinker/) lists all the existing tasks and authors.

- Read the [Tutorials](tutorials/README.md).

- Review the [FAQ](tutorials/faq.md).

- Read the [Contributing guidelines](CONTRIBUTING.md).

- Ask for help (no SLA, not guaranteed): [email protected]

## Authors

- Paul Kenjora ([email protected]) - Engineering Project Lead - [LinkedIn](https://www.linkedin.com/in/pkenjora/)

- Mauricio Desiderio ([email protected]) - Software Engineer - [LinkedIn](https://www.linkedin.com/in/mauricio-desiderio-3482054/)

- John Terwilleger ([email protected]) - Software Engineer - [LinkedIn](https://www.linkedin.com/in/johnterwilleger/)

Additional contributors to individual handlers and recipes are listed in each file.

---

© 2020 Google LLC - Apache License, Version 2.0