{"id":13830486,"url":"https://github.com/google/starthinker","last_synced_at":"2025-10-04T19:31:41.940Z","repository":{"id":33910687,"uuid":"123017995","full_name":"google/starthinker","owner":"google","description":"Reference framework for building data workflows provided by Google.  Accelerates authentication, logging, scheduling, and deployment of solutions using GCP.  To borrow a tagline.. \"The framework for professionals with deadlines.\"","archived":true,"fork":false,"pushed_at":"2024-04-25T17:43:41.000Z","size":32152,"stargazers_count":164,"open_issues_count":22,"forks_count":49,"subscribers_count":21,"default_branch":"master","last_synced_at":"2024-09-25T23:03:23.106Z","etag":null,"topics":["airflow","app-engine","automation","bigquery","cloud-functions","cm360","colab-notebook","data-science","django","dv360","google-ads","google-analytics","logger","python","scheduler","ui","workflows"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/google.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":"AUTHORS","dei":null}},"created_at":"2018-02-26T19:15:09.000Z","updated_at":"2024-08-21T07:06:23.000Z","dependencies_parsed_at":"2024-03-06T23:45:44.908Z","dependency_job_id":null,"html_url":"https://github.com/google/starthinker","commit_stats":{"total_commits":718,"total_committers":12,"mean_commits":"59.833333333333336","dds":"0.34122562674094703","last_synced_commit":"0d4d06e4e8b6fd943c8cbde8e686992e515cbb94"},"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/google%2Fstarthinker","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/google%2Fstarthinker/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/google%2Fstarthinker/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/google%2Fstarthinker/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/google","download_url":"https://codeload.github.com/google/starthinker/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":219876757,"owners_count":16554786,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["airflow","app-engine","automation","bigquery","cloud-functions","cm360","colab-notebook","data-science","django","dv360","google-ads","google-analytics","logger","python","scheduler","ui","workflows"],"created_at":"2024-08-04T10:01:00.856Z","updated_at":"2025-10-04T19:31:36.856Z","avatar_url":"https://github.com/google.png","language":"Python","funding_links":[],"categories":["Python","Frameworks"],"sub_categories":[],"readme":"**End of Google Support:** The StarThinker project will no longer receive new\nsolution contributions from the Google team.  Please read the full\n[StarThinker Open Source Support Ends At Google](https://medium.com/starthinker/starthinker-open-source-support-ends-at-google-a7041f2b0970)\narticle for more details.\n\n**Disclaimer:** This is not an officially supported Google product. It is a reference implementation.\nThere is absolutely NO WARRANTY provided for using this code. **The code is Apache Licensed\nand CAN BE fully modified, white labeled, and disassembled by your team.**\n\n# Scaled Automation Application For Ad Operations Teams\n\nAt gTech, we believe every ad operations team should be faster, nimbler, and able to use all their data sources\nto drive client impact. To that end, we've created StarThinker, a simple and intuitive web UI that allows users\nto create, edit, run, and schedule data pipelines consisting of data transfer and data processing jobs.\nStarThinker deploys on Google Cloud in minutes without engineering or coding required. [Read the WhitePaper](tutorials/images/StarThinker_Whitepaper.pdf).\n\n![StarThinker Screen Shots](tutorials/images/splash.png)\n\n\n## For Ad Operations Teams...\n\nSheets only go so far, with a StarThinker running, the ad operations team can operate on larger data sets, scale\nsolutions across clients fast, and even automate campaign controls. All using a drag and drop UI.\n\n- Start building solutions immediately by leveraging [dozens of existing workflow tasks](https://google.github.io/starthinker/).\n- Scale solutions across clients [without coding](https://google.github.io/starthinker/help/#help_recipe).\n- Pull repository [updates anytime](tutorials/deploy_enterprise.md).\n- Empower your team with simple [UI documentation](https://google.github.io/starthinker/help/).\n- Bill [clients for data usage](https://google.github.io/starthinker/help/#help_setup).\n- Monitor all workflows from [one UI](https://google.github.io/starthinker/help/#help_status).\n- Build enterprise solutions in hours not weeks.\n\nSteps From [Tutorial](tutorials/README.md):\n- [ ] [Deploy UI on GCP.](tutorials/deploy_enterprise.md)\n- [ ] [Configure a GCP Project for client data warehousing.](https://google.github.io/starthinker/help/#help_setup)\n- [ ] [Run a recipe workflow.](https://google.github.io/starthinker/help/#help_recipe)\n\n## For Ad Engineering Teams....\n\nNo one enjoys building boiler plate code, it's slow, error prone, tedious, and honestly drains the energy out of\nany project. At best StarThinker lets you skip all that, at worst it's working code you can strip down for your needs.\nTake what you need.\n\n- Out of the box [authentication](tutorials/deploy_enterprise.md).\n- Out of the box [scaling](tutorials/architecture.md).\n- Out of the box [logging](tutorials/logging.md).\n- Out of the box [testing](tutorials/testing.md).\n- All Apache Licensed to give you a head start and complete development control.\n\nSteps From [Tutorial](tutorials/README.md):\n- [ ] [Deploy developer.](tutorials/deploy_developer.md)\n- [ ] [Run hello world.](tutorials/running.md)\n- [ ] [Develop a new task or recipe workflow.](tutorials/README.md#development)\n- [ ] [Optional: Get your own private copy of the code.](CONTRIBUTING.md)\n- [ ] [Optional: Make contributions to an open source Google project.](CONTRIBUTING.md)\n\n## Where Do I Get Help?\n\n- The [StarThinker Solution Gallery](https://google.github.io/starthinker/) lists all the existing tasks and authors.\n- Read the [Tutorials](tutorials/README.md).\n- Review the [FAQ](tutorials/faq.md).\n- Read the [Contributing guidelines](CONTRIBUTING.md).\n- Ask for help (no SLA, not guaranteed): starthinker-help@google.com\n\n## Authors\n\n- Paul Kenjora (kenjora@google.com) - Engineering Project Lead - [LinkedIn](https://www.linkedin.com/in/pkenjora/)\n- Mauricio Desiderio (mauriciod@google.com) - Software Engineer - [LinkedIn](https://www.linkedin.com/in/mauricio-desiderio-3482054/)\n- John Terwilleger (terwilleger@google.com) - Software Engineer - [LinkedIn](https://www.linkedin.com/in/johnterwilleger/)\n\nAdditional contributors to individual handlers and recipes are listed in each file.\n\n---\n\u0026copy; 2020 Google LLC - Apache License, Version 2.0\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgoogle%2Fstarthinker","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgoogle%2Fstarthinker","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgoogle%2Fstarthinker/lists"}