{"id":23872149,"url":"https://github.com/xiaoyao9184/kettle-project-toolbox","last_synced_at":"2025-09-11T18:37:04.276Z","repository":{"id":47117581,"uuid":"153750496","full_name":"xiaoyao9184/Kettle-Project-Toolbox","owner":"xiaoyao9184","description":"Kettle Project CI/CD Solution","archived":false,"fork":false,"pushed_at":"2023-10-13T02:45:28.000Z","size":2883,"stargazers_count":2,"open_issues_count":0,"forks_count":5,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-03-28T04:41:41.609Z","etag":null,"topics":["cd","ci","jenkins","kettle","kitchen","pan"],"latest_commit_sha":null,"homepage":"","language":"Batchfile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/xiaoyao9184.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-10-19T08:24:54.000Z","updated_at":"2024-05-16T04:07:39.000Z","dependencies_parsed_at":"2025-01-03T15:46:25.779Z","dependency_job_id":null,"html_url":"https://github.com/xiaoyao9184/Kettle-Project-Toolbox","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xiaoyao9184%2FKettle-Project-Toolbox","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xiaoyao9184%2FKettle-Project-Toolbox/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xiaoyao9184%2FKettle-Project-Toolbox/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xiaoyao9184%2FKettle-Project-Toolbox/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/xiaoyao9184","download_url":"https://codeload.github.com/xiaoyao9184/Kettle-Project-Toolbox/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248910799,"owners_count":21181975,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cd","ci","jenkins","kettle","kitchen","pan"],"created_at":"2025-01-03T15:30:28.803Z","updated_at":"2025-04-14T15:52:10.410Z","avatar_url":"https://github.com/xiaoyao9184.png","language":"Batchfile","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Kettle-Project-Toolbox\r\n\r\n[Chinese](README_ZH.md)\r\n\r\nThe toolbox commonly used in the kettle project are gathered.\r\nThis includes running scripts, deployment scripts, and repository templates.\r\n\r\nIn general, we need to use in the background PDI, this time it will not run Spoon, but run Pan and Kitchen, and for complex ETL, a common set of scheduling script can simplify development.\r\n\r\nHere I offer a set of toolbox script has been used in the actual project.\r\n\r\n\r\n\r\n\r\n# Use\r\n\r\n[wiki](https://github.com/xiaoyao9184/Kettle-Project-Toolbox/wiki)\r\n\r\n\r\n\r\n\r\n# Compatibility\r\n\r\n\r\n| Version | Supported | Why |\r\n|:-----:|:-----:|:-----:|\r\n| pdi-ce-7.0.0.0-25 | Yes | Develop on this |\r\n| pdi-ce-7.1.0.0-12 | Yes | Test default flow directory |\r\n| pdi-ce-8.0.0.0-28 | Yes | Test default flow directory |\r\n| pdi-ce-8.1.0.0-365 | Yes | Test default flow directory |\r\n| pdi-ce-8.2.0.0-342 | Yes | Test default flow directory |\r\n| pdi-ce-8.3.0.0-371 | Yes | Test default flow directory |\r\n| pdi-ce-9.0.0.0-423 | Yes | Test default flow directory |\r\n| pdi-ce-9.1.0.0-324 | Yes | Test default flow directory |\r\n\r\n## compatibility test log\r\n\r\n\r\n### pdi-ce-9.1.0.0-324\r\n\r\nnot real test\r\n\r\n\r\n### pdi-ce-9.0.0.0-423\r\n\r\nnot real test\r\n\r\n\r\n### pdi-ce-8.3.0.0-371\r\n\r\nnot real test\r\n\r\n\r\n### pdi-ce-8.2.0.0-342\r\n\r\nnot real test\r\n\r\n\r\n### pdi-ce-8.1.0.0-365\r\n\r\nSet variable with **valid in the root job** in steps `Set Variables` and `Modified Java Script Value` fail,\r\ncant read it form other transformation,\r\ni think variable must replace by parameter,\r\nand especially at `Transformation (job entry)`,\r\nmaybe it cant use static characters mixed with variables, or for the following reasons.\r\n\r\nNeed to explicitly declare that the parent variable is passed to the subset job. and it work.\r\n\r\n\r\n### pdi-ce-8.0.0.0-28\r\n\r\nNo problem found\r\n\r\n\r\n### pdi-ce-7.1.0.0-12\r\n\r\nSince 7.1 changed the relative repository selection window, \r\nsuch as job items: Job (Job Entry), Transformation (Job Entry),\r\ntransformation steps: Simple Mapping, Mapping, etc. \r\nall omit the original path filling box, merged into one text box to fill in the path + name,\r\nHowever, this text box is still two attributes and will be split into path + name according to the last ‘/’. \r\nUnlike 7.0, the name attribute does not support include path symbol!\r\n\r\nBut, now it will support it!\r\n\r\n\r\n### Karaf Folder\r\n\r\nCant change Karaf folder without delete caches folder in `data-integration/system/karaf/caches`\r\n\r\nAlway create caches in this folder, no matter modify of  `data-integration/system/karaf/instances/instance.properties`\r\n\r\n[Wrong answer](https://forums.pentaho.com/threads/207678-Changing-Pentaho-Folder-name-and-Karaf/)\r\n\r\nAnd i think caches files contain own positioning,\r\nif created via a symbolic link will be accessed via a symbolic link path on windows use **Junction**\r\n\r\n\r\n### Unix folder link\r\n\r\nunix not support folder hard link, and symbolic link for `data-integration/` path \r\nnot work with current path(./) in KETTLE_HOME use relative repository path.\r\n\r\nSo use hard link file and copy folder same time for replace folder link.\r\n\r\n\r\n\r\n\r\n# Use with jenkins\r\n\r\nAll scripts can run on jenkins\r\nThe JAVA_HOME environment variable must be set.\r\nOtherwise kitchen and pan will return the error exit code, and jenkins will error.\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fxiaoyao9184%2Fkettle-project-toolbox","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fxiaoyao9184%2Fkettle-project-toolbox","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fxiaoyao9184%2Fkettle-project-toolbox/lists"}