{"id":18810397,"url":"https://github.com/absaoss/spline","last_synced_at":"2025-05-16T05:05:02.174Z","repository":{"id":20842864,"uuid":"92813268","full_name":"AbsaOSS/spline","owner":"AbsaOSS","description":"Data Lineage Tracking And Visualization Solution","archived":false,"fork":false,"pushed_at":"2025-05-05T15:06:52.000Z","size":8760,"stargazers_count":624,"open_issues_count":44,"forks_count":157,"subscribers_count":38,"default_branch":"develop","last_synced_at":"2025-05-16T05:05:00.617Z","etag":null,"topics":["bigdata","hadoop","lineage","scala","spark","tracking","visualization"],"latest_commit_sha":null,"homepage":"https://absaoss.github.io/spline/","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/AbsaOSS.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2017-05-30T08:38:00.000Z","updated_at":"2025-05-15T05:17:58.000Z","dependencies_parsed_at":"2023-12-16T21:14:58.201Z","dependency_job_id":null,"html_url":"https://github.com/AbsaOSS/spline","commit_stats":{"total_commits":1088,"total_committers":60,"mean_commits":"18.133333333333333","dds":0.6553308823529411,"last_synced_commit":"fce1edfb4b9fbafa1b36f18efc4f9074ab7500cd"},"previous_names":[],"tags_count":40,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AbsaOSS%2Fspline","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AbsaOSS%2Fspline/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AbsaOSS%2Fspline/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AbsaOSS%2Fspline/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/AbsaOSS","download_url":"https://codeload.github.com/AbsaOSS/spline/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254471061,"owners_count":22076585,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bigdata","hadoop","lineage","scala","spark","tracking","visualization"],"created_at":"2024-11-07T23:20:05.092Z","updated_at":"2025-05-16T05:05:02.153Z","avatar_url":"https://github.com/AbsaOSS.png","language":"Scala","readme":"[![Maven Central](https://maven-badges.herokuapp.com/maven-central/za.co.absa.spline/parent-pom/badge.svg)](https://search.maven.org/search?q=g:za.co.absa.spline)\n[![TeamCity build (develop)](https://teamcity.jetbrains.com/app/rest/builds/aggregated/strob:%28locator:%28buildType:%28id:OpenSourceProjects_AbsaOSSSpline_AutomaticBuildsWithTests_Spark24%29,branch:develop%29%29/statusIcon.svg)](https://teamcity.jetbrains.com/viewType.html?buildTypeId=OpenSourceProjects_AbsaOSSSpline_AutomaticBuildsWithTests_Spark24\u0026branch=develop\u0026tab=buildTypeStatusDiv)\n[![Codacy Badge](https://api.codacy.com/project/badge/Grade/9b7ba650a3874c2888dba2d25fa73d88)](https://app.codacy.com/gh/AbsaOSS/spline?utm_source=github.com\u0026utm_medium=referral\u0026utm_content=AbsaOSS/spline\u0026utm_campaign=Badge_Grade_Settings)\n[![Sonarcloud Status](https://sonarcloud.io/api/project_badges/measure?project=AbsaOSS_spline\u0026metric=alert_status)](https://sonarcloud.io/dashboard?id=AbsaOSS_spline)\n[![SonarCloud Maintainability](https://sonarcloud.io/api/project_badges/measure?project=AbsaOSS_spline\u0026metric=sqale_rating)](https://sonarcloud.io/dashboard?id=AbsaOSS_spline)\n[![SonarCloud Reliability](https://sonarcloud.io/api/project_badges/measure?project=AbsaOSS_spline\u0026metric=reliability_rating)](https://sonarcloud.io/dashboard?id=AbsaOSS_spline)\n[![SonarCloud Security](https://sonarcloud.io/api/project_badges/measure?project=AbsaOSS_spline\u0026metric=security_rating)](https://sonarcloud.io/dashboard?id=AbsaOSS_spline)\n[![Docker Pulls](https://badgen.net/docker/pulls/absaoss/spline-rest-server?icon=docker\u0026label=pulls)](https://hub.docker.com/r/absaoss/spline-rest-server/)\n\nSpline — an open-source data lineage tracking solution for data processing frameworks like Apache Spark and others\n---\n\n[![Watch the video](https://user-images.githubusercontent.com/795479/193536311-d6ce6ed8-36ca-43fa-addb-4f9dcf59e974.png)](https://youtu.be/Bz_Ml6pNH2E)\n\n### Documentation\n\nSee [Spline GitHub Pages](https://absaoss.github.io/spline/)\n\n### Getting started\n\nSee [Getting Started](https://github.com/AbsaOSS/spline-getting-started)\n\n### Build project\n\n```shell\nmvn install\n```\n\n### Build Docker containers\n\nSee [Building Docker](https://github.com/AbsaOSS/spline-getting-started/blob/main/building-docker.md)\n\n### Building from source code\n\n1. Install Java 11 and Maven 3.6 or above\n2. Run Maven build\n\n```shell\n# this will produce standard Java artifacts (JAR and WAR files)\nmvn install\n\n# or, if you also want Docker images use this command\nmvn install -Ddocker -Ddockerfile.repositoryUrl=my\n```\n\n### Running Spline server\n\nhttps://absaoss.github.io/spline/#step-by-step\n\n### Versioning strategy\n\n##### Application version\n\nSpline server follows _Semantic Versioning_[^1] principles. The _Public API_ in terms of _Semantic Versioning_ is defined as a combination of API of\nall Spline modules, including Producer API (REST and Kafka), Consumer REST API, as well as a set of all command-line interfaces (e.g. Admin CLI).\nAny incompatible change introduced in any of those APIs or CLIs will be accompanied by incrementing the _major version_ component.\n\n##### Database schema version\n\nThe database schema version number does **not** follow the _Semantic Versioning_ principles, it does not directly correlate with the application\nversion and can only be compared to itself. The only relation between the database schema version number and the application version is that the\nformer indicates in which application version the given database schema was introduced.\n\n[^1]: Semantic Versioning - https://semver.org/\n\n### How to measure code coverage\n```shell\n./mvn verify -Dcode-coverage\n```\nIf module contains measurable data the code coverage report will be generated on path:\n```\n{local-path}\\spline\\{module}\\target\\site\\jacoco\n```\n\n---\n\n    Copyright 2019 ABSA Group Limited\n\n    you may not use this file except in compliance with the License.\n    You may obtain a copy of the License at\n\n        http://www.apache.org/licenses/LICENSE-2.0\n\n    Unless required by applicable law or agreed to in writing, software\n    distributed under the License is distributed on an \"AS IS\" BASIS,\n    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n    See the License for the specific language governing permissions and\n    limitations under the License.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fabsaoss%2Fspline","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fabsaoss%2Fspline","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fabsaoss%2Fspline/lists"}