{"id":14958713,"url":"https://github.com/tensorflow/tfx-bsl","last_synced_at":"2025-05-15T21:04:05.311Z","repository":{"id":40364100,"uuid":"202422449","full_name":"tensorflow/tfx-bsl","owner":"tensorflow","description":"Common code for TFX","archived":false,"fork":false,"pushed_at":"2025-05-08T00:00:25.000Z","size":1582,"stargazers_count":64,"open_issues_count":24,"forks_count":62,"subscribers_count":10,"default_branch":"master","last_synced_at":"2025-05-15T00:14:22.209Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tensorflow.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2019-08-14T20:37:44.000Z","updated_at":"2025-05-08T00:00:28.000Z","dependencies_parsed_at":"2023-11-16T23:54:42.662Z","dependency_job_id":"c96acacc-6f66-46d2-b244-9fd26c579017","html_url":"https://github.com/tensorflow/tfx-bsl","commit_stats":{"total_commits":573,"total_committers":10,"mean_commits":57.3,"dds":"0.43630017452006986","last_synced_commit":"635781b2834ed1ed13c4e8a334d0b54691823559"},"previous_names":[],"tags_count":45,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tensorflow%2Ftfx-bsl","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tensorflow%2Ftfx-bsl/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tensorflow%2Ftfx-bsl/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tensorflow%2Ftfx-bsl/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tensorflow","download_url":"https://codeload.github.com/tensorflow/tfx-bsl/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254422754,"owners_count":22068678,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-09-24T13:18:05.154Z","updated_at":"2025-05-15T21:04:05.283Z","avatar_url":"https://github.com/tensorflow.png","language":"Python","readme":"# TFX Basic Shared Libraries\n\n[![Python](https://img.shields.io/badge/python%7C3.9%7C3.10%7C3.11-blue)](https://github.com/tensorflow/tfx-bsl)\n[![PyPI](https://badge.fury.io/py/tfx-bsl.svg)](https://badge.fury.io/py/tfx-bsl)\n\nTFX Basic Shared Libraries (`tfx_bsl`) contains libraries shared by many\n[TensorFlow eXtended (TFX)](https://www.tensorflow.org/tfx) components.\n\n__Only symbols exported by sub-modules under `tfx_bsl/public` are intended for\ndirect use by TFX users__, including by standalone TFX library (e.g. TFDV, TFMA,\nTFT) users, TFX pipeline authors and TFX component authors. Those APIs will\nbecome stable and follow semantic versioning once `tfx_bsl` goes beyond `1.0`.\n\nAPIs under other directories should be considered internal to TFX\n(and therefore there is no backward or forward compatibility guarantee for\nthem).\n\nEach minor version of a TFX library or TFX itself, if it needs to\ndepend on `tfx_bsl`, will depend on a specific minor version of it (e.g.\n`tensorflow_data_validation` 0.14.\\* will depend on, and only work with,\n`tfx_bsl` 0.14.\\*)\n\n## Installing from PyPI\n\n`tfx_bsl` is available as a [PyPI package](https://pypi.org/project/tfx-bsl/).\n\n```bash\npip install tfx-bsl\n```\n\n### Nightly Packages\n\nTFX-BSL also hosts nightly packages at https://pypi-nightly.tensorflow.org on\nGoogle Cloud. To install the latest nightly package, please use the following\ncommand:\n\n```bash\npip install --extra-index-url https://pypi-nightly.tensorflow.org/simple tfx-bsl\n```\n\nThis will install the nightly packages for the major dependencies of TFX-BSL\nsuch as TensorFlow Metadata (TFMD).\n\nHowever it is a dependency of many TFX components and usually as a user you\ndon't need to install it directly.\n\n## Build with Docker\n\nIf you want to build a TFX component from the master branch, past the latest\nrelease, you may also have to build the latest `tfx_bsl`, as that TFX component\nmight have depended on new features introduced past the latest `tfx_bsl`\nrelease.\n\nBuilding from Docker is the recommended way to build `tfx_bsl` under Linux,\nand is continuously tested at Google.\n\n### 1. Install Docker\n\nPlease first install [`docker`](https://docs.docker.com/install/) and\n[`docker-compose`](https://docs.docker.com/compose/install/) by following the\ndirections.\n\n### 2. Clone the `tfx_bsl` repository\n\n```shell\ngit clone https://github.com/tensorflow/tfx-bsl\ncd tfx-bsl\n```\n\nNote that these instructions will install the latest master branch of `tfx-bsl`.\nIf you want to install a specific branch (such as a release branch), pass\n`-b \u003cbranchname\u003e` to the `git clone` command.\n\n### 3. Build the pip package\n\nThen, run the following at the project root:\n\n```bash\nsudo docker-compose build manylinux2010\nsudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010\n```\nwhere `PYTHON_VERSION` is one of `{39}`.\n\nA wheel will be produced under `dist/`.\n\n### 4. Install the pip package\n\n```shell\npip install dist/*.whl\n```\n\n## Build from source\n\n### 1. Prerequisites\n\n#### Install NumPy\n\nIf NumPy is not installed on your system, install it now by following [these\ndirections](https://www.scipy.org/scipylib/download.html).\n\n#### Install Bazel\n\nIf Bazel is not installed on your system, install it now by following [these\ndirections](https://bazel.build/versions/master/docs/install.html).\n\n\n### 2. Clone the `tfx_bsl` repository\n\n```shell\ngit clone https://github.com/tensorflow/tfx-bsl\ncd tfx-bsl\n```\n\nNote that these instructions will install the latest master branch of `tfx_bsl`\nIf you want to install a specific branch (such as a release branch),\npass `-b \u003cbranchname\u003e` to the `git clone` command.\n\n### 3. Build the pip package\n\n`tfx_bsl` wheel is Python version dependent -- to build the pip package that\nworks for a specific Python version, use that Python binary to run:\n```shell\npython setup.py bdist_wheel\n```\n\nYou can find the generated `.whl` file in the `dist` subdirectory.\n\n### 4. Install the pip package\n\n```shell\npip install dist/*.whl\n```\n\n## Supported platforms\n\n`tfx_bsl` is tested on the following 64-bit operating systems:\n\n  * macOS 10.12.6 (Sierra) or later.\n  * Ubuntu 20.04 or later.\n\n## Compatible versions\n\nThe following table is the `tfx_bsl` package versions that are compatible with\neach other. This is determined by our testing framework, but other *untested*\ncombinations may also work.\n\ntfx-bsl                                                                         | apache-beam[gcp] | pyarrow  | tensorflow        | tensorflow-metadata | tensorflow-serving-api |\n------------------------------------------------------------------------------- | -----------------| ---------|-------------------|---------------------|------------------------|\n[GitHub master](https://github.com/tensorflow/tfx-bsl/blob/master/RELEASE.md)   | 2.59.0           | 10.0.1   | nightly (2.x)     | 1.16.1              | 2.16.1\n[1.16.1](https://github.com/tensorflow/tfx-bsl/blob/v1.16.1/RELEASE.md)         | 2.59.0           | 10.0.1   | 2.16              | 1.16.1              | 2.16.1                |\n[1.16.0](https://github.com/tensorflow/tfx-bsl/blob/v1.16.0/RELEASE.md)         | 2.59.0           | 10.0.1   | 2.16              | 1.16.0              | 2.16.1\n[1.15.1](https://github.com/tensorflow/tfx-bsl/blob/v1.15.1/RELEASE.md)         | 2.47.0           | 10.0.0   | 2.15              | 1.15.0              | 2.15.1                 |\n[1.15.0](https://github.com/tensorflow/tfx-bsl/blob/v1.15.0/RELEASE.md)         | 2.47.0           | 10.0.0   | 2.15              | 1.15.0              | 2.15.1                 |\n[1.14.0](https://github.com/tensorflow/tfx-bsl/blob/v1.14.0/RELEASE.md)         | 2.47.0           | 10.0.0   | 2.13              | 1.14.0              | 2.13.0                 |\n[1.13.0](https://github.com/tensorflow/tfx-bsl/blob/v1.13.0/RELEASE.md)         | 2.40.0           | 6.0.0    | 2.12              | 1.13.1              | 2.9.0                  |\n[1.12.0](https://github.com/tensorflow/tfx-bsl/blob/v1.12.0/RELEASE.md)         | 2.40.0           | 6.0.0    | 2.11              | 1.12.0              | 2.9.0                  |\n[1.11.0](https://github.com/tensorflow/tfx-bsl/blob/v1.11.0/RELEASE.md)         | 2.40.0           | 6.0.0    | 1.15 / 2.10       | 1.11.0              | 2.9.0                  |\n[1.10.0](https://github.com/tensorflow/tfx-bsl/blob/v1.10.0/RELEASE.md)         | 2.40.0           | 6.0.0    | 1.15 / 2.9        | 1.10.0              | 2.9.0                  |\n[1.9.0](https://github.com/tensorflow/tfx-bsl/blob/v1.9.0/RELEASE.md)           | 2.38.0           | 5.0.0    | 1.15 / 2.9        | 1.9.0               | 2.9.0                  |\n[1.8.0](https://github.com/tensorflow/tfx-bsl/blob/v1.8.0/RELEASE.md)           | 2.38.0           | 5.0.0    | 1.15 / 2.8        | 1.8.0               | 2.8.0                  |\n[1.7.0](https://github.com/tensorflow/tfx-bsl/blob/v1.7.0/RELEASE.md)           | 2.36.0           | 5.0.0    | 1.15 / 2.8        | 1.7.0               | 2.8.0                  |\n[1.6.0](https://github.com/tensorflow/tfx-bsl/blob/v1.6.0/RELEASE.md)           | 2.35.0           | 5.0.0    | 1.15 / 2.7        | 1.6.0               | 2.7.0                  |\n[1.5.0](https://github.com/tensorflow/tfx-bsl/blob/v1.4.0/RELEASE.md)           | 2.34.0           | 5.0.0    | 1.15 / 2.7        | 1.5.0               | 2.7.0                  |\n[1.4.0](https://github.com/tensorflow/tfx-bsl/blob/v1.4.0/RELEASE.md)           | 2.31.0           | 5.0.0    | 1.15 / 2.6        | 1.4.0               | 2.6.0                  |\n[1.3.0](https://github.com/tensorflow/tfx-bsl/blob/v1.3.0/RELEASE.md)           | 2.31.0           | 2.0.0    | 1.15 / 2.6        | 1.2.0               | 2.6.0                  |\n[1.2.0](https://github.com/tensorflow/tfx-bsl/blob/v1.2.0/RELEASE.md)           | 2.31.0           | 2.0.0    | 1.15 / 2.5        | 1.2.0               | 2.5.1                  |\n[1.1.0](https://github.com/tensorflow/tfx-bsl/blob/v1.1.0/RELEASE.md)           | 2.29.0           | 2.0.0    | 1.15 / 2.5        | 1.1.0               | 2.5.1                  |\n[1.0.0](https://github.com/tensorflow/tfx-bsl/blob/v1.0.0/RELEASE.md)           | 2.29.0           | 2.0.0    | 1.15 / 2.5        | 1.0.0               | 2.5.1                  |\n[0.30.0](https://github.com/tensorflow/tfx-bsl/blob/v0.30.0/RELEASE.md)         | 2.28.0           | 2.0.0    | 1.15 / 2.4        | 0.30.0              | 2.4.0                  |\n[0.29.0](https://github.com/tensorflow/tfx-bsl/blob/v0.29.0/RELEASE.md)         | 2.28.0           | 2.0.0    | 1.15 / 2.4        | 0.29.0              | 2.4.0                  |\n[0.28.0](https://github.com/tensorflow/tfx-bsl/blob/v0.28.0/RELEASE.md)         | 2.28.0           | 2.0.0    | 1.15 / 2.4        | 0.28.0              | 2.4.0                  |\n[0.27.1](https://github.com/tensorflow/tfx-bsl/blob/v0.27.1/RELEASE.md)         | 2.27.0           | 2.0.0    | 1.15 / 2.4        | 0.27.0              | 2.4.0                  |\n[0.27.0](https://github.com/tensorflow/tfx-bsl/blob/v0.27.0/RELEASE.md)         | 2.27.0           | 2.0.0    | 1.15 / 2.4        | 0.27.0              | 2.4.0                  |\n[0.26.1](https://github.com/tensorflow/tfx-bsl/blob/v0.26.1/RELEASE.md)         | 2.25.0           | 0.17.0   | 1.15 / 2.3        | 0.27.0              | 2.3.0                  |\n[0.26.0](https://github.com/tensorflow/tfx-bsl/blob/v0.26.0/RELEASE.md)         | 2.25.0           | 0.17.0   | 1.15 / 2.3        | 0.27.0              | 2.3.0                  |\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftensorflow%2Ftfx-bsl","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftensorflow%2Ftfx-bsl","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftensorflow%2Ftfx-bsl/lists"}