{"id":13487217,"url":"https://github.com/Netflix/metacat","last_synced_at":"2025-03-27T21:32:06.268Z","repository":{"id":38208291,"uuid":"54284914","full_name":"Netflix/metacat","owner":"Netflix","description":null,"archived":false,"fork":false,"pushed_at":"2024-10-28T01:32:38.000Z","size":7035,"stargazers_count":1608,"open_issues_count":51,"forks_count":280,"subscribers_count":401,"default_branch":"master","last_synced_at":"2024-10-29T17:55:29.767Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Netflix.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-03-19T20:06:34.000Z","updated_at":"2024-10-24T06:23:28.000Z","dependencies_parsed_at":"2023-02-18T12:01:55.205Z","dependency_job_id":"e060a891-8fb8-4f25-a450-276d918ba714","html_url":"https://github.com/Netflix/metacat","commit_stats":{"total_commits":582,"total_committers":32,"mean_commits":18.1875,"dds":0.8058419243986255,"last_synced_commit":"dc3bc136072964098755e3bf0eeecc8494d455c0"},"previous_names":[],"tags_count":279,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Netflix%2Fmetacat","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Netflix%2Fmetacat/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Netflix%2Fmetacat/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Netflix%2Fmetacat/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Netflix","download_url":"https://codeload.github.com/Netflix/metacat/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245798590,"owners_count":20673902,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T18:00:56.753Z","updated_at":"2025-03-27T21:32:06.211Z","avatar_url":"https://github.com/Netflix.png","language":"Java","readme":"# Metacat\n\n[![Download](https://api.bintray.com/packages/netflixoss/maven/metacat/images/download.svg)](https://bintray.com/netflixoss/maven/metacat/_latestVersion)\n[![License](https://img.shields.io/github/license/Netflix/metacat.svg)](http://www.apache.org/licenses/LICENSE-2.0)\n[![Issues](https://img.shields.io/github/issues/Netflix/metacat.svg)](https://github.com/Netflix/metacat/issues)\n[![NetflixOSS Lifecycle](https://img.shields.io/osslifecycle/Netflix/metacat.svg)]()\n\n## Introduction\n\nMetacat is a unified metadata exploration API service. You can explore Hive, RDS, Teradata, Redshift, S3 and Cassandra.\nMetacat provides you information about what data you have, where it resides and how to process it. Metadata in the end\nis really data about the data. So the primary purpose of Metacat is to give a place to describe the data so that we\ncould do more useful things with it.\n\nMetacat focusses on solving these three problems:\n\n* Federate views of metadata systems.\n* Allow arbitrary metadata storage about data sets.\n* Metadata discovery\n\n## Documentation\n\nTODO\n\n## Releases\n\n[Releases](https://github.com/Netflix/metacat/releases/)\n\n## Builds\n\nMetacat builds are run on Travis CI [here](https://travis-ci.com/Netflix/metacat).\n[![Build Status](https://travis-ci.com/Netflix/metacat.svg?branch=master)](https://travis-ci.com/Netflix/metacat)\n\n## Getting Started\n\n```\ngit clone git@github.com:Netflix/metacat.git\ncd metacat\n./gradlew clean build\n```\n\nOnce the build is completed, the metacat WAR file is generated under `metacat-war/build/libs` directory. Metacat needs\ntwo basic configurations:\n\n* `metacat.plugin.config.location`: Path to the directory containing the catalog configuration. Please look at\ncatalog [samples](https://github.com/Netflix/metacat/tree/master/metacat-functional-tests/metacat-test-cluster/etc-metacat/catalog) used for functional testing.\n* `metacat.usermetadata.config.location`: Path to the configuration file containing the connection properties to store\nuser metadata. Please look at this [sample](https://github.com/Netflix/metacat/blob/master/metacat-functional-tests/metacat-test-cluster/etc-metacat/usermetadata.properties).\n\n### Running Locally\n\nTake the build WAR in `metacat-war/build/libs` and deploy it to an existing Tomcat as `ROOT.war`.\n\nThe REST API can be accessed @ [http://localhost:8080/mds/v1/catalog](http://localhost:8080/mds/v1/catalog)\n\nSwagger API documentation can be accessed @ [http://localhost:8080/swagger-ui/index.html](http://localhost:8080/swagger-ui/index.html)\n\n### Docker Compose Example\n\n**Pre-requisite: Docker compose is installed**\n\nTo start a self contained Metacat environment with some sample catalogs run the command below.\nThis will start a `docker compose` cluster containing a Metacat container, a Hive Metastore Container, a Cassandra\ncontainer and a PostgreSQL container.\n\n```\n./gradlew metacatPorts\n```\n\n* `metacatPorts` - Prints out what exposed ports are mapped to the internal container ports.\nLook for the mapped port (`MAPPED_PORT`) to port 8080.\n\nREST API can be accessed @ `http://localhost:\u003cMAPPED_PORT\u003e/mds/v1/catalog`\n\nSwagger API documentation can be accessed @ `http://localhost:\u003cMAPPED_PORT\u003e/swagger-ui/index.html`\n\nTo stop the docker compose cluster:\n\n```\n./gradlew stopMetacatCluster\n```\n","funding_links":[],"categories":["Java","Metadata Management","Data Discovery","Data Catalog","others","其他_大数据","Metadata Service","Table of Contents","Uncategorized","大数据"],"sub_categories":["资源传输下载","Vector Database","Metadata Service","Uncategorized"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FNetflix%2Fmetacat","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FNetflix%2Fmetacat","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FNetflix%2Fmetacat/lists"}