{"id":21291574,"url":"https://github.com/Scaseco/dcat-suite","last_synced_at":"2025-07-11T16:30:47.394Z","repository":{"id":31457190,"uuid":"127953651","full_name":"SmartDataAnalytics/dcat-suite","owner":"SmartDataAnalytics","description":"Semantic Web library and tool for retrieval and deployment of data from/to GIT, CKAN, MAVEN repos and triple stores using DCAT as the backbone.","archived":false,"fork":false,"pushed_at":"2024-03-12T18:08:10.000Z","size":3280,"stargazers_count":11,"open_issues_count":23,"forks_count":0,"subscribers_count":16,"default_branch":"develop","last_synced_at":"2024-04-16T07:41:32.932Z","etag":null,"topics":["dcat","maven","rdf","semantic-web","sparql"],"latest_commit_sha":null,"homepage":"https://smartdataanalytics.github.io/dcat-suite/","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/SmartDataAnalytics.png","metadata":{"files":{"readme":"README-wip.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2018-04-03T18:46:46.000Z","updated_at":"2024-04-15T19:31:26.000Z","dependencies_parsed_at":"2023-02-11T00:45:26.154Z","dependency_job_id":"7d2aed3e-364f-447a-b784-2f4f92d92ce6","html_url":"https://github.com/SmartDataAnalytics/dcat-suite","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SmartDataAnalytics%2Fdcat-suite","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SmartDataAnalytics%2Fdcat-suite/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SmartDataAnalytics%2Fdcat-suite/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SmartDataAnalytics%2Fdcat-suite/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/SmartDataAnalytics","download_url":"https://codeload.github.com/SmartDataAnalytics/dcat-suite/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":225738025,"owners_count":17516477,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dcat","maven","rdf","semantic-web","sparql"],"created_at":"2024-11-21T13:36:09.864Z","updated_at":"2025-07-11T16:30:38.517Z","avatar_url":"https://github.com/SmartDataAnalytics.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"##\n\n(work in progress)\n\n\n## Service Management\nThe DCAT System supports creation of services and loading datasets.\n\nCreation of services is typically based on a docker service wrapper.\nThe dcat command adds bookkeeping via `--managed` to track which datasets were loaded into which service.\n\n\nThe DCAT service management provides a simple abstraction for the most common service management and dataset loading tasks.\nThe purpose is NOT to reimplement a virtualization infrastructure such as docker.\nHowever, it should simplify the process of bulk loading datasets from a catalog\n\n\n\nOften, whenever one needs a good example for a dataset, one doesn't have one at hand.\nBased on the catalog it is useful to have quick access to several properties\n\ndcat serendipity\n\n  format preference nt\n  encoding preference gz\n  dataset size estimate -e.g 1GB\n  number of triples - e.g. 1M, .5B\n  number of classes\n  number of properties\n  avg number of properties by resource\n  use of multivalued properties\n  \n\n\n\n\n```\ndcat service create -t myname -e 'KEY=VALUE' tenforce/virtuoso\ndcat service up myname\n\n\n## Dataset Loading\ndcat service load -t myservice datasetid-or-file-or-url\ndcat service load -t myservice --defer datasetid\ndcat service load -t myservice --rm-deferred datasetid\ndcat service load -t myservice --list-deferred\ndcat service load -t myservice run\n\n## Send a request to the service (e.g. a sparql statement)\ndcat service request -t myservice 'query'\n\n\n## Managed Dataset Loading\n--managed registers the service as a distribution of the given dataset\ndcat service load -t myservice --register-dist datasetid\n\n\n## Service/Dataset Mapping\ndcat servicemap\n\nmyname [ containsData [ graph \"g1\"; datasetid \"foo\" ] ]\n\n\n\n## Service Life Cycle Management\ndcat service down myname\ndcat service restart myname\ndcat service reload myname # config relead\ndcat service delete myname\ndcat service getenv myname\ndcat service setenv -t myname KEY1=VALUE1 ... KEYn=VALUEn\ndcat service unsetenv -t myname KEY1 KEYn\n\n\n# Show the list of services and known datasets\ndcat service list\n```\n\n\nFile based services\n  start a fuseki backed by a file\n\n\n\n\n\n\n\n\nQuick serving\n```\ndcat docker serve --immutable dataset tenforce/virtuoso\n```\n\n\n\n\n## The local DCAT repository\nIt serves two purposes\n\n* An *index* of dataset and distribution records as well as downloads. The folder-based index structure is aimed at making the repo easy to maintain in cotrast to a database and allow for efficient lookups\n\nIt is possible to either index whole catalogs at once in advance,\nor to index datasets once they are requested.\n\n\n\nIf the local repository cannot serve the request, the request is delegated to the known catalogs in the order they were registered.\n\n\n\n## Catalog resolvers\n\n\n### Default Directory-based Catalog Resolver\n\n\n\n### Url-based catalogs\n\n\n\n\n### Git-based catalogs\n\nA common use case is for a git repository to host the catalog - in one or more files.\nA repository can contain a single rdf file describing describing the set of files that make up the complete catalog with the use of filename patterns.\n\n\nInterplay between git and the file-index:\nIf pulling a git repo reveals no changes, then there is no need to update the index.\n\n\n\n\n\nhttps://stackoverflow.com/questions/2993902/how-do-i-check-the-date-and-time-of-the-latest-git-pull-that-was-executed\n\n\n\n\n## Catalog management\n\n* Index local or remote dcat entries in the local repository\n```\ndcat catalog index --no-overwrite file.*.ttl\ndcat catalog index http://remote.file/url\n```\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FScaseco%2Fdcat-suite","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FScaseco%2Fdcat-suite","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FScaseco%2Fdcat-suite/lists"}