https://github.com/cmungall/data-manifesto
semantic modeling of data manifests
https://github.com/cmungall/data-manifesto
data-standards filesystems hcls-dataset-description linked-data linkml rdf repositories semantic-web
Last synced: 6 months ago
JSON representation
semantic modeling of data manifests
- Host: GitHub
- URL: https://github.com/cmungall/data-manifesto
- Owner: cmungall
- Created: 2022-03-25T23:57:23.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2022-04-02T00:41:17.000Z (over 3 years ago)
- Last Synced: 2025-02-17T10:54:38.503Z (8 months ago)
- Topics: data-standards, filesystems, hcls-dataset-description, linked-data, linkml, rdf, repositories, semantic-web
- Language: Python
- Homepage: https://cmungall.github.io/data-manifesto/
- Size: 847 KB
- Stars: 2
- Watchers: 2
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Data Manifesto: Data Manifest Objects
PRE-ALPHA
This repo contains a schema and code for working with semantic representation data manifests.
- a LinkML schema
* source: [src/linkml](src/linkml)
* docs: [cmungall.github.io/data-manifesto](https://cmungall.github.io/data-manifesto/)
- simple utility code
* introspect a folder
* apply customizable rules to infer semantic properties
* render as linkml data / rdf / json
## Inference from file systems
See tests
given a folder structure like [tests/input/PersonSchema](tests/input/PersonSchema)
```yaml
name: file:test-manifesto
resources:
- name: file:test-manifesto/input/PersonSchema/personinfo.yaml
created_by: cjm
created_on: '2022-03-21T16:39:39.508942'
path: input/PersonSchema/personinfo.yaml
format: YAML
bytes: 5368
sha256: a9e1b95e90a1b2cfaf03902ed4ee92aa73bc8a14fe0f15ebb16357f0da42f8f4
- name: file:test-manifesto/input/PersonSchema/personinfo.json
created_by: cjm
created_on: '2022-03-21T16:39:39.510421'
path: input/PersonSchema/personinfo.json
format: JSON
bytes: 8025
sha256: aee37e2c6634a2f2ffc417dd1bb07135c4c3352d5552110a0d9ac0e4e490d3be
- name: file:test-manifesto/input/PersonSchema/Makefile
created_by: cjm
created_on: '2022-03-21T16:39:39.511144'
path: input/PersonSchema/Makefile
bytes: 1020
sha256: a17642804c880da49088e16645ed35d1d92bd473ab16ca7b0db69d489b3eb90d
```
or the equivalent:
```turtle
@prefix dcat: .
@prefix dcterms: .
@prefix ns1: .
@prefix ns2: .
@prefix void: .
@prefix xsd: .
a void:Dataset ;
dcat:distribution ,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
.
a dcat:Distribution ;
ns1:createdBy "cjm"^^xsd:anyURI ;
ns1:createdOn "2022-03-21T16:39:39.511144"^^xsd:dateTime ;
dcat:byteSize 1020 ;
ns2:path "input/PersonSchema/Makefile" ;
ns2:sha256 "a17642804c880da49088e16645ed35d1d92bd473ab16ca7b0db69d489b3eb90d" .
a dcat:Distribution ;
ns1:createdBy "cjm"^^xsd:anyURI ;
ns1:createdOn "2022-03-21T16:39:39.513991"^^xsd:dateTime ;
dcat:byteSize 619 ;
ns2:path "input/PersonSchema/README.md" ;
ns2:sha256 "56e144d94c660ff5e32aea964e1b13232bce95c5f9ef1e8053e8335ffcef23fb" .
a dcat:Distribution ;
dcterms:format "JSON" ;
ns1:createdBy "cjm"^^xsd:anyURI ;
ns1:createdOn "2022-03-21T16:39:39.562493"^^xsd:dateTime ;
dcat:byteSize 1088 ;
ns2:path "input/PersonSchema/build/example_personinfo_data.json" ;
ns2:sha256 "d944d8ae8f653160164d5eadaeb6b324264a2e58ab023266eca6c0dc24744e20" .
a dcat:Distribution ;
ns1:createdBy "cjm"^^xsd:anyURI ;
ns1:createdOn "2022-03-21T16:39:39.563553"^^xsd:dateTime ;
dcat:byteSize 809 ;
ns2:path "input/PersonSchema/build/example_personinfo_data.tsv" ;
ns2:sha256 "fcd9fcfdcf69a8151759a69966b93533eca4921ac2f2f505d8a141c3ed0316fd" .
```