{"id":16275928,"url":"https://github.com/gvegayon/googlepublicdata","last_synced_at":"2025-03-20T01:31:37.314Z","repository":{"id":29274163,"uuid":"32806872","full_name":"gvegayon/googlePublicData","owner":"gvegayon","description":"An R package to build Google's Public Data Explorer DSPL Metadata files","archived":false,"fork":false,"pushed_at":"2021-06-06T07:25:52.000Z","size":1312,"stargazers_count":8,"open_issues_count":1,"forks_count":3,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-03-17T12:41:07.238Z","etag":null,"topics":["dspl","gapminder","google","google-public-data","r-package","xml"],"latest_commit_sha":null,"homepage":"","language":"R","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/gvegayon.png","metadata":{"files":{"readme":"readme.md","changelog":"ChangeLog","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-03-24T15:19:43.000Z","updated_at":"2021-06-06T07:25:55.000Z","dependencies_parsed_at":"2022-08-29T20:51:10.797Z","dependency_job_id":null,"html_url":"https://github.com/gvegayon/googlePublicData","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gvegayon%2FgooglePublicData","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gvegayon%2FgooglePublicData/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gvegayon%2FgooglePublicData/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gvegayon%2FgooglePublicData/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/gvegayon","download_url":"https://codeload.github.com/gvegayon/googlePublicData/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244533586,"owners_count":20467898,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dspl","gapminder","google","google-public-data","r-package","xml"],"created_at":"2024-10-10T18:46:13.364Z","updated_at":"2025-03-20T01:31:36.941Z","avatar_url":"https://github.com/gvegayon.png","language":"R","funding_links":[],"categories":[],"sub_categories":[],"readme":"googlePublicData\n================\n\nAn *R* package for building *Google's* *Data Sets Publication Language* (DSPL) metadata files used in *Public Data Explorer*.\n\n[![Downloads](http://cranlogs.r-pkg.org/badges/googlePublicData?color=brightgreen)](http://cran.rstudio.com/package=googlePublicData) [![Travis-CI Build Status](https://travis-ci.org/gvegayon/googlePublicData.svg?branch=master)](https://travis-ci.org/gvegayon/googlePublicData) [![AppVeyor Build Status](https://ci.appveyor.com/api/projects/status/github/gvegayon/googlePublicData?branch=master\u0026svg=true)](https://ci.appveyor.com/project/gvegayon/googlePublicData) [![codecov](https://codecov.io/gh/gvegayon/googlePublicData/branch/master/graph/badge.svg)](https://codecov.io/gh/gvegayon/googlePublicData)\n[![Grand total](http://cranlogs.r-pkg.org/badges/grand-total/googlePublicData)](https://cran.r-project.org/package=googlePublicData)\n\n\nFeatures:\n\n-   Reads tab, csv, xls and xlsx from a folder.\n\n-   Identifies data types and distinguishes between dimensional and metric concepts.\n\n-   Identifies dimensional data tabs.\n\n-   Auto generates conceps id.\n\n-   Auto data sorting on dimensional (no time) concepts.\n\n-   Prints XML and csv files to upload to Public Data Explorer.\n\n-   Some bug trackers before final printing XML.\n\n-   Builds ZIP file containing CSV and XML files.\n\nSo you don't need to mess with the XML coding at all!\n\n``` r\nlibrary(googlePublicData)\n\n# This path has some csv files that we will use\ndata.path \u003c-try(paste(.libPaths()[1],'/googlePublicData/data',sep=''), silent=T)\ndata.path\n```\n\n    ## [1] \"/home/george/R/x86_64-pc-linux-gnu-library/3.4/googlePublicData/data\"\n\n``` r\n# The dspl function looks for csv files in that paths, and analyzes them\nmydspl \u003c- dspl(path=data.path, sep=\";\")\n```\n\n    ## 6 files found...\n\n    ## /home/george/R/x86_64-pc-linux-gnu-library/3.4/googlePublicData/data/countries.csv analyzed correctly\n\n    ## /home/george/R/x86_64-pc-linux-gnu-library/3.4/googlePublicData/data/country_slice.csv analyzed correctly\n\n    ## /home/george/R/x86_64-pc-linux-gnu-library/3.4/googlePublicData/data/gender_country_slice.csv analyzed correctly\n\n    ## /home/george/R/x86_64-pc-linux-gnu-library/3.4/googlePublicData/data/genders.csv analyzed correctly\n\n    ## /home/george/R/x86_64-pc-linux-gnu-library/3.4/googlePublicData/data/states.csv analyzed correctly\n\n    ## /home/george/R/x86_64-pc-linux-gnu-library/3.4/googlePublicData/data/state_slice.csv analyzed correctly\n\n``` r\n# If we wanted to write the zip file... ready to be uploaded to\n# http://publicdata.google.com\n# dspl(path=data.path, sep=\";\", output= \"mydspl.zip\")\n\n# Printing the data\nmydspl\n```\n\n    ## \u003c?xml version=\"1.0\" encoding=\"UTF-8\"?\u003e\n    ## \u003cdspl xmlns=\"http://schemas.google.com/dspl/2010\" xmlns:quantity=\"http://www.google.com/publicdata/dataset/google/quantity\" xmlns:entity=\"http://www.google.com/publicdata/dataset/google/entity\" xmlns:geo=\"http://www.google.com/publicdata/dataset/google/geo\" xmlns:time=\"http://www.google.com/publicdata/dataset/google/time\" xmlns:unit=\"http://www.google.com/publicdata/dataset/google/unit\" targetNamespace=\"\"\u003e\n    ##   \u003c!--Concepts imports--\u003e\n    ##   \u003cimport namespace=\"http://www.google.com/publicdata/dataset/google/quantity\"/\u003e\n    ##   \u003cimport namespace=\"http://www.google.com/publicdata/dataset/google/entity\"/\u003e\n    ##   \u003cimport namespace=\"http://www.google.com/publicdata/dataset/google/geo\"/\u003e\n    ##   \u003cimport namespace=\"http://www.google.com/publicdata/dataset/google/time\"/\u003e\n    ##   \u003cimport namespace=\"http://www.google.com/publicdata/dataset/google/unit\"/\u003e\n    ##   \u003c!--Info lines--\u003e\n    ##   \u003cinfo\u003e\n    ##     \u003cname\u003e\n    ##       \u003cvalue xml:lang=\"es\"\u003eNo name\u003c/value\u003e\n    ##     \u003c/name\u003e\n    ##     \u003cdescription\u003e\n    ##       \u003cvalue xml:lang=\"es\"\u003eNo description\u003c/value\u003e\n    ##     \u003c/description\u003e\n    ##   \u003c/info\u003e\n    ##   \u003c!--Data Provider--\u003e\n    ##   \u003cprovider\u003e\n    ##     \u003cname\u003e\n    ##       \u003cvalue xml:lang=\"es\"\u003eNo provider\u003c/value\u003e\n    ##     \u003c/name\u003e\n    ##   \u003c/provider\u003e\n    ##   \u003c!--Concepts Definitions--\u003e\n    ##   \u003cconcepts\u003e\n    ##     \u003cconcept id=\"country\" extends=\"geo:location\"\u003e\n    ##       \u003cinfo\u003e\n    ##         \u003cname\u003e\n    ##           \u003cvalue xml:lang=\"es\"\u003eCountry\u003c/value\u003e\n    ##         \u003c/name\u003e\n    ##       \u003c/info\u003e\n    ##       \u003ctype ref=\"string\"/\u003e\n    ##       \u003ctable ref=\"countries_table\"/\u003e\n    ##     \u003c/concept\u003e\n    ##     \u003cconcept id=\"population\"\u003e\n    ##       \u003cinfo\u003e\n    ##         \u003cname\u003e\n    ##           \u003cvalue xml:lang=\"es\"\u003ePopulation\u003c/value\u003e\n    ##         \u003c/name\u003e\n    ##       \u003c/info\u003e\n    ##       \u003ctype ref=\"integer\"/\u003e\n    ##     \u003c/concept\u003e\n    ##     \u003cconcept id=\"gender\" extends=\"entity:entity\"\u003e\n    ##       \u003cinfo\u003e\n    ##         \u003cname\u003e\n    ##           \u003cvalue xml:lang=\"es\"\u003eGender\u003c/value\u003e\n    ##         \u003c/name\u003e\n    ##       \u003c/info\u003e\n    ##       \u003ctype ref=\"string\"/\u003e\n    ##       \u003ctable ref=\"genders_table\"/\u003e\n    ##     \u003c/concept\u003e\n    ##     \u003cconcept id=\"state\" extends=\"geo:location\"\u003e\n    ##       \u003cinfo\u003e\n    ##         \u003cname\u003e\n    ##           \u003cvalue xml:lang=\"es\"\u003eState\u003c/value\u003e\n    ##         \u003c/name\u003e\n    ##       \u003c/info\u003e\n    ##       \u003ctype ref=\"string\"/\u003e\n    ##       \u003ctable ref=\"states_table\"/\u003e\n    ##     \u003c/concept\u003e\n    ##     \u003cconcept id=\"unemployment_rate\"\u003e\n    ##       \u003cinfo\u003e\n    ##         \u003cname\u003e\n    ##           \u003cvalue xml:lang=\"es\"\u003eUnemployment Rate\u003c/value\u003e\n    ##         \u003c/name\u003e\n    ##       \u003c/info\u003e\n    ##       \u003ctype ref=\"float\"/\u003e\n    ##     \u003c/concept\u003e\n    ##   \u003c/concepts\u003e\n    ##   \u003c!--Slices Definitions--\u003e\n    ##   \u003cslices\u003e\n    ##     \u003cslice id=\"country_slice_slice\"\u003e\n    ##       \u003cdimension concept=\"country\"/\u003e\n    ##       \u003cdimension concept=\"time:year\"/\u003e\n    ##       \u003cmetric concept=\"population\"/\u003e\n    ##       \u003ctable ref=\"country_slice_table\"/\u003e\n    ##     \u003c/slice\u003e\n    ##     \u003cslice id=\"gender_country_slice_slice\"\u003e\n    ##       \u003cdimension concept=\"country\"/\u003e\n    ##       \u003cdimension concept=\"gender\"/\u003e\n    ##       \u003cdimension concept=\"time:year\"/\u003e\n    ##       \u003cmetric concept=\"population\"/\u003e\n    ##       \u003ctable ref=\"gender_country_slice_table\"/\u003e\n    ##     \u003c/slice\u003e\n    ##     \u003cslice id=\"state_slice_slice\"\u003e\n    ##       \u003cdimension concept=\"state\"/\u003e\n    ##       \u003cdimension concept=\"time:year\"/\u003e\n    ##       \u003cmetric concept=\"population\"/\u003e\n    ##       \u003cmetric concept=\"unemployment_rate\"/\u003e\n    ##       \u003ctable ref=\"state_slice_table\"/\u003e\n    ##     \u003c/slice\u003e\n    ##   \u003c/slices\u003e\n    ##   \u003c!--Tables Definitios--\u003e\n    ##   \u003ctables\u003e\n    ##     \u003ctable id=\"countries_table\"\u003e\n    ##       \u003ccolumn id=\"country\" type=\"string\"/\u003e\n    ##       \u003ccolumn id=\"name\" type=\"string\"/\u003e\n    ##       \u003ccolumn id=\"latitude\" type=\"float\"/\u003e\n    ##       \u003ccolumn id=\"longitude\" type=\"float\"/\u003e\n    ##       \u003cdata\u003e\n    ##         \u003cfile format=\"csv\" encoding=\"utf8\"\u003ecountries.csv\u003c/file\u003e\n    ##       \u003c/data\u003e\n    ##     \u003c/table\u003e\n    ##     \u003ctable id=\"country_slice_table\"\u003e\n    ##       \u003ccolumn id=\"country\" type=\"string\"/\u003e\n    ##       \u003ccolumn id=\"year\" type=\"date\" format=\"yyyy\"/\u003e\n    ##       \u003ccolumn id=\"population\" type=\"integer\"/\u003e\n    ##       \u003cdata\u003e\n    ##         \u003cfile format=\"csv\" encoding=\"utf8\"\u003ecountry_slice.csv\u003c/file\u003e\n    ##       \u003c/data\u003e\n    ##     \u003c/table\u003e\n    ##     \u003ctable id=\"gender_country_slice_table\"\u003e\n    ##       \u003ccolumn id=\"country\" type=\"string\"/\u003e\n    ##       \u003ccolumn id=\"gender\" type=\"string\"/\u003e\n    ##       \u003ccolumn id=\"year\" type=\"date\" format=\"yyyy\"/\u003e\n    ##       \u003ccolumn id=\"population\" type=\"integer\"/\u003e\n    ##       \u003cdata\u003e\n    ##         \u003cfile format=\"csv\" encoding=\"utf8\"\u003egender_country_slice.csv\u003c/file\u003e\n    ##       \u003c/data\u003e\n    ##     \u003c/table\u003e\n    ##     \u003ctable id=\"genders_table\"\u003e\n    ##       \u003ccolumn id=\"gender\" type=\"string\"/\u003e\n    ##       \u003ccolumn id=\"name\" type=\"string\"/\u003e\n    ##       \u003cdata\u003e\n    ##         \u003cfile format=\"csv\" encoding=\"utf8\"\u003egenders.csv\u003c/file\u003e\n    ##       \u003c/data\u003e\n    ##     \u003c/table\u003e\n    ##     \u003ctable id=\"states_table\"\u003e\n    ##       \u003ccolumn id=\"state\" type=\"string\"/\u003e\n    ##       \u003ccolumn id=\"name\" type=\"string\"/\u003e\n    ##       \u003ccolumn id=\"latitude\" type=\"float\"/\u003e\n    ##       \u003ccolumn id=\"longitude\" type=\"float\"/\u003e\n    ##       \u003cdata\u003e\n    ##         \u003cfile format=\"csv\" encoding=\"utf8\"\u003estates.csv\u003c/file\u003e\n    ##       \u003c/data\u003e\n    ##     \u003c/table\u003e\n    ##     \u003ctable id=\"state_slice_table\"\u003e\n    ##       \u003ccolumn id=\"state\" type=\"string\"/\u003e\n    ##       \u003ccolumn id=\"year\" type=\"date\" format=\"yyyy\"/\u003e\n    ##       \u003ccolumn id=\"population\" type=\"integer\"/\u003e\n    ##       \u003ccolumn id=\"unemployment_rate\" type=\"float\"/\u003e\n    ##       \u003cdata\u003e\n    ##         \u003cfile format=\"csv\" encoding=\"utf8\"\u003estate_slice.csv\u003c/file\u003e\n    ##       \u003c/data\u003e\n    ##     \u003c/table\u003e\n    ##   \u003c/tables\u003e\n    ## \u003c/dspl\u003e\n\n``` r\n# Summary of the dspl class object\nsummary(mydspl)\n```\n\n    ## Attributes\n    ## $names\n    ## [1] \"dspl\"              \"concepts.by.table\" \"dimtabs\"          \n    ## [4] \"slices\"            \"concepts\"          \"dimentions\"       \n    ## [7] \"statistics\"       \n    ## \n    ## $class\n    ## [1] \"dspl\"\n    ## \n    ## Dataset contents\n\n    ## $dimtabs\n    ## [1] \"countries\" \"genders\"   \"states\"   \n    ## \n    ## $slices\n    ## [1] \"countries\"            \"country_slice\"        \"gender_country_slice\"\n    ## [4] \"genders\"              \"states\"               \"state_slice\"         \n    ## \n    ## $concepts\n    ## [1] \"Country\"           \"name\"              \"latitude\"         \n    ## [4] \"longitude\"         \"Year\"              \"Population\"       \n    ## [7] \"Gender\"            \"State\"             \"Unemployment Rate\"\n    ## \n    ## $dimentions\n    ##      label\n    ## 1  Country\n    ## 12  Gender\n    ## 14   State\n    ## \n    ## $statistics\n    ##      slices concepts dimentions\n    ## [1,]      6        9          3\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgvegayon%2Fgooglepublicdata","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgvegayon%2Fgooglepublicdata","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgvegayon%2Fgooglepublicdata/lists"}