{"id":22173341,"url":"https://github.com/jmcleodfoss/ms-oxprops-db","last_synced_at":"2025-06-18T19:39:04.421Z","repository":{"id":134882426,"uuid":"265935002","full_name":"Jmcleodfoss/ms-oxprops-db","owner":"Jmcleodfoss","description":"CSV Database of Exchange Properties from MS-OXPROPS","archived":false,"fork":false,"pushed_at":"2020-11-08T15:28:12.000Z","size":49,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-24T17:53:22.455Z","etag":null,"topics":["microsoft-file-format","msg-files","pst-files"],"latest_commit_sha":null,"homepage":"","language":"Perl","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Jmcleodfoss.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-05-21T19:31:46.000Z","updated_at":"2020-11-08T15:28:14.000Z","dependencies_parsed_at":null,"dependency_job_id":"7be40355-d8e7-4045-ac45-ace932281e8b","html_url":"https://github.com/Jmcleodfoss/ms-oxprops-db","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/Jmcleodfoss/ms-oxprops-db","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jmcleodfoss%2Fms-oxprops-db","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jmcleodfoss%2Fms-oxprops-db/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jmcleodfoss%2Fms-oxprops-db/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jmcleodfoss%2Fms-oxprops-db/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Jmcleodfoss","download_url":"https://codeload.github.com/Jmcleodfoss/ms-oxprops-db/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jmcleodfoss%2Fms-oxprops-db/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":260619923,"owners_count":23037427,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["microsoft-file-format","msg-files","pst-files"],"created_at":"2024-12-02T07:32:36.873Z","updated_at":"2025-06-18T19:38:59.407Z","avatar_url":"https://github.com/Jmcleodfoss.png","language":"Perl","funding_links":[],"categories":[],"sub_categories":[],"readme":"# ms-oxprops-db\nCSV Database of Exchange properties pulled from various versions of Microsoft's MS-OXPROPS document. This uses the Excel dialect of CSV; other formats may be provided on request.\n\n## Prerequisites\nThe scripts use bash, Perl, and pdftotext from the poppler suite of PDF tools.\n\n## Procedure\nThis downloads all known MS-OXPROPS pdfs, converts them to text, and then extracts the database info from all text files.\n1. bin/download-pdfs.sh\n2. bin/convert-to-text.sh\n3. bin/generatedb-all.sh \u003e ms-oxprops.csv\n\ngeneratedb-all.sh calls generatadb.pl for each text file.\n\n## Command line arguments to generatedb.pl\nRun as\n```\n\tcat ms-oxprops-text-version-of-pdf | bin/generatedb.pl [--help] [--ids] [--keys] [--nodb] [--nofixtypos] [--noheader] [--orphans] [--version=V] [--delim=D]\n```\nwhere\n\n* --delim=D: use D (can be multiple characters) as the delimiter instead of ','.\n* --help: shows info about the command-line options\n* --ids: List all the property long IDs, tags, and names found in the table of contents\n* --keys: List all keys found (useful during development and to check spelling in new versions of the document. See example below;\n* --nodb: Do not print out the database (useful primarily with --ids. --keys, and --orphans)\n* --nofixtypos: Do not apply fixes for typos in Property Types and Property Set names\n* --noheader: Do not print out the database header\n* --orphans: Show any lines which were not processed but might be part of a field (useful during development)\n* --version=V: use V for the version in the database\n\n### The --keys option\nTo check whether there are any typos in the keys in new versions of the document, run generatedb.pl with the --keys option:\n```\ncat ms-oxprops.txt | bin/generatedb.pl --keys --nodb | sort -u\n```\n\n### The --ids option\nTo generate a list of IDs only, use the --ids option:\n```\ncat ms-oxprops.txt | bin/generatedb.pl --ids --nodb\n```\n\nTo get just the LIDs but not the tags or names:\n```\ncat ms-oxprops.txt | bin/generatedb.pl --ids --nodb |grep PidLid\n```\n\n## Motivation\nI have been working with Microsoft PST and MSG files (as a hobbyist) for almost a decade, and this document is something I wish I had had from the start. Maybe others will find it useful.\n\n## Releases\n### Version 1.0.0 (2020-05-25)\nArtifacts are stored on Dropbox. There is no guarantee that older versions of the database will be available due to space constraints.\n| Artifact | SHA256 Checksum |\n|---|---|\n| [ms-oxprops-2020-05-25.csv](https://www.dropbox.com/s/e945bjijzjlaa2n/ms-oxprops-2020-05-25.csv?dl=0) | 46c2fb8445812e1eb8eb5a99c6db4e61ff177c163a460504f8711ecd1ca3e6d2 *ms-oxprops-2020-05-25.csv |\n| [ms-oxprops-2020-05-25.csv.zip](https://www.dropbox.com/s/yynqininhauff18/ms-oxprops-2020-05-25.csv.zip?dl=0) | 02ea3276c511b64ff68d786a39bd0e0858a8c04be5b774ae79128b265109c05a *ms-oxprops-2020-05-25.csv.zip |\n| [ms-oxprops-2020-05-25.xlsx](https://www.dropbox.com/s/vqivoeba6j4ih9b/ms-oxprops-2020-05-25.xlsx?dl=0) | 3bf09572ac6d3eee84ecf81327afbb94608243698fa83946113d2fd90d531d19 *ms-oxprops-2020-05-25.xlsx |\n\nThe Excel version has a filter and fixed top row and first column\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjmcleodfoss%2Fms-oxprops-db","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjmcleodfoss%2Fms-oxprops-db","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjmcleodfoss%2Fms-oxprops-db/lists"}