{"id":37062979,"url":"https://github.com/dgozal/histlabapi","last_synced_at":"2026-01-14T07:01:07.074Z","repository":{"id":212020802,"uuid":"730495554","full_name":"dgozal/histlabapi","owner":"dgozal","description":"A wrapper package to simplify extracting data from the History Lab's API","archived":false,"fork":false,"pushed_at":"2024-06-12T01:03:42.000Z","size":91,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-01-01T06:19:22.055Z","etag":null,"topics":["api","data-science","python","wrapper-api"],"latest_commit_sha":null,"homepage":"https://histlabapi.readthedocs.io/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dgozal.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":"docs/support.md","governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-12-12T03:43:37.000Z","updated_at":"2024-06-12T01:03:45.000Z","dependencies_parsed_at":null,"dependency_job_id":"8b79ca79-88e1-41e1-aab4-c88bdebe763f","html_url":"https://github.com/dgozal/histlabapi","commit_stats":null,"previous_names":["dgozal/histlabapi"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/dgozal/histlabapi","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dgozal%2Fhistlabapi","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dgozal%2Fhistlabapi/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dgozal%2Fhistlabapi/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dgozal%2Fhistlabapi/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dgozal","download_url":"https://codeload.github.com/dgozal/histlabapi/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dgozal%2Fhistlabapi/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28412480,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-14T05:26:33.345Z","status":"ssl_error","status_checked_at":"2026-01-14T05:21:57.251Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["api","data-science","python","wrapper-api"],"created_at":"2026-01-14T07:01:06.127Z","updated_at":"2026-01-14T07:01:07.063Z","avatar_url":"https://github.com/dgozal.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"https://drive.google.com/uc?export=view\u0026id=1TSmni70LaZFjUYUUCtJ9Sc6LbHbxa0g7\"\u003e\u003cbr\u003e\n\u003c/div\u003e\n\u003ch3 align=\"center\"\u003e\u003cfont size = \"20\"\u003eHistory as Data Science\u003c/font\u003e\u003c/h3\u003e\n\n-----------------\n\n# History Lab API\n\nThe [History Lab](http://history-lab.org/) focuses on digitizing historical documents and turning them into a format more amenable to the tools of modern data analysis. As part of this, the History Lab has compiled a database of more than 3 million declassified historical documents. \n\nTraversing any large database of this sort can be tedious though. `histlabapi` is a Python library that aims to solve this, making it easier for users to access data from the History Lab's database by wrapping around the History Lab's API. \n\n## Installation and setup\nInstallation is quite straightforward with pip. This package is only compatible with Python 3.9+ due to its usage of the [`requests`](https://requests.readthedocs.io/en/latest/) dependency and its reliance on [`sphinx`](https://www.sphinx-doc.org/en/master/) to generate its documentation.\n\n```bash\n$ pip install histlabapi\n```\nOnce installed, you can import the package with this:\n\n```\nfrom histlabapi import histlabapi\n```\n\n## Usage\n\nBefore extracting documents left and right, its important to get some bearing on how the History Lab stores and structures its various documents. As such, I've compiled a quick guide where one can look up the various collections and fields that you can access through this API [here](https://histlabapi.readthedocs.io/en/latest/database.html).\n\nOnce that's settled, you can use this package's various functions to extract information in all kinds of ways:\n- An [overview](https://histlabapi.readthedocs.io/en/latest/usage.html#list-collections) of all the collections currently available in the API\n- [Listing](https://histlabapi.readthedocs.io/en/latest/usage.html#entity-overview) all the entities of a certain type that appear across all collections\n- Searching and extracting documents by [text](https://histlabapi.readthedocs.io/en/latest/usage.html#search-by-text), [entity](https://histlabapi.readthedocs.io/en/latest/usage.html#search-by-entity), [date](https://histlabapi.readthedocs.io/en/latest/usage.html#search-by-date) or [document ID](https://histlabapi.readthedocs.io/en/latest/usage.html#search-by-document-id)\n\n\n## Documentation\n\nFull documentation can be accessed at [Read the Docs](https://histlabapi.readthedocs.io)\n\n\n## Support\n\nFeel free to contact me at dg3279@columbia.edu if you have any questions and/or want to contribute!\n\n\n## License\n\n`histlabapi` was created by Derrick Gozal. It is licensed under the terms of the MIT license.\n\n\n## Credits\n\n`histlabapi` was created with [`cookiecutter`](https://cookiecutter.readthedocs.io/en/latest/) and the `py-pkgs-cookiecutter` [template](https://github.com/py-pkgs/py-pkgs-cookiecutter).\nAlso much thanks to Professor Raymond Hicks and the rest of the History Lab team for all the support in building up this package.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdgozal%2Fhistlabapi","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdgozal%2Fhistlabapi","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdgozal%2Fhistlabapi/lists"}