{"id":13533925,"url":"https://github.com/man-group/arctic","last_synced_at":"2025-05-14T01:02:31.454Z","repository":{"id":32911381,"uuid":"36506399","full_name":"man-group/arctic","owner":"man-group","description":"High performance datastore for time series and tick data ","archived":false,"fork":false,"pushed_at":"2024-04-08T16:35:28.000Z","size":2317,"stargazers_count":3066,"open_issues_count":97,"forks_count":582,"subscribers_count":172,"default_branch":"master","last_synced_at":"2025-05-10T13:05:57.773Z","etag":null,"topics":["arctic","database","mongodb","pandas","python","tickstore","timeseries","timeseries-database"],"latest_commit_sha":null,"homepage":"https://arctic.readthedocs.io/en/latest/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"lgpl-2.1","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/man-group.png","metadata":{"files":{"readme":"README-arctic.md","changelog":"CHANGES.md","contributing":"docs/contributing.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2015-05-29T13:37:30.000Z","updated_at":"2025-04-27T21:39:34.000Z","dependencies_parsed_at":"2022-07-21T04:38:55.114Z","dependency_job_id":"7c486c56-7111-4878-aa02-400b75e28f89","html_url":"https://github.com/man-group/arctic","commit_stats":{"total_commits":935,"total_committers":88,"mean_commits":10.625,"dds":0.7197860962566844,"last_synced_commit":"f1cc8906aba72abf396f72ebe404781a359314e9"},"previous_names":["manahl/arctic"],"tags_count":96,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/man-group%2Farctic","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/man-group%2Farctic/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/man-group%2Farctic/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/man-group%2Farctic/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/man-group","download_url":"https://codeload.github.com/man-group/arctic/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253908981,"owners_count":21982685,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["arctic","database","mongodb","pandas","python","tickstore","timeseries","timeseries-database"],"created_at":"2024-08-01T07:01:24.372Z","updated_at":"2025-05-14T01:02:31.421Z","avatar_url":"https://github.com/man-group.png","language":"Python","readme":"[![Documentation Status](https://readthedocs.org/projects/arctic/badge/?version=latest)](https://arctic.readthedocs.io/en/latest/?badge=latest)\n[![CircleCI](https://circleci.com/gh/man-group/arctic/tree/master.svg?style=shield)](https://app.circleci.com/pipelines/github/man-group/arctic?branch=master)\n[![PyPI](https://img.shields.io/pypi/v/arctic)](https://pypi.org/project/arctic)\n[![Python](https://img.shields.io/badge/Python-3.6|3.7|3.8-green.svg)](https://github.com/man-group/arctic)\n\n## Quickstart\n\n### Install Arctic\n\n``\npip install git+https://github.com/man-group/arctic.git\n``\n\n### Run a MongoDB\n\n``\nmongod --dbpath \u003cpath/to/db_directory\u003e\n``\n\n## Using VersionStore\n``\nfrom arctic import Arctic\nimport quandl\n``\n### Connect to Local MONGODB\n``\nstore = Arctic('localhost')\n``\n\n### Create the library - defaults to VersionStore\n``\nstore.initialize_library('NASDAQ')\n``\n\n### Access the library\n``\nlibrary = store['NASDAQ']\n``\n\n### Load some data - maybe from Quandl\n``\naapl = quandl.get(\"WIKI/AAPL\", authtoken=\"your token here\")\n``\n\n### Store the data in the library\n``\nlibrary.write('AAPL', aapl, metadata={'source': 'Quandl'})\n``\n\n### Reading the data\n``\nitem = library.read('AAPL')\naapl = item.data\nmetadata = item.metadata\n``\n\nVersionStore supports much more: [See the HowTo](howtos/how_to_use_arctic.py)!\n\n\n### Adding your own storage engine\n\nPlugging a custom class in as a library type is straightforward. [This example\nshows how.](howtos/how_to_custom_arctic_library.py)\n\n## Documentation\n\nYou can find complete documentation at [Arctic docs](https://arctic.readthedocs.io/en/latest/)\n\n## Concepts\n\n### Libraries\n\nArctic provides namespaced *libraries* of data.  These libraries allow\nbucketing data by *source*, *user* or some other metric (for example frequency:\nEnd-Of-Day; Minute Bars; etc.).\n\nArctic supports multiple data libraries per user.  A user (or namespace)\nmaps to a MongoDB database (the granularity of mongo authentication).  The library\nitself is composed of a number of collections within the database. Libraries look like:\n\n  * user.EOD\n  * user.ONEMINUTE\n\nA library is mapped to a Python class.  All library databases in MongoDB are prefixed with 'arctic\\_'\n\n### Storage Engines\n\nArctic includes three storage engines:\n\n  * [VersionStore](arctic/store/version_store.py): a key-value versioned TimeSeries store. It supports:\n      * Pandas data types (other Python types pickled)\n      * Multiple versions of each data item. Can easily read previous versions.\n      * Create point-in-time snapshots across symbols in a library\n      * Soft quota support\n      * Hooks for persisting other data types\n      * Audited writes: API for saving metadata and data before and after a write.\n      * a wide range of TimeSeries data frequencies: End-Of-Day to Minute bars\n      * [See the HowTo](howtos/how_to_use_arctic.py)\n      * [Documentation](docs/versionstore.md)\n  * [TickStore](arctic/tickstore/tickstore.py): Column oriented tick database.  Supports\n    dynamic fields, chunks aren't versioned. Designed for large continuously ticking data.\n  * [Chunkstore](https://github.com/man-group/arctic/wiki/Chunkstore): A storage type that allows data to be stored in customizable chunk sizes. Chunks\n    aren't versioned, and can be appended to and updated in place. \n    * [Documentation](docs/chunkstore.md)\n\nArctic storage implementations are **pluggable**.  VersionStore is the default.\n\n\n## Requirements\n\nArctic currently works with:\n\n * python 3.6, 3.7, 3.8\n * pymongo \u003e= 3.6.0 \u003c= 3.11.0\n * pandas \u003e= 0.22.0 \u003c 2\n * MongoDB \u003e= 2.4.x \u003c= 4.4.18\n\n\nOperating Systems:\n * Linux\n * macOS\n * Windows 10\n\n## Acknowledgements\n\nArctic has been under active development at [Man Group](https://www.man.com/) since 2012.\n\nIt wouldn't be possible without the work of the Man Data Engineering Team including:\n\n * [Richard Bounds](https://github.com/richardbounds)\n * [James Blackburn](https://github.com/jamesblackburn)\n * [Vlad Mereuta](https://github.com/vmereuta)\n * [Tom Taylor](https://github.com/TomTaylorLondon)\n * Tope Olukemi\n * [Drake Siard](https://github.com/drakesiard)\n * [Slavi Marinov](https://github.com/slavi)\n * [Wilfred Hughes](https://github.com/wilfred)\n * [Edward Easton](https://github.com/eeaston)\n * [Bryant Moscon](https://github.com/bmoscon)\n * [Dimosthenis Pediaditakis](https://github.com/dimosped)\n * [Shashank Khare](https://github.com/shashank88)\n * [Duncan Kerr](https://github.com/dunckerr)\n * ... and many others ...\n\nContributions welcome!\n\n## License\n\nArctic is licensed under the GNU LGPL v2.1.  A copy of which is included in [LICENSE](LICENSE)\n","funding_links":[],"categories":["Databases","Python","By Industry","数据容器和结构","Numerical Libraries","By Language"],"sub_categories":["Time Series","TimeSeries Analysis","Other","Books","Python"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fman-group%2Farctic","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fman-group%2Farctic","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fman-group%2Farctic/lists"}