{"id":13586698,"url":"https://github.com/timwedde/quandelabra","last_synced_at":"2026-01-18T11:55:10.623Z","repository":{"id":50198721,"uuid":"165327025","full_name":"timwedde/quandelabra","owner":"timwedde","description":"A tiny tool for quickly downloading large (and free) datasets from Quandl.","archived":false,"fork":false,"pushed_at":"2022-12-08T01:32:04.000Z","size":13,"stargazers_count":1,"open_issues_count":3,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2024-02-14T21:40:41.049Z","etag":null,"topics":["data-downloader","python3","quandl","quandl-api","script","trading-systems","utility"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/timwedde.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-01-11T23:53:08.000Z","updated_at":"2020-01-28T00:03:05.000Z","dependencies_parsed_at":"2023-01-24T21:00:11.522Z","dependency_job_id":null,"html_url":"https://github.com/timwedde/quandelabra","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timwedde%2Fquandelabra","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timwedde%2Fquandelabra/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timwedde%2Fquandelabra/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timwedde%2Fquandelabra/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/timwedde","download_url":"https://codeload.github.com/timwedde/quandelabra/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247707763,"owners_count":20982844,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-downloader","python3","quandl","quandl-api","script","trading-systems","utility"],"created_at":"2024-08-01T15:05:45.124Z","updated_at":"2026-01-18T11:55:10.606Z","avatar_url":"https://github.com/timwedde.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"# Quandelabra\n\n\u003cimg src=\"quandelabra.svg\" width=\"130\" height=\"140\" align=\"left\" /\u003e\n\nA tiny tool for quickly downloading large (and free) datasets from Quandl.\n\nSince Quandl limits the ability to download an entire dataset at once to premium offerings, this tool was made to instead download the entire thing in multiple pieces at the same time.  \n\"*But wait!*\" you say, \"*Doesn't the Quandl Python API allow you to do that already?*\".  \nWell, yes, it does.  \nHowever, it is painfully slow while doing it and it is not multithreaded by default. Adding threading or even multiprocessing afterwads is tedious and still suffers from the massive overhead the Quandl Python package has with every request.\n\nQuandelabra solves this problem by \u003cstrike\u003enot giving a shit about official packages\u003c/strike\u003e requesting data directly via the REST API, circumventing the CPU-monster that is the Quandl-provided API wrapper. Additionally, it makes use of `asyncio` and `aiohttp` to deliver buzzword-worthy, *blazing-fast* speeds due to being able to issue dozens of requests simultaneously. And this without eating any of your RAM or CPU for breakfast! Everything stays nice, cool and under control, as long as your network can sustain the load, that is.\n\n## Disclaimer\nAs with most everything that I put out, these are personal projects and there's no guarantee that they will either:\n\n* Always work\n* Be maintained forever\n* Do what you want\n\nIf this works for you, great!  \nIf you got improvements, even better, send me a pull request!  \nIf it doesn't work, let me know and I'l try my best to ignore it. *Just kidding, I gotta keep my GitHub cred high.*\n\n## Rate Limits\nPlease be aware of the [rate limits](https://help.quandl.com/article/68-is-there-a-rate-limit-or-speed-limit-for-api-usage) imposed by the API itself.  \nFree users may only be able to run 3 to 4 requests concurrently, while users with at least one Premium subscription can get away with 50 to 100 requests, depending on their network speed. If the dataset you're downloading is free, the reduced rate limits will still apply.  \nThis tool can also be useful for premium users since the API only allows 10 bulk downloads of a dataset per hour. If you need more, you can use this tool to do so.\n\n## Installation\nQuandelabra is a simple Python script, so the installation procedure is a very complex and error-prone process which works as follows:\n\n1. Download `git clone git@github.com:timwedde/quandelabra.git`\n2. Execute `cd quandelabra/ \u0026\u0026 python3 quandelabra.py`\n3. ??? `python3 quandelabra.py -h`\n4. Profit!\n\n## Usage\n```\nusage: quandelabra.py [-h] -d quandl_code -a key -o dir [-t N]\n\nA tiny tool for quickly downloading large (and free) datasets from Quandl.\n\noptional arguments:\n  -h, --help            show this help message and exit\n  -d quandl_code, --dataset quandl_code\n                        (required) The Quandl Code for the dataset to download\n  -a key, --api_key key\n                        (required) Your Quandl API key\n  -o dir, --output dir  (required) The directory to output data to\n  -t N, --tasks N       The amount of tasks to spawn (default: 75)\n```\n\n## Credits\n* Quandl, for providing amazing datasets for free and even more amazing datasets for little money.\n* \u003cdiv\u003eCandalebra icon made by \u003ca href=\"https://www.freepik.com/\" title=\"Freepik\"\u003eFreepik\u003c/a\u003e and procured from \u003ca href=\"https://www.flaticon.com/\" title=\"Flaticon\"\u003ewww.flaticon.com\u003c/a\u003e, licensed under \u003ca href=\"http://creativecommons.org/licenses/by/3.0/\" title=\"Creative Commons BY 3.0\" target=\"_blank\"\u003eCC 3.0 BY\u003c/a\u003e\u003c/div\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftimwedde%2Fquandelabra","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftimwedde%2Fquandelabra","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftimwedde%2Fquandelabra/lists"}