{"id":25740165,"url":"https://github.com/datadotworld/dw-mws-connector","last_synced_at":"2025-07-30T14:04:51.944Z","repository":{"id":80840600,"uuid":"132060894","full_name":"datadotworld/dw-mws-connector","owner":"datadotworld","description":"Loads data from Amazon Marketplace Web Service into data.world","archived":false,"fork":false,"pushed_at":"2023-12-04T17:51:21.000Z","size":117,"stargazers_count":1,"open_issues_count":5,"forks_count":0,"subscribers_count":28,"default_branch":"master","last_synced_at":"2025-02-26T08:39:17.481Z","etag":null,"topics":["amazon","dwstruct-t01-dist","etl","heroku","mws"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/datadotworld.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-05-03T23:43:14.000Z","updated_at":"2024-04-21T13:03:03.000Z","dependencies_parsed_at":null,"dependency_job_id":"8feb213b-7f0c-45bf-96fe-9b01dacf072d","html_url":"https://github.com/datadotworld/dw-mws-connector","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/datadotworld/dw-mws-connector","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datadotworld%2Fdw-mws-connector","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datadotworld%2Fdw-mws-connector/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datadotworld%2Fdw-mws-connector/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datadotworld%2Fdw-mws-connector/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/datadotworld","download_url":"https://codeload.github.com/datadotworld/dw-mws-connector/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datadotworld%2Fdw-mws-connector/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":267880287,"owners_count":24159668,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-30T02:00:09.044Z","response_time":70,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["amazon","dwstruct-t01-dist","etl","heroku","mws"],"created_at":"2025-02-26T08:37:02.220Z","updated_at":"2025-07-30T14:04:51.936Z","avatar_url":"https://github.com/datadotworld.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# data.world \u0026 Amazon Marketplace Web Service (MWS) Connector\n\n[![Deploy](https://www.herokucdn.com/deploy/button.svg)](https://heroku.com/deploy?template=https://github.com/datadotworld/dw-mws-connector)\n\n## Getting Started\n\n1. [Create a dataset](https://data.world/create-a-dataset) on data.world\n2. You will need your own [Heroku](https://www.heroku.com) account\n3. Deploy to Heroku by pressing the fancy-looking button above\n    * This integration allows you to save all of the reports into one dataset or to multiple datasets. For the latter,\n  take a look at the [Storing Reports in Multiple Datasets](#storing-reports-in-multiple-datasets) section.\n    * `App name` is optional as one will be automatically assigned, but we recommend something descriptive\n    * Take a look at the [Config Vars](#config-vars) section for more details on the individual configuration variables\n    * The initial deployment will take a couple of minutes as it's pulling your historical data\n4. Once deployment is done, click on 'Manage App' to go to the app's 'Overview' page\n5. Under 'Installed add-ons', click on 'Heroku Scheduler'\n6. Add a new job. The command to use is `update_reports`.\n    * Note that times are in UTC. Use a timezone converter if you would like your job to run at a specific local time.\n\nAs an example, the following job is scheduled to run daily at 8 AM CDT:\n![Daily Job](assets/scheduler-daily-job.png)\n\n### Storing Reports in Multiple Datasets\n\nAs mentioned in [Config Vars](#config-vars), you can skip certain reports by leaving the associated filename field\nblank. If you wanted each report in a separate dataset, you can do so by performing multiple deployments, and\nonly including the name of one filename on each deployment.\n\nThis is a good option when you have a ton of data and you're concerned about blowing past a dataset's size limits.\n\n### Config Vars\n\n * The various `_FILENAME` variables determine both the name of the files, as well as which reports to place on that\n dataset. To skip a report, simply leave the name blank.\n * `START_DATE:` How far back to pull your historical data. Format: `2017-01-01`\n * `LAST_THIRTY_DAYS:` If the value is set to TRUE, it will always pull the last 30 days of data,\n regardless of `START_DATE`\n * `DW_TOKEN:` Pay a visit to https://data.world/settings/advanced and copy the Read/Write token\n * `DW_DATASET_SLUG:` As an example, if the URL of your dataset were `https://data.world/my-org/my-cool-dataset`,\n the dataset slug would be `my-org/my-cool-dataset`\n * `MARKETPLACE_IDS:` Marketplace IDs for the marketplaces you are registered to sell in. For the US market, use\n `ATVPDKIKX0DER`. Values for other markets can be found\n [here](http://docs.developer.amazonservices.com/en_US/dev_guide/DG_Endpoints.html). Multiple markets can be checked\n by including them as a comma-separated list, such as `ATVPDKIKX0DER,A2EUQ1WTGCTBG2`\n * The remaining variables are your Amazon MWS credentials that you receive upon registering as a developer.\n Instructions for doing so are available [here](http://docs.developer.amazonservices.com/en_US/dev_guide/DG_Registering.html).\n\n### Known Issues\n\nThis integration currently only supports two report types: All Orders and FBA Returns. Additional reports can be\nrequested through [data.world support](#support), or added by forking this repository and submitting a pull request.\n\n### Contributing\n\nThis integration has been released as an open-source project. Community participation is encouraged and highly\nappreciated. If you'd like to contribute, please follow the [Contributing Guidelines](CONTRIBUTING.md).\n\n### Support\n\nFor support, either create a [new issue](https://github.com/datadotworld/dw-mws-connector/issues) here on\nGitHub, or send an email to help@data.world.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatadotworld%2Fdw-mws-connector","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdatadotworld%2Fdw-mws-connector","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatadotworld%2Fdw-mws-connector/lists"}