{"id":16271266,"url":"https://github.com/dylanhogg/cloud-products","last_synced_at":"2025-10-05T03:31:11.397Z","repository":{"id":43340041,"uuid":"284358158","full_name":"dylanhogg/cloud-products","owner":"dylanhogg","description":"A package for getting cloud products and product descriptions from a cloud provider website.","archived":false,"fork":false,"pushed_at":"2024-03-20T16:17:03.000Z","size":6474,"stargazers_count":1,"open_issues_count":3,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-01-07T03:30:01.349Z","etag":null,"topics":["aws","cloud-products","crawler","data","text-processing"],"latest_commit_sha":null,"homepage":"https://pypi.org/project/cloud-products/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dylanhogg.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-08-01T23:50:31.000Z","updated_at":"2021-09-06T06:47:32.000Z","dependencies_parsed_at":"2024-10-27T21:38:58.054Z","dependency_job_id":"c9c32ba6-0d64-422f-ac20-7e4e786dcbe3","html_url":"https://github.com/dylanhogg/cloud-products","commit_stats":{"total_commits":52,"total_committers":1,"mean_commits":52.0,"dds":0.0,"last_synced_commit":"99409f5f928f507d81f87e5067699472b3676dc7"},"previous_names":[],"tags_count":8,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dylanhogg%2Fcloud-products","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dylanhogg%2Fcloud-products/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dylanhogg%2Fcloud-products/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dylanhogg%2Fcloud-products/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dylanhogg","download_url":"https://codeload.github.com/dylanhogg/cloud-products/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":235356171,"owners_count":18976822,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","cloud-products","crawler","data","text-processing"],"created_at":"2024-10-10T18:13:04.922Z","updated_at":"2025-10-05T03:31:05.594Z","avatar_url":"https://github.com/dylanhogg.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# cloud-products \n\n[![pypi Version](https://img.shields.io/pypi/v/cloud-products.svg?logo=pypi)](https://pypi.org/project/cloud-products/)\n[![Latest Tag](https://img.shields.io/github/v/tag/dylanhogg/cloud-products)](https://github.com/dylanhogg/cloud-products/tags)\n[![Build](https://github.com/dylanhogg/cloud-products/workflows/build/badge.svg)](https://github.com/dylanhogg/cloud-products/actions)\n[![Dependencies](https://img.shields.io/librariesio/github/dylanhogg/cloud-products)](https://libraries.io/github/dylanhogg/cloud-products)\n\nA package for getting cloud products and product descriptions from a cloud provider website with cache support.\n\nCurrently supports getting AWS product information from \n[https://aws.amazon.com/products](https://aws.amazon.com/products)\n\nGCP and Azure product information will be added in time.\n\n\n### Install from PyPi\n```shell script\npip install cloud-products\n```\n\n\n### Example 1: List AWS products\n```python\nfrom cloud_products.aws import AwsCrawler\nfor product in AwsCrawler().get_products():\n    print(f\"{product.code}: {product.name}: {product.desc}\")\n```\n\nExample output:\n```\nalexaforbusiness: Alexa for Business: Empower your Organization with Alexa\namazon-mq: Amazon MQ: Managed Message Broker for ActiveMQ\namplify: AWS Amplify: Build and deploy mobile and web applications\napi-gateway: Amazon API Gateway: Build, Deploy, and Manage APIs\n...\n```\n\n\n### Example 2: Get product descriptions as a list of lines\n```python\nfrom cloud_products.aws import AwsCrawler\ncloud_products = AwsCrawler()\nproduct = cloud_products.get_products()[0]\nlines = cloud_products.get_product_text(product)\nprint(lines[4])\n```\n\nExample output:\n```\nAlexa for Business is a service that enables organizations and employees to use Alexa to ...\n```\n\n\n### Example 3: Usage to get matching product(s):\n```python\nfrom cloud_products import aws\ncloud_products = aws.AwsCrawler()\nsagemaker_products = cloud_products.get_products_matching(\"sagemaker\")\nsagemaker_description = cloud_products.get_product_text(sagemaker_products[0])\nprint(sagemaker_description[3])\n```\n\nExample output:\n```\nAmazon SageMaker is a fully managed service that provides every developer and data scientist with ...\n```\n\n\n### Example 4: Save product descriptions and FAQ pages to files:\n```python\nfrom cloud_products import aws\ncloud_products = aws.AwsCrawler()\nfor product in cloud_products.get_products():\n    print(f\"Saving {product.name}\")\n    cloud_products.save_product(product, output_path)\n    cloud_products.save_faq(product, output_path)\n```\n\nExample output:\n```\nSaving Alexa for Business\nSaving Amazon MQ\nSaving AWS Amplify\nSaving Amazon API Gateway\n...\n```\n\n\n### Example 5: Get [Pandas](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.html) dataframe of products:\nNote: requires the optional `pandas` package to be installed.  \n\nThis dataframe has the product name, code, url and full descriptions.\n\n```python\nfrom cloud_products.aws import AwsCrawler\ndf = AwsCrawler().get_products_as_df()\nprint(df)\n```\n\nExample output:\n```\n                   name            std_name              code  ...                          seed_url                                               desc                                       product_text\n0    Alexa for Business  alexa for business  alexaforbusiness  ...  https://aws.amazon.com/products/               Empower your Organization with Alexa  Alexa for Business Use Alexa for work Get Star...\n1             Amazon MQ              aws mq         amazon-mq  ...  https://aws.amazon.com/products/                     Managed Message Broker Service  Amazon MQ Fully managed service for open sourc...\n2           AWS Amplify         aws amplify           amplify  ...  https://aws.amazon.com/products/       Build and deploy mobile and web applications  AWS Amplify Fastest, easiest way to build mobi...\n3    Amazon API Gateway     aws api gateway       api-gateway  ...  https://aws.amazon.com/products/                     Build, Deploy, and Manage APIs  Amazon API Gateway Create, maintain, and secur...\n4          AWS App Mesh        aws app mesh          app-mesh  ...  https://aws.amazon.com/products/                  Monitor and control microservices  AWS App Mesh Application-level networking for ...\n```\n\n\nCloud Products is distributed under the MIT license.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdylanhogg%2Fcloud-products","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdylanhogg%2Fcloud-products","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdylanhogg%2Fcloud-products/lists"}