https://github.com/jsmith0434/s3-cost-explorer

Retrieve and visualize cost and usage data for S3.
https://github.com/jsmith0434/s3-cost-explorer

Last synced: 10 days ago
JSON representation

Retrieve and visualize cost and usage data for S3.

• Host: GitHub
• URL: https://github.com/jsmith0434/s3-cost-explorer
• Owner: jsmith0434
• Created: 2023-03-18T18:36:25.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-03-18T18:37:45.000Z (over 1 year ago)
• Last Synced: 2024-03-13T03:24:46.714Z (8 months ago)
• Language: Python
• Size: 23.4 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# S3 Cost and Usage Explorer

## Retrieve, visualize, and evaluate S3 usage

### Files:  

main.py - The main file that drives the application.  

converter.py - Helper functions for converting a json to tabular data.  

usage.csv - Usage data transformed and stored as a csv.

usage.json - S3 usage data retrieved from AWS cost explorer.

usage.jpg - Time series of monthly S3 costs.

example_data - Sample S3 usage data that can be used to test functionality without connecting to an AWS account.

### Requirements:

An AWS account and S3 bucket.  

A IAM user with get/put/list S3 and cost explorer permissions.  

Pre-configured profile and access keys.

### Recommendations:

Host the python script on an EC2 instance with a Linux OS.  

Establish rotating access keys and allow developers to remotely SSH into the EC2 instance.  

Store model outputs in S3.  

Connect QuickSight to S3 data and create a monitoring and reporting dashboard.