https://github.com/kitestring/detectorstressquantification

ETL flat data exported from a Chemical Analyzer instrument (TOF-MS). While the data is still in memory, data is cleansed and linked so that primary and foreign keys can be generated prior to loading into a Postgres managed database using a Star schema. A CLI is implemented to query the DB to generate customizable data visualizations.
https://github.com/kitestring/detectorstressquantification

postgresql python3

Last synced: about 2 months ago
JSON representation

ETL flat data exported from a Chemical Analyzer instrument (TOF-MS). While the data is still in memory, data is cleansed and linked so that primary and foreign keys can be generated prior to loading into a Postgres managed database using a Star schema. A CLI is implemented to query the DB to generate customizable data visualizations.

• Host: GitHub
• URL: https://github.com/kitestring/detectorstressquantification
• Owner: kitestring
• Created: 2018-06-08T12:59:00.000Z (about 8 years ago)
• Default Branch: master
• Last Pushed: 2018-08-07T13:38:33.000Z (almost 8 years ago)
• Last Synced: 2025-03-12T16:44:34.154Z (over 1 year ago)
• Topics: postgresql, python3
• Language: Python
• Homepage:
• Size: 1.75 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# DetectorStressQuantification

### Application Dependencies

1. Python 3.6.4

1. Linux cinnamon 18.3 or Windows10 64 bit

1. pandas==0.22.0

1. numpy==1.14.0

1. matplotlib==2.1.2

1. psycopg2==2.7.4

1. os

1. pprint

1. datetime

1. re

1. math

### Application Description

ETL flat data exported from a Chemical Analyzer instrument (TOF-MS).  While the data is still in memory data is cleansed and linked so that primary and foreign keys can be generated prior to loading into a Postgres managed database using a Snowflake schema.  A CLI is implemented to query the DB to generate customizable data visualizations.

### Database Schema

![Schema](https://github.com/kitestring/DetectorStressQuantification/blob/master/DB_Setup/DetectorStress_Schema.png)

### Command Line Interface (CLI) Example

![CLI](https://github.com/kitestring/DetectorStressQuantification/blob/master/ExampleOutput/CLI_Example.png)

### To maintain confidentiality the data examples shown below are not “real” and are simulated data sets.

### Detector Measurement Ion Statistics Plot examle

![Data Set #1 Example](https://github.com/kitestring/DetectorStressQuantification/blob/master/ExampleOutput/DM_API_Analysis_Upgraded.png)

### System Performance vs Detector Voltage Offset

![Data Set #2 Example](https://github.com/kitestring/DetectorStressQuantification/blob/master/ExampleOutput/Eicosane_5_0pg_plots.png)