https://github.com/armahdavi/qff-evalation_code-data-processing-statistics-plotting

Data pipelines and processing codes, statistical modellings, descriptive statistics, and plot visualizations for QFF evaluation phase of for Mahdavi et al. (2021) (Environmental Pollution) Project Miestone: 2018 - 2021 Full-length article: https://www.sciencedirect.com/science/article/abs/pii/S0269749120370779
https://github.com/armahdavi/qff-evalation_code-data-processing-statistics-plotting

data-science data-visualization histogram matplotlib matplotlib-pyplot numpy pandas python

Last synced: 6 days ago
JSON representation

Data pipelines and processing codes, statistical modellings, descriptive statistics, and plot visualizations for QFF evaluation phase of for Mahdavi et al. (2021) (Environmental Pollution) Project Miestone: 2018 - 2021 Full-length article: https://www.sciencedirect.com/science/article/abs/pii/S0269749120370779

• Host: GitHub
• URL: https://github.com/armahdavi/qff-evalation_code-data-processing-statistics-plotting
• Owner: armahdavi
• Created: 2024-07-06T22:30:48.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2024-07-07T00:44:03.000Z (4 months ago)
• Last Synced: 2024-07-08T00:23:21.459Z (4 months ago)
• Topics: data-science, data-visualization, histogram, matplotlib, matplotlib-pyplot, numpy, pandas, python
• Language: Jupyter Notebook
• Homepage: https://www.sciencedirect.com/science/article/abs/pii/S0269749120370779
• Size: 435 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
## Summary

This repository summarizes all the data pipelines, data pre-processing codes, statistical models, descriptive statistics, plot visualizations, and ML modelings from the "QFF evaluation" phase of Mahdavi et al. (2021) (Environmental Pollution). The other phase ("Airborne Measurement") is presented in another repository.

Project Milestone: 2018 - 2021  

## The Hidden Story in Our Air Filters

HVAC filters play a dual role in our homes. Not only do they purify the air we breathe by trapping harmful particles, but they also act as silent samplers, collecting a record of these airborne contaminants. This makes them a valuable resource for experts in Indoor Air Quality (IAQ), Indoor Environmental Engineering, and Health. By analyzing the dust accumulated on used filters, researchers gain insights into the particles and contaminants we may be inhaling.

This analysis technique is known as Filter Forensics. When combined with metadata from HVAC systems (airflow rate, runtime, filter efficiency), it allows for calculating long-term airborne particle concentrations. This concentration data is crucial for exposure assessments in chronic health studies. This more quantitative approach is termed Quantitative Filter Forensics (QFF).

## QFF Evaluation

To ensure QFF is a valid approach, it is necessary to evaluate it. This evaluation can be performed by comparing what QFF measures to what an alternative airborne sampling measurement integrated over the lifetime of the HVAC filter used for QFF measurements.

## This Repository

This repository showcases the data pipelines, pre-processing code, statistical models, descriptive statistics, and visualizations used in Phase 1 of the Mahdavi & Siegel (2020) (AS&T) paper. 

In this phase, filters were artificially loaded with standardized test dust samples in the lab for further extraction experiment processes.

While the paper itself discusses the front-end results, this repository provides the underlying code that generates those results, allowing you to explore the analysis firsthand.

The pre-processing and logical Python codes are provided in .py (originally written in Spyder), and data visualization, statistical models, and front-end calculations are provided in .ipynb (written in Jupyter) for a guided walk-through of the data pipeline process.