Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/thomasthaddeus/dataanalysistoolkit

DataAnalysisToolkit is a Python-based data analysis tool designed to streamline various data analysis tasks. It provides the ability to load data from CSV files, perform statistical calculations, detect outliers, clean data, and visualize data.
https://github.com/thomasthaddeus/dataanalysistoolkit

data-science matplotlib python python-script python3 scikit-learn

Last synced: 7 days ago
JSON representation

Host: GitHub
URL: https://github.com/thomasthaddeus/dataanalysistoolkit
Owner: thomasthaddeus
License: mit
Created: 2023-07-26T23:24:19.000Z (over 1 year ago)
Default Branch: main
Last Pushed: 2024-05-28T13:38:05.000Z (5 months ago)
Last Synced: 2024-05-29T00:17:40.605Z (5 months ago)
Topics: data-science, matplotlib, python, python-script, python3, scikit-learn
Language: Jupyter Notebook
Homepage: https://dataanalysistoolkit.readthedocs.io/en/latest/
Size: 1.14 MB
Stars: 2
Watchers: 2
Forks: 0
Open Issues: 157
Metadata Files:
- Readme: README.md
- License: License

Awesome Lists containing this project

README

# Data Analysis Toolkit

[![Upload Python Package](https://github.com/thomasthaddeus/DataAnalysisToolkit/actions/workflows/python-publish.yml/badge.svg)](https://github.com/thomasthaddeus/DataAnalysisToolkit/actions/workflows/python-publish.yml) [![PyPI](https://img.shields.io/pypi/v/DataAnalysisToolkit.svg)](https://pypi.org/project/DataAnalysisToolkit/) ![License](https://img.shields.io/github/license/thomasthaddeus/DataAnalysisToolkit.svg) ![Python Version](https://img.shields.io/pypi/pyversions/DataAnalysisToolkit.svg) ![Code Size](https://img.shields.io/github/languages/code-size/thomasthaddeus/DataAnalysisToolkit.svg) ![Last Commit](https://img.shields.io/github/last-commit/thomasthaddeus/DataAnalysisToolkit.svg) ![Issues](https://img.shields.io/github/issues-raw/thomasthaddeus/DataAnalysisToolkit.svg) ![Pull Requests](https://img.shields.io/github/issues-pr/thomasthaddeus/DataAnalysisToolkit.svg) [![Documentation Status](https://readthedocs.org/projects/dataanalysistoolkit/badge/?version=latest)](https://dataanalysistoolkit.readthedocs.io/en/latest/?badge=latest)

DataAnalysisToolkit is a comprehensive Python package offering a suite of tools designed for efficient data analysis. This toolkit simplifies tasks such as loading CSV data, performing statistical analysis, cleaning data, and visualizing results. It's an ideal tool for data analysts, scientists, and anyone looking to dive into data exploration and machine learning.

## Features

- **Data Loading**: Load data directly from CSV files into a Python environment.
- **Statistical Analysis**: Perform calculations like mean, median, mode, and trimmed mean.
- **Outlier Detection**: Identify outliers using the z-score method.
- **Data Cleaning**: Handle missing values, drop duplicates, and encode categorical data.
- **Data Splitting**: Easily split data into training and testing sets for machine learning models.
- **Data Visualization**: Create histograms and other plots to explore data visually.
- **Data Export**: Export cleaned and processed data back into CSV format.

## Enhanced Functionalities

- **Advanced Visualization**: Utilize a dedicated visualizer for creating a variety of insightful data plots.
- **Feature Engineering**: Enhance your data with new, informative features.
- **Model Evaluation**: Assess the performance of machine learning models.
- **Report Generation**: Automatically generate comprehensive HTML reports with summaries and visualizations.
- **Data Imputation**: Implement advanced imputation techniques to handle missing data.

This toolkit is an asset for conducting preliminary data analysis, and it seamlessly integrates into larger data processing workflows.

## Getting Started

Here's how you can get started with DataAnalysisToolkit:

```python
from data_analysis_toolkit import DataAnalysisToolkit

# Initialize the analyzer with the path to a CSV file
analyzer = DataAnalysisToolkit('../data/test.csv')

# Calculate the mean, median, mode, and trimmed mean of a column
statistics = analyzer.calculate_budget_statistics('column_name')
print(statistics)

# Detect outliers in a column using the z-score method
outliers = analyzer.detect_outliers('column_name')
print(outliers)

# Handle missing values in a column
analyzer.handle_missing_values('column_name', strategy='fill', fill_value=0)

# Drop duplicate rows in the DataFrame
analyzer.drop_duplicates()

# Encode categorical features in the DataFrame
analyzer.encode_categorical_features()

# Split the data into training and testing sets
X_train, X_test, y_train, y_test = analyzer.split_data('target_column')

# Plot a histogram of a column
analyzer.plot_data('column_name')

# Export the data to a CSV file
analyzer.export_data('new_file.csv')
```

## Installation

Install DataAnalysisToolkit using pip:

```bash
pip install dataanalysistoolkit
```

## Documentation

For detailed documentation, examples, and usage guides, please visit [DataAnalysisToolkit Documentation](https://dataanalysistoolkit.readthedocs.io/en/latest/).

## Contributing

Contributions are welcome! For guidelines on how to contribute, please refer to our [Contribution Guide](https://github.com/thomasthaddeus/DataAnalysisToolkit/CONTRIBUTING.md).

## License

DataAnalysisToolkit is open-sourced under the MIT License. For more details, see the [LICENSE](./LICENSE) file.

---

Developed with ❤ by the DataAnalysisToolkit Team.