https://github.com/weaming/data-process
Make processing 2d data more convenient
https://github.com/weaming/data-process
Last synced: 2 months ago
JSON representation
Make processing 2d data more convenient
- Host: GitHub
- URL: https://github.com/weaming/data-process
- Owner: weaming
- Created: 2018-08-03T05:05:20.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2021-04-14T03:43:49.000Z (about 5 years ago)
- Last Synced: 2025-03-02T08:29:11.566Z (over 1 year ago)
- Language: Python
- Size: 41 KB
- Stars: 1
- Watchers: 3
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Data Process
Make processing 2d data more convenient
## Install
pip install data-process
## Module description
* collect_csv_data: Collect data in a directory contains CSV files
* date: Generate current date and time; get the range of and start, end day of a period date; convert bettween string and `datetime.datetime` type
* date_range: Get the range of date from the start, end, range gap you provided
* decimal_helper: Convert float to Decimal type
* dict_helper: Replace the keys of a dict; infinite `defaultdict` data structure; get data by a series of keys
* filter_date: Filter a series date string by the given start, end date
* green_dict: Make the `dict` compatibal with the `json.dumps`, especially for `date(time)` type
* group_by: Group a series of `dict` by a list of functions; degroup a deep grouped dict by the depths
* io_csv: Read, write csv files
* io_json: Read, write json files
* io_files: List files in a glob pattern directories
* io_lines: Read as lines from a file except the lines are blank or start with '#'
* iter_dict: Convert dict for output, handled by the type of values separately
* join: Left, right, inner, outer join a series of dict as like in SQL
* list_helper: Flat a nested list
* pandas_helper: Functions wrapper for using `pandas` conveniently. Convert `pandas.DataFrame` to a list of dict; aggregate DataFrame by a field.