{"id":24515928,"url":"https://github.com/josmarcristello/lvmtoh5","last_synced_at":"2025-03-15T10:41:29.272Z","repository":{"id":161879410,"uuid":"636510774","full_name":"josmarcristello/LVMtoH5","owner":"josmarcristello","description":"The LVM to H5 Converter is a Python-based tool designed to efficiently process and convert data from .lvm files to .h5 files. The converter reads .lvm files, commonly used in LabVIEW applications, and writes the data to .h5 files, which offer high performance and flexibility for scientific computing.","archived":false,"fork":false,"pushed_at":"2023-05-05T02:44:57.000Z","size":6,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-11T11:09:53.182Z","etag":null,"topics":["data-conversion","data-management","data-processing","hdf5","labview","lvm","python","scientific-computing"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/josmarcristello.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-05-05T02:32:54.000Z","updated_at":"2023-05-05T02:48:28.000Z","dependencies_parsed_at":"2023-09-30T00:16:05.822Z","dependency_job_id":null,"html_url":"https://github.com/josmarcristello/LVMtoH5","commit_stats":{"total_commits":6,"total_committers":1,"mean_commits":6.0,"dds":0.0,"last_synced_commit":"299c87f6d7078773bc571767020e8e830c5c1990"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/josmarcristello%2FLVMtoH5","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/josmarcristello%2FLVMtoH5/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/josmarcristello%2FLVMtoH5/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/josmarcristello%2FLVMtoH5/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/josmarcristello","download_url":"https://codeload.github.com/josmarcristello/LVMtoH5/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243719373,"owners_count":20336596,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-conversion","data-management","data-processing","hdf5","labview","lvm","python","scientific-computing"],"created_at":"2025-01-22T01:19:58.835Z","updated_at":"2025-03-15T10:41:29.245Z","avatar_url":"https://github.com/josmarcristello.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# LVM to H5 Converter\n\n![Python](https://img.shields.io/badge/python-3.10-blue.svg)\n![License: MIT](https://img.shields.io/badge/License-MIT-green.svg)\n![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg)\n\n## Overview\n\nThe LVM to H5 Converter is a Python-based tool designed to process and convert data from .lvm files to .h5 files. The tool reads .lvm files, extracts the data, and writes the data to .h5 files. This project aims to help users manage, process, and store large datasets more efficiently by converting data from the .lvm format, which is commonly used in LabVIEW applications, to the .h5 format, which is widely used in scientific computing for its performance and flexibility.\n\n## Features\n\n### Data Processing and Conversion\n- Reads and processes .lvm files containing data in a tabular format\n- Preserves headers in the final pandas dataframe\n- Handles large .lvm files by reading and writing data in chunks\n- Converts .lvm files to .h5 files, preserving the original data structure\n- Automatically detects existing .h5 files and skips them to avoid duplicating work\n\n### User Interface\n- Provides a simple command-line interface for specifying input and output folders\n- Displays a progress bar to track the conversion status\n- Offers functions for converting single .lvm files to .h5 files for debugging and individual file processing\n- Allows users to read .h5 files into pandas DataFrames for further data manipulation\n\n## Installation\n\n1. Clone the repository to your local machine:\n```\ngit clone https://github.com/josmarcristello/LVMtoH5\n```\n\n2. Change into the project directory:\n```\ncd LVMtoH5\n```\n3. Create a virtual environment and activate it:\n\n```\npython3 -m venv venv\nsource venv/bin/activate\n```\n4. Install the required packages:\n```\npip install -r requirements.txt\n```\n\n## Usage\n\n1. Place your .lvm files in an input folder of your choice.\n\n2. Create an output folder where the converted .h5 files will be stored.\n\n3. Run the main script with the input and output folder paths:\n\n```python\nfrom lvm_to_h5 import convert_lvm_to_h5\n\ninput_folder = \"path/to/input/folder\"\noutput_folder = \"path/to/output/folder\"\n\nconvert_lvm_to_h5(input_folder, output_folder)\n```\n\n4. The converted .h5 files will be stored in the output folder.\n\n5. To read the .h5 files into pandas DataFrames, you can use the `read_h5_to_dataframe` function:\n\n```python\nfrom lvm_to_h5 import read_h5_to_dataframe\n\nh5_file = \"path/to/output/file.h5\"\ndf = read_h5_to_dataframe(h5_file)\nprint(df.head())\n```\n\n## Contributing\n\nWe welcome contributions to improve this project. Please submit a pull request with your proposed changes, and ensure your code follows the project's style guidelines and best practices.\n\n## License\n\nThis project is licensed under the MIT License. Please see the `LICENSE` file for more information.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjosmarcristello%2Flvmtoh5","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjosmarcristello%2Flvmtoh5","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjosmarcristello%2Flvmtoh5/lists"}