{"id":23676501,"url":"https://github.com/pat8901/hpc-data-parser","last_synced_at":"2026-05-10T05:03:18.677Z","repository":{"id":238728066,"uuid":"789132148","full_name":"pat8901/hpc-data-parser","owner":"pat8901","description":"Analyzes Grid Engine log files converting them into a format suitable for time series analysis using Grafana. ","archived":false,"fork":false,"pushed_at":"2024-05-08T15:39:37.000Z","size":87,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-21T13:59:34.000Z","etag":null,"topics":["grafana","large-data","sqlite"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/pat8901.png","metadata":{"files":{"readme":"README.txt","changelog":null,"contributing":null,"funding":null,"license":"License.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-04-19T19:05:23.000Z","updated_at":"2024-05-08T15:39:40.000Z","dependencies_parsed_at":null,"dependency_job_id":"b54228ad-2937-4e5f-b024-4dc867a5fe15","html_url":"https://github.com/pat8901/hpc-data-parser","commit_stats":null,"previous_names":["pat8901/hpc-data-parser"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/pat8901/hpc-data-parser","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pat8901%2Fhpc-data-parser","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pat8901%2Fhpc-data-parser/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pat8901%2Fhpc-data-parser/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pat8901%2Fhpc-data-parser/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/pat8901","download_url":"https://codeload.github.com/pat8901/hpc-data-parser/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pat8901%2Fhpc-data-parser/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265506119,"owners_count":23778659,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["grafana","large-data","sqlite"],"created_at":"2024-12-29T14:53:57.795Z","updated_at":"2026-05-10T05:03:18.581Z","avatar_url":"https://github.com/pat8901.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"Grid Engine Log Analyzer\n\nOverview:\n\nThis program is designed to analyze Grid Engine log files and convert them into a format suitable for time series analysis using Grafana. \nIt consists of a Java program for log file parsing and CSV creation, followed by a bash script to convert the CSV into a SQLite database.\n\nFeatures:\n\n    Reads Grid Engine log files and extracts relevant data.\n    Converts log file data into a CSV format.\n    Uses a bash script to create a SQLite database from the CSV file.\n    Generates binned data tables for use in time series analysis.\n\nInstallation: (This program only runs on Linux systems. Only been tested on Ubuntu)\n\n    Ensure Java (JDK 11 or higher) is installed\n    Clone the repository: git clone https://github.com/pat8901/hpc-data-parser.git\n    Compile the Java program using the gradle wrapper: ./gradlew build\n    Ensure SQLite is installed on your system for the bash script to work.\n\nUsage:\n\n    Ensure that ge-log-analyzer-1.0.0.jar, make_db.sh, and ge_log_file are all in the same directory. (This limitation will be fixed in a later version release)\n\n    For example:\n        john@john-pc:~/Desktop/grid_engine_program$ ls\n        ge-log-analyzer-1.0.0.jar  make_db.sh  source_log.txt\n\n    Run the Java program: java -jar ge-log-analyzer-1.0.0.jar\n    Enter the path to the Grid Engine log file when prompted.\n    The program will create a CSV file with the reformatted data. \n    Using the newly created CSV file the program will automatically call the bash script to create a SQLite database with binned data tables.\n\nRequirements:\n\n    Java (JDK 11 or higher)\n    SQLite\n    Access to a Grafana server for visualization (optional)\n\nExample: (Bash)\n\n$ java -jar ge-log-analyzer-1.0.0\nEnter the path to the Grid Engine log file: /path/to/grid_engine.log\n\nLicense:\n\nThis project is licensed under the MIT License - see the LICENSE file for details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpat8901%2Fhpc-data-parser","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpat8901%2Fhpc-data-parser","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpat8901%2Fhpc-data-parser/lists"}