{"id":19407575,"url":"https://github.com/brutusyhy/polars-explorer","last_synced_at":"2025-04-24T09:31:38.156Z","repository":{"id":260795551,"uuid":"882254250","full_name":"brutusyhy/polars-explorer","owner":"brutusyhy","description":"A data explorer app for Polars based on Tauri","archived":false,"fork":false,"pushed_at":"2024-11-11T12:17:33.000Z","size":903,"stargazers_count":30,"open_issues_count":5,"forks_count":4,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-03T03:05:54.398Z","etag":null,"topics":["data-analysis","data-science","data-visualization","dataframe","full-stack","polars","react","rust","tauri","typescript"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/brutusyhy.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-11-02T10:15:51.000Z","updated_at":"2025-03-29T05:18:42.000Z","dependencies_parsed_at":"2024-11-02T16:28:01.159Z","dependency_job_id":"ce5ed918-23cf-4f62-afa5-e0be4637bb68","html_url":"https://github.com/brutusyhy/polars-explorer","commit_stats":null,"previous_names":["brutusyhy/polars-explorer"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brutusyhy%2Fpolars-explorer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brutusyhy%2Fpolars-explorer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brutusyhy%2Fpolars-explorer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brutusyhy%2Fpolars-explorer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/brutusyhy","download_url":"https://codeload.github.com/brutusyhy/polars-explorer/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250600709,"owners_count":21457012,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-analysis","data-science","data-visualization","dataframe","full-stack","polars","react","rust","tauri","typescript"],"created_at":"2024-11-10T12:03:01.631Z","updated_at":"2025-04-24T09:31:38.148Z","avatar_url":"https://github.com/brutusyhy.png","language":"TypeScript","funding_links":[],"categories":["Tools build with Polars"],"sub_categories":["Ruby"],"readme":"# Polars Explorer\n\n## Introduction\n\nPolars Explorer aims to provide a lightweight GUI to data exploration/manipulation tasks using Rust Polars.\n\nIt is based on Tauri, which provides a lightweight webView to display the React frontend, and allows easy communication\nbetween the React frontend and the Rust backend.\n\nThis project aims to distinguish itself from other data exploration applications by relegating as much data manipulation\noperations to the highly performant Rust backend.\n\nThrough a combination of backend-provided paginated query, Polars-based lazy query evaluation and optimization, and\nlimiting unnecessary data copying and manipulation on the front end, it hopes to provide a very performant data explorer\nthat's capable of handling very large datasets.\n\nRight now, this project is largely at its inception, and any feedback/advice/help would be greatly appreciated!\n\n## Build\n\nThis project is scaffolded using `pnpm create tauri-app` with React and TypeScript.\n\nTo run this app in dev mode, first `cd polars-explorer`. Then, run `pnpm install` to install dependencies.\n\nAfter that, run `pnpm tauri dev`. It utilizes vite to monitor real-time changes to code, and recompile Rust/hot reload\nReact\ncode accordingly.\n\n## Functionalities\n\nAs this project is still at an early stage, it has only implemented a small portion of the designed functionalities.\nThese include:\n\n### Data Import\n\n1. Load (relatively) well-formatted csv files into a Frame\n\n### Frame/View Management\n\n1. Keep multiple Frames in memory, where each Frame can have multiple Views\n2. Freely switch between Frames and Views, where each view stores its reading progress\n3. Delete non-base Views and loaded Frames\n4. Rename Views and Frames\n5. Turn non-base Views into standalone Frames\n\n### Data Exploration/Manipulation\n\n1. A paginated Data Explorer tool\n2. A info panel Displaying View's shape and column information\n3. Create new Views by selecting columns\n4. Provide description of the Polars query plan\n\n### Data Export\n\n1. Export any View into a csv file\n\n## Test CSV\n\n/src-tauri/test-csv-generator is a tool that can generate different kinds of testing csv to check how well the app can\nhandle them\n\nThe scope of testing will be expanded in the future.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrutusyhy%2Fpolars-explorer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbrutusyhy%2Fpolars-explorer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrutusyhy%2Fpolars-explorer/lists"}