Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with arrow

A curated list of projects in awesome lists tagged with arrow .

https://github.com/pola-rs/polars

Extremely fast Query Engine for DataFrames, written in Rust

arrow dataframe dataframe-library dataframes out-of-core polars python rust

Last synced: 01 Apr 2026

https://github.com/apache/arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

arrow parquet

Last synced: 18 Jan 2026

https://github.com/apache/datafusion

Apache DataFusion SQL Query Engine

arrow big-data dataframe datafusion olap python query-engine rust sql

Last synced: 18 Jun 2026

https://github.com/arrow-py/arrow

🏹 Better dates & times for Python

arrow date datetime hacktoberfest python time timestamp timezones

Last synced: 12 Dec 2025

https://github.com/roapi/roapi

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

analytics arrow blob-storage cloud-native columnar datafusion datasets delta-lake graphql in-memory-database parquet query query-frontends rest-api rust s3 sql static-datasets

Last synced: 11 Feb 2026

https://github.com/anseki/leader-line

Draw a leader line in your web page.

arrow attention bubble highlight leader line markup mouse spotlight svg

Last synced: 27 Sep 2025

https://github.com/apache/arrow-rs

Official Rust implementation of Apache Arrow

arrow parquet rust

Last synced: 12 May 2025

https://github.com/lakesoul-io/lakesoul

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

arrow big-data datafusion datalake flink huggingface lakehouse lakesoul postgresql python pytorch rust spark sql streaming vectorized velox

Last synced: 14 May 2025

https://github.com/lakesoul-io/LakeSoul

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

arrow big-data datafusion datalake flink huggingface lakehouse lakesoul postgresql python pytorch rust spark sql streaming vectorized velox

Last synced: 27 Mar 2025

https://github.com/apache/datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine

arrow big-data dataframe distributed olap python query-engine rust sql

Last synced: 12 Dec 2025

https://github.com/apache/incubator-gluten

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

arrow clickhouse simd spark-sql vectorization velox

Last synced: 14 May 2025

https://github.com/lakehq/sail

LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.

arrow artificial-intelligence big-data data data-engineering datafusion distributed-computing machine-learning pyspark python rust spark sql

Last synced: 14 Apr 2026

https://github.com/vortex-data/vortex

An extensible, state of the art columnar file format

array arrow compression python rust

Last synced: 10 Apr 2026

https://github.com/pierpo/react-archer

🏹 Draw arrows between React elements 🖋

arrow arrows dom draw-arrows react

Last synced: 13 May 2025

https://github.com/apache/datafusion-comet

Apache DataFusion Comet Spark Accelerator

arrow datafusion rust spark

Last synced: 01 Apr 2026

https://github.com/zagum/Android-ExpandIcon

Nice and simple customizable implementation of Google style up/down expand arrow.

android arrow expandable google-pixel material ui-components

Last synced: 21 Apr 2025

https://github.com/zagum/android-expandicon

Nice and simple customizable implementation of Google style up/down expand arrow.

android arrow expandable google-pixel material ui-components

Last synced: 16 May 2025

https://github.com/unum-cloud/UStore

Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️

acid apache-arrow arrow big-data bigdata database dataloader document-database graph-database iouring json key-value-store knn-search networkx nosql pandas python search spdk vector-search

Last synced: 09 Jun 2026

https://github.com/unum-cloud/ustore

Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️

acid apache-arrow arrow big-data bigdata database dataloader document-database graph-database iouring json key-value-store knn-search networkx nosql pandas python search spdk vector-search

Last synced: 11 Apr 2025

https://github.com/kylebarron/parquet-wasm

Rust-based WebAssembly bindings to read and write Apache Parquet data

apache-arrow apache-parquet arrow javascript parquet rust wasm webassembly

Last synced: 14 May 2025

https://github.com/RandomFractals/vscode-data-preview

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

array arrow avro config csv data excel extension json parquet perspective viewer vscode yaml

Last synced: 08 Apr 2025

https://github.com/randomfractals/vscode-data-preview

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

array arrow avro config csv data excel extension json parquet perspective viewer vscode yaml

Last synced: 04 Apr 2025

https://github.com/pola-rs/r-polars

Polars R bindings

arrow polars r rust

Last synced: 26 Apr 2026

https://pola-rs.github.io/r-polars/

Polars R bindings

arrow polars r rust

Last synced: 14 Apr 2026

https://github.com/replaysmike/binner

Open source parts inventory system for makers, electronics hobby, and professional engineers

arrow barcode binner digikey electronics inventory inventory-app inventory-management inventory-system makers mouser octopart parts-management raspberry-pi tme

Last synced: 01 Apr 2026

https://github.com/xorq-labs/xorq

multi-engine batch transformation framework

arrow dataframe elt machine-learning multi-engine python sklearn sql

Last synced: 06 Mar 2026

https://github.com/apache/arrow-adbc

Database connectivity API standard and libraries for Apache Arrow

arrow database

Last synced: 06 Jan 2026

https://github.com/duckdb/duckdb-rs

Ergonomic bindings to duckdb for Rust

arrow database duckdb ffi ffi-bindings olap rust

Last synced: 22 May 2026

https://github.com/antoniocasero/Arrows

Arrows is an animated custom view to give feedback about your UI sliding panels.

animations arrow bezier-path core-graphics indicator panels sliding-menu ux

Last synced: 13 Apr 2025

https://github.com/antoniocasero/arrows

Arrows is an animated custom view to give feedback about your UI sliding panels.

animations arrow bezier-path core-graphics indicator panels sliding-menu ux

Last synced: 09 Apr 2025

https://github.com/sutoiku/puffin

Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg

arrow duckdb iceberg serverless

Last synced: 23 Feb 2026

https://github.com/manojkarthick/pqrs

Command line tool for inspecting Parquet files

arrow parquet rust

Last synced: 16 May 2025

https://github.com/replaysMike/Binner

Open source parts inventory system for makers, electronics hobby, and professional engineers

arrow barcode binner digikey electronics inventory inventory-app inventory-management inventory-system makers mouser octopart parts-management raspberry-pi tme

Last synced: 06 Mar 2025

https://github.com/query-farm/airport

The Airport extension for DuckDB, enables the use of Arrow Flight with DuckDB

arrow arrow-flight duckdb duckdb-extension

Last synced: 05 Sep 2025

https://github.com/oap-project/gazelle_plugin

Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.

arrow native-kernels native-sql-engine spark vectorized-simd-optimizations

Last synced: 19 Mar 2025

https://github.com/abs-tudelft/fletcher

Fletcher: A framework to integrate FPGA accelerators with Apache Arrow

accelerators apache-arrow arrow fletcher fpga

Last synced: 09 Apr 2026

https://github.com/scikit-hep/awkward-0.x

Manipulate arrays of complex data structures as easily as Numpy.

analysis apache-arrow arrow big-data columnar columnar-storage hdf5 numpy parquet python python3 root root-cern scikit-hep

Last synced: 02 Oct 2025

https://github.com/toucantoco/fastexcel

A fast excel reader for Rust and Python

arrow pandas polars python rust

Last synced: 20 Jan 2026

https://github.com/tonbo-io/typed-arrow

First-class compile‑time Arrow schemas for Rust.

arrow data rust

Last synced: 06 Feb 2026

https://github.com/clickhouse/spark-clickhouse-connector

Spark ClickHouse Connector build on DataSourceV2 API

arrow clickhouse datasourcev2 grpc http spark

Last synced: 12 Apr 2025

https://github.com/ClickHouse/spark-clickhouse-connector

Spark ClickHouse Connector build on DataSourceV2 API

arrow clickhouse datasourcev2 grpc http spark

Last synced: 03 May 2025

https://github.com/wheretrue/biobear

Work with bioinformatic files using Arrow, Polars, and/or DuckDB

arrow bioinformatics biology biopython duckdb polars pyarrow python rust-bio samtools

Last synced: 20 Jan 2026

https://github.com/apache/arrow-nanoarrow

Helpers for Arrow C Data & Arrow C Stream interfaces

arrow

Last synced: 15 May 2025

https://github.com/jankaul/iceberg-rust

Rust implementation of Apache Iceberg with integration for Datafusion

arrow datafusion iceberg rust

Last synced: 15 May 2025

https://github.com/cda-group/arcon

State-first Streaming Applications in Rust

arrow data-analytics dataflow distributed-computing rust stream-processor

Last synced: 27 Apr 2025

https://github.com/datafusion-contrib/datafusion-dft

Batteries included CLI, TUI, and server implementations for DataFusion.

arrow cli data database datafusion tui

Last synced: 10 May 2025

https://github.com/xiangpenghao/liquid-cache

10x lower latency for cloud-native DataFusion

arrow cache data-analytics datafusion object-store parquet query-engine

Last synced: 21 Feb 2026

https://github.com/xhtmlboi/yocaml

YOCaml is a static site generator, mostly written in OCaml

arrow ocaml static-site-generator

Last synced: 05 Apr 2025

https://github.com/nmandery/h3ronpy

A data science toolkit for the H3 geospatial grid

arrow geopandas geospatial h3 pandas polars python

Last synced: 19 Feb 2026

https://github.com/yeun/open-arrow

Open Arrow is an open-source font that contains 112 arrow symbols from U+2190 to U+21ff

arrow font glyph symbol unicode

Last synced: 13 Apr 2025

https://github.com/mongodb-labs/mongo-arrow

MongoDB integrations for Apache Arrow. Export MongoDB documents to numpy array, parquet files, and pandas dataframes in one line of code.

apache-arrow arrow mongodb numpy-arrays pandas-dataframe parquet-files python

Last synced: 16 May 2025

https://github.com/chmp/serde_arrow

Convert sequences of Rust objects to Arrow tables

arrow

Last synced: 03 May 2026

https://github.com/AceFire6/ordered-arrowverse

A listing of all shows in the Arrowverse in watch order to ensure continuity and sensible ordering for crossover episodes

arrow crossovers episodes python quart series supergirl the-flash

Last synced: 09 Jul 2025

https://github.com/domoritz/streamlit-vega-lite

A Streamlit component to render interactive Vega, Vega-Lite, and Altair visualizations and access the selected data from Python

altair arrow python vega vega-lite

Last synced: 12 Aug 2025

https://github.com/igor-suhorukov/openstreetmap_h3

OSM planet dump high performance data loader. Transform OpenStreetMap World/Region PBF dump into partitioned by H3 regions PostGIS pgsnapshot (lossless) OSM schema representation and/or into ArrowIPC/Parquet dumps

apach-sedona apache-arrow apache-spark arrow citusdb column-store converter duckdb geometry-processing geospatial java openstreetmap parquet parquet-files pbf pbf-format postgis postgresql world

Last synced: 05 Oct 2025

https://github.com/coady/graphique

GraphQL service for arrow tables and parquet data sets.

arrow graphql parquet

Last synced: 09 May 2025

https://github.com/arrow-udf/arrow-udf

A User-Defined Function Framework for Apache Arrow.

arrow python rust udf wasm

Last synced: 06 Apr 2025

https://github.com/returnstring/convergence

A set of tools for writing servers that speak PostgreSQL's wire protocol

arrow postgresql rust

Last synced: 07 Apr 2025

https://github.com/uwdata/flechette

Fast, lightweight access to Apache Arrow data.

arrow data interchange

Last synced: 04 Apr 2025

https://github.com/returnString/convergence

A set of tools for writing servers that speak PostgreSQL's wire protocol

arrow postgresql rust

Last synced: 27 Apr 2025

https://github.com/rcapraro/kalidation

Kalidation = A Kotlin validation DSL

arrow dsl hibernate-validator jsr380 kotlin validation-dsl

Last synced: 14 Jan 2026

https://github.com/datafusion-contrib/datafusion-java

Java binding to Apache DataFusion

arrow ballista datafusion java

Last synced: 14 Jan 2026

https://github.com/pbower/minarrow

Apache Arrow and Polars compatible, Rust-first columnar data library for real-time and systems workloads

arrow data-science dataengineering polars rust

Last synced: 17 May 2026

https://github.com/datafusion-contrib/datafusion-materialized-views

Incremental view maintenance & query rewriting for materialized views in DataFusion

arrow big-data datafusion materialized-views rust sql

Last synced: 12 May 2026

https://github.com/biodatageeks/polars-bio

Blazing-Fast Bioinformatic Operations on Python DataFrames

arrow bioinformatics dataframes datafusion genomic-intervals genomic-ranges genomics pandas polars rust-lang

Last synced: 29 Jul 2025

https://github.com/quackscience/quackflight

DuckDB API Server with Arrow Flight SQL Airport support and concurrent writes/reads (quackpipe)

airport api arrow clickhouse duckdb duckdb-server flight flight-sql fuck-trump server

Last synced: 06 Sep 2025

https://github.com/lucapiccinelli/konad

Monads composition API that just works. For OOP developers

applicative-functors arrow composition functors kotlin kotlin-monads monads nullables

Last synced: 22 Jan 2026

https://github.com/datafusion-contrib/datafusion-distributed

Library for bringing distributed capabilities to Apache DataFusion

arrow datafusion distributed distributed-computing distributed-da distributed-systems query-e

Last synced: 25 Jan 2026

https://github.com/alttch/myval

Lightweight Apache Arrow data frame for Rust

arrow dataframe ipc rust

Last synced: 29 Mar 2025

https://github.com/shauryashaurya/learn-data-munging

Notes on Data Engineering with Pandas, PySpark, Dask, Ray, Arrow DataFusion, Polars etc.

arrow dask dask-distributed data-engineering datafusion jupyter numpy pandas polars pyspark ray spark

Last synced: 16 Apr 2025

https://github.com/biaochenxuying/split

js 实现上下拖动改变父 div 的高度，左右上下拖动动态分割孩子 div 的宽高

arrow javascript jquery split

Last synced: 18 Mar 2026

https://github.com/vknabel/Archery

Declare all your project's metadata and what you can do with it in one single place.

archery arrow cli hacktoberfest metadata mint swift swift-package-manager

Last synced: 14 May 2025

https://github.com/vknabel/archery

Declare all your project's metadata and what you can do with it in one single place.

archery arrow cli hacktoberfest metadata mint swift swift-package-manager

Last synced: 29 Sep 2025

https://github.com/metrico/influxdb3-community

Community InfluxDB 3.0 "IOx" static builds + containers + Examples for Developers & Integrators. Experiment with low-cost storage, unlimited cardinality and FlightSQL APIs

arrow datafusion flightsql flux influx influxdb influxdb3 iox lineprotocol musl rust

Last synced: 12 Apr 2025

https://github.com/respawn-app/ApiResult

Kotlin Multiplatform Error Handling. Catch and handle all errors. Avoid Crashes. Like Arrow but without the black magic. No boilerplate. No performance overhead. 90+ operators.

android arrow arrow-kt error-handling functional-programming kmm kmp kotlin monad result validation

Last synced: 02 Apr 2025

https://github.com/parafoxia/analytix

A simple yet powerful SDK for the YouTube Analytics API.

analytical-information api-wrapper arrow data excel google pandas polars python service utility youtube youtube-api

Last synced: 12 Mar 2026

https://github.com/apache/arrow-site

Mirror of Apache Arrow site

arrow

Last synced: 22 Apr 2025

https://github.com/tarkant/svg-dom-arrows

Draw arrows linking two DOM elements.

arrow dom path svg

Last synced: 29 Aug 2025

https://github.com/vast-data/vastdb_sdk

Python-based SDK designed for interacting with VAST Database & VAST Catalog, enabling schema and table management, efficient ingest, query and modification of columnar data.

arrow database olap python sdk

Last synced: 06 Mar 2026

https://github.com/josephbarbierdarnal/drawarrow

Drawing arrows for matplotlib made easy

arrow matplotlib python

Last synced: 05 Jul 2025

https://github.com/kxsystems/arrowkdb

kdb+ integration with Apache Arrow and Parquet

arrow kdb parquet q

Last synced: 12 Apr 2025

https://github.com/ashvardanian/stringtape

Apache Arrow-compatible space-efficient "tape" class in pure Rust to be used with StringZilla for GPU, NUMA, and disk transfers of variable length strings

allocator apache-arrow arrow pyarrow string-manipulation tape

Last synced: 09 Mar 2026

https://github.com/KxSystems/arrowkdb

kdb+ integration with Apache Arrow and Parquet

arrow kdb parquet q

Last synced: 02 May 2025

https://github.com/treebee/elixir-arrow

Experimental Elixir bindings for Apache Arrow including Parquet and DataFusion

arrow datafusion parquet query-engine

Last synced: 05 Mar 2026

https://github.com/arrow-kt/arrow-integrations

Λrrow Integrations is part of Λrrow, a functional companion to Kotlin's Standard Library

arrow functional-programming kotlin-library

Last synced: 17 Jun 2025