Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists tagged with large-dataset
A curated list of projects in awesome lists tagged with large-dataset .
https://github.com/DiskFrame/disk.frame
Fast Disk-Based Parallelized Data Manipulation Framework for Larger-than-RAM Data
data data-science large-dataset manipulation-data medium-data r
Last synced: 30 Jul 2024
https://github.com/fair-acc/chart-fx
A scientific charting library focused on performance optimised real-time data visualisation at 25 Hz update rates for data sets with a few 10 thousand up to 5 million data points.
chart-fx charting-libraries data-visualisation hacktoberfest java javafx large-dataset scientific-visualization
Last synced: 29 Sep 2024
https://github.com/privefl/bigreadr
R package to read large text files based on splitting + data.table::fread
large-dataset r-package read-csv
Last synced: 05 Aug 2024
https://github.com/kyegomez/EXA-1
An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!
artificial-intelligence dataset gpt4 jax kosmos large-dataset large-language-models multimodal multimodal-data multimodality pytorch pytorch-implementation triton
Last synced: 31 Jul 2024
https://github.com/maxhalford/tuna
:fish: A streaming ETL for fish
etl feature-extraction go golang large-dataset machine-learning online-algorithms stream stream-processing
Last synced: 02 Oct 2024
https://github.com/davidssmith/rawarray.jl
Raw array (RA) file format for simple, robust, and user-friendly N-dimensional array storage
bytes complex-numbers data-science file-format julia large-dataset large-files ra-format rawarray scientific-computing storage
Last synced: 30 Sep 2024
https://github.com/m-wells/alignedbinaryformat.jl
Memory-mapping made easy.
file-format input-output julia julia-language julia-package julialang large-dataset load memory-mapping save serialization
Last synced: 29 Sep 2024