https://github.com/knapply/datapan

https://github.com/knapply/datapan

Last synced: 5 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/knapply/datapan
• Owner: knapply
• License: other
• Created: 2020-02-13T13:03:31.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2020-02-15T22:40:16.000Z (over 6 years ago)
• Last Synced: 2026-01-13T10:12:17.811Z (6 months ago)
• Language: Rust
• Size: 84 KB
• Stars: 1
• Watchers: 1
• Forks: 1
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          

# _`datapan`_ 

![stability-experimental](https://img.shields.io/badge/stability-experimental-yellow.svg)

[![Build](https://github.com/knapply/datapan/workflows/Rust+Python/badge.svg)](https://github.com/knapply/datapan/actions)

[![Depends](https://img.shields.io/badge/Depends-Python%3E=3.6-darkgreen.svg)](https://www.python.org/)

[![PyPI](https://badge.fury.io/py/datapan.svg)](https://badge.fury.io/py/datapan)

[![PyPI download month](https://img.shields.io/pypi/dm/datapan.svg)](https://pypi.python.org/pypi/datapan/)

[![Crates.io](https://img.shields.io/crates/v/datapan.svg)](https://crates.io/crates/datapan)







__This is still a worflow test bed. It is not yet useful.__

_`datapan`_ sifts through enormous files in parallelized Rust to only grab the data you want as quickly and memory-efficiently as possilbe.




# Installation

```sh

## create/activate venv

# sudo apt-get install python3-venv

# python -m venv datapan_env

# source datapan_env/bin/activate

# python -m pip install --upgrade pip

pip install datapan

```

# Usage

```python

import datapan

some_dir = ""

test = datapan.hello_rust(some_dir)

print(test)

```

# Developer Version

* Rust (nightly)

```sh

curl https://sh.rustup.rs -sSf | sh

# rustup default nightly

rustup update nightly

```

* Poetry

```sh

pip install poetry

```

```sh

make install

make test

```