https://github.com/asllop/csv-olap
OLAP tool for CSV files using SQL and PANDAS syntax.
https://github.com/asllop/csv-olap
csv olap pandas pandasql pandastable python sql tkinter tkintertable
Last synced: 4 days ago
JSON representation
OLAP tool for CSV files using SQL and PANDAS syntax.
- Host: GitHub
- URL: https://github.com/asllop/csv-olap
- Owner: asllop
- License: mit
- Created: 2021-02-12T16:23:19.000Z (about 5 years ago)
- Default Branch: master
- Last Pushed: 2021-06-28T09:21:26.000Z (almost 5 years ago)
- Last Synced: 2023-08-06T19:54:50.777Z (over 2 years ago)
- Topics: csv, olap, pandas, pandasql, pandastable, python, sql, tkinter, tkintertable
- Language: Python
- Homepage:
- Size: 251 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# CSV-OLAP
OLAP tool for CSV files.
## Introduction
Have you ever had a CSV file, opened with your favourite spreadsheet application, and you desired being able to work with it like in a database? Well, I did, and usually ended up by loading the file with RStudio or Jupyter+Python. But I always wanted an easier way to work with it. That's the reason I created this super simple python script.
## Installation
Prerequisites: Python 3, pip and venv.
```bash
python3.x -m venv env # where "3.x" is a specific version in your system
source env/bin/activate
pip install -r requirements.txt
```
## Usage
To run CSV-OLAP just write:
```bash
python csvolap.py path/to/file.csv
```
You can also specify the query language you want to use, SQL or PANDAS:
```bash
python csvolap.py path/to/file.csv -l pandas
```
> NOTE: If you get this error on mac:
> `ModuleNotFoundError: No module named '_tkinter'`,
> You may need to install python-tk:
> `brew install python-tk`
Default is SQL.
## Queries
To run a query, write in the text field at the top of the window and press enter.
For the SQL language, the syntax is the same of SQLite. The table name is "model". For example, if your CSV has a field named "Age" and you want to select only the rows where age is greater or equal than 35:
```sql
SELECT * FROM model WHERE "Age" >= 35
```
The other query language is PANDAS. It has the same syntax used in Python when working with pandas data frames. The DataFrame name is "model", and the pandas object is "pd". Following the previous example, in pandas we would do:
```python
model[model["Age"] >= 35]
```
## CSV Parsing
To parse the CSV files it uses Pandas `read_csv` method, with the default arguments. It also post process the DataFrame, cleaning the strings by removing the quotes and all leading and trailing whitespaces. This may be not adequate for all CSV formats. If your CSV doesn't load well, you will have to pre process it or change the parsing mechanism in the script.