https://github.com/jwijffels/ETLUtils
Utilities for easily loading big data from relational databases directly into ffdf objects in R.
https://github.com/jwijffels/ETLUtils
Last synced: 3 months ago
JSON representation
Utilities for easily loading big data from relational databases directly into ffdf objects in R.
- Host: GitHub
- URL: https://github.com/jwijffels/ETLUtils
- Owner: jwijffels
- Created: 2012-05-06T15:18:27.000Z (almost 13 years ago)
- Default Branch: master
- Last Pushed: 2020-07-31T08:18:19.000Z (over 4 years ago)
- Last Synced: 2024-09-21T13:50:07.904Z (5 months ago)
- Language: R
- Homepage: https://github.com/jwijffels/ETLUtils/wiki
- Size: 215 KB
- Stars: 20
- Watchers: 5
- Forks: 7
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- jimsghstars - jwijffels/ETLUtils - Utilities for easily loading big data from relational databases directly into ffdf objects in R. (R)
README
ETLUtils
=========
ETLUtils provides utility functions to execute standard ETL operations (using package ff) on large data.
Currently the following functions might be useful to you if you have some large dataset in SQL and want to import it immediately in an ffdf object
- read.dbi.ffdf (reading of SQL data through DBI)
- read.odbc.ffdf (reading of SQL data through RODBC)
- read.jdbc.ffdf (reading of SQL data through RJDBC)
An example can be found at http://www.bnosac.be/index.php/blog/5-get-your-large-sql-data-in-ff-swiftly and at http://www.bnosac.be/index.php/blog/6-readodbcffdf-a-readdbiffdf-for-fetching-large-corporate-sql-data
For users who want to store data from an ffdf back in a database, the package also provides
- write.dbi.ffdf (writing of ffdf data to a database table through DBI)
- write.odbc.ffdf (writing of ffdf data to a database table through RODBC)
- write.jdbc.ffdf (writing of ffdf data to a database table through RJDBC)
Other utilities
-----------
Other functions include factorise, matchmerge, recoder, naLOCFPlusone and renameColumns.
CRAN
-----------
This is the development version of the package which is available at CRAN.
To install the latest version from github `remotes::install_github("jwijffels/ETLUtils")`
To get the lastest version from CRAN:
* [ETLUtils @ CRAN]
[ETLUtils @ CRAN]: https://cran.r-project.org/package=ETLUtils