https://github.com/infosys/niadatarconnector
R package to allow access views created in Infosys Information Platform (IIP)
https://github.com/infosys/niadatarconnector
Last synced: about 1 year ago
JSON representation
R package to allow access views created in Infosys Information Platform (IIP)
- Host: GitHub
- URL: https://github.com/infosys/niadatarconnector
- Owner: Infosys
- License: apache-2.0
- Created: 2016-11-17T09:56:33.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2019-09-11T13:39:19.000Z (almost 7 years ago)
- Last Synced: 2025-04-30T07:49:50.878Z (about 1 year ago)
- Language: R
- Size: 65.4 KB
- Stars: 2
- Watchers: 11
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
NIADataRConnector Package
========
## Introduction
The NIADataRConnector package has been built to allow data scientists and analysts access views created in NiaData(IIP).
It has many functions which enable various utilities like authentication of user, fetching of data & metadata from NiaData(IIP) and pushing data to HDFS and registering it is views/tables in NiaData(IIP).
## Various functions of the NIADataRConnector
* ***Authenticate User*** - NIADataRConnector has a module that invokes the authentication service to authenticate the user to access data on NIADataRConnector. In build encryption is used to store passwords
* ***Get Metadata*** - NIADataRConnector has a function that calls the web service to get metadata information about a NiaData(IIP) view/table. E.g. location of data on HDFS
* ***Register view*** - Registers data on HDFS as a view/table in NiaData(IIP) by calling the view registration web service.
* ***Access the data*** – This allows the user to fetch the tables from NiaData(IIP) workspace. This can be done
* By using standard Spark SQL queries leveraging standard JDBC connectors.
* By copying the data from HDFS location of the table to local machine
* By reading the file directly from HDFS location of the table
* ***Upload to HDFS*** - it allows the user to upload the R data as csv files to HDFS
## Installation
Get the latest stable development version from github:
```r
install_github("Infosys/NIADataRConnector")
```
## Example
```r
library(NIADataRConnector)
IIP.init("username")
IIP.uploadTable(dataSource = "testDataSource", workspaceName = "testWorkspace",hdfsDelimiter = ",", dataFrame= DataFrame object, tableName= "R_Table", fileType = "csv")
```