https://github.com/data-integrations/data-profiler

Profiles the fields to generate statistics on each column specified.
https://github.com/data-integrations/data-profiler

cdap cdap-plugin data-quality profiler

Last synced: 4 months ago
JSON representation

Profiles the fields to generate statistics on each column specified.

• Host: GitHub
• URL: https://github.com/data-integrations/data-profiler
• Owner: data-integrations
• License: apache-2.0
• Created: 2017-12-07T17:45:01.000Z (about 8 years ago)
• Default Branch: develop
• Last Pushed: 2023-02-16T18:12:23.000Z (almost 3 years ago)
• Last Synced: 2024-04-16T07:44:14.970Z (almost 2 years ago)
• Topics: cdap, cdap-plugin, data-quality, profiler
• Language: Java
• Homepage: http://docs.cask.co/cdap
• Size: 64.5 KB
• Stars: 0
• Watchers: 29
• Forks: 1
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Security: SECURITY.md

Awesome Lists containing this project

README

          
Build

-----

To build your plugins:

    mvn clean package -DskipTests

The build will create a .jar and .json file under the ``target`` directory.

These files can be used to deploy your plugins.

UI Integration

--------------

The CDAP UI displays each plugin property as a simple textbox. To customize how the plugin properties

are displayed in the UI, you can place a configuration file in the ``widgets`` directory.

The file must be named following a convention of ``[plugin-name]-[plugin-type].json``.

See [Plugin Widget Configuration](https://docs.cdap.io/cdap/current/en/developer-manual/pipelines/developing-plugins/presentation-plugins.html)

for details on the configuration file.

The UI will also display a reference doc for your plugin if you place a file in the ``docs`` directory

that follows the convention of ``[plugin-name]-[plugin-type].md``.

When the build runs, it will scan the ``widgets`` and ``docs`` directories in order to build an appropriately

formatted .json file under the ``target`` directory. This file is deployed along with your .jar file to add your

plugins to CDAP.

Deployment

----------

You can deploy your plugins using the CDAP CLI:

    > load artifact  config-file 

For example, if your artifact is named 'my-plugins-1.0.0':

    > load artifact target/my-plugins-1.0.0.jar config-file target/my-plugins-1.0.0.json