https://github.com/cclient/nifi-unique-processor
nifi的去重方案设计
https://github.com/cclient/nifi-unique-processor
Last synced: 13 days ago
JSON representation
nifi的去重方案设计
- Host: GitHub
- URL: https://github.com/cclient/nifi-unique-processor
- Owner: cclient
- License: apache-2.0
- Created: 2021-02-28T10:12:48.000Z (over 5 years ago)
- Default Branch: main
- Last Pushed: 2021-02-28T13:11:51.000Z (over 5 years ago)
- Last Synced: 2025-01-16T22:19:59.126Z (over 1 year ago)
- Language: Java
- Homepage: https://www.cnblogs.com/zihunqingxin/p/14460152.html
- Size: 10.7 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Nifi Unique Processor
================================
```html
-> unique by ${custom_id}->
```
nifi queued distinct/unique by 'custom key'
---
### deploy
#### 1 compile
`mvn package`
#### 2 upload to one of
```nifi
nifi.nar.library.directory=./lib
nifi.nar.library.directory.custom=./lib_custom
nifi.nar.library.autoload.directory=./extensions
nifi.nar.working.directory=./work/nar/
```
cp nifi-unique-nar/target/nifi-unique-nar-0.1.nar nifi/lib_custom/
#### 3 restart nifi if need
nifi/bin/nifi.sh restart