https://github.com/RIPE-NCC/hadoop-pcap
Hadoop library to read packet capture (PCAP) files
https://github.com/RIPE-NCC/hadoop-pcap
Last synced: 7 months ago
JSON representation
Hadoop library to read packet capture (PCAP) files
- Host: GitHub
- URL: https://github.com/RIPE-NCC/hadoop-pcap
- Owner: RIPE-NCC
- License: lgpl-3.0
- Created: 2011-10-02T12:59:52.000Z (over 14 years ago)
- Default Branch: master
- Last Pushed: 2023-06-14T22:55:54.000Z (almost 3 years ago)
- Last Synced: 2025-04-14T13:59:47.463Z (about 1 year ago)
- Language: Java
- Homepage:
- Size: 378 KB
- Stars: 209
- Watchers: 39
- Forks: 99
- Open Issues: 8
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-security - hadoop-pcap - Hadoop library to read packet capture (PCAP) files. (Big Data / Development)
- awesomesecurity - hadoop-pcap - Hadoop library to read packet capture (PCAP) files. (Big Data / Development)
- awesome-java - Hadoop PCAP
README
Hadoop PCAP library
===================
License
-------
This library is distributed under the LGPL.
See: https://raw.github.com/RIPE-NCC/hadoop-pcap/master/LICENSE
Repository
----------
UPDATE: Since Bintray has been discontinued, the latest releases of hadoop-pcap are not available there, and you have to build them from source.
hadoop-pcap
http://dl.bintray.com/hadoop-pcap/hadoop-pcap
Screencast
----------
We have created a screencast showing the use of the Hadoop PCAP SerDe in Hive using [Amazon Elastic MapReduce](http://aws.amazon.com/elasticmapreduce/).
You can find the video on YouTube: http://www.youtube.com/watch?v=FLxeQciax-Q
Components
----------
This project consists of two components:
### Library
Bundles the code used to read PCAPs. Can be used within MapReduce jobs to natively read PCAP files.
See: https://github.com/RIPE-NCC/hadoop-pcap/tree/master/hadoop-pcap-lib
### SerDe
Implements a Hive Serializer/Deserializer (SerDe) to query PCAPs using SQL like commands.
See: https://github.com/RIPE-NCC/hadoop-pcap/tree/master/hadoop-pcap-serde