https://github.com/pfq/PFQ
Functional Network Framework for Multi-Core Architectures
https://github.com/pfq/PFQ
Last synced: 5 months ago
JSON representation
Functional Network Framework for Multi-Core Architectures
- Host: GitHub
- URL: https://github.com/pfq/PFQ
- Owner: pfq
- License: gpl-2.0
- Created: 2011-09-16T14:26:51.000Z (over 14 years ago)
- Default Branch: master
- Last Pushed: 2019-05-02T12:47:26.000Z (almost 7 years ago)
- Last Synced: 2024-06-21T20:06:03.880Z (almost 2 years ago)
- Language: C
- Homepage:
- Size: 24.4 MB
- Stars: 523
- Watchers: 50
- Forks: 71
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
- awesome-security - PFQ - PFQ is a functional networking framework designed for the Linux operating system that allows efficient packets capture/transmission (10G and beyond), in-kernel functional processing and packets steering across sockets/end-points. (Network / Fast Packet Processing)
- awesomesecurity - PFQ - PFQ is a functional networking framework designed for the Linux operating system that allows efficient packets capture/transmission (10G and beyond), in-kernel functional processing and packets steering across sockets/end-points. (Network / Fast Packet Processing)
README
PFQ v6.2
========
[](http://github.com/badges/stability-badges)
[](https://gitter.im/PFQ/pfq?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge)
Introduction
------------
PFQ is a functional framework designed for the Linux operating system built for efficient
packets capture/transmission (10G, 40G and beyond), in-kernel functional processing,
kernel-bypass and packets steering across groups of sockets/end-points.
It is highly optimized for multi-core architecture, as well as for network devices
equipped with multiple hardware queues. Compliant with any NIC, it provides a script
that generates accelerated network device drivers starting from the source code.
PFQ enables the development of high-performance network applications, and it is shipped
with a custom version of libpcap that accelerate and parallelize legacy applications.
Besides, a pure functional language designed for early stages in-kernel packet processing
is included: pfq-lang.
Pfq-Lang is inspired by Haskell and is intended to define applications that run on top
of network device drivers. Through pfq-lang it is possible to build efficient bridges,
port mirrors, simple firewalls, network balancers and so forth.
The framework includes the source code of the PFQ kernel module, user-space libraries
for C, C++11-14, Haskell language, an accelerated pcap library, an implementation of
pfq-lang as eDSL for C++/Haskell, an experimental pfq-lang compiler and a set of diagnostic tools.
Features
--------
* Data-path with full lock-free architecture.
* Preallocated pools of socket buffers.
* Compliant with a plethora of network devices drivers.
* Rx and Tx line-rate on 10-Gbit links (14,8 Mpps), tested with Intel ixgbe _vanilla_ drivers.
* Transparent support of kernel threads for asynchronous packets transmission.
* Transmission with active timestamping.
* Groups of sockets which enable concurrent monitoring of multiple multi-threaded applications.
* Per-group packet steering through randomized hashing or deterministic classification.
* Per-group Berkeley and VLAN filters.
* User-space libraries for C, C++11-14 and Haskell language.
* Functional engine for in-kernel packet processing with **pfq-lang**.
* pfq-lang eDLS for C++11-14 and Haskell language.
* **pfq-lang** compiler used to parse and compile pfq-lang programs.
* Accelerated pcap library for legacy applications (line-speed tested with [captop][2]).
* I/O user<->kernel memory-mapped communications allocated on top of HugePages.
* **pfqd** daemon used to configure and parallelize (pcap) legacy applications.
* **pfq-omatic** script that automatically accelerates vanilla drivers.
Publications
------------
* _"PFQ: a Novel Engine for Multi-Gigabit Packet Capturing With Multi-Core Commodity Hardware"_: Best-Paper-Award at [PAM2012](https://link.springer.com/chapter/10.1007/978-3-642-28537-0_7), paper avaiable from [here](https://pdfs.semanticscholar.org/d0a9/086aff225ed5a0ff0855216faee4072973e8.pdf)
* _"A Purely Functional Approach to Packet Processing"_: ANCS 2014 Conference (October 2014, Marina del Rey)
* _"Network Traffic Processing with PFQ"_: JSAC-SI-MT/IEEE journal Special Issue on Measuring and Troubleshooting the Internet (March 2016)
* _"Enabling Packet Fan--Out in the libpcap Library for Parallel Traffic Processing"_: Network Traffic Measurement and Analysis Conference (TMA 2017)
* _"A Pipeline Functional Language for Stateful Packet Processing"_: IEEE International Workshop on NEtwork Accelerated FunctIOns (NEAF-IO '17)
* _"The Acceleration of OfSoftSwitch"_: IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN '17)
Invited talks
-------------
* _"Functional Network Programming"_ at Tyrrhenian International Workshop on Digital Communication - (Sep. 2016)
* _"Software Accelerations for Network Applications"_ at NetV IRISA / Technicolor Workshop on Network Virtualization (Feb. 2017)
Licenses
--------
The PFQ kernel module is distributed with GPL license. User-space libraries and tools, instead, are distributed with a dual license scheme,
so they are available either as GPL or with a Commercial License. For more information contact the author.
Author
------
Nicola Bonelli
Contributors (in chronological order)
-------------------------------------
Andrea Di Pietro
Loris Gazzarrini
Gregorio Procissi
Giacomo Volpi
Luca Abeni
Tolysz
LSB
Andrey Korolyov
MrClick
Paul Emmerich
Bach Le
Marian Jancar
nizq
Giuseppe Sucameli
Sergio Borghese
Fabio Del Vigna
HomePages
---------
PFQ home-page is [www.pfq.io][1]
[1]: http://www.pfq.io
[2]: https://github.com/awgn/captop