https://github.com/wp-labs/wp-motor
https://github.com/wp-labs/wp-motor
data-collector data-processing engine etl events logging metrics observability oml parse security siem streaming warp-parse wp-parse wpl
Last synced: about 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/wp-labs/wp-motor
- Owner: wp-labs
- License: apache-2.0
- Created: 2026-01-22T09:09:25.000Z (5 months ago)
- Default Branch: main
- Last Pushed: 2026-04-11T03:21:31.000Z (2 months ago)
- Last Synced: 2026-04-11T05:31:04.324Z (2 months ago)
- Topics: data-collector, data-processing, engine, etl, events, logging, metrics, observability, oml, parse, security, siem, streaming, warp-parse, wp-parse, wpl
- Language: Rust
- Homepage: https://warpparse.ai/
- Size: 2.2 MB
- Stars: 8
- Watchers: 0
- Forks: 2
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
- Audit: audit.toml
- Agents: AGENTS.md
Awesome Lists containing this project
README
# Warp Parse Engine
[](https://github.com/wp-labs/wp-motor/actions)
[](https://codecov.io/gh/wp-labs/wp-motor)
[](LICENSE)
High-performance data parsing and processing engine built in Rust
## Overview
Warp Parse Engine (wp-motor) is a high-performance, modular data parsing and processing engine designed for large-scale data stream processing. It provides the domain-specific language WPL (Warp Processing Language) for defining parsing rules and supports multiple data formats and protocols.
## Features
- **High Performance**: Built with Rust for optimal performance and memory safety
- **Domain-Specific Language**: WPL (Warp Processing Language) for flexible rule definitions
- **Multi-format Support**: JSON, CSV, Protobuf, Syslog, and custom formats
- **Real-time Processing**: Stream processing with sub-millisecond latency
- **Extensible Architecture**: Plugin system for custom processors and sinks
- **Enterprise Ready**: Built-in monitoring, metrics, and fault tolerance
## Architecture
```
wp-motor (root)
├── crates/ # Core libraries
│ ├── orion_overload # Common utilities and primitives
│ ├── orion_exp # Expression evaluation
│ ├── wp-config # Engine configuration management
│ ├── wp-data-utils # Data structures and utilities
│ ├── wp-parser # Low-level parsing primitives
│ ├── wp-lang # WPL (Warp Processing Language)
│ ├── wp-oml # Object Modeling Language
│ ├── wp-knowledge # Knowledge database (KnowDB)
│ ├── wp-cli-core # CLI shared infrastructure
│ ├── wp-cli-utils # CLI utilities
│ ├── wp-proj # Project management utilities
│ └── wp-stats # Statistics collection
├── src/ # Main application
│ ├── core/ # Core engine
│ ├── runtime/ # Runtime components
│ ├── sources/ # Data sources
│ ├── sinks/ # Data sinks
│ ├── facade/ Public API
│ └── orchestrator/ # Orchestration
└── tests/ # Integration tests
```
## Feature Flags
- `default`: Community edition with core runtime
- `runtime-core`: Base runtime functionality
- `enterprise-backend`: Enterprise-only backend features
- `perf-ci`: Performance testing in CI
- `dev-tools`: Development utilities
## Contributing
We welcome contributions! Please see our [Contributing Guide](CONTRIBUTING.md) for details.
## License
This project is licensed under the Apache License 2.0 - see the [LICENSE](LICENSE) file for details.
## Support
- [Issues](https://github.com/wp-labs/wp-motor/issues)
- [Discussions](https://github.com/orgs/wp-labs/discussions)
---
## Warp Parse Engine（Warp 解析引擎）
用 Rust 构建的高性能数据解析和处理引擎
## 概述
Warp Parse Engine（wp-motor）是一个高性能、模块化的数据解析和处理引擎，专为处理大规模数据流而设计，具有低延迟和高吞吐量的特点。它提供了领域特定语言（WPL）来定义解析规则，并支持多种数据格式和协议。
## 特性
- **高性能**：使用 Rust 构建，确保最佳性能和内存安全
- **领域特定语言**：WPL（Warp Processing Language）用于灵活的规则定义
- **多格式支持**：JSON、CSV、Protobuf、Syslog 和自定义格式
- **实时处理**：流处理，延迟低于毫秒级
- **可扩展架构**：插件系统支持自定义处理器和输出端
- **企业级就绪**：内置监控、指标和容错功能
## 许可证
本项目采用 Apache License 2.0 许可证 - 详情请参见 [LICENSE](LICENSE) 文件。
## 支持
- [问题反馈](https://github.com/wp-labs/wp-motor/issues)
- [讨论区](https://github.com/orgs/wp-labs/discussions)
---
**Warp Parse Dev Team**