Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/tsale/EDR-Telemetry
This project aims to compare and evaluate the telemetry of various EDR products.
https://github.com/tsale/EDR-Telemetry
Last synced: about 1 month ago
JSON representation
This project aims to compare and evaluate the telemetry of various EDR products.
- Host: GitHub
- URL: https://github.com/tsale/EDR-Telemetry
- Owner: tsale
- Created: 2023-04-01T20:02:33.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-10-28T23:49:08.000Z (about 2 months ago)
- Last Synced: 2024-10-29T15:41:11.380Z (about 1 month ago)
- Language: Python
- Homepage:
- Size: 1.01 MB
- Stars: 1,666
- Watchers: 52
- Forks: 157
- Open Issues: 12
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-lists - EDR Telemetry
README
# EDR Telemetry
This repo provides a list of _**telemetry features**_ from EDR products and other endpoint agents such as [Sysmon](https://learn.microsoft.com/en-us/sysinternals/downloads/sysmon) broken down by category. The main motivation behind this project is to enable security practitioners to compare and evaluate the telemetry potential from those tools while encouraging EDR vendors to be more transparent about the telemetry features they do provide to their users and customers.
Besides compliance, investigations and forensics benefits, rich log telemetry empowers cyber defense teams to develop custom hunting, detection and analytics capabilities tailored to their needs.
Read details about this project in the initial release blog post [here](https://kostas-ts.medium.com/edr-telemetry-project-a-comprehensive-comparison-d5ed1745384b).
## Telemetry Definition
There are many types of *telemetry* when it comes to Security Instrumentation. Here we focus on agents or sensors generating telemetry in the form of *log data*, regardless of the format (json, key-value, csv), as long as the data is automatically generated and transmitted or streamed in near real-time.
## FAQ & Contributions
Please check our [FAQ](https://github.com/tsale/EDR-Telemetry/wiki/FAQ) page to know more and feel free to get in contact in case you cannot find an answer there.
In case you ware willing to contribute, please check the [Contributions](https://github.com/tsale/EDR-Telemetry/wiki#contribution-guidelines) page.
>**Disclaimer**\
The telemetry of the EDR products below could improve with time. The `last_updated` field is the last time the data sources have been updated. This might NOT always be up to date with the current telemetry capabilities of each product.
>
Telemetry Comparison Table
-----------------------------------
>**Disclaimer**\
The data below do not represent the capability of each of the EDR products to detect or prevent a threat. This is ONLY a comparison regarding the available telemetry for each product. Some products, such as Elastic EDR, make additional telemetry available in free or paid modules. Add-on modules, as well as signals, will not be taken into consideration for this project. Please read more about this on our FAQ page [here](https://github.com/tsale/EDR-Telemetry/wiki/FAQ#7-what-is-the-scope-of-the-telemetry-comparison-table-for-edr-products).
## EDR Evaluation and Scoring Script
This script evaluates and scores Endpoint Detection and Response (EDR) Solutions based on their capabilities. It reads data from the main JSON file (`EDR_telem.json`), which contains information about various EDRs and their features. The script then calculates a score for each EDR based on the presence and absence of certain features, as well as the category of the feature.
### Scoring Logic
- Each feature and category is assigned a weight.
- The weights represent the importance of the feature or category. For example, a feature with a weight of 1 is considered more important than a feature with a weight of 0.5.
- The compare.py script multiplies the weight of each feature by the weight of its category, adding this product to the EDR's total score.
- If a feature is absent, its weight is considered 0.
This scoring algorithm allows us to quantitatively compare different EDRs based on their capabilities. The higher the score, the more capable the EDR is. The weights can be adjusted as needed to reflect changes in the importance of different features or categories.
For more details, you can refer to the [Pull Request #61](https://github.com/tsale/EDR-Telemetry/pull/61).
### EDR Scores
| **No.** | **EDRs** | **Score** |
|:-------:|:---------------------:|:---------:|
| **1** | CrowdStrike | 37.45 |
| **2** | MDE | 34.8 |
| **3** | Sentinel One | 34.52 |
| **4** | Harfanglab | 32.22 |
| **5** | Cortex XDR | 31.42 |
| **6** | LimaCharlie | 31.2 |
| **7** | Trellix | 30.6 |
| **8** | ESET Inspect | 28.1 |
| **9** | Elastic | 28.02 |
| **10** | Cybereason | 25.65 |
| **11** | Symantec SES Complete | 24.3 |
| **12** | Sysmon | 23.2 |
| **13** | WatchGuard | 20.9 |
| **14** | Carbon Black | 20.37 |
| **15** | Trend Micro | 20.3 |
| **16** | Qualys | 13.5 |
## EDR Telemetry Table
Below is information about the EDR table, including all values for each EDR and a description for each attribute.
| CSV Values | JSON Values | Description
|------- |----------------------- |-----------------------
| ✅ | Yes | Implemented
| ❌ | No | Not Implemented
| ⚠️ | Partially | Partially Implemented
| ❓ | Pending | Pending Response
| 🪵 | Via EventLogs | Via Windows EventLogs
| 🎚️ | Via EnablingTelemetry | Additional telemetry that can be enabled easily as part of the EDR product but is not on by default.
**Last Updated:** July 05, 2024\
**Google SpreadSheet Table:** [Link](https://docs.google.com/spreadsheets/d/1ZMFrD6F6tvPtf_8McC-kWrNBBec_6Si3NW6AoWf3Kbg/edit?usp=sharing) \
**References to Documentation for each EDR product:** [Link](https://github.com/tsale/EDR-Telemetry/wiki#product-documentation-references)
| **Telemetry Feature Category** | **Sub-Category** | **Carbon Black** | **Cortex XDR** | **CrowdStrike** | **Cybereason** | **ESET Inspect** | **Elastic** | **Harfanglab** | **LimaCharlie** | **MDE** | **Qualys** | **Sentinel One** | **Symantec SES Complete** | **Sysmon** | **Trellix** | **Trend Micro** | **WatchGuard** |
|:------------------------------:|:---------------------------:|:----------------:|:--------------:|:---------------:|:--------------:|:----------------:|:-----------:|:--------------:|:---------------:|:-------:|:----------:|:----------------:|:-------------------------:|:----------:|:-----------:|:---------------:|:--------------:|
| **Process Activity** | Process Creation | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| **** | Process Termination | ⚠️ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ❌ | 🎚️ | ❌ |
| **** | Process Access | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ |
| **** | Image/Library Loaded | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| **** | Remote Thread Creation | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ |
| **** | Process Tampering Activity | ⚠️ | ⚠️ | ✅ | ❓ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ⚠️ | ✅ | ✅ | ✅ | ✅ | ❌ |
| **File Manipulation** | File Creation | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ⚠️ |
| **** | File Opened | ✅ | ❌ | ⚠️ | ❌ | ❌ | ✅ | ✅ | ⚠️ | ❌ | ❌ | ❌ | ✅ | ❌ | ✅ | ⚠️ | ⚠️ |
| **** | File Deletion | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
| **** | File Modification | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | ✅ | ❌ |
| **** | File Renaming | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | ⚠️ |
| **User Account Activity** | Local Account Creation | ❌ | 🪵 | ✅ | ❌ | ✅ | 🪵 | 🪵 | 🪵 | ✅ | ❌ | ✅ | ❌ | ❌ | ✅ | ❌ | ❌ |
| **** | Local Account Modification | ❌ | 🪵 | ⚠️ | ❌ | ✅ | 🪵 | 🪵 | 🪵 | ✅ | ❌ | 🪵 | ❌ | ❌ | ✅ | ❌ | ❌ |
| **** | Local Account Deletion | ❌ | 🪵 | ✅ | ❌ | ✅ | 🪵 | 🪵 | 🪵 | ✅ | ❌ | 🪵 | ❌ | ❌ | ✅ | ❌ | ❌ |
| **** | Account Login | 🪵 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | 🪵 | ✅ |
| **** | Account Logoff | 🪵 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 🪵 | ❌ | ❌ | 🪵 | ✅ | ❌ | ✅ | 🪵 | ✅ |
| **Network Activity** | TCP Connection | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 🎚️ | ✅ | ✅ | ✅ | ✅ |
| **** | UDP Connection | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | 🪵 | ✅ | ✅ | ✅ | ❌ | 🎚️ | ✅ | ✅ | ✅ | ✅ |
| **** | URL | ❌ | ❌ | ✅ | ❌ | ✅ | ⚠️ | ✅ | ⚠️ | ✅ | ✅ | 🎚️ | ⚠️ | ❌ | ✅ | ❌ | ⚠️ |
| **** | DNS Query | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ |
| **** | File Downloaded | ❌ | ❌ | ✅ | ⚠️ | ⚠️ | ❌ | ❌ | ⚠️ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ |
| **Hash Algorithms** | MD5 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| **** | SHA | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ |
| **** | IMPHASH | ❌ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ |
| **Registry Activity** | Key/Value Creation | ✅ | ✅ | ⚠️ | ⚠️ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| **** | Key/Value Modification | ✅ | ✅ | ⚠️ | ⚠️ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| **** | Key/Value Deletion | ✅ | ✅ | ❌ | ⚠️ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| **Schedule Task Activity** | Scheduled Task Creation | ❌ | 🪵 | ✅ | ✅ | ✅ | 🪵 | 🪵 | 🪵 | ✅ | ❌ | ✅ | ❌ | ❌ | ❌ | 🪵 | ❌ |
| **** | Scheduled Task Modification | ❌ | 🪵 | ✅ | ✅ | ❌ | 🪵 | 🪵 | 🪵 | ✅ | ❌ | ✅ | ❌ | ❌ | ✅ | ❌ | ❌ |
| **** | Scheduled Task Deletion | ❌ | 🪵 | ✅ | ❌ | ❌ | 🪵 | 🪵 | 🪵 | ✅ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
| **Service Activity** | Service Creation | ⚠️ | 🪵 | ✅ | ✅ | ✅ | 🪵 | 🪵 | ✅ | 🪵 | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ |
| **** | Service Modification | ❌ | 🪵 | ⚠️ | ❌ | ❌ | 🪵 | 🪵 | ✅ | ❌ | ❌ | 🎚️ | ❌ | ❌ | ✅ | ❌ | ⚠️ |
| **** | Service Deletion | ❌ | ❌ | ❌ | ❌ | ❌ | 🪵 | ❌ | ❓ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ |
| **Driver/Module Activity** | Driver Loaded | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ❌ | ❌ | ❌ |
| **** | Driver Modification | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ |
| **** | Driver Unloaded | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | ❌ | ❌ |
| **Device Operations** | Virtual Disk Mount | ❌ | ⚠️ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ |
| **** | USB Device Unmount | ❌ | ⚠️ | ✅ | ✅ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ❌ | 🎚️ | 🎚️ | ❌ | ❌ | ❌ | ✅ |
| **** | USB Device Mount | ⚠️ | ⚠️ | ✅ | ✅ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ❌ | 🎚️ | 🎚️ | ❌ | ❌ | ❌ | ✅ |
| **Other Relevant Events** | Group Policy Modification | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
| **Named Pipe Activity** | Pipe Creation | ⚠️ | ❌ | ✅ | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | 🎚️ | ❌ | ✅ | ❌ | ❌ | ❌ |
| **** | Pipe Connection | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | 🎚️ | ❌ | ✅ | ✅ | ❌ | ❌ |
| **EDR SysOps** | Agent Start | ❌ | ⚠️ | ✅ | ✅ | ❌ | ❌ | ✅ | ✅ | 🪵 | ✅ | ✅ | 🎚️ | ✅ | ❓ | ❌ | ❌ |
| **** | Agent Stop | ❌ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | 🪵 | ✅ | ✅ | 🎚️ | ✅ | ❓ | ❌ | ❌ |
| **** | Agent Install | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | ✅ | 🪵 | ✅ | ✅ | 🎚️ | ❌ | ✅ | ❌ | ✅ |
| **** | Agent Uninstall | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | 🎚️ | ❌ | ✅ | ❌ | ✅ |
| **** | Agent Keep-Alive | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | 🪵 | ✅ | ✅ | 🎚️ | ❌ | ❓ | ❌ | ❌ |
| **** | Agent Errors | ❌ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 🎚️ | ✅ | ❓ | ❌ | ❌ |
| **WMI Activity** | WmiEventConsumerToFilter | ❌ | 🎚️ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ❌ | ✅ | ⚠️ | ✅ | ✅ | 🪵 | ✅ |
| **** | WmiEventConsumer | ❌ | 🎚️ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ❌ | ✅ | ⚠️ | ✅ | ✅ | 🪵 | ✅ |
| **** | WmiEventFilter | ❌ | 🎚️ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ❌ | ✅ | ⚠️ | ✅ | ✅ | 🪵 | ✅ |
| **BIT JOBS Activity** | BIT JOBS Activity | ❌ | 🎚️ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ |
| **PowerShell Activity** | Script-Block Activity | ✅ | 🪵 | ✅ | ❌ | ✅ | ❌ | ✅ | 🪵 | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | ❌ | ❌ |
## Current Primary Maintainers
Kostas - [@kostastsale](https://twitter.com/Kostastsale)