Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/vdaburon/jmeter-elastic-apm
Manage Elastic Application Performance Monitoring integration for Apache JMeter to see the page timeline in Kibana APM
https://github.com/vdaburon/jmeter-elastic-apm
apm elastic-apm elasticsearch elasticsearch-apm jmeter jmeter-plugin monitoring
Last synced: 4 days ago
JSON representation
Manage Elastic Application Performance Monitoring integration for Apache JMeter to see the page timeline in Kibana APM
- Host: GitHub
- URL: https://github.com/vdaburon/jmeter-elastic-apm
- Owner: vdaburon
- Created: 2024-01-10T12:50:27.000Z (10 months ago)
- Default Branch: main
- Last Pushed: 2024-02-01T12:28:54.000Z (10 months ago)
- Last Synced: 2024-08-03T02:08:30.160Z (3 months ago)
- Topics: apm, elastic-apm, elasticsearch, elasticsearch-apm, jmeter, jmeter-plugin, monitoring
- Language: Java
- Homepage:
- Size: 612 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-jmeter - Elastic APM integration - Manages the integration of Elastic Application Performance Monitoring API in Apache JMeter script. (APM Integration / Utilities)
README
Manages the integration of ElasticSearch Application Performance Monitoring API in the Apache JMeter.
Link to github project jmeter-elastic-apm
# Apache JMeter with integration of ElasticSearch Application Performance Monitoring
This tool manages the integration of ElasticSearch Application Performance Monitoring API in the Apache JMeter.
The main goal is to show the timeline of pages declared in JMeter script in the Kibana APM. For each page on the JMeter side, have all the server-side calls grouped together, the SQL queries and the inter-application exchanges in the notion of page.
This tool adds JSR223 groovy sampler to create a new APM Transaction before a JMeter Transaction Controller
and adds JSR223 groovy sampler to end the transaction after the JMeter Transaction Controller
This tool **adds** also User Defined Variables for elastic APM configuration
This tool could **remove** all JSR223 groovy that contains api calls to return to the initial JMeter script.
## Example
A simple JMeter script with 3 Transaction Controller corresponding to 3 different pages
Launch the tool to modify the script : script1.jmx
java -jar jmeter-elastic-apm-<version>-jar-with-dependencies.jar -file_in script1.jmx -file_out script1_add.jmx -action ADD -regex SC.*
and the script (script1_add.jmx) after **action** = **ADD**
Each JMeter Transaction Controller (page) is surround with a begin transaction and an end transaction (use groovy api call).
In the "groovy begin transaction apm", the groovy code calls the ElasticApm API (simplified code) :
Transaction transaction = ElasticApm.startTransaction();
Scope scope = transaction.activate();
transaction.setName(transactionName); // contains the JMeter Transaction Controller Name
And in the "groovy end transaction apm", the groovy code calls the ElasticApmp API (simplified code):
transaction.end();
In View Results Tree, you will see new request headers (traceparent and elastic-apm-traceparent) automatically added by the elastic apm agent with the transaction id (e.g: 4443e451a1f7d42abdfbd739d455eac5) created by the jsr223 groovy begin transaction apm.
You will see all Transactions in Kibana with the vision of the page in JMeter (JMeter Transaction Controller usually == page) (click on image to see the full size image)
And the TIMELINE for JMeter Transaction Controller, you see the JMeter Page and the web application gestdoc running in Tomcat (click on image to see the full size image)
## Simplified architecture diagram
The simplified architecture : Apache JMeter and a java apm agent, Apache Tomcat and the java apm agent with web application gestdoc, ElasticSearch suite with ElasticSearch, APM Server and Kibana, a user views the Kibana Dashboards with navigator.
## License
See the LICENSE file Apache 2 [https://www.apache.org/licenses/LICENSE-2.0](https://www.apache.org/licenses/LICENSE-2.0)
## Ready to use
In the [Release of the project](https://github.com/vdaburon/jmeter-elastic-apm/releases) you will find the tool compiled in one (uber) jar file which is directly usable.
## Help
[main] INFO io.github.vdaburon.jmeter.elasticapmxml.ElasticApmJMeterManager - main begin
usage: io.github.vdaburon.jmeter.elasticapmxml.ElasticApmJMeterManager -action <action> [-extract_end <extract_end>]
[-extract_start <extract_start>] [-extract_udv <extract_udv>] -file_in <file_in> -file_out <file_out> [-help]
[-regex <regex>]
io.github.vdaburon.jmeter.elasticapmxml.ElasticApmJMeterManager
-action <action> action ADD or REMOVE, ADD : add groovy api call and REMOVE : remove groovy api call
-extract_end <extract_end> optional, file contains groovy end call api (e.g : extract_end.xml), default read file
in the jar
-extract_start <extract_start> optional, file contains groovy start call api (e.g : extract_start.xml), default read
file in the jar
-extract_udv <extract_udv> optional, file contains User Defined Variables (e.g : extract_udv.xml), default read
file in the jar
-file_in <file_in> JMeter file to read (e.g : script.jmx)
-file_out <file_out> JMeter file modified to write (e.g : script_add.jmx)
-help Help and show parameters
-regex <regex> regular expression matches Transaction Controller Label (default .*) (e.g : SC[0-9]+_.
for SC01_P01_HOME or SC09_P12_LOGOUT)
E.g : java -jar jmeter-elastic-apm-<version>-jar-with-dependencies.jar -file_in script1.jmx -file_out script1_add.jmx
-action ADD -regex SC.*
E.g : java -jar jmeter-elastic-apm-<version>-jar-with-dependencies.jar -file_in script1_add.jmx -file_out
script1_remove.jmx -action REMOVE -regex .*
[main] INFO io.github.vdaburon.jmeter.elasticapmxml.ElasticApmJMeterManager - main end (exit 1) ERROR
## Properties in the User Defined Variables
This tool add "User Defined Variables" with default value
This variables could be changed with JMeter properties at launch time, this properties could be set with -J<property>
elastic APM properties are :
| property name | comment |
|------------------|--------------------------------------------------------------------------------------------------|
| param_apm_active | default : TRUE , TRUE OR FALSE, if TRUE then api is call |
| param_apm_prefix | default : TR_ , Prefix of the transaction name, could be empty, SC01_LOGIN will be TR_SC01_LOGIN |
E.g : jmeter -Jparam_apm_prefix=TRANS_ , SC01_LOGIN will be TRANS_SC01_LOGIN in Kibana transactions list
## Limitation at one level Transaction Controller
The main limitation of this tool is only one Transaction Controller level. You can't instrument a Transaction Controller that contains others Transaction Controller because the groovy script use ONE variable to save the Transaction Controller Label. The Parent Transaction Controller set the label and the children Transaction Controller set the same variable and overwrite previous parent label. As a result, the parent will not have an end of transaction.
You can manually remove the groovy code before the parent Transaction Controller or give the regular expression for only children Transaction Controller.
## Start Apache JMeter with ELASTIC APM agent and ELASTIC APM api library
### Declare the ELASTIC APM Agent
Url to find the apm agent : [https://mvnrepository.com/artifact/co.elastic.apm/elastic-apm-agent](https://mvnrepository.com/artifact/co.elastic.apm/elastic-apm-agent)
Add the ELASTIC APM Agent somewhere in the filesystem (could be in the <JMETER_HOME>\lib but not mandatory)
In <JMETER_HOME>\bin modify the jmeter.bat or setenv.bat
Add ELASTIC APM configuration likes :
set APM_SERVICE_NAME=yourServiceName
set APM_ENVIRONMENT=yourEnvironment
set APM_SERVER_URL=http://apm_host:8200
set JVM_ARGS=-javaagent:<PATH_TO_AGENT_APM_JAR>\elastic-apm-agent-<version>.jar -Delastic.apm.service_name=%APM_SERVICE_NAME% -Delastic.apm.environment=%APM_ENVIRONMENT% -Delastic.apm.server_urls=%APM_SERVER_URL%
Another solution, create a windows shell likes jmeter_with_elasticapm.bat in the <JMETER_HOME>\bin:
set APM_SERVICE_NAME=yourServiceName
set APM_ENVIRONMENT=yourEnvironment
set APM_SERVER_URL=http://apm_host:8200
set JVM_ARGS=-javaagent:<PATH_TO_AGENT_APM_JAR>\elastic-apm-agent-<version>.jar -Delastic.apm.service_name=%APM_SERVICE_NAME% -Delastic.apm.environment=%APM_ENVIRONMENT% -Delastic.apm.server_urls=%APM_SERVER_URL% & jmeter.bat
Remark the **& jmeter.bat** at end of the line with set JVM_ARGS
### Add the ELASTIC APM library
Add the ELASTIC APM api library in the <JMETER_HOME>\lib\apm-agent-api-<version>.jar
This library is use by JSR223 groovy code.
Url to find the ELASTIC APM library : [https://mvnrepository.com/artifact/co.elastic.apm/apm-agent-api](https://mvnrepository.com/artifact/co.elastic.apm/apm-agent-api)
## Use jmeter maven plugin and elastic java agent
You could launch a load test with the jmeter maven plugin and ELASTIC APM Agent
[https://github.com/jmeter-maven-plugin/jmeter-maven-plugin](https://github.com/jmeter-maven-plugin/jmeter-maven-plugin)
Paths are relative to the home maven project
- Put your csv files in /src/test/jmeter directory (e.g : logins.csv)
- Put the apm-agent-api-${elastic_apm_version}.jar in /src/test/jmeter directory
- Put your jmeter script that contains groovy code added with **jmeter-elastic-apm** tool in /src/test/jmeter directory (e.g : script1_add.jmx)
- In the maven build section, in the configuration > testPlanLibraries > declare the apm api library co.elastic.apm:apm-agent-api:${elastic_apm_version}
- In the jMeterProcessJVMSettings > arguments add apm agent configuration likes:
-javaagent:${project.build.directory}/jmeter/testFiles/elastic-apm-agent-${elastic_apm_version}.jar
-Delastic.apm.service_name=${elastic_apm_service_name}
-Delastic.apm.environment=${elastic_apm_environment}
-Delastic.apm.server_urls=${elastic_apm_urls}
A pom.xml example, the elastic_apm_version is set to "1.37.0" for the ELASTIC APM Agent agent and the ELASTIC APM library but you could choose another version :
```XML
4.0.0
io.github.vdaburon.jmeter
gestdoc-maven-launch-loadtest-apm
1.0
UTF-8
1.8
1.8
256
756
1.37.0
YourServiceNane
YourEnvironment
http://apm_server:8200
com.lazerycode.jmeter
jmeter-maven-plugin
3.6.1
configuration
configure
jmeter-tests
jmeter
5.5
co.elastic.apm:apm-agent-api:${elastic_apm_version}
false
${jvm_xms}
${jvm_xmx}
-javaagent:${project.build.directory}/jmeter/testFiles/elastic-apm-agent-${elastic_apm_version}.jar
-Delastic.apm.service_name=${elastic_apm_service_name}
-Delastic.apm.environment=${elastic_apm_environment}
-Delastic.apm.server_urls=${elastic_apm_urls}
-Duser.language=en
script1_add.jmx
false
false
csv
```
### Usage Maven
The maven groupId, artifactId and version, this plugin is in the **Maven Central Repository** [](https://maven-badges.herokuapp.com/maven-central/io.github.vdaburon/jmeter-elastic-apm)
```xml
io.github.vdaburon
jmeter-elastic-apm
1.3
```
## Advanced usage
### Change the XML extract file
The action ADD of this tool is reading 3 XML files that contains extract of the XML JMeter script to add the 1) "User Defined Variables", 2) "JSR223 groovy begin transaction apm" and 3) "JRS223 groovy end transaction apm".
This files are include in the tool jar file.
You can change the XML files to include by indicating the path to the new XML files with the parameters -extract_udv or -extract_start or -extract_end
You want to change the "JSR223 start transaction apm" with your own file.
E.g. :
java -jar jmeter-elastic-apm-<version>-jar-with-dependencies.jar -file_in script1.jmx -file_out script1_add.jmx -action ADD -regex SC.* -extract_start my_xml_file.xml
You want to change all 3 files with yours XML files.
E.g. :
java -jar jmeter-elastic-apm-<version>-jar-with-dependencies.jar -file_in script1.jmx -file_out script1_add.jmx
-action ADD -regex SC.* -extract_start my_xml_start_file.xml -extract_end my_xml_end_file.xml -extract_udv my_xml_udv_file.xml
Another solution is to open the tool jar file with 7zip and replace the 3 files by yours files but keep the same XML file name and save the new jar.
## Reserved tags
This tool is looking to **reserved tags** or special string in the XML extract files or in the JMeter script to **REMOVE** previously add JSR223 Samplers and User Defined Variables.
This tags are :
- In the "JSR223 groovy start transaction apm", the reserved tags are : "@@TC\_NAME" in the Parameters text field, this string will be replaced by the label of the following Transaction Controller and the "@@ELASTIC\_APM\_BEGIN" in the Comment text field
- In the "JRS223 groovy end transaction apm", the reserved tag is "@@ELASTIC\_APM\_END" in the Comment text field
- In the "User Defined Variables", the reserved tag is "@@ELASTIC\_APM\_UDV" in the Comment text field
## Call this tool likes a library
To call this tool in an other tool, add the jar jmeter-elastic-apm-<version>-jar and this 2 libraries dependence (common-cli and org.slf4j) in the classpath and :
import io.github.vdaburon.jmeter.elasticapmxml.ElasticApmJMeterManager;
String sRegexTc = ".*";
String sFileIn = "script1.jmx";
String sFileOut = "script1_add.jmx";
ElasticApmJMeterManager.modifyAddSamplerForElasticApm(sFileIn, sFileOut, ElasticApmJMeterManager.ACTION_ADD, sRegexTc, ElasticApmJMeterManager.EXTRACT_START_JSR223, ElasticApmJMeterManager.EXTRACT_END_JSR223, ElasticApmJMeterManager.EXTRACT_UDV_ELASTIC);
## Version
Version 1.3 change method name ELK to ELASTIC et file name tp extract_udv_elastic_under_testplan.jmx
Version 1.2 change globally ELK to ELASTIC
Version 1.1 correct the class name in the uber jar and correct REMOVE result
Version 1.0 first version of this tool.