Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/dynatrace/oneagent-sdk-for-python
Enables custom tracing of Python applications in Dynatrace
https://github.com/dynatrace/oneagent-sdk-for-python
agent apm data-ingestion dev-program dynatrace oneagent sdk sdk-python
Last synced: about 21 hours ago
JSON representation
Enables custom tracing of Python applications in Dynatrace
- Host: GitHub
- URL: https://github.com/dynatrace/oneagent-sdk-for-python
- Owner: Dynatrace
- License: other
- Created: 2018-02-27T16:09:26.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2024-01-04T11:46:54.000Z (11 months ago)
- Last Synced: 2024-11-10T18:53:37.461Z (5 days ago)
- Topics: agent, apm, data-ingestion, dev-program, dynatrace, oneagent, sdk, sdk-python
- Language: Python
- Homepage: https://www.dynatrace.com/support/help/extend-dynatrace/oneagent-sdk/what-is-oneagent-sdk/
- Size: 4.86 MB
- Stars: 26
- Watchers: 12
- Forks: 10
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
> Read the latest version of this README, with working internal links, at [GitHub](https://github.com/Dynatrace/OneAgent-SDK-for-Python#readme).
# Dynatrace OneAgent SDK for Python
This SDK enables Dynatrace customers to extend request level visibility into Python applications. It provides the Python implementation of the [Dynatrace OneAgent SDK](https://github.com/Dynatrace/OneAgent-SDK).
For the latest updates, see [Release notes and announcements](#release-notes-and-announcements)
and make sure you are reading the [latest version of this document](https://github.com/Dynatrace/OneAgent-SDK-for-Python#readme).
- [Requirements](#requirements)
- [Using the OneAgent SDK for Python in your application](#using-the-oneagent-sdk-for-python-in-your-application)
- [API Concepts](#api-concepts)
* [Initialization and SDK objects](#initialization-and-sdk-objects)
* [Tracers](#tracers)
- [Features and how to use them](#features-and-how-to-use-them)
* [Remote calls](#remote-calls)
* [SQL database requests](#sql-database-requests)
* [Incoming web requests](#incoming-web-requests)
* [Outgoing web requests](#outgoing-web-requests)
* [Trace in-process asynchronous execution](#trace-in-process-asynchronous-execution)
* [Custom Request Attributes](#custom-request-attributes)
* [Custom services](#custom-services)
* [Messaging](#messaging)
+ [Outgoing Messages](#outgoing-messages)
+ [Incoming Messages](#incoming-messages)
- [W3C trace context](#w3c-trace-context)
- [Using the OneAgent SDK for Python with forked child processes (only available on Linux)](#using-the-oneagent-sdk-for-python-with-forked-child-processes-only-available-on-linux)
- [Troubleshooting](#troubleshooting)
* [Extended SDK State](#extended-sdk-state)
* [Shutdown crashes](#shutdown-crashes)
- [Repository contents](#repository-contents)
- [Help & Support](#help--support)
* [Read the manual](#read-the-manual)
* [Let us help you](#let-us-help-you)
- [Release notes and announcements](#release-notes-and-announcements)
* [Announcements in November 2023](#announcements-in-november-2023)
* [Version 1.5.1](#version-151)
* [Version 1.5.0](#version-150)
- [License](#license)
The latest release of the SDK supports Python 3 only, see below for exact support status of Python versions.
Only the official CPython (that is, the "normal" Python, i.e. the Python implementation
from ) is supported and only on Linux (musl libc which is used, e.g., on Alpine Linux, is currently not supported)
and Windows with the x86 (including x86-64) architecture.
It is always advised to use the latest patch version of your minor versoin of Python, as these usually contain security
fixes and other important bugfixes.
Additionally, `pip` with the `wheel` and `setuptools` package installed is required for installation,
and on Linux, the system needs to be [`manylinux1`-compatible](https://www.python.org/dev/peps/pep-0513/).
`pip` versions before 8.1.0 are known not to work, but generally it is advised to always use the latest pip version.
Due to factors such as changes in package hosting by PyPI and Python itself,
Dynatrace cannot guarantee that SDK installation is, or will continue to be,
possible with old pip versions.
The Dynatrace OneAgent SDK for Python is a wrapper of the [Dynatrace OneAgent SDK for C/C++](https://github.com/Dynatrace/OneAgent-SDK-for-C)
and therefore the SDK for C/C++ is required and delivered with the Python SDK. See
[here](https://github.com/Dynatrace/OneAgent-SDK-for-C#requirements)
for its requirements, which also apply to the SDK for Python.
The version of the SDK for C/C++ that is included in each version of the SDK for Python is shown in the following table along with the required
Dynatrace OneAgent version (it is the same as
[listed in the OneAgent SDK for C/C++'s documentation](https://github.com/Dynatrace/OneAgent-SDK-for-C/blob/master/README.md#compatibility-of-dynatrace-oneagent-sdk-for-cc-releases-with-oneagent-releases)).
> Note: The OneAgent SDK is not supported on serverless code modules, including those for AWS Lambda.
> Consider using [OpenTelemetry](https://www.dynatrace.com/support/help/shortlink/opentel-lambda) instead in these scenarios.
|OneAgent SDK for Python|Bundled OneAgent SDK for C/C++|Required OneAgent|Required Python |Support status |
|:----------------------|:-----------------------------|:----------------|:---------------------|:--------------|
|1.5.x |1.7.1 |≥1.251 |≥3.5 |🟢 Supported|
|1.4.x |1.6.1 |≥1.179 |3.4.x-3.11.x |ℹ️ Deprecated with support ending 2024-06-01|
|1.3.x |1.5.1 |≥1.179 |2.7.x or 3.4.x-3.11.x |❌ Unsupported since 2023-07-01|
|1.2.x |1.4.1 |≥1.161 |2.7.x or 3.4.x-3.11.x |❌ Unsupported since 2023-07-01|
|1.1.x |1.3.1 |≥1.151 |2.7.x or 3.4.x-3.11.x |❌ Unsupported since 2023-07-01|
|1.0.x |1.1.0 |≥1.141 |2.7.x or 3.4.x-3.11.x |❌ Unsupported since 2023-07-01|
Note that this table only states the support status of the mentioned OneAgent SDK for Python version
with the included OneAgent SDK for C/C++, not the OneAgent itself.
The "required Python" column indicates the Python versions with which the SDK version was developed and tested (where marked with *,
the minimum version has been updated to adjust for Python deprecations from the table below).
We may additionally announce deprecations for older versions of Python in combination with specific or all versions of the SDK,
meaning that we will no longer provide support for these combinations after the given date, even if the SDK version itself
is supported and technically running on that Python version.
We also strongly advise against using Python versions that are no longer supported by your Python vendor.
We intend to deprecate Python versions effective around 6 months after the Python project stops supporting them as documented by the
Python project: . We will announce every deprecation explicitly, usually 6 months before
it becomes effective.
| Python version | Deprecation status |
|:---------------|:---------------|
| Any later 3.x |🟢 Supported unless announced otherwise. Pre-releases are not supported. |
| 3.8.x |🟢 Supported. Expected to be deprecated with support ending around May 2025 |
| 3.7.x |⚠️ Deprecated with SDK support ending 2024-09-01; Declared EOL by Python.org |
| 3.4.x-3.6.x |⚠️ Deprecated with SDK support (with compatible SDK versions) ending 2024-06-01; Declared EOL by Python.org |
| 2.7.x |❌ Unsuspported since 2023-07-01 |
## Using the OneAgent SDK for Python in your application
To install the latest version of the OneAgent SDK for Python, use the PyPI package
`oneagent-sdk`:
```bash
python -m pip install --upgrade oneagent-sdk
```
`pip`, `setuptools` and `wheel` need to be installed and should be up to date before running this command.
To verify your installation, execute
```bash
python -c "import oneagent; print(oneagent.initialize())"
```
If the installation was successful, you should get an output ending with `InitResult(status=0, error=None)`. Otherwise, see the [Troubleshooting](#troubleshooting) section.
To load the OneAgent SDK into your application, just add the following line at the top of your script:
```python
import oneagent
```
Here is a quick "Hello World" that will produce a service call in Dynatrace:
```python
import oneagent
if not oneagent.initialize():
print('Error initializing OneAgent SDK.')
with oneagent.get_sdk().trace_incoming_remote_call('method', 'service', 'endpoint'):
pass
print('It may take a few moments before the path appears in the UI.')
input('Please wait...')
oneagent.shutdown()
```
A more detailed [sample application is available here](https://github.com/Dynatrace/OneAgent-SDK-for-Python/blob/master/samples/basic-sdk-sample/basic_sdk_sample.py).
See also the Quickstart section in the [API documentation](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/quickstart.html).
Common concepts of the Dynatrace OneAgent SDK are explained in the [Dynatrace OneAgent SDK repository](https://github.com/Dynatrace/OneAgent-SDK#apiconcepts).
### Initialization and SDK objects
Before first using any other SDK functions, you need to initialize the SDK.
```python
init_result = oneagent.initialize()
print('OneAgent SDK initialization result' + repr(init_result))
if init_result:
print('SDK should work (but agent might be inactive).')
else:
print('SDK will definitely not work (i.e. functions will be no-ops):', init_result)
```
See the API documentation for the [`initialize` function](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.initialize)
and the [`InitResult` class](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.InitResult) for more information.
To use the SDK, get a reference to the [`SDK`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK)
singleton by calling the oneagent static [`get_sdk`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.get_sdk)
method. The first thing you may want to do with this object, is checking if the agent is active by comparing the value of the
[`agent_state`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.agent_state)
property to the [`oneagent.common.AgentState`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.common.AgentState)
constants. You can also have a look at the [extended SDK state information](#extended-sdk-state).
```python
import oneagent
from oneagent.common import AgentState
# Initialize oneagent, as above
sdk = oneagent.get_sdk()
if sdk.agent_state not in (AgentState.ACTIVE, AgentState.TEMPORARILY_INACTIVE):
print('Too bad, you will not see data from this process.')
```
As a development and debugging aid it is recommended to set a diagnostic callback. The callback will be used by the SDK to inform about unusual events.
Unusual events that prevent an operation from completing successfully include:
* API usage errors
* other unexpected events (like out of memory situations)
> **NOTE**: Use this as a development and debugging aid only. Your application should not rely on a calling sequence or any message content being set
or passed to the callback.
During development, it is additionally recommended to use the "verbose callback" which also informs about other events that may be benign
but can be very helpful in debugging, e.g. a PurePath that was not created because a Tracer is disabled by configuration, etc.
```python
def _diag_callback(unicode_message):
print(unicode_message)
sdk.set_diagnostic_callback(_diag_callback)
sdk.set_verbose_callback(_diag_callback) # Do not use this callback in production
```
To trace any kind of call you first need to create a
[Tracer](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.tracers.Tracer),
using one of the various `trace_*` methods of the
[`SDK`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK)
object. The Tracer object controls the “life cycle” of a trace: Entering a
`with`-block with a tracer starts the trace, exiting it ends it. Exiting the
`with` block with an exception causes the trace to be marked as failed with the
exception message (if you do not want or need this behavior, tracers have
explicit methods for starting, ending and attaching error information too; see the
[documentation](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.tracers.Tracer)).
A Tracer instance can only be used from the thread on which it was created.
Whenever you start a tracer, the tracer becomes a child of the previously active tracer
on this thread and the new tracer then becomes the active tracer. You may only end the active tracer.
If you do, the tracer that was active before it (its parent) becomes active again.
Put another way, tracers must be ended in reverse order of starting them
(you can think of this being like HTML tags where you must also close the child tag before you can close the parent tag).
While the tracer's automatic parent-child relationship works very intuitively in most cases,
it does not work with **asynchronous patterns**, where the same thread handles multiple logically
separate operations in an interleaved way on the same thread. If you need to instrument
such patterns with the SDK, you need to end your tracer before the thread is potentially reused
by any other operation (e.g., before yielding to the event loop). To later continue the trace,
capture an in-process link before and later resume using the in-process link tracer, as explained in
[Trace in-process asynchronous execution](#trace-in-process-asynchronous-execution). This approach is rather awkward and
may lead to complex and difficult to interpret traces. If your application makes extensive use of
asynchronous patterns of the kind that is difficult to instrument with the SDK, consider using
the [OpenTelemetry support of Dynatrace](https://www.dynatrace.com/support/help/shortlink/opent-python) instead.
There are different tracer types requiring different information for creation.
As an example, to trace an incoming remote call, this would be the most simple
way to trace it:
```python
import oneagent
with oneagent.get_sdk().trace_incoming_remote_call('method', 'service', 'endpoint'):
pass # Here you would do the actual work that is timed
```
See the section on [remote calls](#remote-calls) for more information.
Some tracers also support attaching additional information before ending it.
**Important:** In Python 2, tracers accept both byte (“normal”) and unicode
strings. Byte strings must always use the UTF-8 encoding!
## Features and how to use them
The feature sets differ slightly with each language implementation. More functionality will be added over time, see
[Planned features for OneAgent SDK](https://answers.dynatrace.com/spaces/483/dynatrace-product-ideas/idea/198106/planned-features-for-oneagent-sdk.html)
for details on upcoming features.
A more detailed specification of the features can be found in [Dynatrace OneAgent SDK](https://github.com/Dynatrace/OneAgent-SDK#features).
|Feature |Required OneAgent SDK for Python version|
|:-----------------------------------------|:--------|
|W3C trace context for log enrichment |≥1.5.0 |
|Custom services |≥1.2.0 |
|Messaging |≥1.2.0 |
|In-process linking |≥1.1.0 |
|Custom request attributes |≥1.1.0 |
|Outgoing web requests |≥1.1.0 |
|Incoming web requests |≥1.0.0 |
|SQL database requests |≥1.0.0 |
|Trace incoming and outgoing remote calls |≥1.0.0 |
You can use the SDK to trace communication from one process to another. This will enable you to see full Service Flow, PurePath and Smartscape topology
for remoting technologies that Dynatrace is not aware of.
To trace any kind of remote call you first need to create a Tracer. The Tracer object represents the endpoint that you want to call, thus you need to
supply the name of the remote service and method. In addition, you need to transport a tag in your remote call from the client side to the server side
if you want to trace it end to end.
On the client side, you would trace the outgoing remote call like this:
```python
outcall = sdk.trace_outgoing_remote_call(
'remoteMethodToCall', 'RemoteServiceName', 'rmi://Endpoint/service',
oneagent.sdk.Channel(oneagent.sdk.ChannelType.TCP_IP, 'remoteHost:1234'),
protocol_name='RMI/custom')
with outcall:
# Note: You can access outgoing_dynatrace_*_tag only after the trace
# has started!
strtag = outcall.outgoing_dynatrace_string_tag
do_actual_remote_call(extra_headers={'X-dynaTrace': strtag})
```
On the server side, you would trace it like this:
```python
incall = sdk.trace_incoming_remote_call(
'remoteMethodToCall', 'RemoteServiceName', 'rmi://Endpoint/service',
protocol_name='RMI/custom',
str_tag=my_remote_message.get_header_optional('X-dynaTrace'))
with incall:
pass # Here you would do the actual work that is timed
```
See the documentation for more information:
* [`trace_incoming_remote_call`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.trace_incoming_remote_call)
* [`trace_outgoing_remote_call`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.tracers.trace_outgoing_remote_call)
* [General information on tagging](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/tagging.html)
To trace database requests you need a database info object which stores the information about your database which does not change between individual
requests. This will typically be created somewhere in your initialization code (after initializing the SDK):
```python
dbinfo = sdk.create_database_info(
'Northwind', oneagent.sdk.DatabaseVendor.SQLSERVER,
oneagent.sdk.Channel(oneagent.sdk.ChannelType.TCP_IP, '10.0.0.42:6666'))
```
Then you can trace the SQL database requests:
```python
with sdk.trace_sql_database_request(dbinfo, 'SELECT foo FROM bar;') as tracer:
# Do actual DB request
tracer.set_rows_returned(42) # Optional
tracer.set_round_trip_count(3) # Optional
```
Note that you need to release the database info object. You can do this by calling `close()` on it or using it in a `with` block.
See the documentation for more information:
* [`create_database_info`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.create_database_info)
* [`trace_sql_database_request`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.trace_sql_database_request)
* [`DatabaseRequestTracer`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.tracers.DatabaseRequestTracer)
Please note that SQL database traces are only created if they occur within some other SDK trace (e.g. incoming remote call).
[Same as with database infos](#sql-database-requests), to trace incoming web requests you need a web application info object which stores the
information about your web application which does not change:
```python
wappinfo = sdk.create_web_application_info(
virtual_host='example.com',
application_id='MyWebApplication',
context_root='/my-web-app/')
```
Then you can trace incoming web requests:
```python
wreq = sdk.trace_incoming_web_request(
wappinfo,
'http://example.com/my-web-app/foo?bar=baz',
'GET',
headers={'Host': 'example.com', 'X-foo': 'bar'},
remote_address='127.0.0.1:12345')
with wreq:
wreq.add_parameter('my_form_field', '1234')
# Process web request
wreq.add_response_headers({'Content-Length': '1234'})
wreq.set_status_code(200) # OK
```
Note that you need to release the web application info object. You can do this by calling `close()` on it or using it in a `with` block.
Incoming web request tracers support some more features not shown here. Be sure to check out the documentation:
* [`create_web_application_info`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.create_web_application_info)
* [`trace_incoming_web_request`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.trace_incoming_web_request)
* [`IncomingWebRequestTracer`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.tracers.IncomingWebRequestTracer)
To trace an outgoing web request you need to create an 'Outgoing Web Request Tracer' object. You pass the destination URL, the HTTP method and
request headers as parameters.
Let's have a look at a web request example:
```python
from urllib.request import Request
# Create your web request.
url = 'http://example.com'
req = Request(url)
req.add_header('header1', '1234')
req.add_header('header2', '5678')
```
After creating/setting up the request you have to create the tracer object and pass the parameters.
```python
# Create the tracer.
tracer = sdk.trace_outgoing_web_request(url, req.get_method(), req.headers)
```
The next step is to start the tracer and then to retrieve the outgoing Dynatrace tag. The tag is being used to trace a transaction from end-to-end.
You have to send the tag to the destination via an additional request header which is called
[`DYNATRACE_HTTP_HEADER_NAME`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.common.DYNATRACE_HTTP_HEADER_NAME).
[Here you can find more information on tagging](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/tagging.html).
```python
with tracer:
# Get and set the Dynatrace tag.
tag = tracer.outgoing_dynatrace_string_tag
req.add_header(DYNATRACE_HTTP_HEADER_NAME, tag)
# Here you process and send the web request.
response = _process_your_outgoing_request(req)
```
Finally, get the response headers you want to trace and the status code of the response and add them to the tracer.
```python
tracer.add_response_headers({'Content-Length': response.get_content_length()})
tracer.set_status_code(response.get_status_code())
```
Be sure to check out the documentation:
* [`trace_outgoing_web_request`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.trace_outgoing_web_request)
* [`OutgoingWebRequestTracer`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.tracers.OutgoingWebRequestTracer)
* [General information on tagging](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/tagging.html)
### Trace in-process asynchronous execution
You can use the SDK to trace asynchronous in-process code execution. This might be useful if the OneAgent does not support the threading framework
or specific asynchronous libraries. In-process linking should be used to link other services (Database, Webrequests, ...) between thread or
queueing boundaries currently not supported out-of-the-box by the OneAgent.
To link asynchronous execution, you need to create an in-process link, where the execution forks:
```python
in_process_link = sdk.create_in_process_link()
```
The provided in-process link must not be serialized and can only be used inside the process in which it was created. It must be used to start
tracing where the asynchronous execution takes place:
```python
with sdk.trace_in_process_link(in_process_link):
# Do the asynchronous job
:
```
You can use the SDK to add custom request attributes to the currently traced service. Custom request attributes allow you to do easier/better
filtering of your requests in Dynatrace.
Adding custom request attributes to the currently traced service call is pretty simple. Just call the `add_custom_request_attribute` method
with your key and value (only int, float and string values are currently supported):
```python
sdk.add_custom_request_attribute('errorCount', 42)
sdk.add_custom_request_attribute('gross weight', 2.39)
sdk.add_custom_request_attribute('famous actor', 'Benedict Cumberbatch')
```
Check out the documentation at:
* [`add_custom_request_attribute`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.add_custom_request_attribute)
### Custom services
You can use the SDK to trace custom service methods. A custom service method is a meaningful part
of your code that you want to trace but that does not fit any other tracer. An example could be
the callback of a periodic timer.
```python
with sdk.trace_custom_service('onTimer', 'CleanupTask'):
# Do the cleanup task
```
Check out the documentation at:
* [`trace_custom_service`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.trace_custom_service)
You can use the SDK to trace messages sent or received via a messaging system. When tracing messages,
we distinguish between:
* sending a message
* waiting for and receiving a message
* processing a received message
All messaging related tracers need a messaging system info object which you have to create prior
to the respective messaging tracer, which is an outgoing message tracer in the example below.
```python
msi_handle = sdk.create_messaging_system_info(
'myMessagingSystem', 'requestQueue', MessagingDestinationType.QUEUE,
oneagent.sdk.Channel(oneagent.sdk.ChannelType.TCP_IP, '10.11.12.13'))
with msi_handle:
with sdk.trace_outgoing_message(msi_handle) as tracer:
# Get and set the Dynatrace tag.
tag = tracer.outgoing_dynatrace_string_tag
message_to_send.add_header_field(oneagent.sdk.DYNATRACE_MESSAGE_PROPERTY_NAME, tag)
# Send the message.
the_queue.send(message_to_send)
# Optionally set message and/or correlation IDs
tracer.set_vendor_message_id(message_to_send.get_message_id())
tracer.set_correlation_id(message_to_send.get_correlation_id())
```
On the incoming side, we need to differentiate between the blocking receiving part and processing
the received message. Therefore two different tracers are being used:
* IncomingMessageReceiveTracer
* IncomingMessageProcessTracer
```python
msi_handle = sdk.create_messaging_system_info(
'myMessagingSystem', 'requestQueue', MessagingDestinationType.QUEUE,
oneagent.sdk.Channel(oneagent.sdk.ChannelType.TCP_IP, '10.11.12.13'))
with msi_handle:
# Create the receive tracer for incoming messages.
with sdk.trace_incoming_message_receive(msi_handle):
# This is a blocking call, which will return as soon as a message is available.
Message query_message = the_queue.receive()
# Get the Dynatrace tag from the message.
tag = query_message.get_header_field(oneagent.sdk.DYNATRACE_MESSAGE_PROPERTY_NAME)
# Create the tracer for processing incoming messages.
tracer = sdk.trace_incoming_message_process(msi_handle, str_tag=tag)
tracer.set_vendor_message_id(query_message.get_vendor_id())
tracer.set_correlation_id(query_message.get_correlation_id())
with tracer:
# Now let's handle the message ...
print('handle incoming message')
```
In case of non-blocking receive (e. g. using an event handler), there is no need to use an
IncomingMessageReceiveTracer - just trace processing of the message by using the IncomingMessageProcessTracer:
```python
msi_handle = sdk.create_messaging_system_info(
'myMessagingSystem', 'requestQueue', MessagingDestinationType.QUEUE,
oneagent.sdk.Channel(oneagent.sdk.ChannelType.TCP_IP, '10.11.12.13'))
def on_message_received(message):
# Get the Dynatrace tag from the message.
tag = message.get_header_field(oneagent.sdk.DYNATRACE_MESSAGE_PROPERTY_NAME)
# Create the tracer for processing incoming messages.
tracer = sdk.trace_incoming_message_process(msi_handle, str_tag=tag)
tracer.set_vendor_message_id(message.get_vendor_id())
tracer.set_correlation_id(message.get_correlation_id())
with tracer:
# Now let's handle the message ...
print('handle incoming message')
```
See the documentation for more information:
* [`create_messaging_system_info`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.create_messaging_system_info)
* [`trace_outgoing_message`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.tracers.trace_outgoing_message)
* [`trace_incoming_message_receive`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.tracers.trace_incoming_message_receive)
* [`trace_incoming_message_process`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.tracers.trace_incoming_message_process)
* [General information on tagging](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/tagging.html)
* [Messaging tracers in the specification repository](https://github.com/Dynatrace/OneAgent-SDK#messaging)
This feature allows you to retrieve a W3C TraceContext trace ID and span ID referencing the current PurePath node,
as defined in .
This trace ID and span ID information is not intended for tagging and
context-propagation scenarios and primarily designed for log-enrichment use
cases. Refer to [General information on tagging](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/tagging.html)
for tagging traces (see also the usage examples elsewhere in this document).
The following example shows how to print the current trace & span ID to stdout
in a format that works well with Dynatrace Log Monitoring
(see for more):
```python
with sdk.trace_custom_service('onTimer', 'CleanupTask'): # Or any other tracer
tinfo = sdk.tracecontext_get_current()
print('[!dt dt.trace_id={},dt.span_id={}] handle incoming message'.format(tinfo.trace_id, tinfo.span_id))
```
See the documentation for more information:
* [`tracecontext_get_current`](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/sdkref.html#oneagent.sdk.SDK.tracecontext_get_current)
* [Information on trace tagging](https://dynatrace.github.io/OneAgent-SDK-for-Python/docs/tagging.html)
* [W3C trace context in the SDK specification repository](https://github.com/Dynatrace/OneAgent-SDK#tracecontext)
## Using the OneAgent SDK for Python with forked child processes (only available on Linux)
Some applications, especially web servers, use a concurrency model that is based on forked child processes.
Typically a master process is started which is responsible only for creating and managing child processes by means of forking.
The child processes do the real work, for example handling web requests.
The recommended way to use the Python SDK in such a scenario is as follows: You initialize the SDK in the master process setting
the `forkable` argument to `True`.
```python
oneagent.initialize(sdk_options, forkable=True)
```
This way you will not be able to use the SDK in the master process (attempts to do so will be ignored, if applicable with
an error code), but all forked child processes will share the same agent. This has a lower overhead, for example the
startup of worker processes is not slowed down, and the per-worker memory overhead is reduced.
For more information on forked child processes, take a look at those resources:
* [Documentation on forking for the Dynatrace OneAgent SDK for C/C++](https://github.com/Dynatrace/OneAgent-SDK-for-C/blob/master/README.md#forking)
* [Forking sample application](./samples/fork-sdk-sample/fork_sdk_sample.py)
To debug your OneAgent SDK for Python installation, execute the following Python code:
```python
import logging
import time
import oneagent
log_handler = logging.StreamHandler()
log_formatter = logging.Formatter(
'%(asctime)s.%(msecs)03d UTC [%(thread)08x]'
' %(levelname)-7s [%(name)-6s] %(message)s',
'%Y-%m-%d %H:%M:%S')
log_formatter.converter = time.gmtime
log_handler.setFormatter(log_formatter)
oneagent.logger.addHandler(log_handler)
oneagent.logger.setLevel(1)
init_result = oneagent.initialize(['loglevelsdk=finest', 'loglevel=finest'])
print('InitResult=' + repr(init_result))
```
If you get output containing `InitResult=InitResult(status=0, error=None)`, your installation should be fine. Otherwise, the output is helpful in
determining the issue. The [extended SKD state](#extended-sdk-state) might also help to diagnose your problem.
Known gotchas:
* `ImportError` or `ModuleNotFoundError` in line 1 that says that there is no module named `oneagent`.
Make sure that the `pip install` or equivalent succeeded (see [here](#installation)). Also make sure you use the `pip` corresponding to your
`python` (if in doubt, use `python -m pip` instead of `pip` for installing).
* Output ending in a message like `InitResult=InitResult(status=-2, error=SDKError(-1342308345, 'Failed loading SDK stub from .../site-packages/oneagent/_impl/native/libonesdk_shared.so: "/.../libonesdk_shared.so: cannot open shared object file: No such file or directory". Check your installation of the oneagent-sdk Python package, e.g., try running `pip install --verbose --force-reinstall oneagent-sdk`.'))`.
Follow the advice of the message and run `python -m pip install --verbose --force-reinstall oneagent-sdk`
(or the equivalent pip invocation with the `--verbose` and `--force-reinstall` flags).
It is likely that you will now see another message like
******************************************************************************
*** You are trying to build the Python SDK from source. ***
*** This could mean that you are using an outdated version of pip (older ***
*** than 8.1.0) or you are attempting to install the SDK on an ***
*** unsupported platform. Please check the requirements at ***
*** https://github.com/Dynatrace/OneAgent-SDK-for-Python#requirements ***
******************************************************************************
Make sure you are using pip to install a prebuilt package wheel for your system from PyPI, as described in [Using the OneAgent SDK for
Python in your application](#installation). Also make sure you are using an up-to date version of `pip`, `setuptools` and `wheel`. You can
try upgrading them with `python -m pip install --upgrade pip setuptools wheel` (make sure to use the same `python` that you use to install
the `oneagent-sdk` package). ATTENTION: If you use the system-provided pip (e.g. installed via `apt-get` on Ubuntu) you should instead use
a `pip` inside a `virtualenv` (the same as your project), as upgrading system-provided packages via `pip` may cause issues.
If this does not resolve the issue, make sure you are using a supported platform, as listed in [Requirements](#requirements). If you *are*
using a supported system, you can try downloading the [OneAgent SDK for C/C++](https://github.com/Dynatrace/OneAgent-SDK-for-C) in the
version corresponding to your OneAgent SDK for Python as listed in [the table in Requirements](#requirements). Then set the
`DT_PYSDK_CSDK_PATH` environment variable to the `.so`/`.dll` file corresponding to your platform in the `lib` subdirectory of the C SDK
and retry the installation (e.g. in a bash shell, use `export DT_PYSDK_CSDK_PATH=path/to/onesdk_shared.so`). If there is no corresponding
directory, your platform is not supported. Otherwise, regardless if it works with that method or not, please report an issue as described
in [Let us help you](#let-us-help-you).
For debugging and/or diagnosing purposes you can also use the extended SDK state information.
```python
# The agent state is one of the integers in oneagent.sdk.AgentState.
print('Agent state:', oneagent.get_sdk().agent_state)
# The instance attribute 'agent_found' indicates whether an agent could be found or not.
print('Agent found:', oneagent.get_sdk().agent_found)
# If an agent was found but it is incompatible with this version of the SDK for Python
# then 'agent_is_compatible' would be set to false.
print('Agent is compatible:', oneagent.get_sdk().agent_is_compatible)
# The agent version is a string holding both the OneAgent version and the
# OneAgent SDK for C/C++ version separated by a '/'.
print('Agent version:', oneagent.get_sdk().agent_version_string)
```
### Shutdown crashes
If your are experiencing crashes when your application exits, make
sure you uninitialized the SDK properly by calling its `shutdown`
function.
If you are viewing the [GitHub repository](https://github.com/Dynatrace/OneAgent-SDK-for-Python), you will see:
- `LICENSE`: License under which the whole SDK and sample applications are
published.
- `src/`: Actual source code of the Python OneAgent SDK.
- `docs/`: Source files for the ([Sphinx](https://sphinx-doc.org)-based) HTML
documentation. For the actual, readable documentation, see
[here](#documentation).
- `tests/`, `test-util-src/`: Contains tests and test support files that are
useful (only) for developers wanting to contribute to the SDK itself.
- `setup.py`, `setup.cfg`, `MANIFEST.in`, `project.toml`: Development files
required for creating e.g. the PyPI package for the Python OneAgent SDK.
- `tox.ini`, `pylintrc`: Supporting files for developing the SDK itself. See
and .
**Support policy**
The Dynatrace OneAgent SDK for Python has GA status. The features are fully supported by Dynatrace.
For detailed support policy see [Dynatrace OneAgent SDK help](https://github.com/Dynatrace/OneAgent-SDK#help).
* The most recent version of the documentation for the Python SDK can be viewed at
.
* A high level documentation/description of OneAgent SDK concepts is available at
.
* Of course, [this README](#) also contains lots of useful information.
Make sure your issue is not already solved in the [available documentation](#documentation) before you ask for help. Especially the
[troubleshooting section in this README](#troubleshooting) may prove helpful.
**Get Help**
* Ask a question in the [product forums](https://answers.dynatrace.com/spaces/482/view.html).
* Read the product documentation
**Open a [GitHub issue](https://github.com/Dynatrace/OneAgent-SDK-for-Python/issues) to:**
* Report minor defects or typos.
* Ask any questions related to the community effort.
SLAs don't apply for GitHub tickets.
**Customers can open a ticket on the Dynatrace support portal to:**
* Get support from the Dynatrace technical support engineering team
* Manage and resolve product related technical issues
SLAs apply according to the customer's support level.
## Release notes and announcements
For additional updates, see also [OneAgent release notes](https://docs.dynatrace.com/docs/shortlink/release-notes-oneagent)
and [End of support announcements](https://docs.dynatrace.com/docs/shortlink/eos-announcements#dynatrace-oneagent).
### Announcements in November 2023
* ⚠️ **Deprecation announcement for older SDK versions:** Version 1.4 has been put on the path to deprecation and will no longer be supported starting June 1, 2024. Only version 1.5 of the SDK (or any newer version) will be supported from that date on.
* ⚠️ **Deprecation announcement for using any SDK version with older Python versions:** SDK support for Python 3.4.x, 3.5.x, 3.6.x and 3.7.x has been put on the path to deprecation and no version of the SDK will be supported on Python 3.4.x, 3.5.x and 3.6.x starting June 1, 2024.
Usage of the SDK on 3.7.x will remain supported until September 1, 2024.
All Python versions below 3.8.x are already declared End of Life by the Python.org project, and customers are encouraged to upgrade to a newer Python version that is also supported by Python.org.
### Version 1.5.1
Changes:
* Fixes support of Python 3.12 and newer
### Version 1.5.0
Changes:
* Adds limited [W3C trace context](#w3c-trace-context) support (for log enrichment).
* This version **no longer supports Python 2 (Python 2.7.x)**.
* This version **no longer supports Python 3.4.x**.
Announcements:
* ⚠️ **Deprecation announcement for older SDK versions:** Version 1.3 and all older versions have been put on the path to deprecation and will no longer be supported starting July 1, 2023. We strongly advise customers to upgrade to newest versions to avoid incompatibility and security risks. Customers need to upgrade to at least 1.4 but are encouraged to upgrade to the newest available version (1.5) if using Python >3.4 as there are no known incompatibilities or breaking changes other than the increased minimum Python version.
* ⚠️ **Deprecation announcement for using any SDK version with older Python versions:** Python 2.7.x has been put on the path to deprecation and no version of the SDK will be supported on this Python version starting July 1, 2023. Furthermore, we intend to release a similar deprecation announcement regarding versions 3.4-3.6 (which are no longer maintained by the Python project) soon (we plan that this will not become effective before 2023-07-01).
See for older releases.
See the LICENSE file for details. It should be included in your distribution.
Otherwise, see the most recent version on
[GitHub](https://github.com/Dynatrace/OneAgent-SDK-for-Python/blob/master/LICENSE).
Summary: This software is licensed under the terms of the Apache License Version
2.0 and comes bundled with the [six library by Benjamin
Peterson](http://six.readthedocs.io/), which is licensed under the terms of the
MIT license.