Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/averbis/averbis-python-api

Conveniently access the REST API of Averbis products using Python
https://github.com/averbis/averbis-python-api

api-client python text-classification text-mining

Last synced: 9 days ago
JSON representation

Conveniently access the REST API of Averbis products using Python

Awesome Lists containing this project

README 

        
Averbis Python API

==================



.. image:: https://img.shields.io/pypi/v/averbis-python-api.svg

  :alt: PyPI

  :target: https://pypi.org/project/averbis-python-api/



.. image:: https://readthedocs.org/projects/averbis-python-api/badge/?version=latest

  :target: https://averbis-python-api.readthedocs.io/en/latest/?badge=latest

  :alt: Documentation Status



.. image:: https://github.com/averbis/averbis-python-api/workflows/Build/badge.svg?branch=main

  :target: https://github.com/averbis/averbis-python-api/actions?query=workflow%3A%22Build%22

  :alt: Build Status



.. image:: https://codecov.io/gh/averbis/averbis-python-api/branch/main/graph/badge.svg

  :target: https://codecov.io/gh/averbis/averbis-python-api

  :alt: Test Coverage Status



.. image:: https://img.shields.io/pypi/l/averbis-python-api

  :alt: PyPI - License

  :target: https://pypi.org/project/averbis-python-api/

  

.. image:: https://img.shields.io/pypi/pyversions/averbis-python-api.svg

  :alt: PyPI - Python Version

  :target: https://pypi.org/project/averbis-python-api/



.. image:: https://img.shields.io/badge/code%20style-black-000000.svg

  :target: https://github.com/averbis/averbis-python-api

  :alt: Code Style

  

`Averbis `_ is a leading text mining and machine learning company in Healthcare and Life Sciences. We extract information from texts, automate intellectual processes and make meaningful predictions.



The **Averbis Python API** allows convenient access to the REST API of Averbis products. This includes in particular the ability to interact with the text mining pipelines offered by these products, e.g. to use these in data science environments such as Jupyter notebooks or for integration of the Averbis products in other enterprise systems.



Supported products are:



- `Health Discovery `_



- `Information Discovery `_



- `Patent Monitor `_



Status

------



The Averbis Python API is currently in an open alpha development stage. We try to keep breaking changes minimal, but they may happen on the way to the first stable release.



Features

--------



Currently, supported features are:



- Managing projects

- Managing pipelines

- Managing terminologies

- Managing collection of documents

- Managing pears

- Analysing text using a server-side text mining pipeline

- Classifying texts using a server-side classifier



Installation

------------



The library can be installed easily via :code:`pip`



.. code-block:: shell



  pip install averbis-python-api



Documentation

-------------



To get an overview over the methods provided with the client and the corresponding documentation, we refer to our `readthedocs API reference `_.



Moreover, we will provide a number of example Jupyter notebooks that showcase the usage of the client to solve different use cases in an upcoming release.



The usage for a selected number of API endpoints is given below.



Usage

-----



Connecting the client to a platform

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~



.. code:: python



  from averbis import Client

  # Use existing API Token

  client = Client('http://localhost:8400/health-discovery', api_token='YOUR_API_TOKEN')

  # or generate new API Token based on your credentials (invalidates old API Token)

  client = Client('http://localhost:8400/health-discovery', username = 'YOUR_USERNAME', password = 'YOUR_PASSWORD') 



Connecting to a pipeline and assure that it is started

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~



.. code:: python



    project = client.get_project('YOUR_PROJECT_NAME')

    pipeline = project.get_pipeline('YOUR_PIPELINE_NAME')

    pipeline.ensure_started()



Analysing a string

~~~~~~~~~~~~~~~~~~



.. code:: python



  document = 'This is the string we want to analyse.'

  annotations = pipeline.analyse_text(document, language='en')

  for annotation in annotations:

      print(annotation)



Analysing a text file

~~~~~~~~~~~~~~~~~~~~~



.. code:: python



  with open('/path/to/text_file.txt', 'rb') as document:

      annotations = pipeline.analyse_text(document, language='en')

      for annotation in annotations:

          print(annotation)



Restricting returned annotation types

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~



.. code:: python



  annotations = pipeline.analyse_text(document, language='en',

      annotation_types='*Diagnosis') # will return only annotations that end with 'Diagnosis'



Upload documents, process them using a pipeline, and export results

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~



In contrast to the simple text analysis endpoint above, one can also upload the documents into the product and create an analysis process there using experimental endpoints (may change soon). This has some advantages, namely that the results can be inspected in our product using the AnnotationViewer, and that the same document collection could be re-processed several times.



.. code:: python



    document_collection = project.create_document_collection("COLLECTION_NAME")



    file_path = "path/to/text/file.txt"

    with open(file_path, "r", encoding="UTF-8") as input_io:

        document_collection.import_documents(input_io)

    print(f"Number of documents: {document_collection.get_number_of_documents()}")



    pipeline = project.get_pipeline("MY_PIPELINE_NAME")



    # Using experimental endpoints to run the analysis and monitor the process state

    process = document_collection.create_and_run_process(process_name="MY_PROCESS", pipeline=pipeline)

    while process.get_process_state().state == "PROCESSING":

        time.sleep(1)



    results = process.export_text_analysis()

    print(results)



Pear Management

~~~~~~~~~~~~~~~~~~~~~



A `PEAR `_ (Processing Engine ARchive) file is the UIMA standard packaging format for UIMA components like analysis engines (annotators) or CAS consumers. We provdie some (experimental - may change soon) endpoints to upload, delete and list PEARs.



.. code:: python



    project.list_pears()

    pear = project.install_pear("path/to/mypear.pear")

    print(pear.get_default_configuration())

    pear.delete()



Connection profiles

~~~~~~~~~~~~~~~~~~~



To avoid storing API keys in the Python scripts or constantly re-generating them, it is

possible to store the keys for commonly used servers in a configuration file. This file

must be called :code:`client-settings.json` and it must be located either in the working directory

of the script or in the user's home folder in :code:`.averbis/client-settings.json`.



Each profile has four settings:



- :code:`url`: the base URL of the server application

- :code:`api-token`: the API token

- :code:`verify-ssl`: the path to a PEM file used to validate the server certificate if SSL is used

- :code:`timeout`: An optional timeout parameter (in seconds)



Default settings which should be applied to all profiles can be stored in the special profile :code:`*` (star).



.. code:: json



  {

    "profiles": {

      "*": {

        "verify-ssl": "caRoot.pem"

      },

      "localhost-hd": {

        "url": "https://localhost:8080/health-discovery",

        "api-token": "dummy-token"

      },

      "localhost-id": {

        "url": "https://localhost:8080/information-discovery",

        "api-token": "dummy-token",

        "verify-ssl": "id.pem"

      }

    }

  }



An existing profile can then be loaded with



.. code:: python



  from averbis import Client

  client = Client("localhost-id")



Development

------------



To set up a local development environment, check out the repository, set up a virtual environment

and install the required dependencies (if :code:`--no-site-packages` does not work on your system, omit it):



.. code-block:: shell



  virtualenv venv --python=python3 --no-site-packages

  source venv/bin/activate

  pip install -e ".[test, dev, doc]"



To install the latest development version of the library directly from GitHub, you can use the following command:



.. code-block:: shell



  $ pip install --force-reinstall --upgrade git+https://github.com/averbis/averbis-python-api.git@refs/heads/main