Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/erinxocon/requests-xml

Requests-XML: XML Parsing for Humans
https://github.com/erinxocon/requests-xml

Last synced: 15 days ago
JSON representation

Requests-XML: XML Parsing for Humans

Awesome Lists containing this project

README 

        
Requests-XML: XML Parsing for Humans

====================================



.. image:: https://travis-ci.org/erinxocon/requests-xml.svg?branch=master

    :target: https://travis-ci.org/erinxocon/requests-xml

.. image:: https://img.shields.io/pypi/v/requests-xml.svg?maxAge=2592000

    :target: https://pypi.python.org/pypi/requests-xml/

.. image:: https://img.shields.io/pypi/l/requests-xml.svg?maxAge=2592000

    :target: https://opensource.org/licenses/MIT



This library intends to make parsing XML as

simple and intuitive as possible.  **Requests-XML** is related

to the amazing `Requests-HTML `_

and delivers the same quality of user experience — with support for our beloved XML documents.



When using this library you automatically get:



- *XPath Selectors*, for the *brave* at heart.

- *Simple Search/Find* for the *faint* at heart.

- XML to JSON conversion thanks to `xmljson `_.

- Mocked user-agent (like a real web browser).

- Connection–pooling and cookie persistence.

- The Requests experience you know and love, with magical XML parsing abilities.



Installation

============



.. code-block:: shell



    $ pipenv install requests-xml

    ✨🍰✨



Only **Python 3.6** is supported.



Tutorial & Usage

================



Make a GET request to `nasa.gov `_, using `Requests `_:



.. code-block:: pycon



    >>> from requests_xml import XMLSession

    >>> session = XMLSession()



    >>> r = session.get('https://www.nasa.gov/rss/dyn/lg_image_of_the_day.rss')



Grab a list of all links on the page, as–is (this only works for RSS feeds, or other feeds that happen to have `link` elements):



.. code-block:: pycon



    >>> r.xml.links

    ['http://www.nasa.gov/image-feature/from-the-earth-moon-and-beyond', 'http://www.nasa.gov/image-feature/jpl/pia21974/jupiter-s-colorful-cloud-belts', 'http://www.nasa.gov/', 'http://www.nasa.gov/image-feature/portrait-of-the-expedition-54-crew-on-the-space-station', ...]



XPath is the main supported way to query an element (`learn more `_):



.. code-block:: pycon



   >>> item = r.xml.xpath('//item', first=True)

   



Grab an element's text contents:



.. code-block:: pycon



    >>> print(item.text)

    The Beauty of Light

    http://www.nasa.gov/image-feature/the-beauty-of-light

    The Soyuz MS-08 rocket is launched with Soyuz Commander Oleg Artemyev of Roscosmos and astronauts Ricky Arnold and Drew Feustel of NASA, March 21, 2018, to join the crew of the Space Station.

    http://www.nasa.gov/image-feature/the-beauty-of-light

    Wed, 21 Mar 2018 14:12 EDT

    NASA Image of the Day



Introspect an element's attributes (`learn more `_):



.. code-block:: pycon



    >>> rss = r.xml.xpath('//rss', first=True)

    >>> rss.attrs

    {'version': '2.0', '{http://www.w3.org/XML/1998/namespace}base': 'http://www.nasa.gov/'}



Render out an element's XML (note: namespaces will be applied to sub elements when grabbed):



.. code-block:: pycon



    >>> item.xml

    ' The Beauty of Light\n http://www.nasa.gov/image-feature/the-beauty-of-light\n The Soyuz MS-08 rocket is launched with Soyuz Commander Oleg Artemyev of Roscosmos and astronauts Ricky Arnold and Drew Feustel of NASA, March 21, 2018, to join the crew of the Space Station.\n \n http://www.nasa.gov/image-feature/the-beauty-of-light\n Wed, 21 Mar 2018 14:12 EDT\n NASA Image of the Day\n'



Select an element list within an element:



.. code-block:: pycon



    >>> item.xpath('//enclosure')[0].attrs['url']

    'http://www.nasa.gov/sites/default/files/thumbnails/image/nhq201803210005.jpg'



Search for links within an element:



.. code-block:: pycon



    >>> item.links

    ['http://www.nasa.gov/image-feature/the-beauty-of-light']



Search for text on the page.  This is useful if you wish to search out things between specific tags without using XPath:



.. code-block:: pycon



    >>> r.xml.search('{})

    



Using PyQuery we can use CSS selectors to easily grab an element, with a simple syntax for ensuring the element

contains certain text.  This can be used as another easy way to grab an element without an XPath:



.. code-block:: pycon



    >>> light_title = r.xml.find('title', containing='The Beauty of Light')

    []



    >>> light_title[0].text

    'The Beauty of Light'



Note: XPath is preferred as it can allow you to get very specific with your element selection.  Find is intended to be

an easy way of grabbing all elements of a certain name.  Find does however accept CSS selectors, and if you can get those

to work with straight XML, go for it!



JSON Support

============



Using the great `xmljson `_ package, we convert the whole

XML document into a JSON representation.  There are six different conversion convetions available.

See the `about `_ for what they are.  The default is ``badgerfish``.

If you wish to use a different conversion convention, pass in a string with the name of the convetion to the

``.json()`` method.



Using without Requests

======================



You can also use this library without Requests:



.. code-block:: pycon



    >>> from requests_xml import XML

    >>> doc = """

    

        

            

        

        

            

        

    

    """



    >>> xml = XML(xml=doc)

    >>> xml.json()

    {

        "employees": [{

            "person": {

                "name": {

                    "@value": "Alice"

                }

            }

        }, {

            "person": {

                "name": {

                    "@value": "Bob"

                }

            }

        }]

    }



License

=======

MIT