https://github.com/gumblex/htmllisting-parser

Python parser for Apache/nginx-style HTML directory listing
https://github.com/gumblex/htmllisting-parser

apache fuse nginx

Last synced: about 1 month ago
JSON representation

Python parser for Apache/nginx-style HTML directory listing

• Host: GitHub
• URL: https://github.com/gumblex/htmllisting-parser
• Owner: gumblex
• License: mit
• Created: 2016-12-01T13:55:33.000Z (about 8 years ago)
• Default Branch: master
• Last Pushed: 2023-11-25T07:02:29.000Z (about 1 year ago)
• Last Synced: 2024-12-15T18:09:53.644Z (about 1 month ago)
• Topics: apache, fuse, nginx
• Language: Python
• Size: 40 KB
• Stars: 35
• Watchers: 4
• Forks: 12
• Open Issues: 9
• Metadata Files:
  • Readme: README.rst
  • License: LICENSE

Awesome Lists containing this project

README

        
htmllisting-parser

==================

Python parser for Apache/nginx-style HTML directory listing

.. code-block:: python

   import htmllistparse

   cwd, listing = htmllistparse.fetch_listing(some_url, timeout=30)

   # or you can get the url and make a BeautifulSoup yourself, then use

   # cwd, listing = htmllistparse.parse(soup)

where ``cwd`` is the current directory, ``listing`` is a list of ``FileEntry`` named tuples:

* ``name``: File name, ``str``. Have a trailing / if it's a directory.

* ``modified``: Last modification time, ``time.struct_time`` or ``None``. Timezone is not known.

* ``size``: File size, ``int`` or ``None``. May be estimated from the prefix, such as "K", "M".

* ``description``: File description, file type, or any other things found. ``str`` as HTML, or ``None``.

Supports:

* Vanilla Apache/nginx/lighttpd/darkhttpd autoindex

* Most ``
``-style index

* Many other ``
``-style index

* ``
``-style


.. note::

   Please wrap the functions in a general ``try... except`` block. It may throw exceptions unexpectedly.

ReHTTPFS

--------

Reinvented HTTP Filesystem.

* Mounts most HTTP file listings with FUSE.

* Gets directory tree and file stats with less overhead.

* Supports Range requests.

* Supports Keep-Alive.

::

   usage: rehttpfs.py [-h] [-o OPTIONS] [-t TIMEOUT] [-u USER_AGENT] [-v] [-d]

                      url mountpoint

   Mount HTML directory listings.

   positional arguments:

     url                   URL to mount

     mountpoint            filesystem mount point

   optional arguments:

     -h, --help            show this help message and exit

     -o OPTIONS            comma separated FUSE options

     -t TIMEOUT, --timeout TIMEOUT

                           HTTP request timeout

     -u USER_AGENT, --user-agent USER_AGENT

                           HTTP User-Agent

     -v, --verbose         enable debug logging

     -d, --daemon          run in background