Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/apsl/page-size-check
An utility to check the size of your pages and resources used
https://github.com/apsl/page-size-check
harfile python python3 selenium web
Last synced: 3 months ago
JSON representation
An utility to check the size of your pages and resources used
- Host: GitHub
- URL: https://github.com/apsl/page-size-check
- Owner: APSL
- License: mit
- Created: 2018-10-17T15:34:43.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2019-05-15T15:37:58.000Z (over 5 years ago)
- Last Synced: 2024-11-07T02:18:17.508Z (3 months ago)
- Topics: harfile, python, python3, selenium, web
- Language: Python
- Homepage:
- Size: 74.2 KB
- Stars: 4
- Watchers: 6
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.rst
- Changelog: CHANGELOG
- License: LICENSE
Awesome Lists containing this project
README
=========
Page Size Check
=========
Page Size Check is an utility to check the size of pages from a sitemap and its resources parsering the HAR file of the
request using Selenium and haralyzer. The execution of this utility produces some files to allow the user to make an
analysis of the number of requests and its size. The execution use ThreadPoolExecutor to launch the browsers in parallel.
Dependencies
------------
* Git.
* Python 3.5 or higher, `pip`_ and virtualenvwrapper.
* System requeriments in requirements-sys.txt
Installation with PyPI
----------------------
#. Installation ::
pip install page-size-check
#. Download ::
- Firefox webdriver for selenium: geckodriver
- Browsermob-proxy
#. Execution ::
page_size_check --sitemap_url="sitemap.url" [--help]
#. Output ::
- Summary tables: tables with summary info for each url and the total amount of results
- Resume urls file: a resume of the urls with the number of entries, the page size and the page load times
- Resources list file: a list of the resources on every page with its mimetype, size and load time
- Mimetype resources: a resume of the resources grouped by mimetype in each url of the sitemap
Installation with Docker
------------------------
If you want to use Docker and avoid to install external dependencies just type::
docker run --rm apsl/page-size-check --sitemap_url=http://www.example.com/sitemap.xml
Usage
-----
As was showned before, you can execute the script doing :code:`python page_size_check.py --help` to see all the
parameters that you can set:
--browsermob_server_path TEXT Browsermob server path.
--browsermob_server_port INTEGER Browsermob server port.
--firefox_driver_path TEXT Firefox driver path.
--sitemap_url TEXT Sitemap to get urls.
--threads INTEGER Number of threads.
--display_summary BOOLEAN If true displays the results summary to the stdout.
--generate_extra_csv BOOLEAN If true generates extra csv with resume information
--help Show this message and exit.
Contributing
------------
Contributions are very welcome. Please open a `pull request`_ or `file an issue`_.
Tests will be ready as soon as posible, please ensure the coverage at least stays the same
before you submit a pull request.
License
-------
Distributed under the terms of the `MIT`_ license, "page-size-check" is free and open source software
Issues
------
If you encounter any problems, please `file an issue`_ along with a detailed description.
.. _`pip`: https://pypi.python.org/pypi/pip/
.. _`pull request`: https://github.com/APSL/page-size-check/pulls
.. _`file an issue`: https://github.com/APSL/page-size-check/issues
.. _`MIT`: http://opensource.org/licenses/MIT