https://github.com/mozmeao/www-sitemap-generator

https://github.com/mozmeao/www-sitemap-generator

Last synced: about 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/mozmeao/www-sitemap-generator
• Owner: mozmeao
• License: mpl-2.0
• Created: 2018-08-10T19:42:25.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2024-04-16T00:14:08.000Z (9 months ago)
• Last Synced: 2024-04-16T03:18:57.116Z (9 months ago)
• Language: Python
• Homepage:
• Size: 622 MB
• Stars: 0
• Watchers: 9
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# www-sitemap-generator

A tool for ingesting the sitemap.json file from www.mozilla.org and creating

[sitemap protocol](https://www.sitemaps.org/) compatible XML files with lastmod

datetimes based on changes to etags.

## Usage

```bash

$ ./generate_sitemap_docker.sh

```

This will build the docker image, run `update_etags.py` which gets https://www.mozilla.org/sitemap.json,

saves it, then uses that data to do `GET` requests against all of the URLs to get and compare the

[etags](https://en.wikipedia.org/wiki/HTTP_ETag) in the responses, and then run `generate_sitemaps.py`

which takes the data saved by `update_etags.py` and generates the XML sitemaps for use on the site.

## Development

Install [pre-commit](https://pre-commit.com/#install), and then run `pre-commit install` and you'll be setup

to auto format your code according to our style and check for errors for every commit.