Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/leoncvlt/loconotion

📄 Python tool to turn Notion.so pages into lightweight, customizable static websites
https://github.com/leoncvlt/loconotion

notion pyhton scraping static-site-generator

Last synced: about 2 months ago
JSON representation

📄 Python tool to turn Notion.so pages into lightweight, customizable static websites

Awesome Lists containing this project

README 

        
# Loconotion



**Loconotion** is a Python script that parses a [Notion.so](https://notion.so) public page (alongside all of its subpages) and generates a lightweight, customizable static site. 



⚠️ *Note*: The project is currently functional but unmantained and might not be up to date with Notion's latest site structure. Issues will likely not be resolved by me and pull requests are welcome, but you might want to look into alternative projects such as [Notion Snapshot](https://github.com/sueszli/notionSnapshot).



## But Why?



[Notion](https://notion.so) is a web app where you can create your workspace / personal wiki out of content blocks. It feels good to use, and the results look very pretty - the developers did a great job. Given that it also offers the possibility of making a page (and its sub-pages) public on the web, several people choose to use Notion to manage their personal blog, portfolio, or some simple website. Sadly Notion does not support custom domains: your public pages are stuck in the `notion.so` domain, under long computer-generated URLs.



Some services like Super, HostingPotion, HostNotion and Fruition try to work around this issue by relying on a [clever hack](https://gist.github.com/mayneyao/b9fefc9625b76f70488e5d8c2a99315d) using CloudFlare workers. This solution, however, has some disadvantages:



- **Not free** - Super, HostingPotion and HostNotion all take a monthly fee since they manage all the "hacky bits" for you; Fruition is open-source, but any domain with a decent amount of daily visits will soon clash against CloudFlare's free tier limitations, and force you to upgrade to the 5$ or more plan (plus you need to setup Cloudflare yourself)

- **Slow-ish** - As the page is still hosted on Notion, it comes bundled with all their analytics, editing / collaboration javascript, vendors css, and more bloat which causes the page to load at speeds that are not exactly appropriate for a simple blog / website. Running [example page](https://www.notion.so/The-perfect-It-s-Always-Sunny-in-Philadelphia-episode-d08aaec2b24946408e8be0e9f2ae857e) on Google's [PageSpeed Insights](https://developers.google.com/speed/pagespeed/insights/) scores a measly **24 - 66** on mobile / desktop.

- **Ugly URLs** - While the services above enable the use of custom domains, the URLs for individual pages are stuck with the long, ugly, original Notion URL (apart from Fruition - they got custom URLs figured out, although you will always see the original URL flashing for an instant when the page is loaded).

- **Notion Free Account Limitations** - Recently Notion introduced a change to its pricing model where public pages can't be set to be indexed by search engines on a free account (but they also removed the blocks count limitations, which is a good trade-off if you ask me)



**Loconotion** approaches this a bit differently. It lets Notion render the page, then scrapes it and saves a static version of the page to disk. This offers the following benefits:



- Strips out all the unnecessary bloat, like Notion's analytics, vendors scripts / styles, and javascript left in to enable collaboration.

- Caches all images / assets / fonts (hashing filenames), while keeping links intact.

- Cleans up the page urls, letting you use custom slugs if desired

- Full meta tags controls for the whole site or individual pages

- Granular custom Goggle Fonts control on headings, navbar, body and code blocks

- Lets you inject any custom style or script, from custom analytics or real-time chat support to hidden crypto miners (please don't do that)

- Outputs static files ready to be deployed on Netlify, GitHub Pages, Vercel, your Raspberry PI, that cheap second-hand Thinkpad you're using as a random server - you name it.



The result? A faster, self-contained version of the page that keeps all of Notion's nice page layouts and eye candies. For comparison, that same example page parsed with Loconotion and deployed on Netflify's free tier achieves a PageSpeed Insight score of **96 - 100**!



Bear in mind that as we are effectively parsing a static version of the page, there are some limitations compared to Notion's live public pages:



- All pages will open on their own page and not modals (depending on how you look at it this could be a plus)

- Databases will be presented in their initial view - for example, no switching views from table to gallery and such

- All editing features will be disabled - no ticking checkboxes or dragging kanban boards cards around. Usually not an issue since a public page to serve as a website would have changes locked.

- Dynamic elements won't update automatically - for example, the calendar will not highlight the current date.



Everything else should be fine. Loconotion re-implements the logic on the client side for the following dynamic elements, so they still work:



- Toggle blocks (nested ones too!)

- Anchor links

- Embeds

- Name column on tables becomes a link to the page of the database item in that row



On top of that, it defines some additional CSS rules to enable mobile responsiveness across the whole site (in some cases, looking even better than Notion's defaults - it wasn't exactly thought for mobile).



### But Notion already had an html export function?



It does, but I wasn't really happy with the styling - the pages looked a bit uglier than what they look like on a live Notion page. Plus, it doesn't support all the cool customization features outlined above!



## Demo



You can check out an example site containing most of Notion's blocks / elements exported as a static site with Loconotion, and hosted on Netlify: https://loconotion-example.netlify.app/



For reference, the original Notion public page that the site was generated from can be accessed [here](https://www.notion.so/Loconotion-Example-Page-03c403f4fdc94cc1b315b9469a8950ef#ffa3779739fd4ba286b7f8462f9e8e60).



## Installation & Requirements



Make sure you're in your virtual environment of choice, then run

- `poetry install --no-dev` if you have [Poetry](https://python-poetry.org/) installed

- `pip install -r requirements.txt` otherwise



This script uses [ChromeDriver](chromedriver.chromium.org) to automate the Google Chrome browser - therefore Google Chrome needs to be installed in order to work.



The script will automatically try to download and use the appropriate chromedriver distribution for your OS and Chrome version. If this doesn't work, download the right version for you from https://chromedriver.chromium.org/downloads and use the `--chromedriver` argument to specify its path at runtime.



### Docker support



There is a Docker support also. To build a container and to render the page run:

```bash

# Build container with loconotion

$ docker-compose build loconotion



# Run loconotion renderer with any arguments

$ docker-compose run loconotion PATH_TO_NOTION_FILE [ARGS]

```



Docker container is built from `python:3.8` tag, there is google-chrome-stable and chromedriver installed. See more in [docker/Dockerfile](docker/Dockerfile).



## Simple Usage



`python loconotion https://www.notion.so/The-perfect-It-s-Always-Sunny-in-Philadelphia-episode-d08aaec2b24946408e8be0e9f2ae857e`



In its simplest form, the script takes the URL of a public Notion.so page, and generates the site inside the `dist` folder, based on the page's title (the above example will generate the site inside `dist\The-perfect-It-s-Always-Sunny-in-Philadelphia\`).



## Advanced Usage



You can fully configure Loconotion to your needs by passing a [.toml](https://github.com/toml-lang/toml) configuration file to the script instead:



`python loconotion example\example_site.toml`



Here's what a full .toml configuration would look like, alongside with explanations of each parameter.



```toml

## Loconotion Site Configuration File ##

# full .toml configuration example file to showcase all of Loconotion's available settings

# check out https://github.com/toml-lang/toml for more info on the toml format



# name of the folder that the site will be generated in

name = "Notion Test Site"



# the notion.so page to being parsing from. This page will become the index.html

# of the generated site, and loconotion will parse all sub-pages present on the page

page = "https://www.notion.so/Loconotion-Example-Page-03c403f4fdc94cc1b315b9469a8950ef"



# optionally apply notion's dark mode, remove the line below to use the default light mode

theme = "dark"



## Global Site Settings ##

# this [site] table defines override settings for the whole site

# later on we will see how to define settings for a single page

[site]

  ## Custom Meta Tags ##

  # defined as an array of tables (double square brackets)

  # each key in the table maps to an atttribute in the tag

  # the following adds the tag 

  [[site.meta]]

  name = "title"

  content = "Loconotion Test Site"

  [[site.meta]]

  name = "description"

  content = "A static site generated from a Notion.so page using Loconotion"



  ## Custom Fonts ##

  # you can specify the name of a google font to use on the site - use the font embed name

  # if in doubt select a style on fonts.google.com and navigate to the "embed" tag to

  # check the name under CSS rules

  # the following table keys controls the font of specific elements:

  #   site: changes the font for the whole page (apart from code blocks)

  #         but the settings below override it

  #   navbar: site breadcrumbs on the top-left of the page

  #   title: page title (under the icon)

  #   h1: heading blocks, and inline databases' titles

  #   h2: sub-heading blocks

  #   h3: sub-sub-heading blocks

  #   body: non-heading text on the page

  #   code: text inside code blocks

  [site.fonts]

  site = 'Nunito'

  navbar = ''

  title = 'Montserrat'

  h1 = 'Montserrat'

  h2 = 'Montserrat'

  h3 = 'Montserrat'

  body = ''

  code = ''



  ## Custom Element Injection ##

  # defined as an array of tables [[site.inject]], followed by 'head' or 'body' to set

  # the injection point, followed by name of the tag to inject

  # each key in the table maps to an atttribute in the tag

  # e.g. the following injects this tag in the :

  #   

  [[site.inject.head.link]]

  rel="icon"

  sizes="16x16"

  type="image/png"

  href="/example/favicon-16x16.png"



  # the following injects this tag in the in the :

  #   

  # note that all href / src files are copied to the root of the site folder

  # regardless of their original path

  [[site.inject.body.script]]

  type="text/javascript"

  src="/example/custom-script.js"



  # the following injects this script in the :

  #   console.log("Hello, world!")

  [[site.inject.body.script]]

  inner_html="""

  console.log("Hello, world!")

  """



## Individual Page Settings ##

# the [pages] table defines override settings for individual pages, by defining

# a sub-table named after the page url (or part of the url, but careful about

# not using a string that appears in multiple page urls)

[pages]

  # the following settings will only apply to this page:

  #   https://www.notion.so/d2fa06f244e64f66880bb0491f58223d

  [pages.d2fa06f244e64f66880bb0491f58223d]

    ## custom slugs ##

    # inside page settings, you can change the url for that page with the 'slug' key

    # e.g. page "/d2fa06f244e64f66880bb0491f58223d" will now map to "/games-list"

    slug = "games-list"



    # change the description meta tag for this page only

    [[pages.d2fa06f244e64f66880bb0491f58223d.meta]]

    name = "description"

    content = "A fullscreen list database page, now with a pretty slug"



    # change the title font for this page only

    [pages.d2fa06f244e64f66880bb0491f58223d.fonts]

    title = 'DM Mono'



  # set up pretty slugs and options for the other database pages

  [pages.54dab6011e604430a21dc477cb8e4e3a]

    slug = "film-gallery"



  [pages.2604ce45890645c79f67d92833083fee]

    slug = "books-table"



    # don't follow any link on the page, skipping parsing sub-pages linked from this one

    # useful for large tables where we don't want individual pages for each item

    no-links = true



  [pages.a28dba2e7a67448da52f2cd2c641407b]

    slug = "random-board"

    no-links = true

```



On top of this, the script can take these optional arguments:



```

  -h, --help            show this help message and exit

  --chromedriver CHROMEDRIVER

                        Use a specific chromedriver executable instead of the

                        auto-installing one

  --single-page         Only parse the first page, then stop

  --dark-theme          Use dark themed version of the target Notion.so page

  --timeout TIMEOUT     Time in seconds to wait for the loading of lazy-loaded

                        dynamic elements (default 5). If content from the page

                        seems to be missing, try increasing this value

  --clean               Delete all previously cached files for the site before

                        generating it

  --clean-css           Delete previously cached .css files for the site

                        before generating it

  --clean-js            Delete previously cached .js files for the site before

                        generating it

  --non-headless        Run chromedriver in non-headless mode

  -v, --verbose         Increase output log verbosity

```



## Roadmap / Features wishlist



- [ ] Customizable navbar breadcrumbs

- [ ] Dark / light theme toggle

- [ ] Automated deployements (e.g. Netlify / GitHub pages / Vercel / etc.)

- [ ] Injectable custom HTML

- [ ] HTML / CSS / JS minification & images optimization

- [ ] More advanced custom theming



## Sites built with Loconotion



- [44px.ru](https://44px.ru)

- [vincent-maladiere.github.io](https://vincent-maladiere.github.io/)



If you used Loconotion to build a cool site and want it added to the list above, shoot me a mail or submit a pull request!



## Support [![Buy me a coffee](https://img.shields.io/badge/-buy%20me%20a%20coffee-lightgrey?style=flat&logo=buy-me-a-coffee&color=FF813F&logoColor=white "Buy me a coffee")](https://www.buymeacoffee.com/leoncvlt)



If you found this useful, consider [buying me a coffee](https://www.buymeacoffee.com/leoncvlt) so I get a a nice dose of methilxanthine, and you get a nice dose of karma.