{"id":17614893,"url":"https://github.com/gsarti/paperpile-notion","last_synced_at":"2025-05-06T21:02:41.891Z","repository":{"id":37462461,"uuid":"397220226","full_name":"gsarti/paperpile-notion","owner":"gsarti","description":"Integrating Paperpile with Notion Databases 🔄","archived":false,"fork":false,"pushed_at":"2024-03-03T09:11:27.000Z","size":11938,"stargazers_count":54,"open_issues_count":2,"forks_count":11,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-03-31T02:51:10.445Z","etag":null,"topics":["academia","automation","notion","notion-api","paperpile","papers"],"latest_commit_sha":null,"homepage":"https://papers.gsarti.com","language":"TeX","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/gsarti.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2021-08-17T11:03:23.000Z","updated_at":"2025-02-11T21:17:27.000Z","dependencies_parsed_at":"2024-03-03T10:35:08.362Z","dependency_job_id":null,"html_url":"https://github.com/gsarti/paperpile-notion","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gsarti%2Fpaperpile-notion","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gsarti%2Fpaperpile-notion/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gsarti%2Fpaperpile-notion/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gsarti%2Fpaperpile-notion/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/gsarti","download_url":"https://codeload.github.com/gsarti/paperpile-notion/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252769396,"owners_count":21801375,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["academia","automation","notion","notion-api","paperpile","papers"],"created_at":"2024-10-22T18:51:00.672Z","updated_at":"2025-05-06T21:02:41.869Z","avatar_url":"https://github.com/gsarti.png","language":"TeX","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Paperpile Notion Integration\n\nThis repository provides a simple integration between [Paperpile](https://paperpile.com/) and [Notion](www.notion.so) using the new [Notion API](https://developers.notion.com/). The purpose is to make it easy to periodically sync a list of papers in Paperpile to a Notion database.\n\nThis is a work in progress, and is currently intended for personal use only (no support, no warranty, no liability, etc.).\n\n**New**: The WIP script `download_paperpile_folder.py` provides an automated way to download a folder from a Paperpile account. This script uses Chromium and Selenium, so the chrome drivers must be placed under the path to make it work. Check the args for more information. \n\n## Installation\n\nSimply clone the repo locally and install the dependencies, preferably in a virtualenv:\n\n```shell\ngit clone https://github.com/gsarti/paperpile-notion.git\ncd paperpile-notion\npython3 -m venv venv\npip install --upgrade pip\npip install -r requirements.txt\n```\n\n## Requirements\n\nTo run the script, you will need the following things:\n\n1. A CSV file exported from Paperpile containing the list of papers and their metadata. [data.csv](data.csv) is an example of an exported CSV. For now, this needs to be manually downloaded and moved to this folder since Paperpile does not provide any API for exporting data.\n\n2. A configuration file to map categories, journals and conferences to their acronyms. [config.yaml](config.yaml) is an example of a configuration file containing major AI and NLP conferences and journals.\n\n3. A database id for the Notion database you want to sync to. To retrieve the database id, follow the directions provided [here](https://developers.notion.com/docs/working-with-databases). The current structure for the database must contain at least the following columns:\n\n    - `Item type`  ( `select` ): Corresponds to the `Item type` field in the Paperpile export (e.g. `Conference Paper`, `Journal Article`, etc.).\n\n    - `Title`  ( `title` ): The title of the paper.\n\n    - `Status` ( `select` ): Set to `Done` when the paper was read, empty otherwise. Can take other values. Managed by using a \"Read\" and a \"To Read\" folder inside Papepile.\n\n    - `Authors` ( `multi_select` ): The paper's authors. Corresponds to the `Authors` field in the Paperpile export, with only lastnames and first letter of firstnames.\n\n    - `Venues` ( `multi_select` ): The venues in which the paper was published. Based on the config sections for mapping names to acronyms. Multiselect to specify e.g. conference + arXiv.\n\n    - `Date` ( `date` ): The date the paper was published.\n\n    - `Link` ( `url` ): Link to the paper. If multiple links are available, arXiv links are preferred.\n\n    - `Categories` ( `multi_select` ): The categories the paper belongs to. Define the macro-fields to which the paper belongs. These are extracted from the labels that were assigned to the paper on Paperpile.\n\n    - `Methods` ( `multi_select` ): The methods and aspects investigated in the paper. Can be whatever, from architectures (e.g. CNN, Transformer) to sub-topics. On Paperpile, these correspond to labels having the following format: `category_shortname - method_name` (e.g. Probing tasks for interpretability research could be `INT - Probing`). Refer to the CSV file for an example.\n\n4. A Notion API key. To retrieve the API key, follow the directions provided in the [Notion API Getting Started](https://developers.notion.com/docs/getting-started). You will also need to add permission for the integration on the database from the previous point.\n\n## Usage\n\nOnce everything is in place, simply run the script as:\n\n```shell\npython update_notion_db.py \\\n    --input data.csv \\\n    --config config.yaml \\\n    --database \u003cYOUR_DB_ID\u003e \\\n    --token \u003cYOUR_NOTION_API_KEY\u003e\n```\n\nThe experimental script to auto-download a folder from Paperpile can be run as:\n\n```shell\npython download_paperpile_dir.py \\\n    --username \u003cYOUR_GOOGLE_USERNAME\u003e \\\n    --password \u003cYOUR_GOOGLE_PASSWORD\u003e \\\n    --folder_id \u003cYOUR_FOLDER_ID\u003e # e.g. pp-folder-2cb1833f-582f-0000-ad59-567be5718692\n```\n\nThis will download the folder content in CSV format in the default download location.\n\nExample output, adding a new paper to the database:\n\n![Console output](img/output.png)\n\nExample resulting database on Notion:\n\n![Notion result](img/notion_result.png)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgsarti%2Fpaperpile-notion","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgsarti%2Fpaperpile-notion","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgsarti%2Fpaperpile-notion/lists"}