https://github.com/aksakalli/patent-analysis

Analyzing patent network data by downloading patentsview.org into MongoDB
https://github.com/aksakalli/patent-analysis

dataset mongodb network-analysis patent python

Last synced: about 1 month ago
JSON representation

Analyzing patent network data by downloading patentsview.org into MongoDB

• Host: GitHub
• URL: https://github.com/aksakalli/patent-analysis
• Owner: aksakalli
• License: mit
• Created: 2017-07-28T10:35:32.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2022-06-21T21:16:21.000Z (over 2 years ago)
• Last Synced: 2024-04-16T11:35:36.147Z (8 months ago)
• Topics: dataset, mongodb, network-analysis, patent, python
• Language: Jupyter Notebook
• Size: 133 KB
• Stars: 13
• Watchers: 5
• Forks: 1
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Patent Analysis

This is a tool to download US Patent information, particularly, citation network from

[patentsview.org](http://www.patentsview.org) and store into [MongoDB](https://www.mongodb.com/) to analyze.

Currently, this dataset contains 6.215.171 patents (verticies) and 86.184.397 citations (edges).

For example, we can draw _in-degree_ distribution of the citation network.

![PageRank of PageRank Patent](docs/img/degree-distro.png)

or average citations (out-degree) added per year:

![PageRank of PageRank Patent](docs/img/average-degree.png)

or edge/node (loglog) count over time:

![PageRank of PageRank Patent](docs/img/node-to-edge.png)

See [the notebook](Retriever.ipynb) for other demos.

## Getting Started

### 1) Python dependencies

First, you need to have the required packages under [requirements.txt](requirements.txt).

You can install using `virtualenv` or to user.

### 2) Database

Second, you need a MongoDB running.

If you have `docker` you can use following line to run an instance:

```

$ docker run --name patent-mongo -v `pwd`/db:/data/db -p 27017:27017 -d mongo:3.4.6

```

(If your db host is not localhost, set it with environment vars like

  `$ export MONGO_URL="mongodb://host:27017"`

before running the app.)

### 3) Downloading and storing the dataset:

This will download the dataset from

[patentsview.org/download/](http://www.patentsview.org/download/):

```

$ ./download_data.sh

```

Now inserting it to the db:

```

$ python -m patent_analysis.insert_db

```

(It takes ~4h with SSD Disk!)

Now we are ready to work on the patent data.

## Roadmap

* Queries for WIPO categories

* Centrality measure analysis such as `PageRank`

  ![PageRank of PageRank Patent](docs/img/pagerank.png)

* Community analysis

* Embeddings

* Assignee network analysis

* ...

## License

Released under [the MIT license](LICENSE).