Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/benedekrozemberczki/MixHop-and-N-GCN
An implementation of "MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing" (ICML 2019).
https://github.com/benedekrozemberczki/MixHop-and-N-GCN
convolutional convolutional-layers convolutional-neural-networks deep-learning deepwalk gcn graph-attention graph-attention-networks graph-convolution graph-representation-learning machine-learning mixhop multi-scale ngcn node2vec pytorch pytorch-cnn tensorflow walklet walklets
Last synced: 3 months ago
JSON representation
An implementation of "MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing" (ICML 2019).
- Host: GitHub
- URL: https://github.com/benedekrozemberczki/MixHop-and-N-GCN
- Owner: benedekrozemberczki
- License: gpl-3.0
- Created: 2019-02-23T13:59:16.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2022-11-06T21:17:00.000Z (almost 2 years ago)
- Last Synced: 2024-05-02T00:56:09.275Z (6 months ago)
- Topics: convolutional, convolutional-layers, convolutional-neural-networks, deep-learning, deepwalk, gcn, graph-attention, graph-attention-networks, graph-convolution, graph-representation-learning, machine-learning, mixhop, multi-scale, ngcn, node2vec, pytorch, pytorch-cnn, tensorflow, walklet, walklets
- Language: Python
- Homepage:
- Size: 5.06 MB
- Stars: 397
- Watchers: 15
- Forks: 62
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
- awesome-network-embedding - [Python PyTorch
README
MixHop and N-GCN
===========================
[](https://paperswithcode.com/sota/node-classification-on-citeseer?p=mixhop-higher-order-graph-convolution)
[](https://arxiv.org/abs/1905.00067)
[](https://codebeat.co/projects/github-com-benedekrozemberczki-mixhop-and-n-gcn-master)
[](https://github.com/benedekrozemberczki/MixHop-and-N-GCN/archive/master.zip)⠀[](https://twitter.com/intent/follow?screen_name=benrozemberczki)
A **PyTorch** implementation of "MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing" (ICML 2019) and "A Higher-Order Graph Convolutional Layer" (NeurIPS 2018).
---------------------
### Abstract
Recent methods generalize convolutional layers from Euclidean domains to graph-structured data by approximating the eigenbasis of the graph Laplacian. The computationally-efficient and broadly-used Graph ConvNet of Kipf & Welling, over-simplifies the approximation, effectively rendering graph convolution as a neighborhood-averaging operator. This simplification restricts the model from learning delta operators, the very premise of the graph Laplacian. In this work, we propose a new Graph Convolutional layer which mixes multiple powers of the adjacency matrix, allowing it to learn delta operators. Our layer exhibits the same memory footprint and computational complexity as a GCN. We illustrate the strength of our proposed layer on both synthetic graph datasets, and on several real-world citation graphs, setting the record state-of-the-art on Pubmed.
This repository provides a PyTorch implementation of MixHop and N-GCN as described in the papers:
> MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing
> Sami Abu-El-Haija, Bryan Perozzi, Amol Kapoor, Hrayr Harutyunyan, Nazanin Alipourfard, Kristina Lerman, Greg Ver Steeg, and Aram Galstyan.
> ICML, 2019.
> [[Paper]](https://arxiv.org/pdf/1905.00067.pdf)
> A Higher-Order Graph Convolutional Layer.
> Sami A Abu-El-Haija, Bryan Perozzi, Amol Kapoor, Nazanin Alipourfard, Hrayr Harutyunyan.
> NeurIPS, 2018.
> [[Paper]](http://sami.haija.org/papers/high-order-gc-layer.pdf)
The original TensorFlow implementation of MixHop is available [[Here]](https://github.com/samihaija/mixhop).
### Requirements
The codebase is implemented in Python 3.5.2. package versions used for development are just below.
```
networkx 2.4
tqdm 4.28.1
numpy 1.15.4
pandas 0.23.4
texttable 1.5.0
scipy 1.1.0
argparse 1.1.0
torch 1.1.0
torch-sparse 0.3.0
```
### Datasets
The code takes the **edge list** of the graph in a csv file. Every row indicates an edge between two nodes separated by a comma. The first row is a header. Nodes should be indexed starting with 0. A sample graph for `Cora` is included in the `input/` directory. In addition to the edgelist there is a JSON file with the sparse features and a csv with the target variable.
The **feature matrix** is a sparse binary one it is stored as a json. Nodes are keys of the json and feature indices are the values. For each node feature column ids are stored as elements of a list. The feature matrix is structured as:
```javascript
{ 0: [0, 1, 38, 1968, 2000, 52727],
1: [10000, 20, 3],
2: [],
...
n: [2018, 10000]}
```
The **target vector** is a csv with two columns and headers, the first contains the node identifiers the second the targets. This csv is sorted by node identifiers and the target column contains the class meberships indexed from zero.
| **NODE ID**| **Target** |
| --- | --- |
| 0 | 3 |
| 1 | 1 |
| 2 | 0 |
| 3 | 1 |
| ... | ... |
| n | 3 |
### Options
Training an N-GCN/MixHop model is handled by the `src/main.py` script which provides the following command line arguments.
#### Input and output options
```
--edge-path STR Edge list csv. Default is `input/cora_edges.csv`.
--features-path STR Features json. Default is `input/cora_features.json`.
--target-path STR Target classes csv. Default is `input/cora_target.csv`.
```
#### Model options
```
--model STR Model variant. Default is `mixhop`.
--seed INT Random seed. Default is 42.
--epochs INT Number of training epochs. Default is 2000.
--early-stopping INT Early stopping rounds. Default is 10.
--training-size INT Training set size. Default is 1500.
--validation-size INT Validation set size. Default is 500.
--learning-rate FLOAT Adam learning rate. Default is 0.01.
--dropout FLOAT Dropout rate value. Default is 0.5.
--lambd FLOAT Regularization coefficient. Default is 0.0005.
--layers-1 LST Layer sizes (upstream). Default is [200, 200, 200].
--layers-2 LST Layer sizes (bottom). Default is [200, 200, 200].
--cut-off FLOAT Norm cut-off for pruning. Default is 0.1.
--budget INT Architecture neuron budget. Default is 60.
```
### Examples
The following commands learn a neural network and score on the test set. Training a model on the default dataset.
```sh
$ python src/main.py
```
Training a MixHop model for a 100 epochs.
```sh
$ python src/main.py --epochs 100
```
Increasing the learning rate and the dropout.
```sh
$ python src/main.py --learning-rate 0.1 --dropout 0.9
```
Training a model with diffusion order 2:
```sh
$ python src/main.py --layers 64 64
```
Training an N-GCN model:
```sh
$ python src/main.py --model ngcn
```
--------------------------------------------------------------------------------
**License**
- [GNU](https://github.com/benedekrozemberczki/MixHop-and-N-GCN/blob/master/LICENSE)
--------------------------------------------------------------------------------