Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/typedb/typedb-ml
TypeDB-ML is the Machine Learning integrations library for TypeDB
https://github.com/typedb/typedb-ml
ai artificial-intelligence geometric-deep-learning grakn graph graph-convolutional-networks graph-networks graphs graql knowledge-graph knowledge-graph-completion knowledgebase link-prediction machine-learning ml neural-network python relational-learning tensorflow
Last synced: 15 days ago
JSON representation
TypeDB-ML is the Machine Learning integrations library for TypeDB
- Host: GitHub
- URL: https://github.com/typedb/typedb-ml
- Owner: typedb
- License: apache-2.0
- Archived: true
- Created: 2018-09-16T16:46:48.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2023-11-18T17:08:08.000Z (12 months ago)
- Last Synced: 2024-08-04T16:52:53.429Z (3 months ago)
- Topics: ai, artificial-intelligence, geometric-deep-learning, grakn, graph, graph-convolutional-networks, graph-networks, graphs, graql, knowledge-graph, knowledge-graph-completion, knowledgebase, link-prediction, machine-learning, ml, neural-network, python, relational-learning, tensorflow
- Language: Python
- Homepage: https://vaticle.com
- Size: 11 MB
- Stars: 551
- Watchers: 38
- Forks: 93
- Open Issues: 12
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Awesome Lists containing this project
README
# This repository is outdated and not supported. We will be closing this repository by end of 2023.
---
[](https://github.com/vaticle/typedb/releases/latest)
[](https://vaticle.com/discord)
[](https://forum.vaticle.com)
[](https://stackoverflow.com/questions/tagged/typedb)
[](https://stackoverflow.com/questions/tagged/typeql)
# TypeDB-ML
_Previously known as KGLIB._
**TypeDB-ML provides tools to enable graph algorithms and machine learning with [TypeDB](https://github.com/vaticle/typedb).**
There are integrations for [NetworkX](https://networkx.org) and for [PyTorch Geometric (PyG)](https://github.com/pyg-team/pytorch_geometric).
[NetworkX](https://networkx.org) integration allows you to use a [large library of algorithms](https://networkx.org/documentation/stable/reference/algorithms/index.html) over graph data exported from TypeDB.
[PyTorch Geometric (PyG)](https://github.com/pyg-team/pytorch_geometric) integration gives you a toolbox to build Graph Neural Networks (GNNs) for your TypeDB data, with an example included for link prediction (or: binary relation prediction, in TypeDB terms). The structure of the GNNs are totally customisable, with network components for popular topics such as graph attention and graph transformers built-in.
## Features
### NetworkX
- Declare the graph structure of your queries, with optional sampling functions.
- Query a TypeDB instance and combine many results across many queries into a single graph (`build_graph_from_queries`).
### PyTorch Geometric
- A `DataSet` object to lazily load graphs from a TypeDB instance. Each graph is converted to a PyG `Data` object.
- It's most natural to work with PyG `HeteroData` objects since all data in TypeDB has a type. Conversion from `Data` to `HeteroData`is available in PyG, but it loses node ordering information. To remedy this, TypeDB-ML provides `store_concepts_by_type` to store concepts consistent with a `HeteroData` object. This enables concepts to be properly re-associated with predictions after learning is finished.
- A `FeatureEncoder` to orchestrate encoders to generate features for graphs.
- Encoders for Continuous and Categorical values to apply encodings/embedding spaces to the types and attribute values present in TypeDB data.
- A [full example for link prediction](examples/diagnosis)
### Other
- Example usage of Tensorboard for PyG `HeteroData`
## Resources
You may find the following resources useful, particularly to understand why TypeDB-ML started:
- [Strongly Typed Data for Machine Learning](https://www.youtube.com/watch?v=qhUyurWMiSQ) (YouTube, 2021)
- [How Can We Complete a Knowledge Graph?](https://www.youtube.com/watch?v=nYDi1_UaFtU) (YouTube, 2018)
## Quickstart
### Install
- Python >= 3.7.x
- Grab the `requirements.txt` file from [here](requirements.txt) and install the requirements with `pip install -r requirements.txt`. This is due to some intricacies installing PyG's dependencies, see [here](https://github.com/pyg-team/pytorch_geometric/issues/861) for details.
- Installed TypeDB-ML: `pip install typedb-ml`.
- [TypeDB 2.11.1](https://github.com/vaticle/typedb/releases) running in the background.
- `typedb-client-python` 2.11.x ([PyPi](https://pypi.org/project/typedb-client/), [GitHub release](https://github.com/vaticle/typedb-client-python/releases)). This should be installed automatically when you `pip install typedb-ml`.
### Run the Example
Take a look at the [PyTorch Geometric heterogeneous link prediction example](examples/diagnosis) to see how to use TypeDB-ML to build a GNN on TypeDB data.
## Development
To follow the development conversation, please join the [Vaticle Discord](https://discord.com/invite/vaticle), and join the `#typedb-ml` channel. Alternatively, start a new topic on the [Vaticle Discussion Forum](https://forum.vaticle.com).
TypeDB-ML requires that you have migrated your data into a [TypeDB](https://github.com/vaticle/typedb) or TypeDB
Cluster instance. There is an [official examples repo](https://github.com/vaticle/examples) for how to go about this, and information available on [migration in the docs](https://docs.vaticle.com/docs/examples/phone-calls-migration-python). Alternatively, there are fantastic community-led projects growing in the [TypeDB OSI](https://typedb.org) to facilitate fast and easy data loading, for example [TypeDB Loader](https://github.com/typedb-osi/typedb-loader).
### Building from Source
It's expected that you will use Pip to install, but should you need to make your own changes to the library, and import it into your project, you can build from source as follows:
Clone TypeDB-ML:
```
git clone [email protected]:vaticle/typedb-ml.git
```
Go into the project directory:
```
cd typedb-ml
```
Build all targets:
```
bazel build //...
```
Run all tests. Requires Python 3.7+ on your `PATH`. Test dependencies are for Linux since that is the CI environment:
```
bazel test //typedb_ml/... --test_output=streamed --spawn_strategy=standalone --action_env=PATH
```
Build the pip distribution. Outputs to `bazel-bin`:
```
bazel build //:assemble-pip
```