https://github.com/txsun1997/CoLAKE

COLING'2020: CoLAKE: Contextualized Language and Knowledge Embedding
https://github.com/txsun1997/CoLAKE

deep-learning knowledge-embedding knowledge-graph language-model natural-language-processing

Last synced: about 1 month ago
JSON representation

COLING'2020: CoLAKE: Contextualized Language and Knowledge Embedding

• Host: GitHub
• URL: https://github.com/txsun1997/CoLAKE
• Owner: txsun1997
• License: mit
• Created: 2020-08-15T12:52:52.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2021-03-02T12:41:45.000Z (almost 4 years ago)
• Last Synced: 2024-08-03T09:07:11.748Z (5 months ago)
• Topics: deep-learning, knowledge-embedding, knowledge-graph, language-model, natural-language-processing
• Language: Python
• Homepage: https://aclanthology.org/2020.coling-main.327/
• Size: 27.1 MB
• Stars: 114
• Watchers: 4
• Forks: 17
• Open Issues: 2

Awesome Lists containing this project

• StarryDivineSky - txsun1997/CoLAKE - gpu混合训练策略结合负采样机制减少训练时间；最终本文提出的方法在知识图谱补全和若干NLP任务上均带来了增益。然后本文将该图转化为序列，使用Transformer进行预训练，并在训练时采用特殊的type embedding来表示实体、词语与其他子图信息 (知识图谱 / 其他_文本生成、文本对话)