群体知识图谱：分布式知识迁移与联邦式图谱推理

陈名杨; 张文; 陈湘楠; 周虹廷; 陈华钧

doi:10.11959/j.issn.2096-6652.202217

您当前的位置：

首页 >

文章列表页 >

群体知识图谱：分布式知识迁移与联邦式图谱推理

专题：群体智能 | 更新时间：2024-06-05

- 群体知识图谱：分布式知识迁移与联邦式图谱推理
- Collective knowledge graph: meta knowledge transfer and federated graph reasoning
- 智能科学与技术学报 2022年4卷第1期页码：55-64
- 作者机构：
  
  1. 浙江大学计算机科学与技术学院，浙江杭州 310007
  2. 浙江大学软件学院，浙江杭州 310007
- 作者简介：
  
  [ "陈名杨（1997− ），男，浙江大学计算机科学与技术学院博士生，主要研究方向为知识图谱表示学习" ]
  [ "张文（1992− ），女，浙江大学软件学院助理研究员，主要研究方向为知识图谱、大数据系统、图数据处理" ]
  [ "陈湘楠（1998− ），男，浙江大学软件学院硕士生，主要研究方向为知识图谱表示学习" ]
  [ "周虹廷（1997− ），女，浙江大学计算机科学与技术学院硕士生，主要研究方向为知识图谱和图神经网络" ]
  [ "陈华钧（1978− ），男，博士，浙江大学计算机科学与技术学院教授，主要研究方向为知识图谱、大数据系统与自然语言处理" ]
- 基金信息：
  
  国家自然科学基金资助项目;The National Natural Science Foundation of China(91846204);国家自然科学基金资助项目;The National Natural Science Foundation of China(U19B2027)
- DOI：10.11959/j.issn.2096-6652.202217
  中图分类号： TP391
- 网络出版日期：2022-03，
  
  纸质出版日期：2022-03-15
- 稿件说明：
移动端阅览
陈名杨, 张文, 陈湘楠, 等. 群体知识图谱：分布式知识迁移与联邦式图谱推理[J]. 智能科学与技术学报, 2022,4(1):55-64.

Mingyang CHEN, Wen ZHANG, Xiangnan CHEN, et al. Collective knowledge graph: meta knowledge transfer and federated graph reasoning[J]. Chinese journal of intelligent science and technology, 2022, 4(1): 55-64.
陈名杨, 张文, 陈湘楠, 等. 群体知识图谱：分布式知识迁移与联邦式图谱推理[J]. 智能科学与技术学报, 2022,4(1):55-64. DOI： 10.11959/j.issn.2096-6652.202217.

Mingyang CHEN, Wen ZHANG, Xiangnan CHEN, et al. Collective knowledge graph: meta knowledge transfer and federated graph reasoning[J]. Chinese journal of intelligent science and technology, 2022, 4(1): 55-64. DOI： 10.11959/j.issn.2096-6652.202217.

摘要

群体知识图谱是指通过群体协作，以去中心化或分布式方式管理和维护的知识图谱。相比现有的集中式管理的知识图谱，群体知识图谱具备知识确权、隐私保护、众包激励、可信溯责等特点。尝试探讨构建或应用群体知识图谱平台面临的技术挑战。其中分布式知识迁移考虑在一个分散自治的框架下，通过实现不同来源的多个知识图谱之间的知识迁移，缓解单个知识图谱的知识不完备问题。其主要难点是在充分保护知识的自治所有权的前提下，尽可能共享有用的知识，以增强各自的知识图谱表示。联邦式图谱推理也是考虑在一个分布式环境下，通过联邦学习机制实现隐私保护前提下的知识图谱推理。在分布式知识迁移中，强调在关系集合互相重叠的知识图谱间迁移与实体无关的知识；而在联邦式图谱推理中，强调在多个实体集合互相重叠的知识图谱间共同学习更好的实体嵌入表示。针对这两个问题分别进行模型设计及实验验证。

Abstract

Collective knowledge graphs refer to knowledge graphs that are managed and maintained in a decentralized or distributed manner through group collaboration.Compared with the existing centrally managed knowledge graph

the collective knowledge graph has the characteristics of knowledge right confirmation

privacy protection

crowd sourcing incentive

and credible traceability.Tring to explore the technical challenges faced by building and applying a collective knowledge graph platform.For meta knowledge transfer

the knowledge incompleteness of a single knowledge graph by knowledge transfer among multiple knowledge graphs from different sources under a decentralized and autonomous framework was considered.The main difficulty was to enhance the respective knowledge graph representation by sharing useful knowledge with each other as much as possible while fully protecting the autonomous ownership of knowledge.For federated graph reasoning

the knowledge graph reasoning in a distributed environment under the privacy-preserving by means of the federated learning mechanism was considered.Meta knowledge transfer focused on transferring entity-independent knowledge between knowledge graphs with overlapped relation set

while federated graph reasoning aimed at learning better entity embeddings for knowledge graphs with overlapped entity set.The model design and experimental validation for each of these two problems were conducted.

关键词

Keywords

references

BERNERS-LEE T , HENDLER J , LASSILA O . The semantic Web [J ] . Scientific American , 2001 , 284 ( 5 ): 34 - 43 .

VRANDEČIĆ D KRÖTZSCH M . Wikidata [J ] . Communications of the ACM , 2014 , 57 ( 10 ): 78 - 85 .

AUER S , BIZER C , KOBILAROV G , et al . DBpedia:a nucleus for a web of open data [M ] . The semantic Web . Heidelberg : Springer , 2007 .

MITCHELL T , COHEN W , HRUSCHKA E , et al . Never-ending learning [J ] . Communications of the ACM , 2018 , 61 ( 5 ): 103 - 115 .

XIONG W H , DU J F , WANG W Y , et al . Pretrained encyclopedia:weakly supervised knowledge-pretrained language model [C ] // Proceedings of the International Conference on Learning Representations .[S.l.:s.n. ] , 2019 .

YASUNAGA M , REN H Y , BOSSELUT A , et al . QA-GNN:reasoning with language models and knowledge graphs for question answering [C ] // Proceedings of 2021 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies . Stroudsburg:Association for Computational Linguistics , 2021 : 535 - 546 .

ZHANG Q , ZHANG L , QIN C , et al . A survey on knowledge graph-based recommender systems [J ] . Scientia Sinica Informationis , 2020 , 50 ( 7 ): 937 - 956 .

DEVLIN J , CHANG M W , LEE K , et al . BERT:pre-training of deep bidirectional transformers for language understanding [J ] . arXiv preprint , 2018 ,arXiv:1810.04805.

WANG X Z , GAO T Y , ZHU Z C , et al . KEPLER:a unified model for knowledge embedding and pre-trained language representation [J ] . Transactions of the Association for Computational Linguistics , 2021 , 9 : 176 - 194 .

CHEN H J , HU N , QI G L , et al . OpenKG chain:a blockchain infrastructure for open knowledge graphs [J ] . Data Intelligence , 2021 : 1 - 18 .

BORDES A , USUNIER N , GARCIA-DURAN A , , et al . Translating embeddings for modeling multi-relational data [J ] . Advances in Neural Information Processing Systems , 2013 ,26.

WANG Z , ZHANG J W , FENG J L , et al . Knowledge graph embedding by translating on hyperplanes [C ] // Proceedings of the AAAI Conference on Artificial Intelligence .[S.l.:s.n. ] , 2014 .

ZHOU X H , YI Y H , JIA G . Path-RotatE:knowledge graph embedding by relational rotation of path in complex space [C ] // Proceedings of 2021 IEEE/CIC International Conference on Communications in China . Piscataway:IEEE Press , 2021 : 905 - 910 .

NICKEL M , TRESP V , KRIEGEL H . A three-way model for collective learning on multi-relational data [C ] // Proceedings of the 28th International Conference on International Conference on Machine Learning .[S.l.:s.n. ] , 2011 : 809 - 816 .

YANG B S , YIH W T , HE X D , et al . Embedding entities and relations for learning and inference in knowledge bases [J ] . arXiv preprint , 2014 ,arXiv:1412.6575.

TROUILLON T , WELBL J , Riedel S R , et al . Complex embeddings for simple link prediction [C ] // Proceedings of the International Conference on Machine Learning .[S.l.:s.n. ] , 2016 : 2071 - 2080 .

TERU K , DENIS E , HAMILTON W . Inductive relation prediction by subgraph reasoning [C ] // Proceedings of the International Conference on Machine Learning .[S.l.:s.n. ] , 2020 : 9448 - 9457 .

MAI S J , ZHENG S J , YANG Y D , et al . Communicative message passing for inductive relation reasoning [J ] . arXiv preprint , 2020 ,arXiv:2012.08911.

CHEN J J , HE H R , WU F , et al . Topology-aware correlations between relations for inductive link prediction in knowledge graphs [C ] // Proceedings of the AAAI Conference on Artificial Intelligence .[S.l.:s.n. ] , 2021 : 6271 - 6278 .

GALÁRRAGA L A , TEFLIOUDI C , HOSE K , et al . AMIE:association rule mining under incomplete evidence in ontological knowledge bases [C ] // Proceedings of the 22nd International Conference on World Wide Web .[S.l.:s.n. ] , 2013 : 413 - 422 .

MEILICKE C , FINK M , WANG Y J , et al . Fine-grained evaluation of rule- and embedding-based systems for knowledge graph completion [C ] // Proceedings of the International Semantic Web Conference .[S.l.:s.n. ] , 2018 : 3 - 20 .

YANG F , YANG Z L , COHEN W W . Differentiable learning of logical rules for knowledge base reasoning [J ] . arXiv preprint , 2017 ,arXiv:1702.08367.

SADEGHIAN A , ARMANDPOUR M , DING P , et al . DRUM:end-to-end differentiable rule mining on knowledge graphs [J ] . Advances in Neural Information Processing Systems , 2019 , 32 : 15347 - 15357 .

MCMAHAN H B , MOORE E , RAMAGE D , et al . Communication-efficient learning of deep networks from decentralized data [J ] . arXiv preprint , 2016 ,arXiv:1602.05629.

DETTMERS T , MINERVINI P , STENETORP P , et al . Convolutional 2D knowledge graph embeddings [C ] // Proceedings of the AAAI Conference on Artificial Intelligence .[S.l.:s.n. ] , 2018 .

TOUTANOVA K , CHEN D Q , PANTEL P , et al . Representing text for joint embedding of text and knowledge bases [C ] // Proceedings of 2015 Conference on Empirical Methods in Natural Language Processing . Stroudsburg:Association for Computational Linguistics , 2015 : 1499 - 1509 .

XIONG W H , HOANG T , WANG W Y . DeepPath:a reinforcement learning method for knowledge graph reasoning [C ] // Proceedings of 2017 Conference on Empirical Methods in Natural Language Processing . Stroudsburg:Association for Computational Linguistics , 2017 : 564 - 573 .

浏览量

272

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

群体智能中的联邦学习算法综述

联邦可视化：一种隐私保护的可视化新模型