Tibetan entity relation extraction based on multi-level attention fusion mechanism

Like WANG; Yuan SUN; Sisi LIU

doi:10.11959/j.issn.2096-6652.202146

您当前的位置：

首页 >

文章列表页 >

Tibetan entity relation extraction based on multi-level attention fusion mechanism

Papers and Reports | 更新时间：2024-06-05

- Tibetan entity relation extraction based on multi-level attention fusion mechanism
- Chinese Journal of Intelligent Science and Technology Vol. 3, Issue 4, Pages: 466-473(2021)
- 作者机构：
  
  1. 中央民族大学信息工程学院，北京 100081
  2. 中央民族大学国家语言资源监测与研究少数民族语言中心，北京 100081
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-6652.202146
  CLC： TP3
- Published Online：2021-12，
  
  Published：15 December 2021
- 稿件说明：
移动端阅览
Like WANG, Yuan SUN, Sisi LIU. Tibetan entity relation extraction based on multi-level attention fusion mechanism[J]. Chinese journal of intelligent science and technology, 2021, 3(4): 466-473.
DOI：

Like WANG, Yuan SUN, Sisi LIU. Tibetan entity relation extraction based on multi-level attention fusion mechanism[J]. Chinese journal of intelligent science and technology, 2021, 3(4): 466-473. DOI： 10.11959/j.issn.2096-6652.202146.

摘要

与中英文相比，藏文实体关系训练语料规模较小，传统有监督的学习方法难以获得较高的准确率。针对基于远程监督的实体关系抽取存在错误标记的问题，利用远程监督方法将知识库与文本对齐，构建藏文实体关系抽取的数据集，提出一个基于多级注意力融合机制的藏文实体关系抽取模型。在词级别引入自注意力机制来提取单词的内部特征，在句子级别引入注意力机制为每个实例分配权重，从而充分利用包含信息的句子，减少噪声实例的权重。同时引入联合评分函数，修正远程监督的错误标签，并将神经网络与支持向量机结合，实现藏文实体关系分类。实验结果表明，提出的模型有效提高了藏文实体关系抽取的准确率，且优于基线模型效果。

Abstract

Compared with Chinese and English

the training corpus of Tibetan entity relation is smaller

so it is difficult to obtain higher accuracy based on traditional supervised learning methods.And there exists the problem of wrong labels in distant supervision for relation extraction.To solve these problems

the distant supervision method was used to construct the data set of Tibetan entity relation extraction through aligning the knowledge base with texts

which could alleviate the problem of lacking of large-scale corpus in Tibetan.And a Tibetan entity relation extraction model based on multi-level attention fusion mechanism was proposed.The self-attention was added to extract internal features of words in word level.The selective attention mechanism could assign weights of each instance

so as to make full use of informative sentences and reduce weights of noisy instances.Meanwhile

a joint score function was introduced to correct wrong labels

and neural network was combined with support vector machine to extract relations.Experimental results show that the proposed model can effectively improve the accuracy of Tibetan entity relation extraction

and is better than the baseline.

关键词

Keywords

references

MINTZ M , BILLS S , SNOW R , et al . Distant supervision for relation extraction without labeled data [C ] // Proceedings of the 47th Annual Meeting of the ACL and the 4th IJCNLP of the AFNLPJ .[S.l.:s.n. ] , 2009 : 1003 - 1011 .

LIU C Y , SUN W B , CHAO W H , et al . Convolution neural network for relation extraction [C ] // Proceedings of the 9th International Conference on Advanced Data Mining and Applications,Part II .[S.l.:s.n. ] , 2013 : 231 - 242 .

ZENG D J , LIU K , LAI S W , et al . Relation classification via convolutional deep neural network [C ] // Proceedings of the 25th International Conference on Computational Linguistics:Technical Papers .[S.l.:s.n. ] , 2014 : 2335 - 2344 .

NGUYEN T H , GRISHMAN R . Relation extraction:perspective from convolutional neural networks [C ] // Proceedings of NAACL-HLT .[S.l.:s.n. ] , 2015 : 39 - 48 .

ZHANG D X , WANG D . Relation classification via recurrent neural network [J ] . arXiv preprint,2015,arXiv:1508.01006 .

ZHOU P , SHI W , TIAN J , et al . Attention-based bidirectional long short-term memory networks for relation classification [C ] // Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics .[S.l.:s.n. ] , 2016 : 207 - 212 .

WANG L L , CAO Z , MELO G D , et al . Relation classification via multi-level attention CNNs [C ] // Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics .[S.l.:s.n. ] , 2016 : 1298 - 1307 .

ZHU J Z , QIAO J Z , DAI X X , et al . Relation classification via target-concentrated attention CNNs [C ] // Proceedings of the 31st International Conference on Neural Information Processing .[S.l.:s.n. ] , 2017 : 137 - 146 .

DIETTERICH T G , LATHROP R H , LOZANO-PEREZ T , . Solving the multiple instance problem with axis-parallel rectangles [J ] . Journal of the Artificial Intelligence , 1997 , 89 ( 1-2 ): 31 - 71 .

RIEDEL S , YAO L M , MCCALLUM A . Modeling relations and their mentions without labeled text [C ] // Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases .[S.l.:s.n. ] , 2010 : 148 - 163 .

ZENG D J , LIU K , CHEN Y B , et al . Distant supervision for relation extraction via piecewise convolutional neural networks [C ] // Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing .[S.l.:s.n. ] , 2015 : 1753 - 1762 .

LIN Y K , SHEN S Q , LIU Z Y , et al . Neural relation extraction with selective attention over instancess [C ] // Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics .[S.l.:s.n. ] , 2016 : 2124 - 2133 .

JIANG X T , WANG Q , LI P , et al . Relation Extraction with Multi-instance Multi-label Convolutional Neural Networks [C ] // Proceedings of the 26th International Conference on Computational Linguistics:Technical Papers .[S.l.:s.n. ] , 2016 : 1471 - 1480 .

FENG X C , GUO J , QIN B , et al . Effective deep memory networks for distant supervised relation extraction [C ] // Proceedings of the 26th International Joint Conference on Artificial Intelligence .[S.l.:s.n. ] , 2017 : 4002 - 4008 .

VASWANI A , SHAZEER N , PARMAR N , et al . Attention is all you need [C ] // Proceedings of the 31st Conference on Neural Information Processing Systems .[S.l.:s.n. ] , 2017 : 5998 - 6008 .

朱臻 , 孙媛 . 基于 SVM 和泛化模板协作的藏语人物属性抽取 [J ] . 中文信息学报 , 2015 , 29 ( 6 ): 220 - 227 .

ZHU Z , SUN Y . Tibetan person attribute extraction based on SVM and pattern [J ] . Journal of Chinese Information Processing , 2015 , 29 ( 6 ): 220 - 227 .

夏天赐 , 孙媛 . 基于联合模型的藏文实体关系抽取方法研究 [J ] . 中文信息学报 , 2018 , 32 ( 12 ): 76 - 83 .

XIA T C , SUN Y . Tibetan entity relation extraction based on joint model [J ] . Journal of Chinese Information Processing , 2018 , 32 ( 12 ): 76 - 83 .

郭莉莉 , 孙媛 . 基于 BP 神经网络的藏语实体关系抽取 [J ] . 软件导刊 , 2019 , 18 ( 3 ): 7 - 9 , 15 .

GUO L L , SUN Y . Tibetan entity relation extraction based on BP neural network [J ] . Software Guide , 2019 , 18 ( 3 ): 7 - 9 , 15 .

MATTHEW E P , NEUMANN M , IYYER M , et al . Deep contextualized word representations [C ] // Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies .[S.l.:s.n. ] , 2018 : 2227 - 2237 .

Views

461

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Postal code：100079
Tel：（010）53879206 Email：cjist@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：35685 Visits Today：160

⁰