The application of deep learning in data-driven modeling of process industries

Xiaofeng YUAN; Yalin WANG; Chunhua YANG; Weihua GUI

doi:10.11959/j.issn.2096-6652.202012

您当前的位置：

首页 >

文章列表页 >

The application of deep learning in data-driven modeling of process industries

Surveys and Prospectives | 更新时间：2024-06-05

- The application of deep learning in data-driven modeling of process industries
- Chinese Journal of Intelligent Science and Technology Vol. 2, Issue 2, Pages: 107-115(2020)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-6652.202012
  CLC： TP18
- Published Online：2020-06，
  
  Published：20 June 2020
- 稿件说明：
移动端阅览
Xiaofeng YUAN, Yalin WANG, Chunhua YANG, et al. The application of deep learning in data-driven modeling of process industries[J]. Chinese journal of intelligent science and technology, 2020, 2(2): 107-115.
DOI：

Xiaofeng YUAN, Yalin WANG, Chunhua YANG, et al. The application of deep learning in data-driven modeling of process industries[J]. Chinese journal of intelligent science and technology, 2020, 2(2): 107-115. DOI： 10.11959/j.issn.2096-6652.202012.

摘要

深度学习是近年来发展的人工智能技术。相比于传统浅层学习模型，深度学习具有强大的特征表示和函数拟合能力。深度学习能够从海量数据中提取层次特征，其在流程工业过程数据驱动建模中具有较大的潜力和应用前景。首先简单介绍了深度学习的发展历程；然后，介绍了4类广泛使用的深度学习模型以及它们在流程工业过程数据建模中的应用；最后，在流程工业过程数据建模领域对深度学习进行了简要总结。

Abstract

Deep learning is an artificial intelligence technique developed in recent years.Compared with traditional shallow models

deep learning has a strong ability of feature representation and function fitting.It can extract hierarchical features from massive data

which has great potential for data-driven modeling in process industries.Firstly

the history of deep learning was introduced.Then

four widely used deep networks and their applications were introduced in data-driven modeling of process industries.At last

the conclusions about deep learning and its applications in process in dustries were given.

关键词

Keywords

references

张钹 . 人工智能进入后深度学习时代 [J ] . 智能科学与技术学报 , 2019 , 1 ( 1 ): 4 - 6 .

ZHANG B . Artificial intelligence is entering the post deep-learning era [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 1 ): 4 - 6 .

刘远平 , 宋昱锴 , 张小燕 , 等 . 基于深度学习的髋关节应力分布算法研究 [J ] . 智能科学与技术学报 , 2019 , 1 ( 3 ): 260 - 268 .

LIU Y P , SONG Y K , ZHANG X Y , et al . Research on hip joint stress distribution algorithms based on deep learning [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 3 ): 260 - 268

MCCULLOCH W S , PITTS W . A logical calculus of the ideas immanent in nervous activity [J ] . Bulletin of Mathematical Biophysics , 1943 , 52 ( 1-2 ): 99 - 115 .

ROSENBLATT F . The perceptron:a probabilistic model for information storage and organization in the brain [J ] . Psychological Review , 1958 , 65 ( 6 ): 386 - 408 .

MINSKY M , PAPERT S . Perceptrons an introduction to computational geometry [M ] . Cambridg : MIT PressPress , 1969 .

WERBOS P . Beyond regression:new tools for prediction and analysis in the behavioral sciences [D ] . Boston:Harvard University , 1974 .

RUMMELHART D E , HINTON G E , WILLIAMS R J . Learning internal representations by error propagation [J ] . Nature , 1986 , 323 ( 2 ): 318 - 362 .

CORTES C , WAPNIK V . Support-vector networks [J ] . Machine Learning , 1995 , 20 ( 3 ): 273 - 297 .

HINTON G E , OSINDERO S , THE Y W . A fast learning algorithm for deep belief nets [J ] . Neural Computation , 2006 , 18 ( 7 ): 1527 - 1554 .

KRIZHEVSKY A , SUTSKEVER I , HINTON G . Imagenet classification with deep convolutional neural networks [C ] // Advances in Neural Information Processing Systems.[S.l.:s.n] . 2012 : 1097 - 1105 .

WANG Y L , PAN Z F , YANG C H , et al . A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network [J ] . ISA Transactions , 2020 , 96 : 457 - 467 .

SHANG C , YANG F , HUANG D X , et al . Data-driven soft sensor development based on deep learning technique [J ] . Journal of Process Control , 2014 , 24 ( 3 ): 223 - 233 .

刘瑞兰 , 毛佳敏 . 基于深度置信网络的 4-CBA 软测量建模 [J ] . 计算机工程与应用 , 2017 , 53 ( 6 ): 227 - 230 .

LIU R L , MAO J M . Soft sensor modeling of 4-CBA based on deep belief networks [J ] . Computer Engineering and Applications , 2017 , 53 ( 6 ): 227 - 230 .

康岩 , 卢慕超 , 阎高伟 . 基于 DBN-ELM 的球磨机料位软测量方法研究 [J ] . 仪表技术与传感器 , 2015 ( 4 ): 73 - 75 ,92.

KANG Y , LU M C , YAN G W . Soft sensor for ball mill fill level based on DBN-ELM model [J ] . Instrument Technique and Sensor , 2015 ( 4 ): 73 - 75 ,92.

LIU Y , FAN Y , CHEN J H . Flame images for oxygen content prediction of combustion systems using DBN [J ] . Energy ＆ Fuels , 2017 , 31 ( 8 ): 8776 - 8783 .

YUAN Z , WANG B , LIANG K , et al . In application of deep belief network in prediction of secondary chemical components of sinter [C ] // The 13th IEEE Conference on Industrial Electronics and Applications (ICIEA) . Piscataway:IEEE Press , 2018 : 2746 - 2751 .

ZHANG Z P , ZHAO J S . A deep belief network based fault diagnosis model for complex chemical processes [J ] . Computers ＆ Chemical Engineering , 2017 , 107 : 395 - 407 .

赵辉 , 赵德涛 , 岳有军 , 等 . 基于深度置信网络的高炉炉况故障分类方法的研究 [J ] . 铸造技术 , 2018 , 39 ( 5 ): 1028 - 1032 .

ZHAO H , ZHAO D T , YUE Y J , et al . Research on fault classification of blast furnace condition based on deep belief network [J ] . Foundry Technology , 2018 , 39 ( 5 ): 1028 - 1032 .

葛强强 . 基于深度置信网络的数据驱动故障诊断方法研究 [D ] . 哈尔滨:哈尔滨工业大学 , 2016 .

GE Q Q . Research on data driven fault diagnosis method based on deep belief network [D ] . Harbin:Harbin Institute of Technology , 2016 .

YUAN X F , GU Y J , WANG Y L , et al . A deep supervised learning framework for data-driven soft sensor modeling of industrial processes [J ] . IEEE Transactions on Neural Networks and Learning Systems , 2019 : 1 - 10 .

YUAN X F , HUANG B , WANG Y L , et al . Deep learning based feature representation and its application for soft sensor modeling with variable-wise weighted SAE [J ] . IEEE Transactions on Industrial Informatics , 2018 , 14 ( 7 ): 3235 - 3243 .

YUAN X F , OU C , WANG Y L , et al . Deep quality-related feature extraction for soft sensing modeling:a deep learning approach with hybrid VW-SAE [J ] . Neurocomputing , 2019

YUAN X F , ZHOU J , HUANG B , et al . Hierarchical quality-relevant feature representation for soft sensor modeling:a novel deep learning strategy [J ] . IEEE Transactions on Industrial Informatics , 2020 , 16 ( 6 ): 3721 - 3730 .

邱禹 , 刘乙奇 , 吴菁 , 等 . 基于深层神经网络的多输出自适应软测量建模 [J ] . 化工学报 , 2018 , 69 ( 7 ): 3101 - 3113 .

QIU Y , LIU Y Q , WU J , et al . A self-adaptive multi-output soft sensor modeling based on deep neural network [J ] . CIESC Jorunal , 2018 , 69 ( 7 ): 3101 - 3113 .

KONG D H , YAN X F . Industrial process deep feature representation by regularization strategy autoencoders for process monitoring [J ] . Measurement Science Technology , 2019 , 31 ( 2 ):025104.

YAN S F , YAN X F . Design teacher and supervised dual stacked auto-encoders for quality-relevant fault detection in industrial process [J ] . Applied Soft Computing , 2019 ,81:105526.

YAN S F , YUAN X F . Using labeled autoencoder to supervise neural network combined with k-nearest neighbor for visual industrial process monitoring [J ] . Industrial ＆ Engineering Chemistry Research , 2019 , 58 ( 23 ): 9952 - 9958 .

蒋立 . 基于自编码器模型的非线性过程监测 [D ] . 杭州:浙江大学 , 2018 .

JIANG L . Nonlinear process monitoring based on auto-encoder model [D ] . Hangzhou:Zhejiang University , 2018 .

ZHANG T S , WANG W , YE H , et al . Fault detection for ironmaking process based on stacked denoising autoencoders [C ] // The 2016 American Control Conference (ACC).[S.l.:s.n] . 2016 .

ZHANG Z H , JIANG T , LI S H , et al . Automated feature learning for nonlinear process monitoring,an approach using stacked denoising autoencoder and k-nearest neighbor rule [J ] . Journal of Process Control , 2018 , 64 : 49 - 61 .

LECUN Y , BOTTOU L , BENGIO Y , et al . Gradient-based learning applied to document recognition [J ] . Proceedings of the IEEE , 1998 , 86 ( 11 ): 2278 - 2324 .

HORN Z C , AURET L , MCCOY J T , et al . Performance of convolutional neural networks for feature extraction in froth flotation sensing [J ] . IFAC Papersonline , 2017 , 50 ( 2 ): 13 - 18 .

易令 , 吕忠元 , 丁进良 , 等 . 面向原油总氢物性预测的数据扩增预处理方法 [J ] . 控制与决策 , 2018 , 33 ( 12 ): 2153 - 2160 .

YI L , LYU Z Y , DING J L , et al . Data pretreatment approach for crude oil hydrogen properties prediction [J ] . Control and Decision , 2018 , 33 ( 12 ): 2153 - 2160 .

WANG K C , SHANG C , LIU L , et al . Dynamic soft sensor development based on convolutional neural networks [J ] . Industrial ＆ Engineering Chemistry Research , 2019 , 58 ( 26 ): 11521 - 11531 .

WU H , ZHAO J S . Deep convolutional neural network model based chemical process fault diagnosis [J ] . Computers ＆ Chemical Engineering , 2018 :115.

苏堪裂 . 基于卷积神经网络的化工过程故障诊断研究 [D ] . 广州:华南理工大学 , 2019 .

SU K L . Fault diagnosis of chemical process based on convolutional neural network research [D ] . Guangzhou:South China University of Technology , 2019 .

LEE K B , CHEON S , KIM C O . A convolutional neural network for fault classification and diagnosis in semiconductor manufacturing processes [J ] . IEEE Transactions on Semiconductor Manufacturing , 2017 , 30 ( 2 ): 135 - 142 .

BENGIO Y , SIMARD P , FRASCONI P . Learning long-term dependencies with gradient descent is difficult [J ] . IEEE Transactions on Neural Networks , 1994 , 5 ( 2 ): 157 - 166 .

HOCHREITER S , SCHMIDHUBER J . Long short-term memory [J ] . Neural Computation , 1997 , 9 ( 8 ): 1735 - 1780 .

CHO K , WAN MERRIENBOER B , GULCEHRE C , et al . Learning phrase representations using RNN encoder–decoder for statistical machine translation [C ] // The 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP).[S.l.:s.n . ] , 2014 : 1724 - 1734 .

SU H T , MCAVOY T J , WERBOS P . Long-term predictions of chemical processes using recurrent neural networks:a parallel training approach [J ] . Industrial Engineering Chemistry Research , 1992 , 31 ( 5 ): 1338 - 1352 .

CHEN L Z , NGUANG S K , LI X M , et al . Soft sensors for on-line biomass measurements [J ] . Bioprocess and Biosystems Engineering , 2004 , 26 ( 3 ): 191 - 195 .

ZHAO J , LIU Q L , WANG W , et al . Hybrid neural prediction and optimized adjustment for coke oven gas system in steel industry [J ] . IEEE Transactions on Neural Networks ＆ Learning Systems , 2012 , 23 ( 3 ): 439 - 450 .

FU J G , XIAO H , WANG T , et al . Prediction model of desulfurization efficiency of coal-fired power plants based on long short-term memory neural network [C ] // The 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber,Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).[S.l.:s.n . ] , 2019 : 40 - 45 .

HAN Y M , ZHOU R D , GENG Z Q , et al . Production prediction modeling of industrial processes based on Bi-LSTM [C ] // The 34rd Youth Academic Annual Conference of Chinese Association of Automation.[S.l.:s.n . ] , 2019 : 285 - 289 .

YUAN X F , LI L , WANG Y L . Nonlinear dynamic soft sensor modeling with supervised long short-term memory network [J ] . IEEE Transactions on Industrial Informatics , 2020 , 16 ( 5 ): 3168 - 3176 .

YUAN X F , LI L , WANG Y L , et al . Deep learning for quality prediction of nonlinear dynamic process with variable attention-based long short-term memory network [J ] . The Canadian Journal of Chemical Engineering , 2019

WANG K , GOPALUNI B , CHEN J H , et al . Deep learning of complex batch process data and its application on quality prediction [J ] . IEEE Transactions on Industrial Informatics , 2018 :1.

SUN Q Q , GE Z Q . Probabilistic sequential network for deep learning of complex process data and soft sensor application [J ] . IEEE Transactions on Industrial Informatics , 2018 , 15 ( 5 ): 2700 - 2709 .

KATARIA G , SINGH K . Recurrent neural network based soft sensor for monitoring and controlling a reactive distillation column [J ] . Chemical Product and Process Modeling , 2017 , 13 ( 3 ).

Views

269

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Cerberus: cross-site social bot detection system based on deep learning

Survey on vision-based railway track defect detection

Visual SLAM based on semantic information and geometric constraints in dynamic environment

Lipsynthesis incorporating audio-visual synchronisation

A survey of deep learning-based MRI stroke lesion segmentation methods

Related Author

CHEN Yang

WANG Xin

GONG Qingyuan

GAO Min

LIU Yushan

TANG Jiawei

CHEN Dewang

SHI Jinjin

Related Institution

Research Institute of Intelligent Complex Systems, Fudan University

School of Computer Science, Fudan University

School of Computer and Big Data, Minjiang University

School of Rail Transit, Fujian Chuanzheng Communications College

School of Transportation, Fujian University of Technology

Postal code：100079
Tel：（010）53879206 Email：cjist@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：35685 Visits Today：160

⁰