Survey on vision-based railway track defect detection

CHEN Tianyan; HAN Zeming; HUANG Yunhu; SHI Jinjin; CHEN Dewang

doi:10.11959/j.issn.2096-6652.202427

您当前的位置：

首页 >

文章列表页 >

Survey on vision-based railway track defect detection

Papers and Reports | 更新时间：2024-11-04

- Survey on vision-based railway track defect detection
- Chinese Journal of Intelligent Science and Technology Vol. 6, Issue 3, Pages: 367-380(2024)
- 作者机构：
  
  1.福建理工大学交通运输学院，福建福州 350118
  2.福建船政交通职业学院轨道交通学院，福建福州 350007
  3.闽江学院计算机与大数据学院，福建福州 350108
- 作者简介：
- 基金信息：
  
  The Third Batch of Innovation Star Talent Program of Fujian Province(003002);Fujian Provincial Transportation Science and Technology Project(2020030);Science and Education Development Fund of Fujian Shipbuilding and Transportation Vocational College(20220201)
- DOI：10.11959/j.issn.2096-6652.202427
  CLC： TP391.4
- Received：05 March 2024，
  
  Revised：2024-06-15，
  
  Published：15 September 2024
- 稿件说明：
移动端阅览
陈天炎,韩泽明,黄允浒等.基于视觉的列车轨道缺陷检测综述[J].智能科学与技术学报,2024,06(03):367-380.

CHEN Tianyan,HAN Zeming,HUANG Yunhu,et al.Survey on vision-based railway track defect detection[J].Chinese Journal of Intelligent Science and Technology,2024,06(03):367-380.
陈天炎,韩泽明,黄允浒等.基于视觉的列车轨道缺陷检测综述[J].智能科学与技术学报,2024,06(03):367-380. DOI： 10.11959/j.issn.2096-6652.202427.

CHEN Tianyan,HAN Zeming,HUANG Yunhu,et al.Survey on vision-based railway track defect detection[J].Chinese Journal of Intelligent Science and Technology,2024,06(03):367-380. DOI： 10.11959/j.issn.2096-6652.202427.

摘要

列车轨道缺陷检测对轨道交通安全具有重要意义，但当前人工检测已不能满足复杂繁重的轨道巡检要求。深度学习方法极大地扩展了缺陷检测的手段，为了提高表面缺陷检测的效率与质量，结合轨道缺陷的类型与相关属性，系统分析了当前视觉检测方法的变化趋势。详细阐述了轨面及扣件缺陷视觉检测方法，以及与之相关的深度学习方法的基本原理、技术、方法与应用现状，讨论了轨面及扣件缺陷检测方法的理念、应用和意义。最后，对当前研究的轨道缺陷检测领域发展趋势进行分析和总结，首次提出了全自动轨道检修系统的概念，致力于为未来相关研究提供有益的支撑和借鉴。

Abstract

The detection of train track defects is of great significance to the safety of rail transportation

but current manual inspection can no longer meet the complex and heavy track inspection requirements. Deep learning methods have greatly expanded the means and detection capabilities of defect detection

and in order to improve the efficiency and quality of surface defect detection

the current trends of visual detection methods in conjunction with the types and related attributes of track defects was systematically analyzed. The basic principles

technologies

methods

and current application status of visual detection methods for track and fastening defects

as well as the concepts

applications

and significance of these detection methods were elaborated. Finally

the current trends in the field of track defect detection are analyzed and summarized

and for the first time proposes the concept of a fully automatic track maintenance system

which aims to provide useful support and reference for future related research.

关键词

Keywords

references

CANNON D F, EDEL K O, GRASSIE S L, et al. Rail defects: an overview[J]. Fatigue & Fracture of Engineering Materials & Structures, 2003, 26(10): 865-886.

CLARK R. Rail flaw detection: overview and needs for future developments[J]. NDT & E International, 2004, 37(2): 111-118.

中华人民共和国铁道部.钢轨伤损分类: TB/T 1778—2010[S]. 2010.

Ministry of Railways of the People's Republic of China. Classification of rail damages: TB/T 1778—2010[S]. 2010.

TAO X, GONG X Y, ZHANG X, et al. Deep learning for unsupervised anomaly localization in industrial images: a survey[J]. IEEE Transactions on Instrumentation and Measurement, 2022, 71: 5018021.

EDWARDS R S, DIXON S, JIAN X. Characterisation of defects in the railhead using ultrasonic surface waves[J]. NDT & E International, 2006, 39(6): 468-475.

CHEN K, BAI L B, CHEN Y F, et al. Defect automatic identification of eddy current pulsed thermography[J]. Journal of Sensors, 2014, 2014: 326316.

张辉, 宋雅男, 王耀南, 等. 钢轨缺陷无损检测与评估技术综述[J]. 仪器仪表学报, 2019, 40(2): 11-25.

ZHANG H, SONG Y N, WANG Y N, et al. Review of rail defect non-destructive testing and evaluation[J]. Chinese Journal of Scientific Instrument, 2019, 40(2): 11-25.

GONG W D, AKBAR M F, JAWAD G N, et al. Nondestructive testing technologies for rail inspection: a review[J]. Coatings, 2022. 12(11): 1790.

KOU L. A review of research on detection and evaluation of the rail surface defects[J]. Acta Polytechnica Hungarica, 2022, 19(3): 167-186.

MIĆIĆ M, BRAJOVIĆ L, LAZAREVIĆ L, et al. Inspection of RCF rail defects: review of NDT methods[J]. Mechanical Systems and Signal Processing, 2023, 182: 109568.

HAN Q, WANG S C, FANG Y, et al. A rail fastener tightness detection approach using multi-source visual sensor[J]. Sensors, 2020, 20(5): 1367.

GUERRIERI M, PARLA G, CELAURO C. Digital image analysis technique for measuring railway track defects and ballast gradation[J]. Measurement, 2018, 113: 137-147.

XIE X H. A review of recent advances in surface defect detection using texture analysis techniques[J]. ELCVIA Electronic Letters on Computer Vision and Image Analysis, 2008, 7(3): 1-22.

LI Q Y, TAN Y Q, ZHANG H Y, et al. A visual inspection system for rail corrugation based on local frequency features[C]//Proceedings of the 2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress. Piscataway: IEEE Press, 2016: 18-23.

DUBEY A K, JAFFERY Z A. Maximally stable extremal region marking-based railway track surface defect sensing[J]. IEEE Sensors Journal, 2016, 16(24): 9047-9052.

SALVADOR P, NARANJO V, INSA R, et al. Axlebox accelerations: their acquisition and time-frequency characterisation for railway track monitoring purposes[J]. Measurement, 2016, 82: 301-312.

GAN J R, LI Q Y, WANG J Z, et al. A hierarchical extractor-based visual rail surface inspection system[J]. IEEE Sensors Journal, 2017, 17(23): 7935-7944.

MIN Y Z, XIAO B Y, DANG J W, et al. Real time detection system for rail surface defects based on machine vision[J]. EURASIP Journal on Image and Video Processing, 2018(1): 1-11.

GUO X, LIU F, TIAN X T. Noise modeling and denoising of images collected by on-board track inspection system[J]. Multimedia Tools and Applications, 2022, 81(8): 11695-11715.

LI Q Y, REN S W. A real-time visual inspection system for discrete surface defects of rail heads[J]. IEEE Transactions on Instrumentation and Measurement, 2012, 61(8): 2189-2199.

HE Z D, WANG Y N, YIN F, et al. Surface defect detection for high-speed rails using an inverse P-M diffusion model[J]. Sensor Review, 2016, 36(1): 86-97.

LIU J J, LI B L, XIONG Y, et al. Integrating the symmetry image and improved sparse representation for railway fastener classification and defect recognition[J]. Mathematical Problems in Engineering, 2015(1): 1-11.

FENG H, JIANG Z G, XIE F Y, et al. Automatic fastener classification and defect detection in vision-based railway inspection systems[J]. IEEE Transactions on Instrumentation and Measurement, 2014, 63(4): 877-888.

GAN J R, WANG J Z, YU H M, et al. Online rail surface inspection utilizing spatial consistency and continuity[J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020, 50(7): 2741-2751.

LEE H, HONG J, WENDIMAGEGN T W, et al. Rail corrugation detection and characterization using computer vision[J]. Sensors, 2021, 21(24): 8335.

GIBERT X, PATEL V M, CHELLAPPA R. Deep multitask learning for railway track inspection[J]. IEEE Transactions on Intelligent Transportation Systems, 2017, 18(1): 153-164.

HSIEH C C, LIN Y W, TSAI L H, et al. Offline deep-learning-based defective track fastener detection and inspection system[J]. Sensors and Materials, 2020, 32(10): 3429.

HSIEH C C, HSU T Y, HUANG W H. An online rail track fastener classification system based on YOLO models[J]. Sensors, 2022, 22(24): 9970.

FENG J H, YUAN H, HU Y Q, et al. Research on deep learning method for rail surface defect detection[J]. IET Electrical Systems in Transportation, 2020, 10(4): 436-442.

CHANDRAN P, ASBER J, THIERY F, et al. An investigation of railway fastener detection using image processing and augmented deep learning[J]. Sustainability, 2021, 13(21): 12051.

AYDIN İ, SEVİ M, SALUR M U, et al. Defect classification of railway fasteners using image preprocessing and alightweight convolutional neural network[J]. Turkish Journal of Electrical Engineering and Computer Sciences, 2022, 30(3): 891-907.

HU J, QIAO P, LV H H, et al. High speed railway fastener defect detection by using improved YoLoX-Nano model[J]. Sensors, 2022, 22(21): 8399.

ACIKGOZ H, KORKMAZ D. MSRConvNet: classification of railway track defects using multi-scale residual convolutional neural network[J]. Engineering Applications of Artificial Intelligence, 2023, 121: 105965.

LI X, WANG Q, YANG X W, et al. Track fastener defect detection model based on improved YOLOv5s[J]. Sensors, 2023, 23(14): 6457.

LU J, LIANG B, LEI Q J, et al. SCueU-Net: efficient damage detection method for railway rail[J]. IEEE Access, 2020, 8: 125109-125120.

KIM H, LEE S, HAN S. Railroad surface defect segmentation using a modified fully convolutional network[J]. KSII Transactions on Internet and Information Systems, 2020: 4763-4775.

JIN X T, WANG Y N, ZHANG H, et al. DM-RIS: deep multimodel rail inspection system with improved MRF-GMM and CNN[J]. IEEE Transactions on Instrumentation and Measurement, 2020, 69(4): 1051-1065.

TU Z W, WU S R, KANG G Q, et al. Real-time defect detection of track components: considering class imbalance and subtle difference between classes[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 5017712.

GUO F, QIAN Y, RIZOS D, et al. Automatic rail surface defects inspection based on mask R-CNN[J]. Transportation Research Record: Journal of the Transportation Research Board, 2021, 2675(11): 655-668.

GUO F, QIAN Y, YU H Y. Automatic rail surface defect inspection using the pixelwise semantic segmentation model[J]. IEEE Sensors Journal, 2023, 23(13): 15010-15018.

LI M X, PENG B, LIU J, et al. RBNet: an ultrafast rendering-based architecture for railway defect segmentation[J]. IEEE Transactions on Instrumentation and Measurement, 2023, 72: 1-8.

WAN C, MA S, SONG K C. TSSTNet: a two-stream swin transformer network for salient object detection of No-service rail surface defects[J]. Coatings, 2022, 12(11): 1730.

HOSHI T, SHIBAYAMA S, JIANG X N. Employing a hybrid model based on texture-biased convolutional neural networks and edge-biased vision transformers for anomaly detection of signal bonds[J]. Journal of Electronic Imaging, 2023, 32(2): 1-10.

CHENG M Y, KHASANI R R, SETIONO K. Image quality enhancement using HybridGAN for automated railway track defect recognition[J]. Automation in Construction, 2023, 146: 104669.

SU S X, DU S L, LU X B. Geometric constraint and image inpainting-based railway track fastener sample generation for improving defect inspection[J]. IEEE Transactions on Intelligent Transportation Systems, 2022, 23(12): 23883-23895.

XIA Y W, HAN S W, KWON H J. Image generation and recognition for railway surface defect detection[J]. Sensors, 2023, 23(10): 4793.

NIU M H, WANG Y Y, SONG K C, et al. An adaptive pyramid graph and variation residual-based anomaly detection network for rail surface defects[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 5020013.

KIM I, JEON Y, KANG J W, et al. RAG-PaDiM: residual attention guided PaDiM for defects segmentation in railway tracks[J]. Journal of Electrical Engineering & Technology, 2023, 18(2): 1429-1438.

MIN Y Z, LI Y X. Self-supervised railway surface defect detection with defect removal variational autoencoders[J]. Energies, 2022, 15(10): 3592.

FERDOUSI R, YANG C S, HOSSAIN M A, et al. Generative model-driven synthetic TrainingImage generation: an approach to cognition in railway defect detection[J]. Cognitive Computation, 2024, 16(5): 1-16.

YUAN Z D, ZHU S Y, CHANG C, et al. An unsupervised method based on convolutional variational auto-encoder and anomaly detection algorithms for light rail squat localization[J]. Construction and Building Materials, 2021, 313: 125563.

MIN Y Z, WANG Z W, LIU Y, et al. FS-RSDD: few-shot rail surface defect detection with prototype learning[J]. Sensors, 2023, 23(18): 7894.

SRESAKOOLCHAI J, KAEWUNRUEN S. Railway infrastructure maintenance efficiency improvement using deep reinforcement learning integrated with digital twin based on track geometry and component defects[J]. Scientific Reports, 2023, 13: 2439.

WANG J P, SONG K C, ZHANG D F, et al. Collaborative learning attention network based on RGB image and depth image for surface defect inspection of No-service rail[J]. IEEE/ASME Transactions on Mechatronics, 2022, 27(6): 4874-4884.

任中伟, 方维维, 许文元, 等. 面向轨道缺陷检测的联邦学习轻量化模型训练技术研究[J]. 铁道学报, 2023, 45(4): 77-83.

REN Z W, FANG W W, XU W Y, et al. Research on lightweight model training technology of federated learning for railway defect detection[J]. Journal of the China Railway Society, 2023, 45(4): 77-83.

FAGHIH-ROOHI S, HAJIZADEH S, NÚÑEZ A, et al. Deep convolutional neural networks for detection of rail surface defects[C]//Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN). Piscataway: IEEE Press, 2016: 2584-2589.

ZHANG Z H, YU S Z, YANG S W, et al. Rail-5k: a real-world dataset for rail surface defects detection[EB ] . arXiv preprint, 2021, arXiv: 2106.14366 .

BERGMANN P, FAUSER M, SATTLEGGER D, et al. Uninformed students: student-teacher anomaly detection with discriminative latent embeddings[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2020: 4182-4191.

TAKIKAWA T, ACUNA D, JAMPANI V, et al. Gated-SCNN: gated shape CNNs for semantic segmentation[EB ] . arXiv preprint, 2019, arXiv: 1907.05740 .

陈德旺, 欧纪祥. 平行模糊控制:虚实互动、相互增强的自学习控制方法[J]. 智能科学与技术学报, 2023, 5(2): 267-273.

CHEN D W, OU J X. Parallel fuzzy control: a self-learning control method with virtual-real interaction and mutual enhancement[J]. Chinese Journal of Intelligent Science and Technology, 2023, 5(2): 267-273.

王飞跃. 平行控制: 数据驱动的计算控制方法[J]. 自动化学报, 2013, 39(4): 293-302.

WANG F Y. Parallel control: a method for data-driven and computational control[J]. Acta Automatica Sinica, 2013, 39(4): 293-302.

王飞跃, 缪青海, 张军平, 等. 探讨AI for Science的影响与意义: 现状与展望[J]. 智能科学与技术学报, 2023, 5(1): 1-6.

WANG F Y, MIAO Q H, ZHANG J P, et al. The DAOs to AI for Science by DeSci: the state of the art and perspective[J]. Chinese Journal of Intelligent Science and Technology, 2023, 5(1): 1-6.

王鹏, 陈森. 基于平行控制的信息安全管理措施仿真与优化[J]. 自动化学报, 2011, 37(11): 1351-1355.

WANG P, CHEN S. A parallel control approach to optimization of information security management measures[J]. Acta Automatica Sinica, 2011, 37(11): 1351-1355.

项凤涛, 罗俊仁, 谷学强, 等, 群视角下的多智能体强化学习方法综述[J]. 智能科学与技术学报, 2023. 5(3): 313-329.

XIANG F T, LUO J R, GU X Q, et al. Survey on multi-agent reinforcement learning methods from the perspective of population[J]. Chinese Journal of Intelligent Science and Technology, 2023, 5(3): 313-329.

杨静, 王晓, 王雨桐, 等. 平行智能与CPSS: 三十年发展的回顾与展望[J]. 自动化学报, 2023, 49(3): 614-634.

YANG J, WANG X, WANG Y T, et al. Parallel intelligence and CPSS in 30 years: an ACP approach[J]. Acta Automatica Sinica, 2023, 49(3): 614-634.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Feature-enhanced visual-inertial SLAM method for low-texture dynamic environment

A complex unknown radar signal deinterleaving method based on selective deep embedding clustering

HCANet: a micro expression recognition model based on hierarchical Transformer architecture

Cerberus: cross-site social bot detection system based on deep learning

Visual SLAM based on semantic information and geometric constraints in dynamic environment

Related Author

XIE Mingyang

XU Xin

YANG Chen

YU Zirui

WANG Yao

DING Chencong

YANG Aonan

MO Hong

Related Institution

College of Automation Engineering, Nanjing University of Aeronautics and Astronautics

Unit of PLA

School of Electrical & Information Engineering, Changsha University of Science & Technology

Research Institute of Intelligent Complex Systems, Fudan University

School of Computer Science, Fudan University

Postal code：100079
Tel：（010）53879206 Email：cjist@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：161982 Visits Today：145

⁰