The paper "Multi-task deep learning-based failure diagnosis for tubular joints: Automated identification and description generation" was published in the journal Advanced Engineering Informatics.
This study addresses the critical yet vulnerable tubular joints in offshore platforms and bridges, proposing a multi-task deep learning model for simultaneous failure identification and description generation. Traditional failure inspection methods are time-consuming and labor-intensive, while existing intelligent methods often focus on single-task or single-modal designs, which fail to fully leverage multimodal data and struggle to capture coexisting failure modes, limiting comprehensive diagnostic assessments. To overcome these challenges, a multimodal database is constructed from 141 experimental programs, including 409 failed joints with images, textual descriptions, and component-level labels, further augmented to 1,227 images and 3,681 sentences. The proposed model employs a pretrained encoder for image feature extraction, a multi-label classification decoder for failure identification, and an attention-based image captioning decoder for failure description generation. Experimental results demonstrate that the model achieves a BLEU-4 score of 76.70 and an mAP of 0.9467, outperforming single-task baselines. Validation on real engineering images further shows its preliminary transferability, highlighting the potential of the multi-task learning framework for automated failure diagnosis.
Note: Advanced Engineering Informatics is a top-tier Q1 journal in the field of engineering technology, with an impact factor of 9.9 in 2025. The first author of the paper is Zhang Wenhao, a PhD student at Southern University of Science and Technology, with Professor Hou Chao as the corresponding author. The research was funded by the National Natural Science Foundation of China (NSFC) , the National Key Research and Development Program of China, and Shenzhen Science and Technology Program.