In the intelligent production process of wood products, the classification system of wood knot defects is a very practical solution. However, traditional image processing methods cannot handle it well due to the uncertainty of manually extracted features. Therefore, a lightweight and reliable artificial neural network model is proposed to classify and identify our objective. To solve this problem, a wood knot defect recognition model named SE-ResNet18 combining convolutional neural network, attention mechanism, and transfer learning is proposed in this paper. First, the Sequence-and-Exception (SE) module is combined with Basicblock and is constructed as two modules called RBBSE-1 and RBBSE-2. These modules learn to enhance features that are useful for the current task, suppress useless features, and fuse the output features with the original features. Then, the fully connected layer is replaced with a global average pooling layer, which can effectively reduce the parameters of the fully connected layer in the model. Finally, a SE-ResNet18 was constructed by one convolutional layer, five RBBSE-1 modules, and three RBBSE-2 modules of different channels. The SE-ResNet18 has a higher accuracy (98.85%) in the test set compared to the unimproved model ResNet-18. Compared with the previously proposed ReSENet-18, more SE modules are used in SE-ResNet18 to provide a basis for future training on a larger-scale dataset. Based on the same test set, a comparison with other classical models (such as LeNet-5, AlexNet, etc.) was conducted, and the results validated the superiority of the proposed model. The proposed model achieves the expected objective and provides a new way of thinking for non-destructive testing of wood.
REFERENCES
1.
F.
Longuetaud
, F. Mothe, B.
Kerautret
, A.
Krähenbühl
, L.
Hory
, J. M.
Leban
, and I.
Debled-Rennesson
, “Automatic knot detection and measurements from X-ray CT images of wood: a review and validation of an improved algorithm on softwood samples
,” Comput. Electron. Agric.
85
, 77
–89
(2012
). 2.
K.
Kamal
, R.
Qayyum
, S.
Mathavan
, and T.
Zafar
, “Wood defects classification using laws texture energy measures and supervised learning approach
,” Adv. Eng. Inform.
34
, 125
–135
(2017
). 3.
M.
Asif
, “Sustainability of timber, wood and bamboo in construction
,” in Sustainability of Construction Materials
(Woodhead Publishing
, 2009
), pp. 31
–54
.4.
S.
Koman
, S.
Feher
, J.
Abraham
, and R.
Taschner
, “Effect of knots on the bending strength and the modulus of elasticity of wood
,” Wood Res.
58
(4
), 617
–626
(2013
).5.
Y.
Fang
, L.
Lin
, H.
Feng
, Z.
Lu
, and G. W.
Emms
, “Review of the use of air-coupled ultrasonic technologies for nondestructive testing of wood and wood products
,” Comput. Electron. Agric.
137
, 79
–87
(2017
). 6.
R. W.
Conners
, C. W.
Mcmillin
, K.
Lin
, and R. E.
Vasquez-Espinosa
, “Identifying and locating surface defects in wood: Part of an automated lumber processing system
,” IEEE Trans. Pattern Anal. Mach. Intell.
PAMI-5
(6
), 573
–583
(1983
). 7.
N.
Macchioni
and M.
Mannucci
, “The assessment of Italian trusses: Survey methodology and typical pathologies
,” Int. J. Archit. Heritage
12
(4
), 533
–544
(2018
). 8.
R.
Gazo
, J.
Vanek
, M.
Abdul_Massih
, and B.
Benes
, “A fast pith detection for computed tomography scanned hardwood logs
,” Comput. Electron. Agric.
170
, 105107
(2020
). 9.
L.
Wen
, X.
Li
, L.
Gao
, and Y.
Zhang
, “A new convolutional neural network-based data-driven fault diagnosis method
,” IEEE Trans. Ind. Electron.
65
(7
), 5990
–5998
(2018
). 10.
O. I.
Abiodun
, A.
Jantan
, A. E.
Omolara
, K. V.
Dada
, N. A.
Mohamed
, and H.
Arshad
, “State-of-the-art in artificial neural network applications: A survey
,” Heliyon
4
(11
), e00938
(2018
). 11.
D.
Wu
, N.
Ye
, L.
Shen
, Q.
Zhang
, and Z.
Lai
, “Clustering method for automatic timber defects detection based on the color moment
,” J. Jiangnan Univ. (Nat. Sci. Ed.)
8
(5
), 520
–524
(2009
).12.
Y.
Zhang
, C.
Xu
, C.
Li
, H.
Yu
, and J.
Cao
, “Wood defect detection method with PCA feature fusion and compressed sensing
,” J. For. Res.
26
(3
), 745
–751
(2015
). 13.
R.
Qayyum
, K.
Kamal
, T.
Zafar
, and S.
Mathavan
, “Wood defects classification using GLCM based features and PSO trained neural network
,” in 2016 22nd International Conference on Automation and Computing (ICAC)
, 7 September 2016
(IEEE
, 2016
), pp. 273
–277
.14.
X.
Ji
, H.
Guo
, and M.
Hu
, “Features extraction and classification of wood defect based on HU invariant moment and wavelet moment and BP neural network
,” in Proceedings of the 12th International Symposium on Visual Information Communication and Interaction
, 20 September 2019
(ACM, 2019
), pp. 1
–5
.15.
S. W.
Hwang
, T.
Lee
, H.
Kim
, H.
Chung
, J. G.
Choi
, and H.
Yeo
, “Classification of wood knots using artificial neural networks with texture and local feature-based image descriptors
,” Holzforschung
76
, 1
–13
(2022
). 16.
R.
Norlander
, J.
Grahn
, and A.
Maki
, “Wooden knot detection using convnet transfer learning
,” in Scandinavian Conference on Image Analysis
, 15 June 2015
(Springer
, Cham
, 2015
), pp. 263
–274
.17.
A.
Urbonas
, V.
Raudonis
, R.
Maskeliūnas
, and R.
Damaševičius
, “Automated identification of wood veneer surface defects using faster region-based convolutional neural network with data augmentation and transfer learning
,” Appl. Sci.
9
(22
), 4898
(2019
). 18.
W.
Hongjun
, L.
Zouzou
, and Z.
Xiangjun
, “Wood surface defect detection based on adaboost and CNN
,” J. Syst. Simul.
31
(8
), 1636
(2019
). 19.
J.
Shi
, Z.
Li
, T.
Zhu
, D.
Wang
, and C.
Ni
, “Defect detection of industry wood veneer based on NAS and multi-channel mask R-CNN
,” Sensors
20
(16
), 4398
(2020
). 20.
D.
Li
, W.
Xie
, B.
Wang
, W.
Zhong
, and H.
Wang
, “Data augmentation and layered deformable mask R-CNN-based detection of wood defects
,” IEEE Access
9
(9
), 108162
–108174
(2021
). 21.
M.
Gao
, P.
Song
, F.
Wang
, J.
Liu
, A.
Mandelis
, and D.
Qi
, “A novel deep convolutional neural network based on ResNet-18 and transfer learning for detection of wood knot defects
,” J. Sens.
2021
, 16
(2021
). 22.
H.
Kauppinen
and O.
Silven
, “A color vision approach for grading lumber
,” in Theory and Applications of Image Processing II—Selected Papers from the 9th Scandinavian Conference on Image Analysis
, Borgefors
, G
, Ed. (World Scientific, Singapore
, 1995
), pp. 367
–379
.23.
O.
Silven
and H.
Kauppinen
, “Recent developments in wood inspection
,” Int. J. Pattern Recognit. Artif. Intell.
10
, 83
–95
(1996
). 24.
H.
Kauppinen
and O.
Silven
, “The effect of illumination variations on color-based wood defect classification
,” in Proceedings of the 13th International Conference on Pattern Recognition (13th ICPR)
, Vienna, Austria
, 25–29 August 1996
(IEEE, 1996
), pp. 828
–832
.25.
J.
Kim
, T.
Kim
, S.
Kim
, and C. D.
Yoo
, “Edge-labeling graph neural network for few-shot learning
,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
(IEEE, 2019
), pp. 11
–20
.26.
Q.
Yang
, C.
Li
, W.
Dai
, J.
Zou
, G. J.
Qi
, and H.
Xiong
, “Rotation equivariant graph convolutional network for spherical image classification
,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
(IEEE, 2020
), pp. 4303
–4312
.27.
W.
Li
, C.
Chen
, M.
Zhang
, H.
Li
, and Q.
Du
, “Data augmentation for hyperspectral image classification with deep CNN
,” IEEE Geosci. Remote Sens. Lett.
16
(4
), 593
–597
(2019
). 28.
F. S.
Hassan
and A.
Gutub
, “Improving data hiding within colour images using hue component of HSV colour space
,” CAAI Trans. Intell. Technol.
7
, 56
(2022
). 29.
W.
You
, X.
Zhao
, S.
Ma
, and Y.
Liu
, “Restegnet: A residual steganalytic network
,” Multimed. Tools Appl.
78
(16
), 22711
–22725
(2019
). 30.
T.
Moreau
, T.
Chen
, and L.
Ceze
, “Leveraging the VTA-TVM hardware-software stack for FPGA acceleration of 8-bit ResNet-18 inference
,” in Proceedings of the 1st on Reproducible Quality-Efficient Systems Tournament on Co-Designing Pareto-Efficient Deep Learning
, 20 June 2018
(ACM, 2018
), p. 1
.31.
L.
Wen
, X.
Li
, and L.
Gao
, “A transfer convolutional neural network for fault diagnosis based on ResNet-50
,” Neural Comput. Appl.
32
(10
), 6111
(2020
). 32.
H.
Yong
, J.
Huang
, X.
Hua
, and L.
Zhang
, “Gradient centralization: A new optimization technique for deep neural networks
,” in European Conference on Computer Vision
, 23 August 2020
(Springer
, Cham, 2020
), pp. 635
–652
.33.
Y.
Zhang
, X.
Wang
, and H.
Tang
, “An improved Elman neural network with piecewise weighted gradient for time series prediction
,” Neurocomputing
359
, 199
–208
(2019
). 34.
Z.
Li
, K.
Jiang
, S.
Qin
, Y.
Zhong
, and A.
Elofsson
, “GCSENet A GCN, CNN and SENet ensemble model for microRNA-disease association prediction
,” PLOS Comput. Biol.
17
(6
), e1009048
(2021
). 35.
I.
Sarasua
, S.
Pölsterl
, and C.
Wachinger
, “Recalibration of neural networks for point cloud analysis
,” in 2020 International Conference on 3D Vision (3DV)
, 25 November 2020
(IEEE
, 2020
), pp. 443
–451
.36.
T.
Yang
, S.
Zhu
, C.
Chen
, S.
Yan
, M.
Zhang
, and A.
Willis
, “Mutualnet: Adaptive convnet via mutual learning from network width and resolution
,” in European Conference on Computer Vision
, 23 August 2020
(Springer
, Cham
, 2020
), pp. 299
–315
.37.
S.
Zhang
, S.
Zhang
, C.
Zhang
, X.
Wang
, and Y.
Shi
, “Cucumber leaf disease identification with global pooling dilated convolutional neural network
,” Comput. Electron. Agric.
162
, 422
–430
(2019
). 38.
A.
Ghosh
, B.
Bhattacharya
, and S. B.
Chowdhury
, “Adgap: Advanced global average pooling
,” in Thirty-Second AAAI Conference on Artificial Intelligence
29 April 2018
(AAAI, 2018
).39.
Y.
Wen
, L.
Chen
, Y.
Deng
, and C.
Zhou
, “Rethinking pre-training on medical imaging
,” J. Vis. Commun. Image Represent.
78
, 103145
(2021
). 40.
T.
He
, Y.
Liu
, Y.
Yu
, Q.
Zhao
, and Z.
Hu
, “Application of deep convolutional neural network on feature extraction and detection of wood defects
,” Measurement
152
, 107357
(2020
). © 2022 Author(s). Published under an exclusive license by AIP Publishing.
2022
Author(s)
You do not currently have access to this content.
