TY - JOUR
T1 - A comparative study of point clouds semantic segmentation using three different neural networks on the railway station dataset
AU - Lumban-Gaol, Y. A.
AU - Chen, Z.
AU - Smit, M.
AU - Li, X.
AU - Erbaşu, M. A.
AU - Verbree, E.
AU - Balado, J.
AU - Meijers, M.
AU - Van Der Vaart, N.
PY - 2021
Y1 - 2021
N2 - Point cloud data have rich semantic representations and can benefit various applications towards a digital twin. However, they are unordered and anisotropically distributed, thus being unsuitable for a typical Convolutional Neural Networks (CNN) to handle. With the advance of deep learning, several neural networks claim to have solved the point cloud semantic segmentation problem. This paper evaluates three different neural networks for semantic segmentation of point clouds, namely PointNet++, PointCNN and DGCNN. A public indoor scene of the Amersfoort railway station is used as the study area. Unlike the typical indoor scenes and even more from the ubiquitous outdoor ones in currently available datasets, the station consists of objects such as the entrance gates, ticket machines, couches, and garbage cans. For the experiment, we use subsets from the data, remove the noise, evaluate the performance of the selected neural networks. The results indicate an overall accuracy of more than 90% for all the networks but vary in terms of mean class accuracy and mean Intersection over Union (IoU). The misclassification mainly occurs in the classes of couch and garbage can. Several factors that may contribute to the errors are analyzed, such as the quality of the data and the proportion of the number of points per class. The adaptability of the networks is also heavily dependent on the training location: the overall characteristics of the train station make a trained network for one location less suitable for another.
AB - Point cloud data have rich semantic representations and can benefit various applications towards a digital twin. However, they are unordered and anisotropically distributed, thus being unsuitable for a typical Convolutional Neural Networks (CNN) to handle. With the advance of deep learning, several neural networks claim to have solved the point cloud semantic segmentation problem. This paper evaluates three different neural networks for semantic segmentation of point clouds, namely PointNet++, PointCNN and DGCNN. A public indoor scene of the Amersfoort railway station is used as the study area. Unlike the typical indoor scenes and even more from the ubiquitous outdoor ones in currently available datasets, the station consists of objects such as the entrance gates, ticket machines, couches, and garbage cans. For the experiment, we use subsets from the data, remove the noise, evaluate the performance of the selected neural networks. The results indicate an overall accuracy of more than 90% for all the networks but vary in terms of mean class accuracy and mean Intersection over Union (IoU). The misclassification mainly occurs in the classes of couch and garbage can. Several factors that may contribute to the errors are analyzed, such as the quality of the data and the proportion of the number of points per class. The adaptability of the networks is also heavily dependent on the training location: the overall characteristics of the train station make a trained network for one location less suitable for another.
KW - Deep learning
KW - Indoor Scene
KW - Point Clouds
KW - Railway Station
KW - Semantic Segmentation
UR - http://www.scopus.com/inward/record.url?scp=85115872687&partnerID=8YFLogxK
U2 - 10.5194/isprs-archives-XLIII-B3-2021-223-2021
DO - 10.5194/isprs-archives-XLIII-B3-2021-223-2021
M3 - Conference article
AN - SCOPUS:85115872687
SN - 1682-1750
VL - 43
SP - 223
EP - 228
JO - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
JF - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
IS - B3-2021
T2 - 2021 24th ISPRS Congress Commission III: Imaging Today, Foreseeing Tomorrow
Y2 - 5 July 2021 through 9 July 2021
ER -