Surveillance System Scheme using Multi-detection Attribute with Optimized Neural Network Algorithm on Intelligent Transportation System
Abstrak
Abstract- Intelligent Transportation System (ITS) combines a transportation system with Information and Communication Technology (ICT) system, where ICT system plays a role in adding functionality in the form of intelligence resembling human intelligence to the transportation system. The combination allows humans to know the real state of the transportation system including transportation components, such as the status of the road, objects around the vehicle, and the state of the vehicle, thus enabling humans to optimize the transportation system. For example, if there is a group of thief that using a van on the road, we can fasten the process to detect where is the route that used by the thief by adding a vehicle detector on the traffic light camera. This detector will be work better if the detector can detect the van in real-time and in a high resolution image. This work will discuss on how to increase the detector system performance on inference time (fps) and accuracy using HRNet and FCOS. HRNet is a high resolution image network architecture that can process image in a multiple resolution (low, medium, high) to maintain the high resolution but still have an enough image feature to process, while FCOS is a one stage anchor-free detector, so it can detect the object faster than the anchor-based detector. The performances was even more better when we add a warm up training before the training process. Our experimental results shows that our system has a better result compared with the reference result using same dataset and hyperparameter. It also has a better result compared with the reference result that using the reference dataset and hyperparameter.
Keywords- intelligent transportation system; objet detection; vehicle detection; attribute detection; computer vision; image processing; surveillance system.
Referensi
Fang, Wenhua, et al. "Vehicle re-identification collaborating visual and temporal-spatial network." Proceedings of the fifth international conference on internet multimedia computing and service. 2013..
Zapletal, Dominik, and Adam Herout. "Vehicle re-identification for automatic video traffic surveillance." Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 2016.
Schroff, Florian, Dmitry Kalenichenko, and James Philbin. "Facenet: A unified embedding for face recognition and clustering." Proceedings of the IEEE conference on computer vision and pattern recognition. 2015..
Ding, Shengyong, et al. "Deep feature learning with relative distance comparison for person re-identification." Pattern Recognition 48.10 (2015): 2993-3003.
Lin, Weiyao, et al. "Learning correspondence structures for person re-identification." IEEE Transactions on Image Processing 26.5 (2017): 2438-2453.
Kuznetsova, Alina, et al. "The open images dataset v4." International Journal of Computer Vision 128.7 (2020): 1956-1981.
Liu, Wei, et al. "Ssd: Single shot multibox detector." European conference on computer vision. Springer, Cham, 2016.
He, Kaiming, et al. "Mask r-cnn." Proceedings of the IEEE international conference on computer vision. 2017.
Ren, Shaoqing, et al. "Faster r-cnn: Towards real-time object detection with region proposal networks." Advances in neural information processing systems 28 (2015)..
Girshick, Ross, et al. "Rich feature hierarchies for accurate object detection and semantic segmentation." Proceedings of the IEEE conference on computer vision and pattern recognition. 2014.
Girshick, Ross. "Fast r-cnn." Proceedings of the IEEE international conference on computer vision. 2015.
Bertozzi, Massimo, Alberto Broggi, and Stefano Castelluccio. "A real-time oriented system for vehicle detection." Journal of Systems Architecture 43.1-5 (1997): 317-325..
Gao, Yongbin, and Hyo Jong Lee. "Vehicle make recognition based on convolutional neural network." 2015 2nd International Conference on Information Science and Security (ICISS). IEEE, 2015./
Kalinke, Thomas, Christos Tzomakas, and Wemer von Seelen. "A texture-based object detection and an adaptive model-based classification." Procs. IEEE Intelligent Vehicles Symposium. Vol. 98. Citeseer, 1998.
Buluswar, Shashi D., and Bruce A. Draper. "Color machine vision for autonomous vehicles." Engineering Applications of Artificial Intelligence 11.2 (1998): 245-256.
Fan, Quanfu, Lisa Brown, and John Smith. "A closer look at Faster R-CNN for vehicle detection." 2016 IEEE intelligent vehicles symposium (IV). IEEE, 2016..
Ahmed, Mohammed Jameel, et al. "License plate recognition system." 10th IEEE International Conference on Electronics, Circuits and Systems, 2003. ICECS 2003. Proceedings of the 2003. Vol. 2. IEEE, 2003.
Chang, Shyang-Lih, et al. "Automatic license plate recognition." IEEE transactions on intelligent transportation systems 5.1 (2004): 42-53.
Gerber, Christian, and Mokdong Chung. "Number plate detection with a multi-convolutional neural network approach with optical character recognition for mobile devices." Journal of Information Processing Systems 12.1 (2016): 100-10.
Liu, Hongye, et al. "Deep relative distance learning: Tell the difference between similar vehicles." Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.
Liu, Xiaobin, et al. "Ram: a region-aware deep model for vehicle re-identification." 2018 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 2018.
Wang, Zhongdao, et al. "Orientation invariant feature embedding and spatial temporal regularization for vehicle re-identification." Proceedings of the IEEE international conference on computer vision. 2017.
Zhou, Yi, Li Liu, and Ling Shao. "Vehicle re-identification by deep hidden multi-view inference." IEEE Transactions on Image Processing 27.7 (2018): 3275-3287.
Tian, Zhi, et al. "Fcos: Fully convolutional one-stage object detection." Proceedings of the IEEE/CVF international conference on computer vision. 2019.
Dai, Jifeng, et al. "R-fcn: Object detection via region-based fully convolutional networks." Advances in neural information processing systems 29 (2016).
Redmon, Joseph, et al. "You only look once: Unified, real-time object detection." Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.
Wang, Jingdong, et al. "Deep high-resolution representation learning for visual recognition." IEEE transactions on pattern analysis and machine intelligence 43.10 (2020): 3349-3364.
Lin, Tsung-Yi, et al. "Focal loss for dense object detection." Proceedings of the IEEE international conference on computer vision. 2017.
Pasupa, Kitsuchart, et al. "Evaluation of deep learning algorithms for semantic segmentation of car parts." Complex & Intelligent Systems (2021): 1-13..
Chen, Kai, et al. "Hybrid task cascade for instance segmentation." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019..
Liu, Yudong, et al. "Cbnet: A novel composite backbone network architecture for object detection." Proceedings of the AAAI conference on artificial intelligence. Vol. 34. No. 07. 2020.
Wang, Kaixin, et al. "Panet: Few-shot image semantic segmentation with prototype alignment." Proceedings of the IEEE/CVF International Conference on Computer Vision. 2019.
Cao, Yue, et al. "Gcnet: Non-local networks meet squeeze-excitation networks and beyond." Proceedings of the IEEE/CVF international conference on computer vision workshops. 2019
Redmon, Joseph, and Ali Farhadi. "YOLO9000: better, faster, stronger." Proceedings of the IEEE conference on computer vision and pattern recognition. 2017.
Zhang, Shifeng, et al. "Bridging the gap between anchor-based and anchor-free detection via adaptive training sample selection." Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020.
Zhao, Yanzhu, et al. "Structural analysis of attributes for vehicle re-identification and retrieval." IEEE Transactions on Intelligent Transportation Systems 21.2 (2019): 723-734.
