Similar Plant Species Classification With Dual Input  Transfer Learning Models

Parul Sharma; Pawanesh Abrol

doi:10.48165/

Authors

Parul Sharma Department of Computer Science and Information Technology, University of Jammu, Baba Saheb Ambedkar Road, Gujarbasti, Jammu - 180 006, Jammu & Kashmir (India)
Pawanesh Abrol Department of Computer Science and Information Technology, University of Jammu, Baba Saheb Ambedkar Road, Gujarbasti, Jammu - 180 006, Jammu & Kashmir (India)

DOI:

https://doi.org/10.48165/

Keywords:

Citrus species classification, dual-input CNN, Grad-CAM, similar species classification, transfer learning

Abstract

The classification of plant species is crucial for preserving biodiversity, identifying endangered species, preventing diseases, and controlling weeds. However, with the vast number of species and their similar physical appearances, identifying and classifying them correctly can be difficult for human experts. Artificial Intelligence, such as Convolution Neural Networks (CNNs), can aid in automatic plant species recognition, especially for identifying similar species that require the learning of subtle differences. In the present investigation, transfer learning models such as MobileNet, AlexNet, and GoogLeNet were used to classify ten citrus species that look alike. A dataset of images of fruits and leaves of these citrus plants was compiled, and all images were segmented and their backgrounds were subtracted to create a new segmented dataset. In addition, instead of using only one organ as input to the CNN, dual inputs of both fruits and leaves were also used. The classification accuracy of 78.25% was achieved when MobileNet model was used on original dataset of fruits and it extended to 97.25% when GoogLeNet model was used on segmented dataset when both the organs were used as input. Evidently, present study provides innovative methods and techniques to accurately distinguish and classify visually similar plant species.

Downloads

Download data is not yet available.

References

Andrew, G. and Menglong, Z. 2017. Efficient convolutional neural networks for mobile vision applications. Mobilenets. arXiv preprint arXiv:1704.04861.

Barbedo, J.G.A. 2018. Impact of dataset size and variety on the effectiveness of deep learning and transfer learning for plant disease classification. Computers and Electronics in Agriculture, 153: 46-53.

Canny, J. 1986. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6: 679-698.

Davis, J. and Goadrich, M. 2006. The relationship between Precision-Recall and ROC curves. pp. 233-240. In: Proceedings of the 23rd international conference on Machine learning. 26-29 June 2006. Pittsburgh, Pennsylvania, USA.

Deng, J., Dong, W., Socher, R., Li, L.J., Li, K. and Fei-Fei, L. 2009. Imagenet: A large-scale hierarchical image database. pp. 248-255. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE, June 20, 2009. Miami, USA.

Dueck, K. 2023. How many plants are in the world? AZ Animals. [https://a-z-animals.com/blog/how many-plants-are-in-the-world/].

Gaston, K.J. and O’Neill, M.A. 2004. Automated species identification: Why not? Philosophical Transactions of the Royal Society of London B Biological Sciences. 359(1444): 655-667. Goëau, H., Joly, A., Bonnet, P., Lasseck, M., Šulc, M. and Hang, S.T. 2018. Deep learning for plant identification: How the web can compete with human experts? Biodiversity Information Science and Standards. 2: e25637. [https://biss.pensoft.net/article/25637/].

He, K., Zhang, X., Ren, S. and Sun, J. 2016. Deep residual learning for image recognition. pp. 770- 778. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 27- 30 June, Las Vegas, USA.

Hu, R., Jia, W., Ling, H., and Huang, D. 2012. Multiscale distance matrix for fast plant leaf recognition. IEEE Transactions on Image Processing, 21(11): 4667-4672.

Kamal, K.C., Yin, Z., Li, B., Ma, B. and Wu, M. 2019, September. Transfer learning for fine-grained crop disease classification based on leaf images. pp. 1-5. In: 10th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing. IEEE. 24-26 September 2019, Amsterdam, the Netherlands.

Krizhevsky, A., Sutskever, I. and Hinton, G.E. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 25, (eds. F. Pereira, C. Burges, L. Bottou, and K.Q. Weinberger). Curran Associates Incorporated

Lee, S.H. Chan, C.S., Wilkin, P. and Remagnino, P. 2015. Deep-plant: Plant identification with convolutional neural networks. pp. 452-456. In: IEEE International Conference on Image Processing, 27-30 September, Quebec City, Canada.

Lee, S.H., Chan, C.S. and Remagnino, P. 2018. Multi-organ plant classification based on convolutional and recurrent neural networks. IEEE Transactions on Image Processing, 27(9): 4287-4301.

Lee, S.H., Chang, Y.L., Chan, C.S. and Remagnino, P. 2017. HGO-CNN: Hybrid generic-organ convolutional neural network for multi-organ plant classification. pp. 4462-4466. In: 2017 IEEE International Conference on Image Processing. IEEE. 17-20 September, 2017, Beijing, China.

Liu, Z., Wang, J., Tian, Y. and Dai, S. 2019. Deep learning for image-based large-flowered chrysanthemum cultivar recognition. Plant Methods, 15(1): 1-11.

Mohamed, S.S., Tahir, N.M. and Adnan, R. 2010. Background modelling and background subtraction performance for object detection. pp. 1-6. In: 2010 6th International Colloquium on Signal Processing & its Applications. IEEE. 21-23 May, 2010, Malacca, Malaysia.

Nilsback, M.E. and Zisserman, A. 2006. A visual vocabulary for flower classification. pp. 1447-1454. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06), 2: IEEE, 17-22 June, 2006, New York, USA.

Nilsback, M.E. and Zisserman, A. 2008. Automated flower classification over a large number of classes. pp. 722-729. In: Sixth Indian Conference on Computer Vision, Graphics & Image Processing. IEEE. 16-19 December, 2008, Bhubaneswar, India.

Pereira, C.S., Morais, R. and Reis, M.J. 2018. Pixel-based leaf segmentation from natural vineyard images using colour model and threshold techniques. pp. 96-106. In: International Conference Image Analysis and Recognition. (eds. A. Campilho, F. Karray, & B. ter Haar Romeny). Image Analysis and Recognition, Lecture Notes in Computer Science. Vol 10882. Cham. Springer.

Pereira, C.S., Morais, R. and Reis, M.J. 2019. Deep learning techniques for grape plant species identification in natural images. Sensors, 19(22): 4850 [https://www.mdpi.com/1424-8220/19/ 22/4850].

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M. and Berg, A.C. 2015. ImageNet large scale visual recognition challenge. International Journal of Computer Vision, 115(3): 211-252.

Rzanny, M., Mäder, P., Deggelmann, A., Chen, M. and Wäldchen, J. 2019. Flowers, leaves or both? How to obtain suitable images for automated plant identification. Plant Methods, 15: 1-11. Sarvamangala, D.R. and Kulkarni, R.V. 2021. Convolutional neural networks in medical image

understanding: A survey. Evolutionary Intelligence, 1-22. [https://doi.org/10.1007/s12065-020- 00540-3].

Sekehravani, E.A., Babulak, E. and Masoodi, M. 2020. Implementing canny edge detection algorithm for noisy image. Bulletin of Electrical Engineering and Informatics, 9(4): 1404-1410. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D. and Batra, D. 2017. Grad-cam: Visual explanations from deep networks via gradient-based localization. pp. 618-626. In: Proceedings of the IEEE International Conference on Computer Vision. Venice, Italy. Sokolova, M. and Lapalme, G. 2009. A systematic analysis of performance measures for classification tasks. Information Processing & Management, 45(4): 427-437.

Smith, J., Johnson, L. and Kim, S. 2022. A Review on classification methods for plants leaves recognition. Journal of Plant Research, 135(4): 437-452.

Söderkvist, O. 2001. Computer Vision Classification of Leaves from Swedish Trees. Master’s Thesis, Department of Electrical Engineering, Computer Vision, Linkoping University, Sweden. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D. and Rabinovich, A. 2015. Going deeper with convolutions. pp. 1-9. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7-12 June, 2015, Boston, USA.

Wäldchen, J., Rzanny, M., Seeland, M. and Mäder, P. 2018. Automated plant species identification - Trends and future directions. PLoS Computational Biology, 14(4). [https://doi.org/10.1371/journal.pcbi.1005993].

Wang, K., Gao, X., Zhao, Y., Li, X., Dou, D. and Xu, C.Z. 2019. September. Pay attention to features, transfer learn faster CNNs. In: International Conference on Learning Representations. April 30, 2020. Addis Ababa, Ethiopia.

Wu, S.G., Bao, F.S., Xu, E.Y., Wang, Y.X., Chang, Y.F. and Xiang, Q.L. 2007. A leaf recognition algorithm for plant classification using probabilistic neural network pp. 11-17. In: IEEE International Symposium on Signal Processing and Information Technology, IEEE. Giza, Egypt.