Abstract
Previous studies on different satellite images have not yet introduced a single attribute with the highest accuracy for different applications. In this paper, a novel classification system with the highest strength against possible noises is offered using Support Vector Machine (SVM) and its performance is evaluated on the selected satellite images. So, an optimal high-strength classifier with the sufficient level of accuracy is proposed executing Composite Kernels and Ensemble of Classifiers. Results obtained from applying this method on IKONOS (91.65%) and AVIRIS (97.71%) satellite images (in Tehran and Indian Pine study areas) showed that the proposed method accuracy is higher than the Direct Summation of Kernels, Weighted Summation of Kernels, Cross Information Kernels and Extracted Features techniques. The main reason for this significant difference is the wide range and variety of input features.










Similar content being viewed by others
Data availability
The raw/processed data required to reproduce the above findings cannot be shared at this time due to technical/ time limitations. We will share if it is requested by the journal.
Rouzbeh shad (Corresponding Author).
Seyyed Tohid Seyyed-Al-hosseini, Yaser Maghsoudi, Marjan Ghaemi.
References
Alpaydin E (2010) Introduction to machine learning, 2nd ed. Massachusetts Institute of Technology
Bensalem R, Ettabaa KS, Hamdi MA (2014) Spectral-spatial classification of hyperspectral images using different spatial features and composite kernels. IEEE International Image Processing Applications and Systems Conference
Camps-Valls G, Chova G, Munoz-Mari L, Vila-Frances J (2006) Composite kernels for hyperspectral image classification. Geosci Remote Sens Lett IEEE, IEEE, p 3
Camps-Valls G, Gómez-Chova L, Muñoz-Marí J, Rojo-Álvarez JL, Ramón MM (2008) Kernel-based framework for multitemporal and multisource remote sensing data classification and change detection. Geosci Remote Sens IEEE Trans 46
Canty M (2014) Image analysis classification and change detection in remote sensing, 3rd ed, pp 275–277
Chen Y, Nasrabadi NM, Tran TD (2011) Hyperspectral image classification using dictionary based sparse representation. Trans Geosci Remote Sens IEEE 49(10)
Chen H, Liu J, Xiao L (2019) An improved composite kernel framework for hyperspectral image classification using canonical correlation analysis. Remote Sens Lett 411–420
Chen YN, Thaipisutikul T, Han CC, Liu TJ, Fan KC (2021) Feature line embedding based on support vector machine for hyperspectral image classification. Remote Sens 13(1)
Ergul U, Bilgin G (2019) HCKBoost: Hybridized composite kernel boosting with extreme learning machines for hyperspectral image classification. Neurocomputing 334:100–113
Fan GF, Zhang LZ, Yu M, Hong WC, Dong SQ (2020) Applications of random forest in multivariable response surface for short-term load forecasting. Int J Electric Power Energy System
Fauvel M, Benediktsson JA, Chanussot J, Sveinsson JR (2008) Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles. Trans Geosci Remote Sens, IEEE, p 46
Geijn Van de RA (2011) Notes on Cholesky factorization. Department of Computer Science, The University of Texas, Austin
Gonzalesalonso F, Lopezsoria S (2010) Using contextual information to improve land use classification of satellite images in central Spain. Int J Remote Sens 12
Guillamet D, Schiele B, Vitria J (2002) Analyzing non-negative matrix factorization for image classification. In: 16th International Conference on Pattern Recognition. IEEEXplor 2
Guo Y, Yin X, Zhao X et al (2019) Hyperspectral image classification with SVM and guided filter. J Wireless Com Network 2019:56. https://doi.org/10.1186/s13638-019-1346-z
Hasan H, Shafri HZM, Habshi M (2019) A comparison between Support Vector Machine (SVM) and Convolutional Neural Network (CNN) models for hyper spectral image classification. In: IOP Conf. Earth Environ Science, Series
Higham NJ (2003) Solving nonlinear equations with Newton's method. Society for Industrial and Applied Mathematics, Philadelphia
Huang X, Zhang L (2013) An SVM ensemble approach combining spectral, structural, and semantic features for the classification of high-resolution remotely sensed imagery. Trans Geosci Remote Sens IEEE 51(1):257–272
Huang X, Zhang L (2013) An SVM ensemble approach combining spectral, structural and semantic features for the classification of high-resolution remotely sensed imagery. Trans Geosci Remote Sens IEEE 51
Jain DK, Dubey SB, Choubey RK, Sinhal A, Arjaria SK, Jain A, Wang H (2018) An approach for hyperspectral image classification by optimizing SVM using self-organizing map. J Comput Sci 25:252–259
Ji R, Gao Y, Hong R, Liu Q, Tao D, Li X (2014) Spectral-spatial constraint hyperspectral image classification. Trans Geosci Remote Sens IEEE 52(3)
Jia X, Kuo BC, Crawford MM (2013) Feature mining for hyperspectral image classification. Proc IEEE IEEEXplore 101(3):676–697
Karakatič S, Podgorelec V (2016) Improved classification with allocation method and multiple classifiers. In: Special issue on applications of ensemble methods, information fusion, vol 31. Elsevier, pp 26–42
Kavitha K, Arivazhagan S, .Banu S (2015) Combined features based spatial composite kernel formation for hyperspectral image classification. Int J Innov Res Sci Eng Technol, 4(5)
Kuncheva LI (2014) Combining pattern classifiers: methods and algorithms. A John Wiley & Sons Inc Publication
Li J, Marpu PR, Plaza A, Bioucas-Dias JM, Benediktsson JA (2013) Generalized composite kernel framework for hyperspectral image classification. Trans Geosci Remote Sens 51(9)
Lv W, Wang X (2020) overview of hyperspectral image classification. J Sens
Majdar RS, Ghassemian H (2017) A probabilistic SVM approach for hyperspectral image classification using spectral and texture features. Int J Remote Sens 38(15)
Mura MD, Benediktsson JA, Waske B, Bruzzone L (2010) Morphological attribute profiles for the analysis of very high-resolution images. In: Trans Geosci Remote Sens IEEE 48
Mura MD, Benediktsson JA, Waske B, Bruzzone L (2010) Extended profiles with morphological attribute filters for the analysis of hyperspectral data. Int J Remote Sens 31:5975–5991
Mura MD, Villa A, Benediktsson JA, Chanussot J, bruzzone l (2011) classification of hyperspectral images by using extended morphological attribute profiles and independent component analysis. IEEE Geosci Remote Sens Lett IEEEXplore 8(3)
Okwuashi O, Ndehedehe CE (2020) Deep support vector machine for hyper spectral image classification. Pattern Recogn 103
Oza NC, Tumer K (2008) Classifier ensembles: select real-world applications, special issue on applications of ensemble methods. Inf Fus 9:4–20
Sesmero MP, Alonso-Weber JM, Gutierrez G, Ledezma A, Sanchis A (2015) An ensemble approach of dual base learners for multi-class classification problems. Special Issue. Appl Ensemble Methods. Inf Fus 24:122–136
Shang W et al (2019) Spectral-spatial feature extraction and supervised classification by MF-KELM classifier on hyperspectral imagery. APSIPA Trans Signal Inf Process 8
Taylor JS, Cristianini N (2000) Support vector machines and other kernel-based learning methods. Cambridge University
Wang Y, Duan H (2018) Classification of hyperspectral images by SVM using a composite Kernel by employing spectral, spatial and hierarchical structure information. Remote Sens 10(3):441
Waske B, Benediktsson JA (2007) Fusion of support vector machines for classification of multisensor data. Trans Geosci Remote Sens IEEE 45(12)
Wu TF, Lin CJ, Weng RC (2004) Probability estimates for multi-class classification by Pairwise Coupling. J Mach Learn:975–1005
Zhu X, Li N, Pan Y (2019) optimization performance comparison of three different group intelligence algorithms on a SVM for hyperspectral imagery classification. J Remote Sens 11(6)
Funding
The authors certify that they have NO affiliations with or involvement in any organization or entity with any financial interest (such as honoraria; educational grants; participation in speakers’ bureaus; membership, employment, consultancies, stock ownership, or other equity interest; and expert testimony or patent-licensing arrangements), or non-financial interest (such as personal or professional relationships, affiliations, knowledge or beliefs) in the subject matter or materials discussed in this manuscript.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
The authors declare the following financial interests/personal relationships which may be considered as potential competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Shad, R., Seyyed-Al-hosseini, S.T., Mehrani, Y.M. et al. Ensemble of Support Vector Machines for spectral-spatial classification of hyperspectral and multispectral images. Multimed Tools Appl 82, 42119–42146 (2023). https://doi.org/10.1007/s11042-023-14972-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-14972-3