Abstract
Extreme learning machine (ELM) is an efficient learning algorithm for single hidden layer feed forward neural networks. Its main feature is the random generation of the hidden layer weights and biases and then we only need to determine the output weights in model learning. However, the random mapping in ELM impairs the discriminative information of data to certain extent, which brings side effects for the output weight matrix to well capture the essential data properties. In this paper, we propose a factorized extreme learning machine (FELM) by incorporating another hidden layer between the ELM hidden layer and the output layer. Mathematically, the original output matrix is factorized so as to effectively explore the structured discriminative information of data. That is, we constrain the group sparsity of data representation in the new hidden layer, which will be further projected to the output layer. An efficient learning algorithm is proposed to optimize the objective of the proposed FELM model. Extensive experiments on EEG-based emotion recognition show the effectiveness of FELM.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Duan, R.N., Zhu, J.Y., Lu, B.L.: Differential entropy feature for EEG-based emotion classification. In: NER, pp. 81–84 (2013)
Horata, P., Chiewchanwattana, S., Sunat, K.: Robust extreme learning machine. Neurocomputing 102, 31–44 (2013)
Huang, G.B., Chen, L., Siew, C.K., et al.: Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Netw. 17(4), 879–892 (2006)
Huang, G.B., Li, M.B., Chen, L., Siew, C.K.: Incremental extreme learning machine with fully complex hidden nodes. Neurocomputing 71(4–6), 576–583 (2008)
Huang, G.B., Zhou, H., Ding, X., Zhang, R.: Extreme learning machine for regression and multiclass classification. IEEE TSMC-B 42(2), 513–529 (2012)
Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70(1–3), 489–501 (2006)
Luo, H., Shen, R., Niu, C., Ullrich, C.: Sparse group restricted Boltzmann machines. In: AAAI Conference on Artificial Intelligence, pp. 429–434 (2011)
Peng, Y., Lu, B.L.: Discriminative extreme learning machine with supervised sparsity preserving for image classification. Neurocomputing 261, 242–252 (2017)
Peng, Y., Zhu, J.Y., Zheng, W.L., Lu, B.L.: EEG-based emotion recognition with manifold regularized extreme learning machine. In: EMBC, pp. 974–977 (2014)
Shi, L.C., Lu, B.L.: EEG-based vigilance estimation using extreme learning machines. Neurocomputing 102, 135–143 (2013)
Zhang, W., Ji, H.: Fuzzy extreme learning machine for classification. Electron. Lett. 49(7), 448–450 (2013)
Zong, W., Huang, G.B.: Learning to rank with extreme learning machine. Neural Process. Lett. 39(2), 155–166 (2014)
Acknowledgements
This work was supported by NSFC (61971173,U1909202), Fundamental Research Funds for the Provincial Universities of Zhejiang (GK209907299001-008), Postdoctoral Science Foundation of China (2017M620470), Key Laboratory of Advanced Perception and Intelligent Control of High-end Equipment of Ministry of Education, Anhui Polytechnic University (GDSC202015) and Provincial Key Laboratory for Computer Information Processing Technology, Soochow University (KJS1841).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Peng, Y., Tang, R., Kong, W., Nie, F. (2020). A Factorized Extreme Learning Machine and Its Applications in EEG-Based Emotion Recognition. In: Yang, H., Pasupa, K., Leung, A.CS., Kwok, J.T., Chan, J.H., King, I. (eds) Neural Information Processing. ICONIP 2020. Communications in Computer and Information Science, vol 1333. Springer, Cham. https://doi.org/10.1007/978-3-030-63823-8_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-63823-8_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63822-1
Online ISBN: 978-3-030-63823-8
eBook Packages: Computer ScienceComputer Science (R0)