Music emotion recognition using convolutional long short term memory deep neural networks

dc.authoridYILDIRIM, Serdar/0000-0003-3151-9916
dc.authoridHizlisoy, Serhat/0000-0001-8440-5539
dc.contributor.authorHizlisoy, Serhat
dc.contributor.authorYildirim, Serdar
dc.contributor.authorTufekci, Zekeriya
dc.date.accessioned2025-01-06T17:43:45Z
dc.date.available2025-01-06T17:43:45Z
dc.date.issued2021
dc.description.abstractIn this paper, we propose an approach for music emotion recognition based on convolutional long short term memory deep neural network (CLDNN) architecture. In addition, we construct a new Turkish emotional music database composed of 124 Turkish traditional music excerpts with a duration of 30 s each and the performance of the proposed approach is evaluated on the constructed database. We utilize features obtained by feeding convolutional neural network (CNN) layers with log-mel filterbank energies and mel frequency cepstral coefficients (MFCCs) in addition to standard acoustic features. Classification results show that the best performance is obtained when the new feature set is combined with the standard features using the long short term memory (LSTM) + deep neural network (DNN) classi fier. The overall accuracy of 99.19% is obtained using the proposed system with 10 fold cross-validation. Specifically, 6.45 points improvement is achieved. Additionally, the results also show that the LSTM + DNN classifier yields 1.61, 1.61 and 3.23 points improvements in music emotion recognition accuracies compared to k-nearest neighbor (k-NN), support vector machine (SVM), and Random Forest classifiers, respectively. (C) 2020 Karabuk University. Publishing services by Elsevier B.V.
dc.identifier.doi10.1016/j.jestch.2020.10.009
dc.identifier.endpage767
dc.identifier.issn2215-0986
dc.identifier.issue3
dc.identifier.scopus2-s2.0-85096857185
dc.identifier.scopusqualityQ1
dc.identifier.startpage760
dc.identifier.urihttps://doi.org/10.1016/j.jestch.2020.10.009
dc.identifier.urihttps://hdl.handle.net/20.500.14669/2773
dc.identifier.volume24
dc.identifier.wosWOS:000636739000003
dc.identifier.wosqualityQ1
dc.indekslendigikaynakWeb of Science
dc.indekslendigikaynakScopus
dc.language.isoen
dc.publisherElsevier - Division Reed Elsevier India Pvt Ltd
dc.relation.ispartofEngineering Science and Technology-An International Journal-Jestech
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/openAccess
dc.snmzKA_20241211
dc.subjectMusic emotion recognition
dc.subjectConvolutional long short term memory deep neural networks
dc.subjectTurkish emotional music database
dc.titleMusic emotion recognition using convolutional long short term memory deep neural networks
dc.typeArticle

Dosyalar