Stronger correlation of music features with brain signals predicts increased levels of enjoyment

Pankaj Pandey*, Poorva Satish Bedmutha, Krishna Prasad Miyapuram, Derek Lomas

*Corresponding author for this work

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

1 Citation (Scopus)
18 Downloads (Pure)

Abstract

Music recommendation systems struggle with predicting the aesthetic responses of listeners based solely on acoustic characteristics, which are dependent on the listener's perception. This research correlates acoustic music features with brain responses to report the neural aesthetic hypothesis that the intensity of an aesthetic experience can be decoded based on the degree of correlation to brain responses. We employ hybrid encoding-decoding model (Canonical Correlation Analysis) to identify music features that maximally covary with brain responses. EEG signals of 20 participants are analyzed while they listen to 12 songs and mark their enjoyment on a scale of 1 to 5. Firstly, 18 acoustic features are extracted from music signals and transformed into the first principal component (PC1). In addition, two other features used for analysis are root mean square (RMS) and Spectral Flux (Flux). The first principal canonical component (CC1) with PC1 determines significant (p<0.05) evidence of correlating with brain responses that increasing correlation reflects increased enjoyment. We consider each participant's average CC1 values and enjoyment rating over all 12 songs, followed by plotting a correlation graph to decode the relationship. We observe a significant (p<0.05) positive linear correlation with increasing CC1 scores of PC1 features against increased enjoyment rating. PC1 shows the maximum Pearson correlation (r = 0.48, p = 0.03). In addition, we segregate the brain responses based on low (1,2) and high (3,4) enjoyment ratings and find that higher CC1 values correspond to brain responses of high enjoyment and low values to low enjoyment in all three features. Our experiments reveal that Canonical correlation reflects music-induced pleasure and can be employed in EEG-enabled headphones to decode the user experience, leading to better recommendations.

Original languageEnglish
Title of host publicationAPSCON 2023 - IEEE Applied Sensing Conference, Symposium Proceedings
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages3
ISBN (Electronic)9781665461634
DOIs
Publication statusPublished - 2023
Event2023 IEEE Applied Sensing Conference, APSCON 2023 - Bengaluru, India
Duration: 23 Jan 202325 Jan 2023

Publication series

NameAPSCON 2023 - IEEE Applied Sensing Conference, Symposium Proceedings

Conference

Conference2023 IEEE Applied Sensing Conference, APSCON 2023
Country/TerritoryIndia
CityBengaluru
Period23/01/2325/01/23

Keywords

  • Aesthetic
  • CCA
  • EEG
  • Music

Fingerprint

Dive into the research topics of 'Stronger correlation of music features with brain signals predicts increased levels of enjoyment'. Together they form a unique fingerprint.

Cite this