Music has been proven to be a valuable tool for the understanding of human cognition, human emotion, and their underlying brain mechanisms. The objective of this study is to analyze the effect of Hindustani music on brain activity during normal relaxing conditions using electroencephalography (EEG). Ten male healthy subjects without special musical education participated in the study. EEG signals were acquired at the frontal (F3/F4) lobes of the brain while listening to music at three experimental conditions (rest, with music and without music). Frequency analysis was done for the alpha, theta and gamma brain rhythms. The finding shows that arousal based activities were enhanced while listening to Hindustani music of contrasting emotions (romantic/sorrow) for all the subjects in case of alpha frequency bands while no significant changes were observed in gamma and theta frequency ranges. It has been observed that when the music stimulus is removed, arousal activities as evident from alpha brain rhythms remain for some time, showing residual arousal. This is analogous to the conventional 'Hysteresis' loop where the system retains some 'memory' of the former state. This is corroborated in the non linear analysis (Detrended Fluctuation Analysis) of the alpha rhythms as manifested in values of fractal dimension. After an input of music conveying contrast emotions, withdrawal of music shows more retention as evidenced by the values of fractal dimension. (C) 2015 Elsevier B.V. All rights reserved.