This paper proposes a continuous and unsupervised approach of monitoring the arousal trend of an individual from his heart rate using Kalman Filter. The state-space model of the filter characterizes the baseline arousal condition. Deviations from this baseline model are used to recognize the arousal trend. A publicly available dataset, DECAF, comprising the physiological responses of 30 subjects while watching 36 movie clips inducing different emotions, is used to validate the proposed technique. For each clip, annotations of arousal given by experts per second are used to quantify the ground truth of arousal change. Experimental results suggest that the proposed algorithm achieves a median correlation of 0.53 between the computed and expected arousal levels which is significantly higher than that achievable by the state-of-the-art technique.