Abstract
Mining of music data is one of the most important problems in multimedia data mining. In this paper, two research issues of mining music data, i.e., online mining of music query streams and change detection of music query streams, are discussed. First, we proposed an efficient online algorithm, FTP-stream (Frequent Temporal Pattern mining of streams), to mine all frequent melody structures over sliding windows of music melody sequence streams. An effective bit-sequence representation is used in the proposed algorithm to reduce the time and memory needed to slide the windows. An effective list structure is developed in the FTP-stream algorithm to overcome the performance bottleneck of 2-candidate generation. Experiments show that the proposed algorithm FTP-stream only needs a half of memory requirement of original melody sequence data, and just scans the music query stream once. After mining frequent melody structures, we developed a simple online algorithm, MQS-change (changes of Music Query Streams), to detect the changes of frequent melody structures in current user-centered music query streams. Two music melody structures (set of chord-sets and string of chord-sets) are maintained and four melody structure changes (positive burst, negative burst, increasing change and decreasing change) are monitored in a new summary data structure, MSC-list (a list of Music Structure Changes). Experiments show that the MQS-change algorithm is an effective online method to detect the changes of music melody structures over continuous music query streams.

















Similar content being viewed by others
References
Agrawal R, Srikant R (1994) Fast algorithms for mining association rules. In: Proc. VLDB, pp 487–499
Babcock B, Babu S, Data M, Motwani R, Widom J (2002) Models and issues in data stream systems. In: Proc. PODS, pp 1–16
Bakhmutora V, Gusev VU, Titkova TN (1997) The search for adaptations in song melodies. Comput Music J 21(1):58–67. doi:10.2307/3681219
Chang JH, Lee WS (2003) Finding recent frequent itemsets adaptively over online data streams. In: Proc. KDD, pp 487–492
Chang JH, Lee WS (2004) A sliding window method for finding recently frequent itemsets over online data streams. J Inform Sci Eng (JISE) 20(4):753–762
Chi Y, Wang H, Yu P, Muntz R (2004) MOMENT: maintaining closed frequent itemsets over a stream sliding window. In: Proc. ICDM, pp 59–66
Dong G, Han J, Lakshmanan LVS, Pei J, Wang H, Yu PS (2003) Online mining of changes from data streams: research problems and preliminary results. In: Proc. ACM SIGMOD-MPDS
Gaber MM, Zaslavsky A, Krishnaswamy S (2005) Mining data streams: a review. SIGMOD Rec 34(1):18–26
Hsu J-L, Liu C-C, Chen ALP (2001) Discovering nontrivial repeating patterns in music data. IEEE Trans Multimed 3(3):311–325. doi:10.1109/6046.944475
Jones GT (1974) Music theory. Harper & Row, New York
Li H-F, Lee S-Y, Shan M-K (2004) Mining frequent closed structures in streaming melody sequences. In: Proc. ICME
Li H-F, Lee S-Y, Shan M-K (2005) Online mining maximal frequent structures in continuous landmark melody streams. Pattern Recognit Lett 26(11):1658–1674. doi:10.1016/j.patrec.2005.01.016
Li H-F, Lee S-Y, Shan M-K (2005) Online mining changes of items over continuous append-only and dynamic data streams. J Univers Comput Sci 11(8):1411–1425
Shan M-K, Kuo F-F (2003) Music style mining and classification by melody. IEICE Trans Inform Syst E 86-D(4):655–659
Yoshitaka A, Ichikawa T (1999) A survey on content-based retrieval for multimedia databases. IEEE Trans Knowl Data Eng 11(1):81–93. doi:10.1109/69.755617
Acknowledgements
The authors thank the reviewers’ precious comments for improving the quality of the paper. We would like to thank Dr. Yun Chi for contributing the source codes of Moment algorithm (MomentFP). The research is supported in part by the National Science Council, Project No. NSC 96-2218-E-424-001-, Taiwan, Republic of China.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, HF. Pattern discovery and change detection of online music query streams. Multimed Tools Appl 41, 287–304 (2009). https://doi.org/10.1007/s11042-008-0229-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-008-0229-9