Elsevier

Automatica

Volume 49, Issue 6, June 2013, Pages 1601-1613
Automatica

Generalized adaptive comb filters/smoothers and their application to the identification of quasi-periodically varying systems and signals

https://doi.org/10.1016/j.automatica.2013.02.037Get rights and content

Abstract

The problem of both causal and noncausal identification of linear stochastic systems with quasi-harmonically varying parameters is considered. The quasi-harmonic description allows one to model nonsinusoidal quasi-periodic parameter changes. The proposed identification algorithms are called generalized adaptive comb filters/smoothers because in the special signal case they reduce down to adaptive comb algorithms used to enhance or suppress nonstationary harmonic signals embedded in noise. The paper presents a thorough statistical analysis of generalized adaptive comb algorithms, and demonstrates their statistical efficiency in the case where the fundamental frequency of parameter changes varies slowly with time according to the integrated random-walk model.

Introduction

We will consider the problem of identification of quasi-periodically varying complex-valued systems governed by y(t)=i=1nθi(t)u(ti+1)+v(t)=φT(t)θ(t)+v(t) where t=1,2, denotes the normalized discrete time, y(t) denotes the system output, φ(t)=[u(t),,u(tn+1)]T denotes regression vector, made up of the past input samples, v(t) denotes measurement noise, and θ(t)=[θ1(t),,θn(t)]T is the vector of time-varying system coefficients, modeled as weighted sums of complex exponentials θ(t)=k=1Kβk(t)eji=1tωk(i)βk(t)=[bk1(t),,bkn(t)]Tbki(t)=aki(t)ejνki,i=1,,n. The following three types of real-valued quantities are incorporated in (2): the instantaneous angular frequencies ωk(t), the instantaneous amplitudes aki(t), and the time-invariant phase shifts νki. With a slight abuse of terminology, the complex-valued vectors βk(t) will be further referred to as ‘complex amplitudes’.

Under certain circumstances (in the presence of several strong reflectors) the model (1)–(2) can be used to describe rapidly fading mobile radio channels (Bakkoury et al., 2000, Giannakis and Tepedelenlioǧlu, 1998, Tsatsanis and Giannakis, 1996). In this case y(t) denotes the sampled baseband signal received by the mobile unit, {u(t)} denotes the sequence of transmitted symbols, and v(t) denotes channel noise.

We will assume that the frequencies ωk(t) are harmonically related, namely ωk(t)=mkω0(t),k=1,,K where ω0(t) denotes the slowly varying fundamental frequency and mk are integer numbers. Such multiple frequencies, called harmonics, appear in the Fourier series expansions of periodic signals. For example, if parameter trajectory θ(t) is periodic with period L, it admits the following Fourier representation: θ(t)=k=0L1βkejkω0t,ω0=(2π)/L.

The notion of ‘time-varying harmonics’ can be regarded as a natural extension of the Fourier analysis to quasi-periodically varying systems, such as (1)–(2). The choice of the multipliers mk,k=1,,K, depends on our prior knowledge of the system time variation. When all harmonics are expected to be present, one should set mk=k. In the presence of odd harmonics only, the natural choice is mk=2k1, etc.

In the special case where n=1 and φ(t)1, Eqs. (1), (2), (3) describe a complex-valued harmonic signal s(t)=θ(t) buried in noise y(t)=s(t)+v(t),s(t)=k=1Kbk(t)eji=1tωk(i). The problem of either elimination or extraction of harmonic signals buried in noise can be solved using adaptive comb filters (Nehorai and Porat, 1986, Regalia, 1995). For this reason the system identification/tracking algorithm described below can be considered a generalized comb filter.

The problem of causal identification (tracking) of single-mode quasi-periodically varying systems was studied in Niedźwiecki and Kaczmarek, 2004, Niedźwiecki and Kaczmarek, 2005a, Niedźwiecki and Kaczmarek, 2005b.

In the recent conference paper (Niedźwiecki & Meller, 2011a), the results presented earlier were extended to noncausal identification (smoothing). Additionally, a more sophisticated frequency estimation scheme was proposed, incorporating frequency rate tracking/smoothing and yielding better results in practice.

All papers published so far focus on the identification of single-mode systems, i.e., systems with parameters that can be modeled as complex sinusoids (cisoids) with slowly varying amplitudes and a slowly varying instantaneous frequency.

This paper extends results presented in Niedźwiecki and Meller (2011a) to nonstationary systems with quasi-harmonically varying parameters, i.e., to systems with several frequency modes governed by the same slowly varying fundamental frequency. In practice such harmonic modes of variation often arise in oscillatory systems with nonlinear elements and/or loads (Neimark, 2003).

In principle, quasi-harmonically varying systems can be identified using the multiple-frequency versions of the algorithms mentioned above. Such algorithms are made up of several single-frequency sub-algorithms that work in parallel and are driven by the common prediction error. Since the estimated frequencies are in this case regarded as mutually unrelated quantities, the harmonic structure of the system/signal time variation is not exploited in any way. In this paper we present algorithms that take advantage of such a prior information, i.e., the algorithms that perform a coordinated frequency search. This allows one to improve estimation results considerably.

Section snippets

Generalized adaptive notch filter — overview of known results

Suppose that the identified nonstationary system has a single frequency mode (K=1), i.e., it is governed by y(t)=φT(t)θ(t)+v(t),θ(t)=β(t)eji=1tω(i) where β(t)=[b1(t),,bn(t)]T and ω(t)(π,π] are slowly varying quantities. Furthermore, suppose that:

  • (A1)

    The measurement noise {v(t)} is a zero-mean circular white sequence with variance σv2.

  • (A2)

    The sequence of regression vectors {φ(t)}, independent of {v(t)}, is nondeterministic, wide-sense stationary and ergodic with known correlation matrix2

Multiple-frequency GANF

Denote by yk(t)=φT(t)θk(t)+v(t), where θk(t)=fk(t)βk(t), and f̂k(t) is an estimate of fk(t)=eji=1tωk(i), the output of this subsystem of (1) which is associated with the frequency ωk. If the signals y1(t),,yK(t) were measurable, one could design K independent GANF algorithms of the form (6), each taking care of a particular subsystem. Since it holds that θ(t)=k=1Kθk(t), the final parameter estimate could be easily obtained by combining the partial estimates.

Even though the outputs yk(t) are

Generalized adaptive comb filter

In order to arrive at the algorithm which performs a coordinated search of the instantaneous fundamental frequency ω0(t), one should minimize J(t) for ϵ(t)=y(t)φT(t)k=1Kfk(t)β̂k(t1) where fk(t)=eji=1tωk(i)=ejmki=1tω0(i). Note that J(t)ω0(t)=Re[jϵ(t)φH(t)k=1Kmkfk(t)β̂k(t1)]=k=1KmkIm[ϵ(t)φT(t)fk(t)β̂k(t1)]. This leads to the following recursive estimation scheme which will be further referred to as a generalized adaptive comb filter (GACF) f̂k(t)=ejmk[ω̂0(t1)+α̂0(t1)]f̂k(t1)ε(t)=

Generalized adaptive comb smoother

The important consequence of the fact that the approximate error equations (13)–(14) are identical with those derived in Niedźwiecki and Meller (2011a) for systems with a single frequency mode of parameter variation, is that the smoothing technique proposed there is directly applicable to the multiple-frequency case. Following Niedźwiecki and Meller (2011a), suppose that a pre-recorded data block Ω(N)={y(i),φ(i),i=1,,N} of length N is available, which is typical of off-line applications,

Optimization and Cramér–Rao bounds

Consider a system (1), (2), (3) with pseudo-linear frequency changes. In order to achieve the best tracking/smoothing results, the adaptation gains of the GACF/GACS algorithms should be chosen so as to trade-off the bias and variance components in (19)–(20) and (21)–(22). Such optimal settings depend exclusively on the balance between the bias and variance error components, determined by the scalar coefficient κ=E[w2(t)]2E[e02(t)]Tb02σδ2σv2=ESNRσδ2 further referred to as the rate of

ALF-based analysis

To check the validity of the analytical expressions (19)–(20), based on the approximating linear filter equations (13)–(14), the following two-tap FIR system (inspired by channel equalization applications) was simulated y(t)=θ1(t)u(t)+θ2(t)u(t1)+v(t) where u(t) denotes a white 4-QAM [quadrature amplitude modulation — see e.g. Giannakis and Tepedelenlioǧlu (1998)] input sequence (u(t)=±1±j,σu2=2) and v(t) denotes a complex-valued Gaussian measurement noise.

Each of n=2 impulse response

Conclusion

The problem of identification of linear stochastic systems with quasi-harmonically varying parameters was considered. Both causal and noncausal identification algorithms were derived, referred to as generalized adaptive comb filters (GACFs) and generalized adaptive comb smoothers (GACSs), respectively. In both cases the frequency and frequency rate estimation properties of the proposed algorithms were analyzed using the method of approximating linear filter. It was shown, and later confirmed by

Maciej Niedźwiecki was born in Poznań, Poland in 1953. He received the M.Sc. and Ph.D. degrees from the Gdańsk University of Technology, Gdańsk, Poland, and the Dr. Hab. (D.Sc.) degree from the Technical University of Warsaw, Warsaw, Poland, in 1977, 1981 and 1991, respectively.

He spent three years as a Research Fellow with the Department of Systems Engineering, Australian National University from 1986 to 1989. From 1990 to 1993 he served as a Vice-Chairman of the Technical Committee on Theory

References (17)

  • J. Bakkoury et al.

    Adaptive MLSE receiver over rapidly fading channels

    Signal Processing

    (2000)
  • M. Niedźwiecki et al.

    Estimation and tracking of quasi-periodically varying systems

    Automatica

    (2005)
  • G.B. Giannakis et al.

    Basis expansion models and diversity techniques for blind identification and equalization of time-varying channels

    Proceedings of the IEEE

    (1998)
  • B. James et al.

    Conditional mean and maximum likelihood approaches to multiharmonic frequency estimation

    IEEE Transactions on Signal Processing

    (1994)
  • M. Jury

    Theory and application of the Z-transform method

    (1964)
  • Y. Kurumi et al.

    MR-guided microwave ablation for malignancies

    International Journal of Clinical Oncology

    (2007)
  • A. Nehorai et al.

    Adaptive comb filtering for harmonic signal enhancement

    IEEE Transactions on Acoustics, Speech and Signal Processing

    (1986)
  • J.I. Neimark

    Mathematical models in natural sciences and engineering

    (2003)
There are more references available in the full text version of this article.

Cited by (6)

  • Separated periodic/aperiodic state feedback control using periodic/aperiodic separation filter based on lifting

    2019, Automatica
    Citation Excerpt :

    A periodic/aperiodic separation filter (PASF), which separates a state into the periodic and aperiodic states, is constructed from the definition of the periodic and aperiodic states using the lifting technique. Comb filters are well-known for eliminating periodic elements, as in Dolecek and Fernandez-Vazquez (2014), Liu and Declercq (2017), Niedźwiecki and Meller (2013) and Tahir and Mazumder (2014). However, the comb filters are not suitable for the separation because they do not consider aperiodic signals.

  • Pulsed ultrasonic comb filtering effect and its applications in the measurement of sound velocity and thickness of thin plates

    2017, Ultrasonics
    Citation Excerpt :

    In the auditory physiological and psycho-physical studies, it is even applied for generating noises [12]. As an algorithm of signal processing, its application for separating mixed signals [13], tracking slow changes in system frequencies [14,15], improving sensor performance [16] and GPS code tracking performance [17] have been investigated. The most recent research is focused on its application in optics [18], electronics [19] and photonics [20].

  • Active Suppression of Nonstationary Narrowband Acoustic Disturbances

    2021, Studies in Systems, Decision and Control
  • Estimation of nonstationary harmonic signals and its application to active control of MRI noise

    2013, ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Maciej Niedźwiecki was born in Poznań, Poland in 1953. He received the M.Sc. and Ph.D. degrees from the Gdańsk University of Technology, Gdańsk, Poland, and the Dr. Hab. (D.Sc.) degree from the Technical University of Warsaw, Warsaw, Poland, in 1977, 1981 and 1991, respectively.

He spent three years as a Research Fellow with the Department of Systems Engineering, Australian National University from 1986 to 1989. From 1990 to 1993 he served as a Vice-Chairman of the Technical Committee on Theory of the International Federation of Automatic Control (IFAC). He is currently a Professor and Head of the Department of Automatic Control, Faculty of Electronics, Telecommunications and Computer Science, Gdańsk University of Technology. His main areas of research interest include system identification, statistical signal processing and adaptive systems. He is the author of the book Identification of Time-varying Processes (Wiley, 2000).

Dr. Niedźwiecki is currently Associate Editor for IEEE Transactions on Signal Processing, a member of the IFAC committees on Modeling, Identification and Signal Processing and on Large Scale Complex Systems, and a member of the Automatic Control and Robotics Committee of the Polish Academy of Sciences (PAN).

Michał Meller received the M.Sc. and Ph.D. degrees in Automatic Control from the Gdańsk University of Technology, Gdańsk, Poland, in 2007 and 2010, respectively. Since 2007 he has been working in the Department of Signal and Information Processing, Bumar Elektronika, Gdańsk Division. In 2010 he also joined the Department of Automatic Control at the Gdańsk University of Technology, Faculty of Electronics, Telecommunications and Computer Science. His professional interests include signal processing and adaptive systems.

This work was supported by the National Science Center. The material in this paper was not presented at any conference. This paper was recommended for publication in revised form by Associate Editor Wolfgang Scherrer under the direction of Editor Torsten Söderström.

1

Tel.: +48 58 3472519; fax: +48 58 3415821.

View full text