Skip to main content
Log in

Convergence analysis of central and minimax algorithms in scalar regressor models

  • Published:
Mathematics of Control, Signals and Systems Aims and scope Submit manuscript

Abstract

In this paper, the estimation of a scalar parameter is considered with given lower and upper bounds of the scalar regressor. We derive non-asymptotic, lower and upper bounds on the convergence rates of the parameter estimate variances of the central and the minimax algorithms for noise probability density functions characterized by a thin tail distribution. This presents an extension of the previous work for constant scalar regressors to arbitrary scalar regressors with magnitude constraints. We expect our results to stimulate further research interests in the statistical analysis of these set-based estimators when the unknown parameter is multi-dimensional and the probability distribution function of the noise is more general than the present setup.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Abramowitz M, Stegun IA (1972) Handbook of mathematical functions with formulas, graphs, and mathematical Tables. vol 55. Applied Mathematics Series, National Bureau of Standards, Washington

  2. Akçay H (2004) The size of the membership-set in a stochastic framework. Automatica 40:253–260

    Google Scholar 

  3. Akçay H, Ninness B (1998) Rational basis functions for robust identification from frequency and time domain measurements. Automatica 34:1101–1117

    Google Scholar 

  4. Akçay H, Hjalmarsson H, Ljung L (1996) On the choice of norms in system identification. IEEE Trans Automat Control 41:1367–1372

    Google Scholar 

  5. At N, Akçay H (2004) Central and projection algorithms in set membership identification with periodic inputs. In: Proceedings of the 43rd IEEE Conference on Decision and Control, Paradise Island, Bahamas, pp 5188–5191

  6. Bai EW (2002) An optimization based robust identification algorithm in the presence of outliers. J Global Optim 23:195–211

    Google Scholar 

  7. Bai EW, Tempo R, Cho H (1995) Membership set estimators: size, optimal inputs, complexity and relations with least squares. IEEE Trans Circuits Syst I: Fundamental Theory Appl 42:266–277

    Google Scholar 

  8. Bai EW, Cho H, Tempo R (1998) Convergence properties of the membership set. Automatica 34:1245–1249

    Google Scholar 

  9. Bai EW, Ye Y, Tempo R (1999) Bounded error parameter estimation: a sequential analytic center approach. IEEE Trans Automat Control 44:1107–1117

    Google Scholar 

  10. Bai EW, Fu M, Tempo R, Ye Y (2000) Convergence results of the analytic center estimator. IEEE Trans Automat Control 45:569–572

    Google Scholar 

  11. Bai EW, Cho HT, Tempo R, Ye YY (2002) Optimization with few violated constraints for linear bounded error parameter estimation. IEEE Trans Automat Control 47:1067-1077

    Google Scholar 

  12. Campi MC, Weyer E (2002) Finite sample properties of system identification methods. IEEE Trans Automat Control 47:1329–1334

    Google Scholar 

  13. Campi MC, Ooi SK, Weyer E (2004) Non-asymptotic quality assessment of FIR models with periodic input. Automat 12:2029–2041

    Google Scholar 

  14. Dahleh MA, Theodosopoulos T, Tsitsiklis JN (1993) The sample complexity of worst-case identification of FIR linear systems. Syst Control Lett 20:157–166

    Google Scholar 

  15. David HA (1981) Order statistics. Wiley, New York

  16. Harrison KJ, Ward JA, Gamble DK (1996) Sample complexity of worst-case identification. Syst Control Lett 27:255–260

    Google Scholar 

  17. Harrison KJ, Partington JR, Ward JA (1998) Complexity of identification of linear systems with rational transfer functions. Math Control Signals and Sysems 11:265–288

    Google Scholar 

  18. Kacewicz B, Milanese M (1995) Optimality properties in finite sample ℓ1 identification with bounded noise. Int J Adapt Control Signal Process 9:87–96

    Google Scholar 

  19. Ljung L (1999) System Identification: theory for the user, 2nd edn. Prentice-Hall, Englewood Cliffs, NJ, USA

  20. Mäkilä PM (1991) Robust identification and Galois sequences. Int J Control 54:1189–1200

    Google Scholar 

  21. Milanese M, Tempo R (1995) Optimal algorithms theory for robust estimation and prediction. IEEE Trans Automat Control 30:730–738

    Google Scholar 

  22. Partington JR (1994) Worst-case identification in ℓ2: linear and non-linear algorithms. Syst Control Lett 22:93–98

    Google Scholar 

  23. Partington JR (1994) Interpolation in normed spaces from the values of linear functionals. Bull London Math Soc 26:165–170

    Google Scholar 

  24. Partington JR, Mäkilä PM (1995) Worst-case analysis of the least-squares method and related identification methods. Syst Control Lett 24:193–200

    Google Scholar 

  25. Poolla K, Tikku A (1994) On the time complexity of worst-case system identification. IEEE Trans Automat Control 39:944–950

    Google Scholar 

  26. Traub JF, Wasilkowski GW, Wozniakowski H (1988) Information based complexity theory. Academic Press, New York

  27. Veres SM, Norton JP (1991) Structure selection for bounded-parameter models: consistency conditions and selection criterion. IEEE Trans Automat Control 36:474–481

    Google Scholar 

  28. Weyer E, Williamson RC, Mareels IMY (1999) Finite sample properties of linear model identification. IEEE Trans Automat Control 44:1370–1383

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hüseyin Akçay.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Akçay, H., At, N. Convergence analysis of central and minimax algorithms in scalar regressor models. Math. Control Signals Syst. 18, 66–99 (2006). https://doi.org/10.1007/s00498-005-0162-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00498-005-0162-7

Keywords

Navigation