This paper proposes a robust algorithm to adapt a model for EEG signal classification using a modified Extended Kalman Filter (EKF). By applying Bayesian conjugate priors and marginalising the parameters, we can avoid the needs to estimate the covariances of the observation and hidden state noises. In addition, Laplace approximation is employed in our model to approximate non-Gaussian distributions as Gaussians.