The adaptive projected subgradient method offers a unified mathematical perspective for the adaptive (set-membership/set-theoretic) filtering schemes. In this paper, we introduce an overview of its recent theoretical advances and successful applications to robust signal processing problems including the stereo acoustic echo canceling, the MAI suppression in DS/CDMA receivers, and the robust adaptive beamforming with array antenna systems