High-frequency components are the most crucial parts of the visual signals for the task of image super resolution. The deep image super resolution networks that are able to process the high-frequency components efficiently can provide high performances. In view of this, in this letter, we develop a new residual block for image super resolution, in which the feature attention process is carried out by focusing on various high-frequency components of the feature tensors. Specifically, we design a novel multi-dimensional filter design technique for the task of image super resolution, and employ it for obtaining a finite impulse response (FIR) high-pass filter bank to be embedded in a deep super resolution network for the feature attention process. Moreover, we utilize two other feature attention processes in the proposed residual block, namely, multi-scale transformer-based and convolutional learnable feature attention mechanisms, to generate rich sets of feature maps for a deep super resolution network. The results of different experiments demonstrate the effectiveness of the various modules of the proposed residual block in enhancing the super resolution performance.