Two novel schemes are proposed to represent intermediate-scale features for normal-abnormal classification of colonoscopy images. The first scheme works on the full-resolution image, the second on a multi-scale pyramid space. Both schemes support any feature descriptor; here we use multi-resolution local binary patterns which outperformed other features reported in the literature in our comparative experiments. We also compared experimentally two types of features not previously used in colonoscopy image classification, bag of features and sparse coding, each with and without spatial pyramid matching (SPM). We find that SPM improves performance, therefore supporting the importance of intermediate-scale features as in the proposed schemes for classification. Within normal-abnormal frame classification, we show that our representational schemes outperforms other features reported in the literature in leave-N-out tests with a database of 2100 colonoscopy images.