Video representation through key frames is suitable for the purpose of video retrieval or browsing in limited storage or transmission bandwidth environments. In this case, the controllability of the total key frame number depending on the storage or bandwidth capacity is an important requirement for the key frame selection method. In this paper, we present a sequential key frame selection method when the number of key frames is given as a constraint. Experimental result demonstrates the improved performance of our algorithm over the existing approaches.