A fast means of object segmentation in a video sequence using low-level features existing in the compressed video stream is presented. These features include the DCT coefficient values of I-frames and motion vectors. The work described here is the foundation of a spatial segmentation system that approaches real time. Potential applications for the system include the separation of foreground and background objects and video database searching.