In this paper, we present a novel buffer cache management scheme for video-on-demand servers called hybrid buffer cache management (HBM). We carefully argue that multimedia workload may exhibit characteristics other than sequential access pattern. If the access pattern is not sequential, the legacy buffer cache schemes that are grounded on the assumption that the applications sequentially access the multimedia file may not work properly. The HBM automatically detects the reference patterns of each file and intelligently switches between different buffer cache management schemes on per-file basis. According to our experiment, the HBM exhibits better buffer cache hit ratio than interval based caching or LRU, especially when the workload exhibits not only sequential but also looping reference property.