For hyperspectral image, low spatial and spectral resolution will cause inaccurate object detection and classification. In this paper, a novel jointly spatial-spectral resolution enhancement algorithm is proposed to promote the spatial resolution and spectral resolution simultaneously, high spatial resolution information from panchromatic image is used as constraint in spectral enhancement while the high spectral resolution details are benefited for spatial enhancement, which makes spatial SR and spectral SR promote each other. The experiments prove that our algorithm can provide joint spatial-spectral enhanced results, which can outperform the state-of-art methods both in spatial and spectral domains.