Using spectra of hyperspectral remote sensing imagery to identify and classify land cover has been a hot topic thanks for its high resolution spectrum. However, when the quantity of labeled samples is too small, the classification accuracy of hyperspectral data will be reduced greatly. Most classification algorithms take dimensional reduction strategy and require plentiful labeled samples in order to learn the classifier that could then recognize a specific material. But in most remote sensing situations labeling samples is a costly task and the valued information would be lost with dimensional reduction. Sparse representation as a fast and effective algorithm has the advantages that it can perform quite well with small labeled samples without dimensional reduction. Therefore, we proposed a new framework to construct a graph-based semi-supervised model to solve paucity problem of labeled samples and combine the k nearest neighbor (knn) graph to take the advantage of space features. In this new model, sparse representation is used to build the probability matrix by estimating if a pairwise pixels belonging to the same class, and this probability matrix is integrated into ℓ¹norm graph to form a more discriminating graph called dℓ¹graph. Then we combine this dℓ¹graph with knn graph in proportion. The new graph can employ both spectral values and space information of hyperspectral data. We demonstrate the effectiveness of our proposal on the Indiana Pines hyperspectral data set and the results outperform state of the art.