Hyperspectral images (HSIs) must be preprocessed by a compression model, which reduces the pressure of storing and transmitting huge data in applications. Whereas most of the existing methods consider only the compression or reconstruction requirements, an end-to-end optimization would simultaneously improve the performance of both requirements. We propose a three-dimensional convolutional autoencoder that precisely achieves end-to-end joint spectral–spatial compression and reconstruction of HSIs. In an experimental evaluation, the proposed method improved the spectral angle mapper, peak signal-to-noise ratio, and structural similarity index measurement of the reconstructed HSIs by 20.8% to 33.1%, 0.9% to 11.5%, and 0.5% to 2.2%, respectively, relative to competitive methods.