Direct estimation of body weight through noncontact methods is crucial for applications such as health monitoring, surveillance, and robot-assisted casualty rescue. Existing methods for body weight estimation from images are often affected by various factors, such as camera distance, human orientation, and body posture, which ignore the fact that bodies typically inhabit 3-D space. To address the problem, we propose an approach for estimating body weight based on virtual anthropometric measurements and deep features instead of estimating by reasoning pixels. Specifically, we develop a three-branch framework that includes face feature extraction, body feature extraction, and deep feature extraction and maps all features with a regressor. The developed method adds 3-D shape reconstruction to explicitly reason about virtual anthropometric measurements. To enable this, our model is trained to robustly compute anthropometric measurements in various orientations and postures. Furthermore, we evaluate our method on a public dataset and Image-VM-BMI, a new dataset of 4740 images, including body mass index (BMI) labels and virtual anthropometric measurement labels with paired 3-D reconstruction. Extensive experimental results demonstrate that the proposed method outperforms pixel-based analysis approaches on BMI estimation.