This letter introduces a novel methodology for letting a user interact with a robotic system in a natural manner. The main idea is that of defining an interaction system that does not require any specific infrastructure or device but relies on commonly utilized objects while leaving the user's hands free. Specifically, we propose to utilize a smartwatch (or any commercial sensorized wristband) for recognizing the motion of the user's forearm. This is achieved by measuring accelerations and angular velocities, which are then elaborated for recognizing gestures and for defining velocity commands for the robot. The proposed interaction system is evaluated experimentally with different users controlling a semiautonomous quadrotor. Results show that the usability and effectiveness of the proposed natural interaction system provide significant improvement in the human-robot interaction experience.