We introduce our initial design of gesture interface for the TV control of visually impaired users, with its implementation and user study. Two bare-hand gesture sets were designed using simple linear and circular motions of arms. For the two gesture sets, a rule-based recognition system was developed using a Kinect sensor. In a user study, the linear and circular gesture sets on our recognition system scored similarly and showed equal or better subjective ratings compared to the commercial pointer-type gesture interface. The users were negative at pointer-type gestures and showed their concerns about large motions of linear gestures and difficult matching of circular gestures.