This paper deals with the design and adaptation of the response displayed by an interactive photo frame application. The user of the system is monitored with a camera, and based on the user's facial expressions and activity levels, the system selects its response, and in time, fine-tunes it to the particular user. A user study is conducted showing that the user adaptation significantly increases the responsiveness of the system.