In this paper, we present FEIF, a novel framework for 6D object pose estimation from a single RGBD image. Compared with previous approaches, this model fully leverages the complementary RGB and depth information through lay-erwise feature excitation and interactive fusion, thus improving the effectiveness and robustness of extracted features. The representative RGBD features can be subsequently applied for object keypoints prediction and pose computation. In addition, our FEIF includes a self-evaluation module to make robots aware of the confidence of pose estimation, so they are flexible to take the corresponding strategy for following tasks. Experiment results prove the SOTA performance of our model on LineMOD, Occlusion-LineMOD and YCB-Video datasets, and we also demonstrate its applicability and robustness in real-world robotic manipulation.