The automation scenario in the current industrial as well as domestic applications has seen an exponential growth over the decade. Robot plays an important role in industrial automation but in some cases, it needs some extent of human intervention in quality inspection. This paper focuses on solving problems related to defect identification and segregation of fruits using 3-DOF articulated robot configuration with the integration of machine vision system and deep learning algorithms. To perceive the features of object, A USB camera is utilized. The machine vision algorithm will next use a variety of methods for processing digital images to extract the relevant data and decide whether to continue processing the product, redirect it to a different stage of production, or just throw it away. In recent days, the advancement in deep learning leads to the phenomenal growth in computer vision. There are many state-of-the-art object detection algorithms available in deep learning technology and we are using Inception-V3 algorithm that can be used for the machine vision operation in our solution. Based on the results from the algorithm, segregation operation is carried out successfully.