Agriculture is critical to ensuring and securing food supply for human consumption. Paddy crops are an agricultural practice that produces one of the highest food yields in agriculture. Paddy diseases must now be detected and diagnosed as soon as possible rather than later. Farmers currently use the naked eye to observe suspected infected paddies. The suspected infected paddy will then be sampled and sent to the laboratory for further examination. These methods are highly inefficient, time-consuming, and error prone. Most paddy farmers lack the knowledge to make an informed and accurate diagnosis of which paddies are infected by which diseases. This paper explores using deep learning algorithms to detect and classify various paddy diseases automatically. This method will take an image of paddy leaves and classify it based on the disease category indicated by the idea. The PaddyDoctor dataset from the Kaggle website was used to train and test the deep-learning models. Convolutional Neural Network (CNN) and Transfer Learning models, including MobileNet, MobileNetv2, and InceptionV3, have been constructed. The results of an experiment involving different dataset split ratios, learning rates, and batch sizes. CNN with MobileNetV2 outperformed CNN with MobileNetV1 and CNN with InceptionV3 by 98.05 percent, 80.08 percent, and 83.98 percent, respectively.