The experimental work is carried out in Jupiter notebook in the Anaconda environment. Python packages like Keras, pandas, etc. are used to develop the model. After 25 epochs of training, the ResNet50 model obtained a 0.0178 loss and a 99.81% accuracy on the training set (Fig 4). This high accuracy implies that the model was successfully trained to categorize images of bean leaf diseases and healthy leaves with minimum error on the training data. For the validation set, the model had a loss of 0.1161 and an accuracy of 93.23%. While the validation accuracy is slightly lower than the training accuracy, it performs well in differentiating between diverse classes, such as leaf diseases and healthy leaves. The difference between training and validation metrics indicates that the model generalizes effectively, while there may be potential for improvement in managing unknown data or decreasing overfitting.
After 25 epochs of training, the VGG19 model obtained a training loss of 0.3173 and an accuracy of 89.17% on the training set. This suggests that the model performed well in categorizing images of bean leaf diseases and healthy leaves, but with a larger error rate than the ResNet50 model. On the validation set, the VGG19 model had a 0.2118 loss and an accuracy of 94.74%. This greater validation accuracy compared to training accuracy shows that the VGG19 model generalizes well to new data and distinguishes well across classes. The higher validation performance over training accuracy suggests that the model is more resilient and less susceptible to overfitting than the ResNet50 model.
The ResNet50 and VGG19 models’ performance was assessed using confusion matrices, which offer information on their classification accuracy for bean leaf diseases such as Angular Leaf Spot, Rust and Healthy leaves (Fig 5). The ResNet50 model exhibited good accuracy, with 41 true positives for Angular Leaf Spot, 38 for Rust and 41 for Healthy, proving its ability to discriminate between these classes with few misclassifications. It misclassified just two Angular Leaf Spots as Rust and one Healthy leaf as Rust, demonstrating its effectiveness in class identification and differentiation.
In comparison, the VGG19 model accurately recognized 40 Angular Leaf Spot, 37 Rust and 40 Healthy pictures. However, it revealed a little more misunderstanding, with three Angular Leaf Spot photos mislabeled as Rust and two Healthy images mistakenly labeled as Angular Leaf Spot. Compared to ResNet50, the VGG19 model has a greater rate of misclassification, notably between Rust and other classes.
Error analysis revealed that most misclassifications occurred between Angular Leaf Spot and Rust classes, indicating that these diseases share similar visual symptoms in certain leaf images. A small number of healthy leaves were also incorrectly classified as diseased leaves. These errors may be attributed to variations in lighting conditions, image quality, disease severity and symptom overlap. Despite these challenges, ResNet50 exhibited fewer misclassifications than VGG19, suggesting a greater ability to extract discriminative disease-related features.
The performance of the ResNet50 and VGG19 models was evaluated using four essential classification metrics (Table 1 and Fig 6). The findings show that ResNet50 performs well in comparison to VGG19 in most tests. ResNet50 achieved 89.13% accuracy and 95.35% recall for Angular Leaf Spot, resulting in an F1-score of 92.13%, whereas VGG19 achieved slightly lower precision (86.96%) and recall (93.02%), with an F1-score of 89.89%. This demonstrates that ResNet50 is slightly more accurate in differentiating Angular Leaf Spot, despite VGG19 having a high F1-score in this class. ResNet50 performed well in the Rust classification, with an accuracy of 92.68%, recall of 88.37% and an F1-score of 90.48%. VGG19 showed comparable accuracy (92.50%) but lesser recall (86.05%), yielding an F1-score of 89.16%. This shows that, although both models perform well, ResNet50 marginally exceeds VGG19 in properly finding Rust instances.
ResNet50 attained a good precision of 100.00% and recall of 97.62% for healthy leaves, with an F1-score of 98.80%. In comparison, VGG19 achieved a precision of 95.24% and a recall of 95.24%, yielding an F1-score of 95.24%. This reveals that ResNet50 is better at recognizing healthy leaves with greater accuracy and a better mix of precision and recall.
Overall, ResNet50 performed well than VGG19 (91.41%) with an accuracy of 93.75%. ResNet50 had greater accuracy and better macro and weighted averages (precision: 93.94%, recall: 93.78%, F1-score: 93.80%), indicating better overall performance. Although competitive, VGG19 has slightly lower average metrics (precision: 91.56%, recall: 91.44%, F1-score: 91.43%) and total accuracy. This comparison research demonstrates ResNet50’s stronger classification skills, notably in recognizing Angular Leaf Spot and Healthy leaves. The good performance of ResNet50 may be attributed to its residual learning architecture, which facilitates efficient gradient propagation and enables the extraction of more representative features from complex leaf images.
The performance of the ResNet50 and VGG19 models to distinguish between classes of bean leaf disease was examined by analyzing their ROC curves (Fig 7). AUC values of 0.95 for Angular Leaf Spot, 0.92 for Rust and 0.99 for Healthy leaves were shown by the ROC curve for ResNet50. ResNet50 differentiates effectively between classes. It performed well in the classification of healthy leaves. Comparatively, VGG19 showed a slightly lower ROC curve performance, with AUC values of 0.96 for healthy leaves, 0.91 for rust and 0.93 for angular leaf spots. Although VGG19 also exhibits good performance, its AUC values are slightly lower than ResNet50’s, especially when it comes to the categorization of Rust and Angular Leaf Spot. This implies that, in comparison to ResNet50, VGG19 may have a greater false positive rate or lower sensitivity.
The ability of the developed models was further evaluated using 5-fold cross-validation. ResNet50 achieved fold accuracies of 93.75%, 93.75%, 95.09%, 95.54% and 94.62%, resulting in a mean accuracy of 94.55±0.71% and a mean F1-score of 94.54±0.72%. In comparison, VGG19 achieved fold accuracies of 87.95%, 85.27%, 91.52%, 89.73% and 91.03%, yielding a mean accuracy of 89.10 ± 2.28% and a mean F1-score of 88.80±2.52%. The lower standard deviation observed for ResNet50 indicates more stable performance across different data partitions compared with VGG19.
A paired Student’s t-test was conducted using the fold-wise accuracies of the two models. The analysis yielded a t-statistic of 6.014 and a p-value of 0.0039. Since the p-value was less than 0.05, the difference in classification performance between ResNet50 and VGG19 was statistically significant. These findings suggest that ResNet50 consistently provided superior classification performance for bean leaf disease identification under the experimental conditions considered in this study.
Table 2 presents a summary of the performance of several models for the categorization of bean leaf disease, comparing our findings with those of earlier studies. The comparison with other well-known models in the area shows the effectiveness of the ResNet50 and VGG19 models used in this study.
Elfatimi et al., (2022) explored the use of MobileNetV2 model for classifying bean leaf diseases. The MobileNetV2 model achieved a classification accuracy of approximately 92% using a dataset of 1296 images. This result illustrates MobileNetV2’s ability to handle bean leaf disease classification tasks well, but significantly lower than the accuracy attained by the presented ResNet50 model.
Kumar et al., (2022) also employed MobileNetV2 to classify bean leaf diseases on a dataset of 1295 images. Their study reported a slightly higher accuracy of 93.54% for MobileNetV2 compared to
Elfatimi et al., (2022) indicating a slight performance improvement.
Abed et al., (2021) presented a comprehensive deep-learning framework for bean leaf disease identification using multiple models, including Densenet121, ResNet34, ResNet50, VGG-16 and VGG-19. The study used a dataset of 1295 images and evaluated the models’ performance in binary and multi-class classification. Densenet121 achieved the highest accuracy with a Classification Accuracy Rate (CAR) of 98.31% for binary classification and 91.01% for multi-class classification. Among the models tested, ResNet50 achieved notable performance with a CAR of 91.01% in the multi-class classification scenario.
Sahu et al., (2021) investigated GoogleNet and VGG16 for classifying bean leaf diseases. With a dataset of 1296 images, GoogleNet performed better than VGG16, achieving an accuracy of 95.31%. This indicates that GoogleNet was particularly effective for this classification task, surpassing VGG16 in accuracy.
In this study, two models ResNet50 and VGG19 were evaluated on a dataset of 1295 bean leaf images. The ResNet50 model achieved an accuracy of 93.75%, while VGG19 reached 91.41%. These results indicate that ResNet50 provides slightly superior performance compared to VGG19, aligning closely with the accuracy of MobileNetV2 reported by
Kumar et al., (2022) and slightly exceeding the performance of VGG19. Overall, our results demonstrate that ResNet50 outperforms VGG19 and is competitive with other top-performing models like Densenet121 and GoogleNet in the literature. The findings highlight ResNet50’s effectiveness in bean leaf disease classification, particularly in comparison to other DL models.
The findings of this study are consistent with previous research reporting the effectiveness of residual learning-based architectures for plant disease classification. Although some studies reported slightly higher accuracies using alternative architectures such as GoogleNet and DenseNet121, differences in datasets, preprocessing methods, training strategies and evaluation protocols limit direct comparison. Nevertheless, the performance achieved by ResNet50 demonstrates its competitiveness with established deep learning models reported in the literature.
From a practical perspective, the developed ResNet50 model could support automated bean disease diagnosis in precision agriculture systems. Integration of such models into mobile applications, drone-based monitoring systems, or smart farming platforms may assist farmers in early disease detection and timely intervention. Early identification of bean leaf diseases can reduce crop losses, improve disease management practices and contribute to sustainable agricultural production.