The evaluation of the bean leaf disease detection model using MobileNetV3 showed good results in terms of performance indicators after epoch 25 (Fig 2).
The training loss was measured to be 0.2428, indicating a small error in the model’s predictions on the training dataset. The training process resulted in an accuracy of 90.91%, meaning that the model accurately diagnosed bean leaf diseases in about 91% of cases. The validation dataset, which evaluates the model’s capacity to apply its skills to new data, yielded a reduced validation loss of 0.2121. The decrease in loss indicates successful generalisation and less overfitting. Furthermore, the validation accuracy achieved a remarkable rate of 94.74%, demonstrating the model’s strong and dependable capacity to effectively detect diseases in unknown data. The validation accuracy being slightly higher than the training accuracy can be attributed to the application of data augmentation and dropout regularisation during training. Data augmentation introduces variability in the training samples, making the learning task more challenging, whereas the validation dataset contains unaltered images. Consequently, the model may exhibit slightly higher performance on the validation data compared to the augmented training samples. The findings emphasise the effectiveness of MobileNetV3 in achieving accurate disease identification while maintaining a balanced compromise between training and validation metrics.
The confusion matrix of the bean leaf disease detection model utilising MobileNetV3 provides a clear representation of the model’s performance in classifying angular leaf spot, rust and healthy categories (Fig 3). The model accurately detected 41 instances of angular leaf spot, with only 2 cases mistakenly categorised as Rust and no incorrect positive identifications. The rust detection performance was good, successfully identifying 38 cases. However, there were 5 misclassifications as angular leaf spot and 3 instances that were mistakenly labelled as healthy. The model demonstrated good performance in accurately detecting healthy leaves, correctly recognising 39 cases without any misclassifications. These results indicate that the model performs particularly well in distinguishing healthy leaves from diseased ones, while some confusion occurs between angular leaf spot and rust due to their similar visual characteristics such as lesion colour and texture patterns.
Overall, the confusion matrix indicates that the model is quite efficient, achieving a high level of accuracy in differentiating between healthy leaves and diseases. In addition, it shows low misunderstanding when discriminating between angular leaf spot and rust. The performance of the model highlights its reliable and effective capacity to identify diseases.
The performance metrics of the bean leaf disease detection model using MobileNetV3 are summarised in Table 1. The model achieved a precision of 89.13% for angular leaf spot, indicating that 89.13% of the cases predicted as angular leaf spot were accurate. The recall rate was 95.35%, indicating that the model correctly detected 95.35% of the actual instances of angular leaf spot. The F1-score, a metric that combines precision and recall, achieved a value of 92.13%, indicating a high level of accuracy in disease detection. Based on the dataset, which includes 43 confirmed instances, these measures provide good detection ability for angular leaf spot. The model achieved an accuracy of 88.37% for rust, indicating that 88.37% of the predicted instances of rust were properly categorised. The recall rate was 88.37%, indicating that the model accurately detected 88.37% of the actual instances of rust. The F1-score, which is 88.37%, indicates an optimal equilibrium between accuracy and recall in rust identification. The dataset had 43 verified instances of rust and these metrics demonstrate the efficacy of rust detection. The precision rate of healthy leaves is 100% which indicates all events predicted as healthy were really healthy. The recall rate was 92.86%, indicating that the model correctly identified 92.86% of all real healthy events. The F1-score of 96.30% demonstrates a strong equilibrium between accuracy and recall for healthy leaves, using a dataset of 42 real instances.
The model had an overall accuracy rate of 92.19% across all classes. The macro average measures, which include an accuracy of 92.50%, recall of 92.19% and F1-score of 92.27%, represent the overall performance across all classes, with equal consideration given to each class. The weighted average metrics, including an accuracy of 92.44%, recall of 92.19% and F1-score of 92.24%, take into consideration the number of true instances for each class. These metrics provide a performance assessment that accurately represents the effectiveness of the model across different class frequencies.
The ROC (Receiver Operating Characteristic) curve study of the bean leaf disease detection model using MobileNetV3 offers useful insights into its classification performance across several classes (Fig 4). The ROC curve for angular leaf spots demonstrates a remarkable performance in discriminating angular leaf spots from other classes, as shown by an area under the curve (AUC) of 0.95. The high Area Under the Curve (AUC) indicates that the model has a significant capability to properly detect instances of angular leaf spots with low uncertainty. The ROC curve for rust has an AUC of 0.91, indicating an impressive capacity to distinguish rust from other leaf diseases. Although the AUC for rust is significantly lower than that of angular leaf spot, the result of 0.91 still indicates a high level of performance. This suggests that the model is skilled at identifying rust, even though there may be some similarities with other classes. The ROC curve for healthy leaves has a remarkable Area Under the Curve (AUC) value of 0.96, highlighting the model’s remarkable ability to accurately identify healthy leaves. The high Area Under the Curve (AUC) value suggests that the model exhibits outstanding performance in accurately differentiating healthy leaves from both angular leaf spot and rust. This implies a minimal rate of misclassification and highlights the model’s reliability in recognising healthy samples. The findings demonstrate the model’s efficacy in effectively differentiating between various leaf states, especially in precisely detecting healthy leaves and angular leaf spots with a high level of accuracy.
A comparison of the presented work is done with existing literature in Fig 5.
Elfatimi et al., (2022) examined the use of MobileNet models in the classification of bean leaf diseases. The research conducted a comparison of several MobileNet topologies, such as MobileNetV2. The model was trained and tested using a total of 1296 images. The findings indicated that the MobileNet model attained a notable classification accuracy, with an accuracy of ~92%.
Kumar et al., (2022) investigated the use of MobileNet models for accurately detecting and categorising diseases affecting bean leaves. The MobileNetV2 model obtained an accuracy of 93.54% when tested on a publicly available bean leaf dataset.
Abed et al., (2021) introduced a DL architecture designed to automatically identify bean leaf diseases. The framework comprises two primary stages: identification of bean leaves and diagnosis of diseases. To identify leaves, a U-Net architecture was used, using a pre-trained ResNet34 encoder. The research assessed the efficacy of five DL models: Densenet121, ResNet34, ResNet50, VGG-16 and VGG-19, during the classification phase. The framework underwent testing using a dataset consisting of 1295 images, which were classified into three categories: Healthy, Angular Leaf Spot and Bean Rust. The findings showed that Densenet121 had better results in both binary and multi-class classification tests. Densenet121 earned a Classification Accuracy Rate (CAR) of 98.31% for binary classification. It also achieved a Sensitivity of 99.03%, Specificity of 96.82%, Precision of 98.45%, F1-Score of 98.74% and an Area Under the Curve (AUC) of 100%. The model obtained a classification accuracy rate (CAR) of 91.01% in the multi-class classification challenge, with image processing durations of under 2 seconds per image.
Sahu et al., (2021) explored DL models for classifying bean crop diseases. The study utilized a dataset of 1296 images of bean leaves, categorized into three classes: Angular Leaf Spot, Bean Rust and Healthy. Two deep learning models, GoogleNet and VGG16, were employed for feature extraction from these images. The results indicated that GoogleNet outperformed VGG16, achieving an accuracy of 95.31%. The study also incorporated several visualization techniques, including Intermediate Layer Activations, CNN Filter Visualization and Heat Maps.
Compared with these studies, the proposed MobileNetV3-based approach achieved a competitive classification accuracy of 92.19%. Although certain architectures such as GoogleNet and DenseNet reported slightly higher accuracy values, these models typically involve larger network structures and higher computational requirements. In contrast, MobileNetV3 is specifically designed as a lightweight architecture that balances accuracy and computational efficiency. This characteristic makes it particularly suitable for real-time plant disease detection applications where computational resources may be limited. Furthermore, the performance achieved in this study demonstrates that lightweight deep learning architectures can provide reliable classification results even when trained on relatively small datasets. This highlights the potential of MobileNetV3 as an efficient model for agricultural disease detection systems that require fast inference and low computational cost.
From a practical perspective, the proposed model can be integrated into mobile or edge-based agricultural monitoring systems, allowing farmers to capture leaf images using smartphones and obtain rapid disease diagnosis. Such systems could support early disease detection, reduce crop losses and improve decision-making in precision agriculture practices. However, further validation using larger field datasets and real-world environmental conditions would be necessary before large-scale deployment.