Fig 3 presents the training and validation accuracy curves of the MobileNet model over 50 epochs. The model exhibited rapid convergence during the initial training phase, with accuracy increasing from approximately 40% to above 90% within the first 10 epochs. This sharp improvement indicates effective early-stage feature extraction and stable gradient updates.
As training progressed, both training and validation accuracy curves gradually stabilized and continued to improve at a slower rate, eventually reaching 97.36% training accuracy and 96.32% validation accuracy at Epoch 50. The minimal gap of approximately 1% between training and validation accuracy demonstrates strong generalization performance and suggests the absence of significant overfitting. The close alignment of the two curves throughout the training process further confirms the robustness of the optimization strategy and the suitability of the selected hyperparameters. The plateau observed after approximately 30 epochs indicates convergence of the learning process, where additional epochs contributed marginal but consistent improvements. Notably, despite being trained from scratch without pretrained weights, the MobileNet architecture achieved high validation performance, demonstrating its capability to learn discriminative features effectively using depthwise separable convolutions.
Table 1 presents the confusion matrix of the MobileNet model for four-class classification. Out of 1605 total samples, 1527 were correctly classified, resulting in an overall accuracy of 95.14%, which confirms strong predictive performance. The diagonal elements show high true positive rates for all classes, indicating effective discrimination among disease categories. The Healthy class achieved the highest correct predictions (403 out of 404), with only one misclassification, demonstrating excellent recognition capability for healthy leaves. The Gall class recorded 377 correct predictions out of 400, with minor confusion mainly toward Chocolate Spot and Rust. Chocolate Spot showed 360 correct predictions out of 401 samples, with some misclassification primarily into Rust (24 samples). Similarly, Rust achieved 387 correct predictions out of 400, with limited confusion toward Chocolate Spot and other classes. The concentration of values along the diagonal and relatively small off-diagonal errors indicate that the model learned discriminative features effectively, with only minor overlap between visually similar disease symptoms. Overall, the confusion matrix confirms strong class-wise performance and reliable generalization across all categories.
The classification metrics demonstrate strong and balanced performance of the MobileNet model across all four classes (Fig 4). An overall accuracy of 95.14% was achieved on 1605 test samples, confirming high predictive reliability. The healthy class recorded the highest recall (99.75%) and F1-score (98.05%), indicating near-perfect identification with minimal false negatives. The gall class also showed robust performance, with a precision of 97.42% and an F1-score of 95.81%, reflecting low false positive and false negative rates. Although chocolate spot exhibited slightly lower recall (89.78%), its precision remained high (94.24%), suggesting that most predicted cases were correct despite some missed detections. Similarly, rust achieved balanced performance with a recall of 96.75% and an F1-score of 94.62%, indicating effective recognition with minor misclassification. The macro and weighted averages (approximately 95.1% across precision, recall and F1-score) confirm consistent performance across classes without significant bias toward any specific category. Overall, the results indicate stable, well-generalized multi-class classification performance.
Fig 5 shows ROC curves and PR curves for fava bean disease classes. The model achieved strong class separability, as evidenced by high AUC values for all classes: chocolate spot (0.9980), gall (0.9994), healthy (1.0000) and rust (0.9991). Precision-recall analysis further confirmed this performance, with average precision (AP) values of 0.9941, 0.9982, 0.9999 and 0.9977, respectively. The 5-fold cross-validation results demonstrate consistent model performance across different data splits. Specifically, the model achieved accuracies of 0.9460, 0.9460, 0.9168, 0.9366 and 0.9449 for folds 1 through 5, respectively. The overall mean cross-validation accuracy was 0.9381 with a standard deviation of 0.0112, indicating stable and reliable generalization capability.
Fig 6 shows representative test sample predictions with corresponding true (T) and predicted (P) labels and confidence scores. The majority of samples are correctly classified with high confidence values exceeding 98%, demonstrating strong model certainty and reliable feature learning. A few misclassifications are present, such as a gall leaf predicted as rust with 75.46% confidence and a rust sample predicted with comparatively lower confidence (69.77%), indicating overlapping visual characteristics between certain disease categories. Overall, the high confidence levels for correct predictions further validate the model’s discriminative capability and classification reliability.
For baseline comparison, additional experiments were conducted using MobileNet (trained from scratch), ResNet50 and EfficientNetB0 under identical training conditions. The proposed MobileNet model achieved a test accuracy of 95.14%, demonstrating effective learning of domain-specific features without relying on pretrained weights. In comparison, ResNet50 and EfficientNetB0 achieved test accuracies of 93.70% and 90.90%, respectively, showing comparable performance but with higher computational complexity, particularly in the case of ResNet50 (23.59M parameters) and EfficientNetB0 (4.05M parameters).
These results indicate that MobileNet provides an efficient and effective solution for this task while maintaining competitive accuracy. The model size comparison further highlights its advantage (3.23M parameters) over ResNet50 (23.59M) and EfficientNetB0 (4.05M).
Several recent studies have demonstrated the effectiveness of lightweight deep learning architectures, particularly MobileNet variants, for plant leaf disease classification across different crops (Table 2).
Zaki et al., (2020) fine-tuned MobileNetV2 for tomato leaf disease detection using the PlantVillage dataset and achieved over 90% accuracy.
Elfatimi et al., (2022) applied MobileNet and MobileNetV2 for bean leaf disease classification and reported more than 97% training accuracy and over 92% test accuracy. Similarly,
Jeong and Na (2024) developed a deep CNN model for Faba bean diseases and obtained 99.37% training accuracy with an overall accuracy of 91%, while
Salau et al., (2023) showed that preprocessing significantly improved CNN performance from 92.1% to 98.14% training accuracy.
Sireesha et al., (2025) further demonstrated the superiority of MobileNetV2 with transfer learning for potato leaf disease detection, achieving 98.33% accuracy.
Appati et al., (2026) enhanced MobileNet with custom layers and ensemble techniques for tomato early blight detection, attaining 94.5% accuracy on field data and up to 100% under controlled conditions.
In comparison with these studies, the present work implemented MobileNet trained from scratch for four-class Faba bean leaf disease classification and achieved a test accuracy of 95.14% on 1,605 samples. Unlike several prior approaches that relied heavily on transfer learning or ensemble methods, this study demonstrated that a carefully optimized lightweight architecture can achieve competitive and balanced performance without pretrained weights.
Limitations and practical implications
Despite the strong performance, some limitations were observed. Minor misclassifications occurred between visually similar classes, particularly chocolate spot and rust, likely due to overlapping lesion patterns, color similarities and variations in illumination conditions. These challenges are common in field-acquired datasets where environmental variability affects feature consistency. Additionally, while the model achieved high accuracy, its performance may vary when applied to unseen datasets with different backgrounds or acquisition conditions.
From a practical perspective, the proposed MobileNet model is computationally efficient, with a relatively small size (3.23M parameters) and low inference time (~11.34 ms per image), making it suitable for deployment on mobile and edge devices. This enables real-time disease detection in field conditions, supporting precision agriculture and early intervention. However, further optimization and validation on embedded hardware platforms are recommended for large-scale deployment.