The descriptive statistics presented in the Table 1 offer a comprehensive overview of sentiment analysis results derived from user feedback for the TNAU Cattle Expert System Application (TNCESA). The feedback was categorized into three distinct groups: Group A (Negative), Group B (Neutral) and Group C (Positive), utilizing sentiment analysis conducted through Azure Machine Learning.
Group A, comprising 88 instances of negative feedback, yields a mean sentiment score of 0.380, indicative of a moderately negative sentiment inclination. Skewness and kurtosis analyses reveal a slight positive skewness (0.105) and negative kurtosis (-1.36), respectively, suggesting a deviation from a typical Gaussian distribution within this group.Conversely, Group B, encompassing 63 instances of neutral feedback, demonstrates a mean sentiment score of 0.506, reflective of a consistently neutral sentiment stance. The skewness indicates a strong negative inclination (-1.29) and the kurtosis suggests a distribution leaning towards lower sentiment scores (0.652), hinting at potential underlying negative sentiments within ostensibly neutral feedback instances. In contrast, Group C, consisting of 372 instances of positive feedback, presents a substantially higher mean sentiment score of 0.719, indicative of a prevailing positive sentiment among users.
The skewness nearing zero (-0.009) and the negative kurtosis (-0.525) suggest a relatively symmetrical distribution with a discernible inclination towards higher positive scores. The Shapiro-Wilk W test confirms the normal distribution of the data, as evident in Fig 1, leading to the acceptance of H0. These findings provide valuable insights into the sentiment distribution of user feedback for TNCESA, indicating the presence of sub-groups within these three categories and confirming the normality of the data, which facilitates further analysis.
The feedback analysis of the TNCESA application, focusing on cattle husbandry, revealed that approximately 71% of the received feedback was positive, indicating a favorable response from users. The positive feedback primarily praised the comprehensive content of the application, especially its detailed information on cattle protection and precautions against various diseases. Users expressed satisfaction with the presentation of precautions and diagnostic methods for diseases such as Foot-and-Mouth Disease (FMD), Bovine Respiratory Disease (BRD), Mastitis, Johne ’s disease, Brucellosis, Clostridial diseases and Bovine Viral Diarrhea (BVD), finding them highly useful for managing their cattle effectively. Furthermore, many users highlighted the application’s detailed guidance on aspects ranging from feeding practices to disease diagnosis in cattle husbandry. However, amidst the positive feedback, some users raised concerns and suggestions for improvement. One notable concern was the absence of regional language support, limiting accessibility for certain users. Additionally, criticisms were voiced regarding the quality of videos demonstrating diagnostic procedures for specific cattle diseases. Some users expressed a desire for the application to evolve into a social media platform, facilitating networking among cattle farmers and enabling marketing opportunities. Furthermore, requests were made for expanded content coverage, including information on physical injuries like fractures and broken bones, as well as details on nearby veterinary clinics and ethnolectal treatments.
The subsequent log-linear regression analysis delves deeper into the relationships between the identified sentiment groups and their impact on the overall sentiment distribution (Table 2). The model fit measures, including the coefficient of determination (R-squared = 0.858), adjusted R-squared (0.737) and F-statistic (728), indicate that the regression model adequately explains a substantial portion of the variance in the sentiment distribution which is statistically significant at 1 per cent level. Additionally, the Durbin-Watson statistic (DW Stat) provides insights into the presence of autocorrelation in the residuals, with a value close to 2 suggesting no significant autocorrelation.
Table 3 outlines the estimates for each predictor variable in the log-linear regression model. The intercept, valued at 0.380, represents the baseline sentiment level when no specific sentiment category dominates, with a small standard error (SE) of 0.009 indicating the precision of this estimate. The coefficients for Group (2-1) and Group (3-1) quantify the change in sentiment scores relative to the reference group (Group 1, Negative). Specifically, a coefficient of 0.126 for Group (2-1) suggests an average increase of 0.126 units in sentiment when transitioning from Negative to Neutral sentiment, while the coefficient of 0.339 for Group (3-1) indicates a larger increase of 0.339 units when moving from Negative to Positive sentiment. These coefficients, along with their standard errors and confidence intervals, provide insights into the significance and precision of the estimated effects.
In the Table 4, the significant F-statistic of 728 (p<.001) indicates that the regression model as a whole is statistically significant in explaining the variance in overall sentiment scores. The sum of squares for the Group predictor variables confirms their collective significance in explaining variance, with a notable effect size (η² = 0.737), suggesting that approximately 73.7% of the variance in sentiment scores is accounted for by the sentiment categories.
Levene’s and Bartlett’s tests show significant p-values (<0.001), indicating variance heterogeneity and sub-groups within the sentiment data, offering insights for further analysis (Table 5). The cluster analysis depicted in Fig 2 reveals discernible patterns within the user feedback dataset for the TNCES application, effectively categorizing users into four distinct clusters denoted as C1, C2, C3 and C4. Each cluster demonstrates varying levels of agreement and engagement with the TNCES application, reflecting the varied feedback from users.
Cluster 1 (C1), comprising 122 feedbacks, is characterized by a high level of agreement and positive sentiment towards the TNCES application. The feedback pooled within this cluster is indicative of strong satisfaction and endorsement of the application’s utility. Therefore, C1 is aptly named “Functionality Feedback,” denoted in blue colour in the Fig 2, emphasizing the prevalence of more positive feedback regarding the TNCES mobile application usage. Cluster 2 (C2), encompassing 1115 feedbacks, exhibits a suggestive nature, reflecting users’ inclination towards providing recommendations or suggestions for improvement. As such, C2 is designated as “Advisory Feedback,” represented in grey colour, highlighting the constructive feedback and potential areas for enhancement identified. Cluster 3 (C3), consisting of 151 feedbacks, encompasses a blend of appreciation and criticism towards the development of the TNCES application.
The feedback within this cluster reflects a nuanced spectrum of sentiments, including both commendations and reservations. Hence, C3 is labelled “Evaluating Feedback,” underscoring the diversity of opinions and perspectives expressed in this cluster denoted as orange colour in the Fig 2. Finally, Cluster 4 (C4), comprising 135 feedbacks, is distinguished by the provision of substantial queries and inquiries, indicating a proactive engagement with the application and a desire for clarification or additional information. C4 is therefore named “Inquisitive Feedback,” emphasizing the critical role of queries in elucidating and refining the TNCES application’s functionalities. The delineation of these four clusters aligns with the previous results, indicating distinct subgroups within the sentiment categories identified earlier.
In Table 1, it was mentioned that normal distribution had happened in the study, the normal distribution curve created for the study using the scores obtained also proves the same. From the normal distribution curve Fig 3, it was detected that area lying to the left of the mean opinional score of TNCES agricultural mobile application users minus two standard deviation (x - 2𝛔) includes the first 4.17 per cent of the individuals to provide “Harsh stringer”.
From Table 6, the next 12.50 per cent of the users were included between (x - 𝛔) and (x - 2𝛔) were labeled as “Criticizers”. At the mean opinional score of TNCES agricultural mobile application users one two standard deviation (x - 𝛔), a point of inflection occurs including 26.04 per cent of the users, they were labeled as “Arbitrator”. At that point, positive feedback start to increase (and level off) between the mean and other inflection point (x + 𝛔), where the more gentle positive feedback begins to be received are 36.84 per cent of the TNCES users labeled as “Delicate”.
The last 18.75% of individuals who provided elated responses (to the right of the inflection point at (x + 𝛔) were labeled as “Eloquent”. The normal distribution parameters can divide a continuous variable into various categories. For feedback not reaching 100%, a sixth category, “Taciturn,” represents users who do not respond, aligning with the ungrouped box-whisker plot (Fig 2). Log-linear regression analysis revealed that negative feedback was close to neutral and moderately different from positive feedback, suggesting mildly negative sentiments. Some users noted the app’s lack of coverage on specific regional diseases, while others desired more detailed information on advanced topics. Positive feedback highlighted the app’s effort and potential as a useful tool for cattle farmers. This diversity in feedback underscores distinct user perspectives and expectations, confirming different user and feedback types. Thus, the log-linear regression analysis validates these differences, as shown in the feedback data analysis.
Table 7 provides a clear breakdown of the feedback received for the TNCES mobile application. About 30.20 per cent of the feedback falls into the category of utilitarian feedback. Within this utilitarian feedback group, a significant portion (12.50%) was contributed by delicate users, with another substantial segment (10.41%) provided by eloquent users. This underscores the TNCES mobile application’s success in meeting users’ needs and expectations during their interactions with the app.
Suggestive feedback constitutes about 25.00 per cent of the total feedback received. Among these suggestions, delicate users (10.41%) and arbitrator users (06.25%) stand out as active contributors, indicating their desire for future updates and improvements in the application. These valuable insights from users should be considered in the ongoing development of the app to enhance its functionality and user experience. A noteworthy 22.92 per cent of the feedback expressed appreciation for the TNCES mobile application, lauding it as one of the best applications available, particularly for its provision of valuable information in the regional language.
Delicate users (12.50%) and arbitrator users (07.29%) feature prominently among those expressing appreciation. This positive opinion underscores the significance of providing content in regional languages to cater to a diverse user base. Lastly, query feedback emerges as a crucial category, with substantial contributions from arbitrator users (07.29%) and criticizer users (06.25%).
Addressing these query-based feedback items is essential, as they represent users seeking clarifications or additional information. These queries should be acknowledged and responded to constructively to support ongoing app development. It’s important to note that within the suggestive and constructive feedback categories, there exists a minor subset of harsh critics. While these criticisms cannot be entirely avoided, they serve as valuable input for refining the application further. The box-whisker plot for different groups showed variations that happened due to the presence of various categories of individuals who provided their feedback about the TNCES mobile application was identified. The TNCES application offers numerous benefits to cattle farmers in handling their livestock and managing cattle husbandry practices. Firstly, the application provides access to comprehensive information on various aspects of cattle protection, disease prevention and management. This enables farmers to make informed decisions and take proactive measures to safeguard the health and well-being of their cattle. Overall, the feedback possesed TNCES application as a necessary tool plays a significant role in empowering cattle farmers knowledge to enhance their productivity, profitability and sustainability in the livestock community which was supported by the results of the feedbck analysis.