Western blot analysis confirmed the successful expression of the target protein, revealing a molecular weight of approximately 42 kDa (Fig 2). The BVDV-positive serum displayed recognition of the protein, indicating its antigenicity. In contrast, no reactivity was observed with the negative serum. In Fig 3, the checkerboard titration displayed that using 1.25 µg/well of protein and serum diluted to 1:12.5 yielded the greatest discrepancy in OD values between positive and negative samples. However, for the ELISA working dilution, a protein concentration of 0.63 ug/well and a serum dilution of 1:25 were selected, as lower background readings in the control well were achieved, effectively minimizing non-specific binding.
Out of the 311 collected serum samples, a commercial ELISA identified 59 as positive and 252 as negative. All of these samples, along with the inclusion of 186 positive stock samples, were used as reference samples to assess the performance of the newly-developed ELISA. In total, 245 positive samples and 252 negative samples were subjected to testing using the developed ELISA.
The discriminatory power of the developed assay is illustrated in Fig 4. The resulting Area Under the Curve (AUC) was 0.86, indicating a good discriminatory test (0.8£AUC<0.9), in accordance with the interpretation guidelines by
Nahm (2022). A two-way sensitivity-specificity plot, shown in Fig 5, revealed that equal sensitivity and specificity (approximately 79%) were achieved at a cut-off value of 0.364.
Measurement of test agreement
The test results obtained from both the commercial and the developed ELISA were categorized based on the determined optimal cut-off value of 0.364, as presented in Table 1. The McNemar’s chi-square test yielded a non-significant result (
P=.922), suggesting a lack of substantial evidence that the proportion positives of the two tests were dissimilar. Furthermore, the calculated kappa value was 0.577, with a 95% confidence interval ranging from 0.506-0.649. This value fall within the category of moderate strength of agreement strength, as per the classification by
Landis and Koch, (1977).
Repeatability assessment
The results of the precision assessment for the developed assay are presented in Table 2, indicating its strong precision. Both the intra- and inter-assay CVs for raw OD450 value were under 20%. The intra-assay CV ranged between 7.7% and 9.7% with an average of 8.8%. The inter-assay CV stood at 15.1% across the three plates. Additionally, Levey-Jennings charts were plotted using the mean OD450 values of positive (Fig 6A) and negative control duplicates (Fig 6B) over ten runs of the assay. The results demonstrated acceptable between-run repeatability, as all mean values fell within the range of ±2 SD of the mean of all runs. The means of positive and negative control OD450 results were 0.565 and 0.098, respectively. The upper and lower control limits for each control sample were shown in Table 3.
As the NS3 protein became a candidate antigen for ELISA
(Chi et al., 2022; Yitagesu, et al., 2021) and was prepared in various immunogenic regions, vector choices and expression systems, it is worth noting that the study of the whole NS3 protein of BVDV by
Mahmoodi et al., (2015) revealed high sensitity and specificity. However, the full-length NS3 (683 amino acids with about 80-kDa molecular weight) when combined with maltose binding protein resulted in a larger protein size, which may lead to a lower yield of target protein expression
(Bao et al., 2006). Subsequently, shorter sequences were shown to be more favorable for plasmid construction and protein expression
(Qiu et al., 2022). Furthermore, the use of smaller fragments concentrates more specific epitopes and avoids the non-significant part of NS3
(Bhatia et al., 2008). In this current study, we specifically selected the region of interest within the NS3 protein based on the displayed epitopes, hydrophilicity profile and conserved region. This resulted in a protein with a length of only 381 amino acids and a molecular weight of 42 kDa.
For protein expression, this study chose the
E. coli expression system due to its simplicity, rapidity, high yield and cost-effectiveness
(Francis and Page, 2010). However, codon usage bias in native sequences can limit expression levels. To address this, the present study designed and synthesized a codon-optimized gene sequence to enhance heterologous protein expression in
E. coli (Gustafsson
et al., 2004). The NS3 gene region was successfully incorporated into the pET-28(+) plasmid and codon adaptation indices (CAI) were maximized (increasing from 0.39 to 0.98 in fragment 1 and from 0.4 to 0.99 in fragment 2), indicating the potential for high-level expression in the target host.
The AUC value of 0.86 indicates strong test discrimination (
Nahm, 2022), suggesting an 86% probability that serum from a randomly selected BVDV-positive cow will yield a higher OD450 reading than that from a negative cow. Instead of standard ROC curve, this study employed a two-way sensitivity-specificity plot, also known as a two-graph ROC plot, to facilitate the selection of optimal cut-off values. This plot highlights various cut points for maximizing sensitivity or specificity, taking into account the costs of false positive and false negative results. The study determined the optimal cut point, set at 0.364, to achieve equal sensitivity and specificity, as reflected by a kappa coefficient of 0.577, indicating moderate agreement (0.41 to 0.6). Kappa’s sensitivity to the prevalence of the condition of interest was considered, with our study group having a prevalence of approximately 0.5, expected to yield a robust kappa value (
Vach, 2005).
The developed ELISA successfully identifies 193 negative serum samples out of 251 negative references, indicating the potential for false positives that can diminish the assay’s specificity. Generally, the use of recombinant protein as coated antigens for ELISA is expected to provide higher specificity compared to the whole viral antigens employed in commercial ELISA kits. This is because cross-reactions with mammalian cell proteins in cell culture can lead to false-positive results in the whole-virus-based assay
(Reddy et al., 1997). However, the conflicting results observed may be attributed to false negatives generated by the commercial ELISA. In whole-virus-based assay, there may be an insufficient concentration of protein with immunogenic significance
(Reddy et al., 1997). Another potential factor contributing to the significant occurrence of false-positive reactions could be the hydrophobic binding of serum immunoglobulin components to plastic surfaces in individual samples. This phenomenon, often referred to as background noise reaction, is a common issue encountered during ELISA development, regardless of the type of antigen used
(Terato et al., 2014).
This developed assay also displayed strong repeatability, as indicated by the CV values for both inter and intra-assay variation of the raw OD value readings, which remained well below 20% (
Jacobson, 1998). To properly assess the repeatability of the assay, subsequent tests using field serum samples must be carried out following the same optimized procedures and conditions mentioned earlier. This study has established stringent validity criteria for the developed ELISA to ensure consistency across multiple runs. Specifically, each ELISA plate run should include duplicates of one positive and one negative control. An ELISA assay is deemed valid if the averaged OD value of positive control falls within the range of 0.40-0.70 (calculated as the mean ± 2SD from the between-run repeatability results, as previously mentioned), with a difference of more than 0.30 OD units between the average positive control and the negative control. In cases where these conditions are not met, the results should be considered suspect and invalid.
To ensure the practical application of our developed assay, the cut-off value was carefully selected by considering the costs associated with false positives and false negatives. It is worth noting that the cost of false negative can have a continuous, detrimental impact on production within Thai dairy herds due to potential subclinical BVDV infections. These hidden infections can lead to significant economic losses. In Thailand, previous research has primarily focused on BVDV seroprevalence, while the economic consequences of BVDV infections remain poorly documented. Nonetheless, there is compelling evidence indicating a substantial negative impact on the reproductive system, as observed through prolonged first-service intervals, calving- to-conception intervals, calving intervals and reduced overall pregnancy rate
(Kampa et al., 2011), all of which contribute to economic losses. On the other hand, in Thailand, where control policies or eradication measures like test-and-cull are not widely implemented, the consequences of false positive results appear to be less significant. Additionally, if a BVDV-seropositive cow is identified, further sample collection and confirmatory tests are typically carried out to validate the suspected animal’s current infection status. This use of sequential testing ultimately results in a higher level of specificity in the screening process
(Dohoo et al., 2009). Overall, it is evident that the cost associated with false positives in BVDV testing is more substantial than that of false negatives. As a result, an ELISA based on recombinant NS3 protein has been developed for the screening purpose to be used as an alternative to the routine assay.
For a screening assay, a suggested cut-off value at the S/P ratio of 0.18 offers a high sensitivity of 90% without significantly compromising specificity (54%). If the S/P ratio obtained from a serum sample is below 0.18, the sample is categorized as negative. Conversely, if the S/P ratio is greater or equal to 0.18, the sample is deemed positive. However, the sensitivity and specificity of the developed ELISA were maximized concurrently but only at a moderate level of 78%. Out of 246 positive sera, only 193 samples tested positive using the developed assay. This occurrence might be attributed to the relatively low antigenicity of the prepared NS3 protein, as indicated by western blot analysis of positive serum, which exhibited a weaker signal compared to the amount of protein loaded in SDS-PAGE run concurrently under the same conditions. Another potential reason for the occurrence of false negative results is the stage of infection, as antibodies against the non-structural protein are produced later in the infection and decreased earlier compared to other structural proteins
(Mohanty et al., 2021). Commercial kits based on whole BVDV are considered superior in terms of detecting antibodies during various infectious periods, as they contain a more diverse array of antigenic determinants from the virus. This diversity sometimes leads to false negative results when using the newly-developed ELISA. Using different regions of NS3 and a combination of multiple immunogenic proteins from BVDV such as E0, E2 and NS3, in the development of ELISA could potentially enhance accuracy of diagnostic parameters. This idea is supported by a previous study conducted by (
Chimeno Zoth and Taboga, 2006), which achieved high sensitivity and specificity relative to the viral neutralization test through the use of three recombinant antigens.