Full Research Article

volume 36 issue 4 (december 2021) : 334-337, Doi: 10.18805/BKAP397

Outlier Removal in Sheep Farm Datasets Using Winsorization

A

Ambreen Hamadani

N

Nazir A. Ganai

T

Tariq Raja

S

Safeer Alam

S

Syed Mudasir Andrabi

I

Ishraq Hussain

H

Haider Ali Ahmad

Affiliations

¹Sher-e-Kashmir University of Agricultural Sciences and Technology of Kashmir, Srinagar-190 006, Jammu and Kashmir, India.

Submitted22-11-2021|
Accepted06-01-2022|
First Online 26-01-2022|
doi 10.18805/BKAP397

Cite article:- Hamadani Ambreen, Ganai A. Nazir, Raja Tariq, Alam Safeer, Andrabi Mudasir Syed, Hussain Ishraq, Ahmad Ali Haider (2022). Outlier Removal in Sheep Farm Datasets Using Winsorization. Bhartiya Krishi Anusandhan Patrika. 36(4): 334-337. doi: 10.18805/BKAP397.

ABSTRACT

Background: Sheep farm data is often biased by extreme values which are generally introduced due to errors in manual measurement. These values interfere with the accuracy of estimations especially in state-of-the-art techniques like Machine Learning.
Methods: Therefore, winsorization technique was attempted for the removal of outliers from sheep farm data data for 11 years (2011-2021) for body weights at different ages. Some outliers were deliberately introduced into the data to check the efficiency of the technique. This study was conducted during the year 2021.
Result: Our results indicate that outlier values of 15.3, 42, 44, 60, 90 for birth weight, weaning weight, 6-month, 9 month and 12-month body weight which were far from the normal range were removed using this technique. The mean and standard deviation values were altered after winsorization. Winsorization technique works well for sheep farm data to remove the bias introduced by outliers and also removes, to a large extent, the need for manual outlier removal in data.

KEYWORDS

REFERENCES

Chambers, R., Kokic, P., Smith, P., Cruddas, M. (2000). Winsorization for identifying and treating outliers in business surveys. Proceedings of the Second International Conference on Establishment Surveys, American Statistical Association Alexandria, Virginia. pp. 717-726.

Gerard-Marchant, P.G. (2007). scipy.stats.mstats.winsorize. https:/ /docs.scipy.org/doc/scipy/reference/generated/scipy. stats.mstats.winsorize.html.

Grubbs, F.E. (1969). Procedures for detecting outlying observations in samples. Technometrics. 11 (1): 1-21. doi: 10.1080/00 401706.1969.10490657.

Hargrave, M., Clarine, S. (2021). Winsorized Mean. https://www. investopedia.com/terms/w/winsorized_mean.asp.

Hunter, J.D. (2007). Matplotlib: A 2D graphics environment. Computing in Science and Engineering. 9(3): 90-95. 10.1109/MCSE. 2007.55.

Maddala, G.S. (1992). Outliers. Introduction to Econometrics (2^nd ed.). New York: MacMillan. pp. 89. ISBN 978-0-02-374545-4.

Moso, J., Cormier, S., Fouchal, F., de Runz, C., Wandeto, J. (2021). Anomaly Detection on Data Streams for Smart Agriculture. Agriculture. 11: 1083. https://doi.org/ 10.3390/agriculture 11111083.

Widenius, M., Axmark, D., DuBois, P. (2002). Mysql Reference Manual (1^st. ed.). O’Reilly and Associates, Inc., USA. ISBN:978-0-596-00265-7. pp 712.

Disclaimer :

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Copyright :

This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Full Research Article

Outlier Removal in Sheep Farm Datasets Using Winsorization

ABSTRACT

KEYWORDS

REFERENCES

In this Article

APC

Publish With US

Become a Reviewer/Member

Open Access

Products and Services

Support and Policies

Editorial Board