Automated 3D Computer Vision Model Offers a New Tool to Measure and Understand Dairy Cow Behavior and Welfare

Dairy cows typically rest for 10 or more hours a day, so a dry, clean, and comfortable place—such as a freestall—to lie down and rest is essential for their health, well-being, and production performance. One key factor in whether stalls are comfortable for cows is the ease with which they can get up and down, so it is common on farms for staff to watch for abnormal rising behaviors as part of standard welfare management. In a new studyopens in new tab/window in the Journal of Dairy Scienceopens in new tab/window, published by Elsevier, a Swedish team, in collaboration with Sony Nordic, introduced a new automated model that accurately detects posture transitions in dairy cows. This innovative approach using 3-dimensional (3D) pose estimation offers valuable, unbiased insights into animal welfare and could offer a less time-consuming and more consistent assessment tool for researchers and farmers alike.

Led by Niclas Högberg, DVM, and Adrien Kroese, Eng, Department of Clinical Sciences, Faculty of Veterinary Medicine and Animal Science, Swedish University of Agricultural Sciences, Uppsala, Sweden, the study aimed to develop a reliable method for monitoring the ease with which cows can get up and down in their cubicles, a crucial indicator of overall comfort and well-being.

Adrien Kroese explained, “Evidence points to a clear link between restricted movement for cows and signs of reduced welfare, so it is common to have some kind of observation practice in place to catch signs of movement struggles.”

Traditional methods—which often rely on human observation—can be subjective, sporadic, and time-consuming.

Considering the need for more consistent methods, the study team proposed a novel framework for detecting cow movements, specifically to understand how to measure lying-to-standing transitions from 3D pose estimation data compared with the human eye.

The team employed a 24-hour setup of seven cameras recording a herd of Swedish Holstein and Swedish Red cows. This footage was then used with 3D pose estimation software, which tracks and records movements via a 2D object detector and pose estimator. These datapoints are then fed into convolutional neural networks to detect cow movements in comparison to specific anatomical landmarks on static images from the footage. The result is a 3D map of cows’ movement in their stalls and a selection of which movements indicate the transition to standing.

Dr. Kroese explained, “We then compared the standing data gathered by the software against timestamps in the video annotated by three human observers, which is considered the gold standard for behavioral observations.”

How did the 3D data model hold up in comparison to the human eye? Dr. Kroese said, “The framework was able to detect when a cow was transitioning from lying to standing with the same accuracy as humans. The sensitivity of the detection was over 88%.”

Notably, the results also indicate that the model introduced no more bias compared with human observers.

Although not without limitations, the study’s findings demonstrate the potential of 3D pose estimation to provide objective and reliable data on cow behavior. Dr. Kroese noted, “This technology represents an exciting advancement in our ability to study and monitor animal behavior and welfare. By automatically and accurately detecting posture transitions, we can gain valuable insights into the comfort and well-being of dairy cows.”

The model offers potential to help researchers scale up the study of dairy cow behavior and motion patterns and opens the door to the development of new assessment tools for farmers to make informed decisions about their herds.

Notes for editors

The article is “3-Dimensional pose estimation to detect posture transition in freestall-housed dairy cows,” by Adrien Kroese, Moudud Alam, Elin Hernlund, David Berthet, Lena-Mari Tamminen, Nils Fall, and Niclas Högberg (https://doi.org/10.3168/jds.2023-24427opens in new tab/window). It appears in the Journal of Dairy Science, volume 107, issue 9 (September 2024), published by the American Dairy Science Associationopens in new tab/window and Elsevier.

The article is openly available at https://www.journalofdairyscience.org/article/S0022-0302(24)00755-0/fulltextopens in new tab/window and the PDF version is available at https://www.journalofdairyscience.org/action/showPdf?pii=S0022-0302%2824%2900755-0opens in new tab/window.

Full text of this article is also available to credentialed journalists upon request; contact Eileen Leahy at +1 732 406 1313 or [email protected]opens in new tab/window. Journalists wishing to interview the author should contact Adrien Kroese, Eng, Department of Clinical Sciences, Faculty of Veterinary Medicine and Animal Science, Swedish University of Agricultural Sciences, Uppsala, Sweden, at [email protected]opens in new tab/window.

About the Journal of Dairy Science

The Journal of Dairy Science® (JDS), an official journal of the American Dairy Science Association® (ADSA), is co-published by Elsevier and ADSA. It is the leading general dairy research journal in the world. JDS readers represent education, industry, and government agencies in more than 70 countries, with interests in biochemistry, breeding, economics, engineering, environment, food science, genetics, microbiology, nutrition, pathology, physiology, processing, public health, quality assurance, and sanitation. JDS has a 2023 Journal Impact Factor of 3.7 and five-year Journal Impact Factor of 4.1 according to Journal Citation Reports™ (Source: Clarivate™ 2024). www.journalofdairyscience.orgopens in new tab/window

About the American Dairy Science Association (ADSA®)

The American Dairy Science Association (ADSA) is an international organization of educators, scientists, and industry representatives who are committed to advancing the dairy industry and keenly aware of the vital role the dairy sciences play in fulfilling the economic, nutritive, and health requirements of the world’s population. It provides leadership in scientific and technical support to sustain and grow the global dairy industry through generation, dissemination, and exchange of information and services. Together, ADSA members have discovered new methods and technologies that have revolutionized the dairy industry. www.adsa.orgopens in new tab/window

엘스비어 소개

엘스비어는 첨단 정보와 의사결정 지원 분야의 글로벌 선도 기업으로 100년 넘게 과학과 헬스케어의 발전을 지원하며 인류 진보에 기여해 왔습니다. 우리는 170개국 이상에서 학술 및 기업 연구 커뮤니티, 의사, 간호사, 미래의 의료 전문가와 교육자들을 지원합니다. 근거에 기반한 신뢰할 수 있는 과학·의학 콘텐츠와 최첨단 AI 기술을 결합해 중요한 통찰과 혁신적인 솔루션을 제공해, 의미있는 성과를 이루도록 돕고 있습니다. 또한 다양성과 지속 가능성을 제품과 기업 문화 전반에 내재화하며, 우리가 속한 커뮤니티와 협력합니다. 엘스비어 재단opens in new tab/window은 전 세계에서 연구와 보건 파트너십을 지원합니다.

엘스비어는 전문가 및 기업 고객에게 정보 기반의 분석과 의사결정 도구를 제공하는 글로벌 기업 RELXopens in new tab/window의 일원입니다. 자세한 내용은 www.elsevier.com에서 확인할 수 있으며, 소셜미디어 @elsevierconnect를 통해 최신 소식을 받아보실 수 있습니다.