Collaborating with cinematographer Douglas Thron and under the guidance of remote sensing engineer professor Javaan Chahl, Danyi Wang used signal processing techniques to detect vital signs of zebra, sable antelopes, waterbucks, and giraffe from drone footage.
Pioneered by professor Chahl and his team in 2019, this technique has been used to extract the heart and breathing rates of animals filmed from a drone at long distances.
The collaboration with Thron came after he read about prof Chahl’s remote sensing study with Adelaide Zoo.
Thron films using specialised drones with infrared cameras, zoom lenses and spotlights to rescue animals affected by natural disasters.
He spent six months in Australia in 2020 after the World Wildlife Fund hired him to find vulnerable wildlife in the wake of the country’s devastating bushfires.
That experience – as well as the world-first experiment in Malawi, Africa – features in a documentary series, aptly named Doug to the Rescue, which airs in more than 30 countries worldwide on the Curiosity Stream channel.
In the Malawi documentary, Wang and professor Chahl are interviewed via Zoom, discussing the challenges they faced to pick up tiny movements from the animals’ chest cavities filmed by Thron’s drone from ranges of more than 50 metres.
“We had to select the right sequences in the video where it was stable enough for us to get heart rates, but we were able to do it,” Chahl says.
According to Wang, the sable antelope’s heart rate was right in the middle of the normal range and its breathing rate was at the lower end, which indicated it was very healthy and not stressed at all, even by the presence of the drone.
Likewise, the vital signs captured from a giraffe, zebra, and waterbuck were all in the expected range.
“It was exciting to work with a US-based documentary team on location in Malawi, via video conferencing from Adelaide, while Australia’s borders were closed,” Wang says. “It just shows what is possible in a research context using modern technology, even in a pandemic.”
Wang was also part of the university team who worked remotely with Canadian drone manufacturer Draganfly in 2020 to create pandemic screening technology for humans.
Chahl says there is significant potential to use the same technology to monitor the health of wildlife globally, particularly endangered animals, and assist conservation efforts.
“We have demonstrated that a drone can be used to film wildlife at long distances without disturbing or stressing them, and then use AI techniques to successfully extract cardiopulmonary signals to remotely monitor for signs of poor health,” he said.
This first appeared in the subscription newsletter CommsWire on 26 July 2022.