Analysis of Roadkill Rates from a Trial of a Virtual Fence for Reducing Wombat Road Mortalities. Are Severely Under-Powered Studies Worth the Effort?
Current Journal of Applied Science and Technology,
Page 1-13
DOI:
10.9734/cjast/2022/v41i333946
Abstract
Aims: Evaluation of the effectiveness of methods of roadkill mitigation requires field experiments and thus experimental designs. We evaluated such a published experiment that used a virtual road-fence (VF) system to attempt to reduce roadkill of bare-nosed wombats (Vombatus ursinus) and draw general conclusions on the ability of the implemented design, given overall mean rates of roadkill, to detect a substantial reduction of 50%.
Study Design: The study site consisted of contiguous fenced and unfenced road sections that were each monitored for road kill for 995 and 322 days pre- and post-installation, respectively. The study design was an unreplicated BACI (Before-After-Control-Impact) design.
Methodology: No statistical analysis of the roadkill data were carried out in the original study. We used a Poisson/log-link Generalized Linear Model fit to their BACI data as a single 2x2 table of counts and define a single interaction parameter as a function of control-adjusted rate reduction due to the VF. This parameter can also be defined as the logarithm of the ratio of odds of a random kill in the fenced section occurring in the post-installation period to the corresponding odds for the unfenced section. A null hypothesis of no effect of the VF corresponds to a log odds-ratio of zero. We use simulation to show that estimates of this parameter have close to a Gaussian distribution and from this derive an estimate of the statistical power of the design to detect a hypothetical effect of a 50% reduction in rate. We also used simulation to estimate the corresponding power to detect this reduction if the BACI had been physically replicated three times.
Results: The estimated log odds-ratio and the corresponding percent reduction inferred for the VF were -0.02 (SE=0.53) and 1.8%, respectively, and the statistical power of the design to detect a hypothetical effect of a 50% reduction in rate was only .35 but gave an improved power of .7 under the hypothetical replication.
Conclusion: Our results showed that there was very low confidence in this design combined with similar overall roadkill rates being able to detect a 50% reduction. This increased to medium-to-high confidence if the experiment had been replicated in three locations. The very small point estimate of reduction could have been so low compared to a true but modest effect purely by chance, thus our conclusion is that there is very low confidence in any estimate of the VF’s effect obtained using this study’s design in the context of common roadkill rates.
Keywords:
- Roadkill mitigation device
- BACI
- MBACI
- Poisson GLM
- statistical power
How to Cite
References
D'Angelo GJ, D'Angelo JG, Gallagher GR, Osborn DA, Miller KV, Warren RJ. Evaluation of wildlife warning reflectors for altering white‐tailed deer behavior along roadways. Wildlife Society Bulletin. 2006;34:1175-1183.
Wildlife Safety Solutions. What is Virtual Fencing?; 30 Oct 2020.
Available:https://www.wildlifesafe tysolutions.com.au/
Fox S, Potts JM, Pemberton D, Crosswell D. Roadkill mitigation: Trialing virtual fence devices on the west coast of Tasmania. Aust. Mammal. 2019;41:205–211.
DOI: 10.1071/AM18012
Hurlbert SH. Pseudoreplication and the design of ecological field experiments. Ecol. Monogr. 1984;54:187-211.
Coulson G, Bender H. Roadkill mitigation is paved with good intentions: A critique of Fox et al. (2019). Aust. Mammal. 2019;42:122-130.
Available:https://doi.org/10.1071/AM19009
Englefield B, Candy SG, Starling M, McGreevy PD. A Trial of a Solar-Powered, Cooperative Sensor/Actuator, Opto-Acoustical, Virtual Road-Fence to Mitigate Roadkill in Tasmania, Australia. Animals. 2019;9(10):752.
DOI: 10.3390/ani9100752
Fox S, Potts J. Virtual fence devices – a promising innovation: A response to Coulson and Bender (2019). Aust. Mammal. 2022;42(1):131-133.
Available:https://doi.org/10.1071/AM19031
Rytwinski T, van der Ree R, Cunnington GM, Fahrig L, Findlay CS, Houlahan J, et al. Experimental study designs to improve the evaluation of road mitigation measures for wildlife. J. Environ. Manage. 2015; 154:48–64.
DOI: 10.1016/j.jenvman.2015.01.048
Conner MM, Saunders WC, Bouwes N, Jordan C. Evaluating impacts using a BACI design, ratios, and a Bayesian approach with a focus on restoration. Environ. Monit. Assess. 2016;188:1–14. [CrossRef]
Wood SN. Generalized additive models, 2nd ed.; Chapman and Hall/CRC: London, UK; 2017.
Stannard HJ, Wynan MB, Wynan RJ, Dixon BA, Mayadunnage S, Old JM. Can virtual fences reduce wombat road mortalities? Ecol. Eng. 2021;172:106414.
Coulson G, Bender H. Wombat Roadkill Was Not Reduced by a Virtual Fence. Comment on Stannard et al. Can Virtual Fences Reduce Wombat Road Mortalities? Ecol. Eng. 2021;172:106414. Animals. 2022;12:1323.
Available:https://doi.org/10.3390/ani12101323
Mc Cullagh P, Nelder JA. Generalized Linear Models, (2nd Ed.) Chapman and Hall, London, UK; 1989.
Freeberg TM, Lucas JR. Pseudoreplication Is (Still) a Problem. J. Comp. Psychol. 2009;123(4):450–451.
Hurlbert SH. On misinterpretations of pseudoreplication and related matters: A reply to Oksanen. OIKOS. 2004;104:3.
Almeida A, Loy A, Hofmann H. ggplot2 Compatible Quantile-Quantile Plots in R. The R Journal. 2018;10(2):248-261.
DOI: org/10.32614/RJ-2018-051
R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria; 2018.
Haight FA. Handbook of the Poisson Distribution, John Wiley & Sons, New York, NY, USA; 1967.
ISBN 978-0-471-33932-8.
Rytwinski T, Soanes K, Jaeger JA, Fahrig L, Findlay CS, Houlahan J, et al. How effective is road mitigation at reducing road-kill? A meta-analysis. PLoS One. 2016;11:e0166941.
DOI: 10.1371/journal.pone.0166941
Woolson RF, Bean JA, Rojas PB. Sample Size for Case-Control Studies Using Cochran's Statistic. Biometrics. 1984;42(4): 927-932.
Harkness WL. Properties of the Extended Hypergeometric Distribution. Ann. Math. Statist. 1965;36(3):938-945.
-
Abstract View: 62 times
PDF Download: 21 times
