Normal view MARC view ISBD view

Does Size Matter? A Critical Review of Meta-analysis in Agronomy

By: Krupnik, T.J.
Contributor(s): Andersson, J.A | Rusinamhodzi, L | Corbeels, M | Shennan, C | Gerard, B.
Material type: materialTypeLabelArticlePublisher: Cambridge (United Kingdom) : Cambridge University Press, 2019ISSN: 0014-4797; 1469-4441 (Online).Subject(s): Analysis | Agricultural research | Organic agriculture | Conservation agricultureOnline resources: Open Access through Dspace In: Experimental Agriculture v. 55, no. 2, p. 200-229Summary: Intended to test broad hypotheses and arrive at unifying conclusions, meta-analysis is the process of extracting, assembling, and analyzing large quantities of data from multiple publications to increase statistical power and uncover explanatory patterns. This paper describes the ways in which meta-analysis has been applied to support claims and counter-claims regarding two topics widely debated in agricultural research, namely organic agriculture (OA) and conservation agriculture (CA). We describe the origins of debate for each topic and assess prominent meta-analyses considering data-selection criteria, research question framing, and the interpretation and extrapolation of meta-analytical results. Meta-analyses of OA and CA are also examined in the context of the political economy of development-oriented agricultural research. Does size matter? We suggest that it does, although somewhat ironically. While meta-analysis aims to pool all relevant studies and generate comprehensive databases from which broad insights can be drawn, our case studies suggest that the organization of many meta-analyses may affect the generalizability and usefulness of research results. The politicized nature of debates over OA and CA also appear to affect the divergent ways in which meta-analytical results may be interpreted and extrapolated in struggles over the legitimacy of both practices. Rather than resolving scientific contestation, these factors appear to contribute to the ongoing debate. Meta-analysis is nonetheless becoming increasingly popular with agricultural researchers attracted by the power for the statistical inference offered by large datasets. This paper consequently offers three suggestions for how scientists and readers of scientific literature can more carefully evaluate meta-analyses. First, the ways in which papers and data are collected should be critically assessed. Second, the justification of research questions, framing of farming systems, and the scales at which research results are extrapolated and discussed should be carefully evaluated. Third, when applied to strongly politicized topics situated in an arena of scientific debate, as is the case with OA and CA, more conservative interpretations of meta-analytical results that recognize the socially and politically embedded nature of agricultural research is are needed.
Tags from this library: No tags from this library for this title. Log in to add tags.
    average rating: 0.0 (0 votes)
Item type Current location Call number Status Date due Barcode Item holds
Article CIMMYT Knowledge Center: John Woolston Library

Lic. Jose Juan Caballero Flores

 

Available
Total holds: 0

Peer review

Open Access

Intended to test broad hypotheses and arrive at unifying conclusions, meta-analysis is the process of extracting, assembling, and analyzing large quantities of data from multiple publications to increase statistical power and uncover explanatory patterns. This paper describes the ways in which meta-analysis has been applied to support claims and counter-claims regarding two topics widely debated in agricultural research, namely organic agriculture (OA) and conservation agriculture (CA). We describe the origins of debate for each topic and assess prominent meta-analyses considering data-selection criteria, research question framing, and the interpretation and extrapolation of meta-analytical results. Meta-analyses of OA and CA are also examined in the context of the political economy of development-oriented agricultural research. Does size matter? We suggest that it does, although somewhat ironically. While meta-analysis aims to pool all relevant studies and generate comprehensive databases from which broad insights can be drawn, our case studies suggest that the organization of many meta-analyses may affect the generalizability and usefulness of research results. The politicized nature of debates over OA and CA also appear to affect the divergent ways in which meta-analytical results may be interpreted and extrapolated in struggles over the legitimacy of both practices. Rather than resolving scientific contestation, these factors appear to contribute to the ongoing debate. Meta-analysis is nonetheless becoming increasingly popular with agricultural researchers attracted by the power for the statistical inference offered by large datasets. This paper consequently offers three suggestions for how scientists and readers of scientific literature can more carefully evaluate meta-analyses. First, the ways in which papers and data are collected should be critically assessed. Second, the justification of research questions, framing of farming systems, and the scales at which research results are extrapolated and discussed should be carefully evaluated. Third, when applied to strongly politicized topics situated in an arena of scientific debate, as is the case with OA and CA, more conservative interpretations of meta-analytical results that recognize the socially and politically embedded nature of agricultural research is are needed.

Maize CRP FP1 - Sustainable intensification of maize-based farming systems

Text in English

There are no comments for this item.

Log in to your account to post a comment.

Click on an image to view it in the image viewer

baner

International Maize and Wheat Improvement Center (CIMMYT) © Copyright 2015. Carretera México-Veracruz. Km. 45, El Batán, Texcoco, México, C.P. 56237.
Monday –Friday 9:00 am. 17:00 pm. If you have any question, please contact us at CIMMYT-Knowledge-Center@cgiar.org

Centro Internacional de Mejoramiento de Maíz y Trigo (CIMMYT) © Copyright 2015. Carretera México-Veracruz. Km. 45, El Batán, Texcoco, México, C.P. 56237.
Lunes –Viernes 9:00 am. 17:00 pm. Si tiene cualquier pregunta, contáctenos a CIMMYT-Knowledge-Center@cgiar.org