Publication: Evaluation : Why, for Whom and How?
No Thumbnail Available
Date
2010
ISSN
0265-5012
Published
2010
Author(s)
Editor(s)
Abstract
The overall objective of this article is to discuss current theoretical debates in the evaluation literature to assess their relevance for agriculture. After noting the 'bad press' of monitoring and evaluation (M&E) in agriculture, the literature is selectively reviewed to see what light is shed from different evaluation paradigms and methodologies. Experiences in the health sector are then examined in greater depth, emphasising debates around randomised controlled trials (RCTs). The final section considers some possible ways forward.
Link to Data Set
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Citations
- Cited 3 times in Scopus (view citations)
Collections
Related items
Showing items related by metadata.
Publication Cash for Coolers : Evaluating a Large-Scale Appliance Replacement Program in Mexico(American Economic Association, 2014-11)This paper evaluates a large-scale appliance replacement program in Mexico that from 2009 to 2012 helped 1.9 million households replace their old refrigerators and air conditioners with energy-efficient models. Using household-level billing records from the universe of Mexican residential customers, we find that refrigerator replacement reduces electricity consumption by 8 percent, about one-quarter of what was predicted by ex ante analyses. Moreover, we find that air conditioning replacement actually increases electricity consumption. Overall, we find that the program is an expensive way to reduce externalities from energy use, reducing carbon dioxide emissions at a program cost of over $500 per ton.Publication Evaluating the Effects of Community-based Organization Engagement on HIV and AIDS-related Risk Behavior in Kenya(Taylor and Francis, 2013-06-09)International donors have increasingly shifted AIDS funding directly to community-based organizations (CBOs) with the assumption that responding to the epidemic is best achieved at the community level. The World Bank, ICF Macro, and the National Council for Population and Development in Kenya, conducted a study to evaluate the community response in Kenya. The study used a quasi-experimental design comparing seven study communities and seven comparison communities in Nyanza Province and Western Province. We examined the impact of CBO activity on individual and community-level outcomes, including HIV knowledge, awareness and perceptions, sexual risk behavior, and social transformation (gender ideology and social capital). The study consisted of two components: a household survey conducted in all 14 communities, and qualitative data collected in a subset of communities. Individuals in communities with higher CBO engagement were significantly more likely to have reported consistent condom use. Higher CBO engagement was associated with some measures of social capital, including participation in local and national elections, and participation in electoral campaigns. CBOs provide added value in addressing the HIV and AIDS epidemic in very targeted and specific ways that are closely tied to the services they provide (e.g., prevention education); thus, increasing CBO engagement can be an effective measure in scaling up prevention efforts in those areas.Publication Do Returns to Education Depend on How and Whom You Ask?(Elsevier, 2017-10)Returns to education remain an important parameter of interest in economic analysis. A large literature estimates these returns, often carefully addressing issues such as selection into wage employment and endogeneity in terms of completed schooling. There has been much less exploration of whether the estimates of Mincerian returns depend on how information about wage work is collected. Relying on a survey experiment in Tanzania, this paper finds that estimates of the returns to education vary by questionnaire design, but not by whether the information on employment and wages is self-reported or collected by a proxy respondent. The differences derived from questionnaire type are substantial, varying from higher returns of 5 percentage points among the most well educated men to 16 percentage points among the least well educated women. These differences are at magnitudes similar to the bias in ordinary least squares estimation, which receives considerable attention in the literature. The findings demonstrate that survey design matters in the estimation of returns to schooling and that care is needed in comparing across contexts and over time, particularly if the data are generated through different surveys.Publication What are Public Services Worth, and to Whom? Non-parametric Estimation of Capitalization in Pune(World Bank, Washington, DC, 2006-05)The availability and quality of basic public services are important determinants of urban quality of life. In many cities, rapid population growth and fiscal constraints are limiting the extent to which urban governments can keep up with increasing demand for these services. It therefore becomes important to prioritize provision of those services to best reflect local demand. The authors present a strategy to estimate the demand for public services, which is sensitive to heterogeneity in preferences across types of households, and the nonparametric estimation addresses problems arising from functional form restrictions. Using data from Pune, India, they estimate the demand for public services, as represented by the marginal change in the self-assessed monthly rental price of dwellings from the services. The authors find that the value of publicly provided services accruing to the poor is greater than that going to wealthier households, and even untargeted across-the-board investment in specific services can be progressive.Publication Do Labor Statistics Depend on How and to Whom the Questions Are Asked? Results from a Survey Experiment in Tanzania(World Bank, 2011-10-18)Labor market statistics are critical for assessing and understanding economic development. However, widespread variation exists in how labor statistics are collected in household surveys. This paper analyzes the effects of alternative survey design on employment statistics by implementing a randomized survey experiment in Tanzania. Two features of the survey design are assessed – the level of detail of the employment questions and the type of respondent. It turns out that both features have relevant and statistically significant effects on employment statistics. Using a short labor module without screening questions induces many individuals to adopt a broad definition of employment, incorrectly including domestic duties. But after reclassifying those in domestic work as ‘not working’ in order to obtain the correct ILO classification, the short module turns out to generate lower female employment rates, higher working hours for both men and women who are employed, and lower rates of wage employment than the detailed module. Response by proxy rather than self-report has no effect on female labor statistics but yields substantially lower male employment rates, mostly due to underreporting of agricultural activity. The large impacts of proxy responses on male employment rates are attenuated when proxy informants are spouses and individuals with some schooling.
Users also downloaded
Showing related downloaded files
No results found.