Publication: Measuring Skills in Developing Countries
Loading...
Date
2017-03
ISSN
Published
2017-03
Author(s)
Editor(s)
Abstract
Measures of cognitive, noncognitive, and technical skills are increasingly used in development economics to analyze the determinants of skill formation, the role of skills in economic decisions, or simply because they are potential confounders. Yet in most cases, these measures have only been validated in high-income countries. This paper tests the reliability and validity of some of the most commonly used skills measures in a rural developing context. A survey with a series of skills measurements was administered to more than 900 farmers in western Kenya, and the same questions were asked again after three weeks to test the reliability of the measures. To test predictive power, the study also collected information on agricultural practices and production during the four following seasons. The results show the cognitive skills measures are reliable and internally consistent, while technical skills are difficult to capture and very noisy. The evidence further suggests that measurement error in noncognitive skills is non-classical, as correlations between questions are driven in part by the answering patterns of the respondents and the phrasing of the questions. Addressing both random and systematic measurement error using common psychometric practices and repeated measures leads to improvements and clearer predictions, but does not address all concerns. The paper provides a cautionary tale for naïve interpretations of skill measures. It also points to the importance of addressing measurement challenges to establish the relationship of different skills with economic outcomes. Based on these findings, the paper derives guidelines for skill measurement and interpretation in similar contexts.
Link to Data Set
Citation
“Laajaj, Rachid; Macours, Karen. 2017. Measuring Skills in Developing Countries. Policy Research Working Paper;No. 8000. © World Bank. http://hdl.handle.net/10986/26250 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.Publication From Patriarchy to Policy(Washington, DC: World Bank, 2025-05-29)Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Demand versus Returns? Pro-Poor Targeting of Business Grants and Vocational Skills Training(World Bank, Washington, DC, 2013-03)Interventions aimed at increasing the income generating capacity of the poor, such as vocational training, micro-finance or business grants, are widespread in the developing world. How to target such interventions is an open question. Many programs are self-targeted, but if perceived returns differ from actual returns, those self-selecting to participate may not be those for whom the program is the most effective. The authors analyze an unusual experiment with very high take-up of business grants and vocational skills training, randomly assigned among nearly all households in selected poor rural communities in Nicaragua. On average, the interventions resulted in increased participation in non-agricultural employment and higher income from related activities. The paper investigates whether targeting could have resulted in higher returns by analyzing heterogeneity in impacts by stated baseline demand, prior participation in non-agricultural activities, and a wide range of complementary asset endowments. The results reveal little heterogeneity along observed baseline characteristics. However, the poorest households are more likely to enter and have higher profits in non-agricultural self-employment, while less poor households assigned to the training have higher non-agricultural wages. This heterogeneity appears related to unobserved characteristics that are not revealed by stated baseline demand, and more difficult to target. In this context, self-targeting may reduce the poverty-reduction potential of income generating interventions, possibly because low aspirations limit the poor's ex-ante demand for productive interventions while the interventions have the potential to increase those aspirations. Overall, targeting productive interventions to poor households would not have come at the cost of reducing their effectiveness. By contrast, self-targeting would have limited poverty reduction by excluding the poorest.Publication Transfers, Diversification and Household Risk Strategies : Experimental Evidence with Lessons for Climate Change Adaptation(World Bank, Washington, DC, 2012-04)While climate change is likely to increase weather risks in many developing countries, there is little evidence on effective policies to facilitate adaptation. This paper presents experimental evidence on a program in rural Nicaragua aimed at improving households' risk-management through income diversification. The intervention targeted agricultural households exposed to weather shocks related to changes in rainfall and temperature patterns. It combined a conditional cash transfer with vocational training or a productive investment grant. The authors identify the relative impact of each complementary package based on randomized assignment, and analyze how impacts vary by exposure to exogenous drought shocks. The results show that both complementary interventions provide full protection against drought shocks two years after the end of the intervention. Households that received the productive investment grant also had higher average consumption levels. The complementary interventions led to diversification of economic activities and better protection from shocks compared to beneficiaries of the basic conditional cash transfer and control households. These results show that combining safety nets with productive interventions can help households manage future weather risks and promote longer-term program impacts.Publication Cash Transfers, Behavioral Changes, and Cognitive Development in Early Childhood : Evidence from a Randomized Experiment(World Bank, Washington, DC, 2008-10)A variety of theories of skill formation suggest that investments in schooling and other dimensions of human capital will have lower returns if children do not have adequate levels of cognitive and social skills at an early age. This paper analyzes the impact of a randomized cash transfer program on cognitive development in early childhood in rural Nicaragua. It shows that the program had significant effects on cognitive outcomes, especially language. Impacts are larger for older pre-school age children, who are also more likely to be delayed. The program increased intake of nutrient-rich foods, early stimulation, and use of preventive health care-all of which have been identified as risk factors for development in early childhood. Households increased expenditures on these inputs more than can be accounted for by the increases in cash income only, suggesting that the program changed parents' behavior. The findings suggest that gains in early childhood development outcomes should be taken into account when assessing the benefits of cash transfer programs in developing countries. More broadly, the paper illustrates that gains in early childhood development can result from interventions that facilitate investments made by parents to reduce risk factors for cognitive development.Publication Impact Evaluation of Three Types of Early Childhood Development Interventions in Cambodia(World Bank, Washington, DC, 2013-07)Scaling up early childhood development services has the potential to increase children's cognitive and socio-emotional development and promote school readiness in a large segment of the population. This study used a randomized controlled trial approach to evaluate three scaled-up programs designed to widen access to early childhood development services: formal preschools, community preschools, and home-based services. The impacts of all three programs fell short of expectations because of two key flaws in how they were scaled up. First, implementation did not receive due attention; as a result, school facilities were not completed as planned, community-based programs were not always established, and low, irregular stipends created difficulties in hiring and retaining teachers. Second, the services that were available were not promoted and thus not used as widely as anticipated. The results imply that the quality of programs supplied is critical, as is attention to the demand side of the problem. The finding that these programs fell short of expectations does not mean that interventions such as these are ineffective. Rather, it indicates that quality and demand require careful attention in attempts to scale up early childhood development interventions, and any problems should be addressed prior to evaluating effectiveness.Publication Wealth Gradients in Early Childhood Cognitive Development in Five Latin American Countries(World Bank, Washington, DC, 2014-02)Research from the United States shows that gaps in early cognitive and noncognitive abilities appear early in the life cycle. Little is known about this important question for developing countries. This paper provides new evidence of sharp differences in cognitive development by socioeconomic status in early childhood for five Latin American countries. To help with comparability, the paper uses the same measure of receptive language ability for all five countries. It finds important differences in development in early childhood across countries, and steep socioeconomic gradients within every country. For the three countries where panel data to follow children over time exists, there are few substantive changes in scores once children enter school. These results are robust to different ways of defining socioeconomic status, to different ways of standardizing outcomes, and to selective non-response on the measure of cognitive development.
Users also downloaded
Showing related downloaded files
Publication Government Matters III : Governance Indicators for 1996-2002(World Bank, Washington, DC, 2003-08)The authors present estimates of six dimensions of governance covering 199 countries and territories for four time periods: 1996, 1998, 2000, and 2002. These indicators are based on several hundred individual variables measuring perceptions of governance, drawn from 25 separate data sources constructed by 18 different organizations. The authors assign these individual measures of governance to categories capturing key dimensions of governance and use an unobserved components model to construct six aggregate governance indicators in each of the four periods. They present the point estimates of the dimensions of governance as well as the margins of errors for each country for the four periods. The governance indicators reported here are an update and expansion of previous research work on indicators initiated in 1998 (Kaufmann, Kraay, and Zoido-Lobat 1999a,b and 2002). The authors also address various methodological issues, including the interpretation and use of the data given the estimated margins of errors.Publication Governance Matters VIII : Aggregate and Individual Governance Indicators 1996–2008(2009-06-01)This paper reports on the 2009 update of the Worldwide Governance Indicators (WGI) research project, covering 212 countries and territories and measuring six dimensions of governance between 1996 and 2008: Voice and Accountability, Political Stability and Absence of Violence/Terrorism, Government Effectiveness, Regulatory Quality, Rule of Law, and Control of Corruption. These aggregate indicators are based on hundreds of specific and disaggregated individual variables measuring various dimensions of governance, taken from 35 data sources provided by 33 different organizations. The data reflect the views on governance of public sector, private sector and NGO experts, as well as thousands of citizen and firm survey respondents worldwide. The authors also explicitly report the margins of error accompanying each country estimate. These reflect the inherent difficulties in measuring governance using any kind of data. They find that even after taking margins of error into account, the WGI permit meaningful cross-country comparisons as well as monitoring progress over time. The aggregate indicators, together with the disaggregated underlying indicators, are available at www.govindicators.org.Publication Measuring Financial Inclusion : The Global Findex Database(World Bank, Washington, DC, 2012-04)This paper provides the first analysis of the Global Financial Inclusion (Global Findex) Database, a new set of indicators that measure how adults in 148 economies save, borrow, make payments, and manage risk. The data show that 50 percent of adults worldwide have an account at a formal financial institution, though account penetration varies widely across regions, income groups and individual characteristics. In addition, 22 percent of adults report having saved at a formal financial institution in the past 12 months, and 9 percent report having taken out a new loan from a bank, credit union or microfinance institution in the past year. Although half of adults around the world remain unbanked, at least 35 percent of them report barriers to account use that might be addressed by public policy. Among the most commonly reported barriers are high cost, physical distance, and lack of proper documentation, though there are significant differences across regions and individual characteristics.Publication Governance Matters IV : Governance Indicators for 1996-2004(World Bank, Washington, DC, 2005-06)The authors present the latest update of their aggregate governance indicators, together with new analysis of several issues related to the use of these measures. The governance indicators measure the following six dimensions of governance: (1) voice and accountability; (2) political instability and violence; (3) government effectiveness; (4) regulatory quality; (5) rule of law, and (6) control of corruption. They cover 209 countries and territories for 1996, 1998, 2000, 2002, and 2004. They are based on several hundred individual variables measuring perceptions of governance, drawn from 37 separate data sources constructed by 31 organizations. The authors present estimates of the six dimensions of governance for each period, as well as margins of error capturing the range of likely values for each country. These margins of error are not unique to perceptions-based measures of governance, but are an important feature of all efforts to measure governance, including objective indicators. In fact, the authors give examples of how individual objective measures provide an incomplete picture of even the quite particular dimensions of governance that they are intended to measure. The authors also analyze in detail changes over time in their estimates of governance; provide a framework for assessing the statistical significance of changes in governance; and suggest a simple rule of thumb for identifying statistically significant changes in country governance over time. The ability to identify significant changes in governance over time is much higher for aggregate indicators than for any individual indicator. While the authors find that the quality of governance in a number of countries has changed significantly (in both directions), they also provide evidence suggesting that there are no trends, for better or worse, in global averages of governance. Finally, they interpret the strong observed correlation between income and governance, and argue against recent efforts to apply a discount to governance performance in low-income countries.Publication Design Thinking for Social Innovation(2010-07)Designers have traditionally focused on enchancing the look and functionality of products.