Publication: Measuring Skills in Developing Countries
Loading...
Published
2017-03
ISSN
Date
2017-03-08
Author(s)
Editor(s)
Abstract
Measures of cognitive, noncognitive, and technical skills are increasingly used in development economics to analyze the determinants of skill formation, the role of skills in economic decisions, or simply because they are potential confounders. Yet in most cases, these measures have only been validated in high-income countries. This paper tests the reliability and validity of some of the most commonly used skills measures in a rural developing context. A survey with a series of skills measurements was administered to more than 900 farmers in western Kenya, and the same questions were asked again after three weeks to test the reliability of the measures. To test predictive power, the study also collected information on agricultural practices and production during the four following seasons. The results show the cognitive skills measures are reliable and internally consistent, while technical skills are difficult to capture and very noisy. The evidence further suggests that measurement error in noncognitive skills is non-classical, as correlations between questions are driven in part by the answering patterns of the respondents and the phrasing of the questions. Addressing both random and systematic measurement error using common psychometric practices and repeated measures leads to improvements and clearer predictions, but does not address all concerns. The paper provides a cautionary tale for naïve interpretations of skill measures. It also points to the importance of addressing measurement challenges to establish the relationship of different skills with economic outcomes. Based on these findings, the paper derives guidelines for skill measurement and interpretation in similar contexts.
Link to Data Set
Citation
“Laajaj, Rachid; Macours, Karen. 2017. Measuring Skills in Developing Countries. Policy Research Working Paper;No. 8000. © World Bank. http://hdl.handle.net/10986/26250 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication Climate and Social Sustainability in Fragility, Conflict, and Violence Contexts(Washington, DC: World Bank, 2026-01-07)Climate change is widely recognized as a driver of violent conflict, but its broader social effects remain less understood. Ignoring these dimensions risks a vicious cycle where climate policies might undermine socially just adaptation. Evidence is still limited on how climate shocks influence political participation, trust, or migration. This paper helps fill that gap by examining links between climate change, conflict, and social sustainability, with a focus on inclusion, resilience, cohesion, and legitimacy. Using secondary data from 2019–24, the study applies simple correlation-based methods to test three hypotheses on the nature, severity, and composition of these associations. The analysis combines multiple climate impact measures, new conflict classifications, recent social sustainability frameworks, and controls for population and geography. The results reveal strong correlations—not causation—between climate events and contexts of fragility, conflict, and violence. Climate impacts are most pronounced in both national and subnational conflict settings. The study also finds robust links between fragility, conflict, and violence and low levels of social sustainability, reflecting its role as both a driver and consequence of conflict. Some dimensions—such as violent events and insecurity—appear weaker in areas most affected by climate shocks. Two of the hypotheses are supported, and one remains inconclusive.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication Investment in Emerging and Developing Economies(Washington, DC: World Bank, 2026-01-07)The world faces a pressing challenge to meet key development objectives amid slowing growth and rising macroeconomic and geopolitical risks. With the number of job seekers rising rapidly, infrastructure shortfalls continuing to be large, and climate costs mounting, the case for a significant investment push has never been stronger. Yet the capacity to respond in many emerging markets and developing economies has eroded. Since the global financial crisis, investment growth has slowed to about half its pace in the 2000s, with both public and private investment weakening. Foreign direct investment inflows—a critical source of capital, technology, and managerial know-how—have also fallen sharply and become increasingly concentrated, leaving low-income countries with only a marginal share. The risks of further retrenchment are significant, as trade tensions, policy uncertainty, and elevated debt levels continue to weigh on investment. Reigniting momentum will require ambitious domestic reforms to strengthen institutions, rebuild macro-fiscal stability, and deepen trade and investment integration—the foundations of a supportive business climate. At the same time, international cooperation is indispensable. A renewed commitment to a predictable system of cross-border trade and investment flows, combined with scaled-up financial support and sustained technical assistance, is essential to help emerging markets and developing economies—especially low-income countries and economies in fragile and conflict situations—bridge financing gaps and implement the domestic reforms needed to restore investment as an engine of growth, jobs, and development.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Demand versus Returns? Pro-Poor Targeting of Business Grants and Vocational Skills Training(World Bank, Washington, DC, 2013-03)Interventions aimed at increasing the income generating capacity of the poor, such as vocational training, micro-finance or business grants, are widespread in the developing world. How to target such interventions is an open question. Many programs are self-targeted, but if perceived returns differ from actual returns, those self-selecting to participate may not be those for whom the program is the most effective. The authors analyze an unusual experiment with very high take-up of business grants and vocational skills training, randomly assigned among nearly all households in selected poor rural communities in Nicaragua. On average, the interventions resulted in increased participation in non-agricultural employment and higher income from related activities. The paper investigates whether targeting could have resulted in higher returns by analyzing heterogeneity in impacts by stated baseline demand, prior participation in non-agricultural activities, and a wide range of complementary asset endowments. The results reveal little heterogeneity along observed baseline characteristics. However, the poorest households are more likely to enter and have higher profits in non-agricultural self-employment, while less poor households assigned to the training have higher non-agricultural wages. This heterogeneity appears related to unobserved characteristics that are not revealed by stated baseline demand, and more difficult to target. In this context, self-targeting may reduce the poverty-reduction potential of income generating interventions, possibly because low aspirations limit the poor's ex-ante demand for productive interventions while the interventions have the potential to increase those aspirations. Overall, targeting productive interventions to poor households would not have come at the cost of reducing their effectiveness. By contrast, self-targeting would have limited poverty reduction by excluding the poorest.Publication Transfers, Diversification and Household Risk Strategies : Experimental Evidence with Lessons for Climate Change Adaptation(World Bank, Washington, DC, 2012-04)While climate change is likely to increase weather risks in many developing countries, there is little evidence on effective policies to facilitate adaptation. This paper presents experimental evidence on a program in rural Nicaragua aimed at improving households' risk-management through income diversification. The intervention targeted agricultural households exposed to weather shocks related to changes in rainfall and temperature patterns. It combined a conditional cash transfer with vocational training or a productive investment grant. The authors identify the relative impact of each complementary package based on randomized assignment, and analyze how impacts vary by exposure to exogenous drought shocks. The results show that both complementary interventions provide full protection against drought shocks two years after the end of the intervention. Households that received the productive investment grant also had higher average consumption levels. The complementary interventions led to diversification of economic activities and better protection from shocks compared to beneficiaries of the basic conditional cash transfer and control households. These results show that combining safety nets with productive interventions can help households manage future weather risks and promote longer-term program impacts.Publication Cash Transfers, Behavioral Changes, and Cognitive Development in Early Childhood : Evidence from a Randomized Experiment(World Bank, Washington, DC, 2008-10)A variety of theories of skill formation suggest that investments in schooling and other dimensions of human capital will have lower returns if children do not have adequate levels of cognitive and social skills at an early age. This paper analyzes the impact of a randomized cash transfer program on cognitive development in early childhood in rural Nicaragua. It shows that the program had significant effects on cognitive outcomes, especially language. Impacts are larger for older pre-school age children, who are also more likely to be delayed. The program increased intake of nutrient-rich foods, early stimulation, and use of preventive health care-all of which have been identified as risk factors for development in early childhood. Households increased expenditures on these inputs more than can be accounted for by the increases in cash income only, suggesting that the program changed parents' behavior. The findings suggest that gains in early childhood development outcomes should be taken into account when assessing the benefits of cash transfer programs in developing countries. More broadly, the paper illustrates that gains in early childhood development can result from interventions that facilitate investments made by parents to reduce risk factors for cognitive development.Publication Impact Evaluation of Three Types of Early Childhood Development Interventions in Cambodia(World Bank, Washington, DC, 2013-07)Scaling up early childhood development services has the potential to increase children's cognitive and socio-emotional development and promote school readiness in a large segment of the population. This study used a randomized controlled trial approach to evaluate three scaled-up programs designed to widen access to early childhood development services: formal preschools, community preschools, and home-based services. The impacts of all three programs fell short of expectations because of two key flaws in how they were scaled up. First, implementation did not receive due attention; as a result, school facilities were not completed as planned, community-based programs were not always established, and low, irregular stipends created difficulties in hiring and retaining teachers. Second, the services that were available were not promoted and thus not used as widely as anticipated. The results imply that the quality of programs supplied is critical, as is attention to the demand side of the problem. The finding that these programs fell short of expectations does not mean that interventions such as these are ineffective. Rather, it indicates that quality and demand require careful attention in attempts to scale up early childhood development interventions, and any problems should be addressed prior to evaluating effectiveness.Publication Wealth Gradients in Early Childhood Cognitive Development in Five Latin American Countries(World Bank, Washington, DC, 2014-02)Research from the United States shows that gaps in early cognitive and noncognitive abilities appear early in the life cycle. Little is known about this important question for developing countries. This paper provides new evidence of sharp differences in cognitive development by socioeconomic status in early childhood for five Latin American countries. To help with comparability, the paper uses the same measure of receptive language ability for all five countries. It finds important differences in development in early childhood across countries, and steep socioeconomic gradients within every country. For the three countries where panel data to follow children over time exists, there are few substantive changes in scores once children enter school. These results are robust to different ways of defining socioeconomic status, to different ways of standardizing outcomes, and to selective non-response on the measure of cognitive development.
Users also downloaded
Showing related downloaded files
Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication Assessing the Environmental, Forest, and Other Natural Resource Aspects of Development Policy Lending(Washington, DC, 2008)The operations policy on Development Policy Lending (DPL), approved by the Board in August 2004, requires that the Bank systematically analyze whether specific country policies supported by an operation are likely to have "significant effects" on the country's environment, forests, and other natural resources. The implicit objective behind this requirement is to ensure that there is adequate capacity in the country to deal with adverse effects on the environment, forests, and other natural resources that the policies could trigger, even at the program design stage. DPL operations are associated with a whole array of policies such as macro policy reforms, fiscal policies, and specific sectoral policies, particularly in key sectors such as agriculture, health and education, energy, etc. In some cases, the operation may deal directly with reforms in certain environmentally sensitive sectors such as energy, transport, water and sanitation, agriculture, and forestry. In these cases, there is an obvious need for careful analysis of environmental, natural resource, and forestry impacts. In other cases, such as public sector reform and governance, there is less potential for likely significant impacts on the natural environment and natural resources. The toolkit is designed to be concise and user-friendly. It consists of three specific modules. The first module identifies relevant transmission channels through which the proposed reform would have a likely effect on the identified environmental, forest, and other natural resource priorities. The second module provides assistance in identifying key environmental issues in the country, regions, or sectors likely to be influenced by the DPL program. The third module presents different tools and methodologies for rapid assessment of the likely significant effects of each reform.Publication Mining in Africa(Washington, DC: World Bank and Agence Francaise de developpement, 2017-02-21)This study focuses on the local and regional impact of large-scale gold mining in Africa in the context of a mineral boom in the region since 2000. It contributes to filling a gap in the literature on the welfare effects of mineral resources, which, until now, has concentrated more on the national or macroeconomic impacts. Economists have long been intrigued by the paradox that a rich endowment of natural resources may retard economic performance, particularly in the case of mineral-exporting developing countries. Studies of this phenomenon, known as the “resource curse,” examine the economy-wide consequences of mineral exports. Africa’s resource boom has lifted growth, but has been less successful in improving people’s welfare. Yet much of the focus in academic and policy circles has been on appropriate management of the macro-fiscal and governance risks that have historically undermined development outcomes. This study focuses instead on the fortune of local communities where resources are located. It aims to better inform public policy and corporate behavior on the welfare of communities in Africa in which the extraction of resources takes place.Publication Ensuring Quality to Gain Access to Global Markets(Washington, DC: World Bank; Braunschweig, Germany: Physikalisch-Technische Bundesanstalt, 2019-03-12)In a modern world with rapidly growing international trade, countries compete less on the availability of natural resources, geographical advantages, and lower labor costs and more on factors related to a firm’s ability to enter and compete in new markets. One such factor is the ability to demonstrate the quality and safety of goods and services expected by consumers and to confirm compliance with international standards. To ensure such compliance, a sound quality infrastructure (QI) ecosystem is essential. Jointly developed by the World Bank Group and the National Metrology Institute of Germany, Ensuring Quality to Gain Access to Global Markets: A Reform Toolkit is designed to help development partners and governments analyze a country’s QI ecosystem, provide recommendations to design and implement reforms, and enhance the capacity of QI institutions. The toolkit’s 12 modules provide a systematic, holistic knowledge resource—supported by practical case studies and examples—for QI diagnostics, reform interventions and approaches, and monitoring and evaluation. Related diagnostic tools are also available online at http://www.worldbank.org/qi and https://www.ptb.de/qitoolkit.Publication Evolution of Quality Infrastructure Investment in Japan(World Bank, Washington, DC, 2021-04)This report reviews the evolution of Quality Infrastructure Investments (QII) in the Japanese urban sector. The report is structured around the six QII principles (sustainable development, economic efficiency, environmental considerations, disaster resilience, social considerations and governance) and the three phases of post-war development in Japan. Specifically, the evolution of the six principles is reviewed in relation to historical events during the periods 1956–73, 1974–90, and 1990–2020. The report has the associated case studies for urban practitioners' further read.