Publication: Improving the Quality of Survey Estimates from Longitudinal Studies: An Application to LSMS Panel Surveys
Loading...
Date
2025-01-10
ISSN
Published
2025-01-10
Author(s)
Editor(s)
Abstract
Longitudinal surveys are an invaluable source for analyzing the current state of and changes in human populations over time. However, maintaining the accuracy of estimates from a panel sample becomes more difficult as the length of the panel survey increases. Key concerns are the lack of sample representativeness, due to the sample erosion caused by deaths and movers and the impact of new births, and migration flows. Moreover, sample fatigue introduces an increasing measurement error. Correct design, implementation, and use of a panel survey considers a set of methods to deal with these problems at different stages of the statistical process: the sampling design, the data collection, and the estimation. This paper focuses on the case of panels with a rotating sample design. This case represents a powerful hybrid solution for facing the impact of panel dynamics on sample representativeness. Empirically, the paper focuses on the estimation procedures. Using data from the Uganda National Panel Survey, the longest Living Standards Measurement Study panel survey, it experimentally evaluates the suggested technique. In summary, the findings show that the calibrated generalized weight share method base estimator yields individual-level statistics that appear to be more accurate than those produced by the current Uganda National Panel Survey estimator. Additionally, the calibrated generalized weight share method base cross-sectional estimates on the transition matrix show a generally higher degree of stability when the sample is changed compared to the current Uganda National Panel Survey estimates.
Link to Data Set
Citation
“Falorsi, Piero; Righi, Paolo; Ponzini, Giulia. 2025. Improving the Quality of Survey Estimates from Longitudinal Studies: An Application to LSMS Panel Surveys. Policy Research Working Paper; 11026. © World Bank. http://hdl.handle.net/10986/42655 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.Publication Economic Consequences of Trade and Global Value Chain Integration(World Bank, Washington, DC, 2025-04-04)This paper introduces a new approach to measuring Global Value Chains (GVC), crucial for informed policy-making. It features a tripartite classification (backward, forward, and two-sided) covering trade and production data. The findings indicate that traditional trade-based GVC metrics significantly underestimate global GVC activity, especially in sectors like services and upstream manufacturing, and overstate risks in early trade liberalization stages. Additionally, conventional backward-forward classifications over-estimate backward linkages. The paper further applies these measures empirically to assess how GVC participation mediates the impact of demand shocks on domestic output, highlighting both the exposure and stabilizing potential of GVC integration. These new measures are comprehensively available on the World Bank’s WITS Platform, providing a key resource for GVC analysis.Publication Participation in Pension Programs in Low- and Middle-Income Countries(Washington, DC: World Bank, 2025-04-24)Low- and middle-income countries are aging rapidly but stagnation of growth in participation in pension programs, due to widespread informal employment, presents a major fiscal challenge. Some claim that improving the design of pension program rules can encourage more pension contributions, while others push for universal non-contributory pensions. This paper reviews the recent academic literature on the determinants of active participation in pension systems in high- informality settings. An emerging body of evidence shows that participation responds significantly to financial incentives as well as nonfinancial obstacles. At the same time, pensions are imperfect substitutes for other strategies to cover longevity risk, including support through the family, which will remain crucial for many older people in fiscally constrained environments. Therefore, policy makers should integrate the design of contributory pensions, social pensions, and policies that facilitate other forms of elderly support and consider how all three interact. To inform such efforts, these interactions must be more systematically investigated, and the empirical evidence must be expanded beyond a small number of middle-income countries.Publication Capitalizing on Digital Transformation to Enhance the Effectiveness of Property Institutions(Washington, DC: World Bank, 2025-04-14)Property registries have long been a pillar of state capacity and a basis for private market activity. While registry establishment and operation traditionally were costly and time consuming, digital technology makes low-cost registry operation and wide outreach easier. To guide developing countries aiming to establish such registries and measure progress, this paper develops indicators (in terms of digital coverage, interoperability, and property taxation for local service delivery and public land management) of effective digital registry service provision. Data from 85 countries highlight vast differences and provide suggestions for strategic reforms as well as a basis for measuring progress over time. Expanding geographical coverage and collecting these indicators on a regular basis could provide guidance to improve the way in which, by protecting property, the state creates the basis for widely shared prosperity and a livable environment.Publication Bridging the Gap(Washington, DC: World Bank, 2025-04-21)This paper examines tax revenue shortfalls in South Asian countries. On average during 2019–23, South Asian revenues totaled 18 percent of GDP—well below the average 24 percent among emerging market and developing economies (EMDEs). Econometric estimates from stochastic frontier analysis, which control for tax rates and the size of potential tax bases, suggest that tax revenues in the region are 1 to 7 percentage points of GDP below potential, with shortfalls in five of the region’s eight countries larger than in the average EMDE. Even after controlling for country characteristics, such as widespread informal economic activity outside the tax net and large agriculture sectors, sizable tax gaps remain, suggesting the need for improved tax policy and administration. The paper discusses and provides evidence from international experience with reforms to raise government revenues.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Effectiveness of Interventions Aimed atImproving Women’s Employability and Quality of Work : A Critical Review(World Bank, Washington, DC, 2012-09)This paper examines the effectiveness of a variety of policy interventions that have been tried in developing and transition economies with the goal of improving women's employability and quality of work. The programs include active labor market programs, education and training programs, programs that facilitate work (such as childcare subsidies, parental leave programs and land titling programs), microfinance programs, entrepreneurship and leadership programs, and conditional cash transfer programs. Some of these policy interventions were undertaken to increase employment, some to increase female employment, and some for other reasons. All of these programs have been subjected to impact evaluations of different kinds and some also to rigorous cost-benefit analyses. Many were found to be effective in increasing women's quantity of work as measured by increased rates of labor market participation and number of hours worked. In some cases, the programs also increased women's quality of work, for example, by increasing the capacity for women to work in the formal rather than the informal sector where wages are higher and where women are more likely to have access to health, retirement, and other benefits.Publication Attrition in Longitudinal Household Survey Data : Some Tests for Three Developing-Country Samples(World Bank, Washington, DC, 2000-09)For capturing dynamic demographic relationships, longitudinal household data can have considerable advantages over more widely used cross-sectional data. But because the collection of longitudinal data may be difficult and expensive, analysts must assess the magnitudes of the problems, specific to longitudinal, but not to cross-sectional data. One problem that concerns many analysts is that sample attrition may make the interpretation of estimates problematic. Such attrition may be especially severe where there is considerable migration between rural, and urban areas. And attrition is likely to be selective on such characteristics as schooling, so high attrition is likely to bias estimates. The authors consider the extent, and implications of attrition for three longitudinal household surveys from Bolivia, Kenya, and South Africa that report very high annual attrition rates between survey rounds. Their estimates indicate that: 1) the means for a number of critical outcome, and family background variables differ significantly between those who are lost to follow-up, and those who are re-interviewed. 2) A number of family background variables are significant predictors of attrition. 3) Nevertheless, the coefficient estimates for standard family background variables in regressions, and probit equations for the majority of outcome variables in all three data sets, are not significantly affected by attrition. So attrition is apparently not a general problem for obtaining consistent estimates of the coefficients of interest for most of these outcomes. These results, which are very similar to those for industrial countries, suggest that multivariate estimates of behavioral relations may not be biased because of attrition. This would support the collection of longitudinal data.Publication Estimating Quarterly Poverty Rates Using Labor Force Surveys : A Primer(World Bank, Washington, DC, 2013-05)The paper shows how Labor Force Surveys can be used effectively to estimate poverty rates using Household Expenditure Surveys and cross-survey imputation methods. With only two rounds of Household Expenditure Survey data for Morocco (2001 and 2007), the paper estimates quarterly poverty rates for the period 2001-2010 by imputing household expenditures into the Labor Force Surveys. The results are encouraging. The methodology is able to accurately reproduce official poverty statistics by combining current Labor Force Surveys with previous period Household Expenditure Surveys, and vice versa. Although the focus is on head-count poverty, the method can be applied to any welfare indicator that is a function of household income or expenditure, such as the poverty gap or the Gini index of inequality. The newly produced time-series of poverty rates can help researchers and policy makers to: (a) study the determinants of poverty reduction or use poverty as an explanatory factor in cross-section and panel models; (b) forecast poverty rates based on a time-series model fitted to the data; and (c) explore the linkages between labor market conditions and poverty and simulate the effects of policy reforms or economic shocks. This is a promising research agenda that can expand significantly the tool-kit of the welfare economist.Publication Findings from the Bhutan Learning Quality Survey(Washington, DC, 2009-01)The education sector in Bhutan has been growing steadily since the 1960s and concomitantly the literacy rates of the population have also been steadily going up over time. The mostly mountainous country regards education as central to its national development. Every cohort has seen an increasing share of children going to school and the education system now strains to keep up with the speed with which enrolment has expanded over the last ten years, in-line with Bhutan's commitment to meet the education Millennium Development Goals (MDGs). This report is structured as follows: section two presents the background and context of Bhutan's education system; section three discusses previous theoretical and empirical literature on education quality; section four describes the sampling design methodology, the sample and empirical methodology used in this study; section five presents findings on students' actual knowledge in three subjects and their corresponding scaled scores; section six presents the results of multivariate regression analysis for estimating school, teacher and child related correlates of learning outcomes; section seven profiles teachers in grades two and four and the education process; and section eight concludes with brief summary, discussion of policy implications, and recommendation for future research.Publication The Consequences of Child Labor : Evidence from Longitudinal Data in Rural Tanzania(World Bank, Washington, DC, 2008-07)This paper exploits a unique longitudinal data set from Tanzania to examine the consequences of child labor on education, employment choices, and marital status over a 10-year horizon. Shocks to crop production and rainfall are used as instrumental variables for child labor. For boys, the findings show that a one-standard-deviation (5.7 hour) increase in child labor leads 10 years later to a loss of approximately one year of schooling and to a substantial increase in the likelihood of farming and of marrying at a younger age. Strikingly, there are no significant effects on education for girls, but there is a significant increase in the likelihood of marrying young. The findings also show that crop shocks lead to an increase in agricultural work for boys and instead lead to an increase in chore hours for girls. The results are consistent with education being a lower priority for girls and/or with chores causing less disruption for education than agricultural work. The increased chore hours could also account for the results on marriage for girls.
Users also downloaded
Showing related downloaded files
Publication Expanding Financial Inclusion through Digital Financial Services(Washington, DC: World Bank, 2024-12-23)Worldwide, account ownership increased by 50 percent in the 10 years spanning 2011 to 2021, to reach 76 percent of the global adult population. The goal of financial inclusion is not just for more adults to have accounts but for account owners to benefit from using them, such as for digital payments, which provide a range of positive benefits that extend far beyond convenience. This paper reviews the evidence demonstrating how digital payments can expand financial inclusion among recipients and encourage the use of additional formal financial services, such as savings, credit, and insurance. It explores how digital transactions offer greater security and privacy, especially for women, as well as opportunities to build a digital credit history for credit risk assessments. The introduction of digital payments to low-income adults brings some risks, however, such as fraud and phishing scams targeting accounts, over indebtedness in digital credit, and customers receiving incomplete or incorrect information on the fees and costs of financial products.Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Measuring the Risk of Corruption and Its Price Impact in North Macedonia 2011–2022(Washington, DC: World Bank, 2024-12-20)Public procurement in North Macedonia amounted to 16 percent of total government expenditure in 2018, or 5 percent of gross domestic product. The country’s public procurement is also vulnerable to corruption risks, which typically push prices up, leading to overspending. To support better budget policies, this paper maps corruption and state capture risks using administrative data on public procurement and examines their impact on prices. The analysis finds that overall corruption risk decreased slightly in 2011–22, with, for example, the single bidding rate remaining around 30 percent. Estimated overpricing at the contracting stage due to corruption risks ranged between 5 and 6 percent of spending throughout the period. The highest savings potentials are presented by lowering single bidding, increasing the use of a simplified open procedure, and advertising tendering opportunities longer. Network analysis of contracting relationships reveals that the 2017 change in government weakened the centrality of high corruption risk groups of organizations, leading to an overall higher integrity core.Publication Poverty, Prosperity, and Planet Report 2024(Washington, DC: World Bank, 2024-10-15)The Poverty, Prosperity, and Planet Report 2024 is the latest edition of the series formerly known as Poverty and Shared Prosperity. The report emphasizes that reducing poverty and increasing shared prosperity must be achieved in ways that do not come at unacceptably high costs to the environment. The current “polycrisis”—where the multiple crises of slow economic growth, increased fragility, climate risks, and heightened uncertainty have come together at the same time—makes national development strategies and international cooperation difficult. Offering the first post-Coronavirus (COVID)-19 pandemic assessment of global progress on this interlinked agenda, the report finds that global poverty reduction has resumed but at a pace slower than before the COVID-19 crisis. Nearly 700 million people worldwide live in extreme poverty with less than US$2.15 per person per day. Progress has essentially plateaued amid lower economic growth and the impacts of COVID-19 and other crises. Today, extreme poverty is concentrated mostly in Sub-Saharan Africa and fragile settings. At a higher standard more typical of upper-middle-income countries—US$6.85 per person per day—almost one-half of the world is living in poverty. The report also provides evidence that the number of countries that have high levels of income inequality has declined considerably during the past two decades, but the pace of improvements in shared prosperity has slowed, and that inequality remains high in Latin America and the Caribbean and Sub-Saharan Africa. Worldwide, people’s incomes today would need to increase fivefold on average to reach a minimum prosperity threshold of US$25 per person per day. Where there has been progress in poverty reduction and shared prosperity, there is evidence of an increasing ability of countries to manage natural hazards, but climate risks are significantly higher in the poorest settings. Nearly one in five people globally is at risk of experiencing welfare losses due to an extreme weather event from which they will struggle to recover. The interconnected issues of climate change and poverty call for a united and inclusive effort from the global community. Development cooperation stakeholders—from governments, nongovernmental organizations, and the private sector to communities and citizens acting locally in every corner of the globe—hold pivotal roles in promoting fair and sustainable transitions. By emphasizing strategies that yield multiple benefits and diligently monitoring and addressing trade-offs, we can strive toward a future that is prosperous, equitable, and resilient.