Publication: A Metadata Schema for Data from Experiments in the Social Sciences
Loading...
Files
762 downloads
22 downloads
Published
2023-02
ISSN
Date
2023-02-14
2023-03-06
2023-03-06
Author(s)
Editor(s)
Abstract
The use of randomized controlled trials (RCTs) in the social sciences has greatly expanded, resulting in newly abundant, high-quality data that can be reused to perform methods research in program evaluation, to systematize evidence for policymakers, and for replication and training purposes. However, potential users of RCT data often face significant barriers to discovery and reuse. This paper proposes a metadata schema that standardizes RCT data documentation and can serve as the basis for one—or many, interoperable —data catalogs that make such data easily findable, searchable, and comparable, and thus more readily reusable for secondary research. The schema is designed to document the unique properties of RCT data. Its set of fields and associated encoding schemes (acceptable formats and values) can be used to describe any dataset associated with a social science RCT. The paper also makes recommendations for implementing a catalog or database based on this metadata schema.
Link to Data Set
Citation
“Cavanagh, Jack; Fliegner, Jasmin Claire; Kopper, Sarah; Sautmann, Anja. 2023. A Metadata Schema for Data from Experiments in the Social Sciences. Policy Research Working Papers;10296. © World Bank. http://hdl.handle.net/10986/39414 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Using Locational Data from Mobile Phones to Enhance the Science of Delivery(World Bank, Washington, DC, 2014-06)The objective of this report is to examine the potential of locational data for the 'science of delivery' in the field of development. The 'science of delivery' is a term popularized by the World Bank President, Jim Yong Kim, and refers to using evidence-based experimentation to improve development outcomes (Walji, 2013). In this context, locational data is a new tool that is starting to be used in a variety of development fields including health, education, disaster risk management, traffic planning etc. this broad introduction to the topic in chapter one, the next chapter explores the technology behind locational data. Chapter three presents the methodology followed in this research and chapter four, which is the heart of this report, then presents a series of mini case studies of how it is actually being used in a representative sample of different development fields. This is the 'evidence-based experimentation' which can be harnessed to improve the 'science of delivery', and examples of both active and passive collection of locational data are presented. Finally, chapter five examines, in broader terms, the longer term potential of locational data as a development tool, once smartphone ownership becomes more widespread.Publication Open Data Challenges and Opportunities for National Statistical Offices(Washington, DC, 2014-07-01)Open Data initiatives are transforming how governments and other public institutions interact and provide services to their constituents. They increase transparency and value to citizens, reduce inefficiencies and barriers to information, enable data-driven applications that improve public service delivery, and provide public data that can stimulate innovative business opportunities. As the gatekeepers of official statistics, National Statistics Offices (NSOs) produce many datasets that could typically comprise the foundation of an Open Data program. They may also have relationships with other data producing agencies in the national statistical system and have expertise in dealing with the many technical and data quality issues attendant in publishing data. In short, they are extremely well placed to make a valuable contribution to Open Data initiatives. Despite these advantages, NSOs do not always feature prominently in government-sponsored Open Data programs and they may be missing an important opportunity to expand the use and re-use of the data they produce. The goal of this working paper is to better understand the opportunities and challenges that Open Data presents to NSOs and to identify what steps and solutions are needed to enable NSOs to play a valuable role in national or sub-national Open Data initiatives.Publication Central America : Big Data in Action for Development(Washington, DC, 2014)This report stemmed from a World Bank pilot activity to explore the potential of big data to address development challenges in Central American countries. As part of this activity we collected and analyzed a number of examples of leveraging big data for development. Because of the growing interest in this topic this report makes available to a broader audience those examples as well as the underlying conceptual framework to think about big data for development. To make effective use of big data, many practitioners emphasize the importance of beginning with a question instead of the data itself. A question clarifies the purpose of utilizing big data, whether it is for awareness, understanding, and/or forecasting. In addition, a question suggests the kinds of real-world behaviors or conditions that are of interest. These behaviors are encoded into data through some generating process which includes the media through which behavior is captured. Then various data sources are accessed, prepared, consolidated and analyzed. This ultimately gives rise to insights into the question of interest, which are implemented to effect changes in the relevant behaviors. Utilizing big data for any given endeavor requires a host of capabilities. Hardware and software capabilities are needed for interaction of data from a variety of sources in a way which is efficient and scalable. Human capabilities are needed not only to make sense of data but to ensure a question-centered approach, so that insights are actionable and relevant. To this end, cooperation between development experts as well as social scientists and computer scientists is extremely important.Publication The Entry of Randomized Assignment into the Social Sciences(World Bank, Washington, DC, 2017-05)Although the concept of randomized assignment to control for extraneous factors reaches back hundreds of years, the first empirical use appears to have been in an 1835 trial of homeopathic medicine. Throughout the 19th century, there was primarily a growing awareness of the need for careful comparison groups, albeit often without the realization that randomization could be a particularly clean method to achieve that goal. In the second and more crucial phase of this history, four separate but related disciplines introduced randomized control trials within a few years of one another in the 1920s: agricultural science, clinical medicine, educational psychology, and social policy (specifically political science). Randomized control trials brought more rigor to fields that were in the process of expanding their purviews and focusing more on causal relationships. In the third phase, the 1950s through the 1970s saw a surge of interest in more applied randomized experiments in economics and elsewhere, in the lab and especially in the field.Publication Cash or Condition? Evidence from a Cash Transfer Experiment(2010-03-01)Conditional Cash Transfer programs are "...the world's favorite new anti-poverty device," (The Economist, July 29 2010) yet little is known about the specific role of the conditions in driving their success. In this paper, we evaluate a unique cash transfer experiment targeted at adolescent girls in Malawi that featured both a conditional (CCT) and an unconditional (UCT) treatment arm. We find that while there was a modest improvement in school enrollment in the UCT arm in comparison to the control group, this increase is only 43 percent as large as the CCT arm. The CCT arm also outperformed the UCT arm in tests of English reading comprehension. The schooling condition, however, proved costly for important non-schooling outcomes: teenage pregnancy and marriage rates were substantially higher in the CCT than the UCT arm. Our findings suggest that a CCT program for early adolescents that transitions into a UCT for older teenagers would minimize this trade-off by improving schooling outcomes while avoiding the adverse impacts of conditionality on teenage pregnancy and marriage.
Users also downloaded
Showing related downloaded files
Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication Universal Health Coverage for Inclusive and Sustainable Development : A Synthesis of 11 Country Case Studies(Washington, DC: World Bank, 2014-06-25)The goals of Universal Health Coverage (UHC) are to ensure that all people can access quality health services, to safeguard all people from public health risks, and to protect all people from impoverishment due to illness, whether from out-of-pocket payments for health care or loss of income when a household member falls sick. Countries as diverse as Brazil, France, Japan, Thailand, and Turkey that have achieved UHC are showing how these programs can serve as vital mechanisms for improving the health and welfare of their citizens, and lay the foundation for economic growth and competitiveness grounded in the principles of equity and sustainability. Ensuring universal access to affordable, quality health services will be an important contribution to ending extreme poverty by 2030 and boosting shared prosperity in low income and middle-income countries (LMICs), where most of the world s poor live.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication Rethinking School Feeding Social Safety Nets, Child Development, and the Education Sector(World Bank, 2009)This review highlights three main findings. First, school feeding programs in low-income countries exhibit large variation in cost, with concomitant opportunities for cost containment. Second, as countries get richer, school feeding costs become a much smaller proportion of the investment in education. For example, in Zambia the cost of school feeding is about 50 percent of annual per capita costs for primary education; in Ireland it is only 10 percent. Further analysis is required to define these relationships, but supporting countries to maintain an investment in school feeding through this transition may emerge as a key role for development partners. Third, the main preconditions for the transition to sustainable national programs are mainstreaming school feeding in national policies and plans, especially education sector plans; identifying national sources of financing; and expanding national implementation capacity. Mainstreaming a development policy for school feeding into national education sector plans offers the added advantage of aligning support for school feeding with the processes already established to harmonize development partner support for the education for all-fast track initiative.Publication Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners(Washington, DC: World Bank, 2004)An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, Non-governmental Organizations (NGOs), civil society, international organizations, and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a 'readiness assessment' and take the practitioner through the design, management, and importantly, the sustainability of such systems. The handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way.