Policy Research Working Paper 9249 A Multiple-Arm, Cluster-Randomized Impact Evaluation of the Clean India (Swachh Bharat) Mission Program in Rural Punjab, India Luis Andrés Saubhik Deb George Joseph María Isabel Larenas Jonathan Grabinsky Zabludovsky Water Global Practice May 2020 Policy Research Working Paper 9249 Abstract This study reports the findings of a large-scale, multi- the incremental effects of intensive hygiene awareness ple-arm, cluster-randomized control study carried out in campaigns in selected schools and follow-up initiatives in rural Punjab, India, to assess the impact of a flagship sani- selected communities. The study finds that the coverage tation program of the Government of India. The program, of “safely managed” toilets among households without toi- the Clean India Mission for Villages, was implemented lets increased by 6.8–10.4 percentage points across various between October 2014 and October 2019 and aimed to intervention arms, compared with a control group. Open encourage the construction of toilets, eliminate the prac- defecation was reduced by 7.3–7.8 percentage points. The tice of open defecation, and improve the awareness and program also had significant positive impacts on hygiene practice of good hygiene across rural India. It utilized a awareness among adults and children, although the inter- combination of behavioral change campaigns, centered on ventions of school campaigns and intensive follow-up were the community-led total sanitation approach, and financial of limited additional impact. incentives for eligible households. The study also evaluates This paper is a product of the Water Global Practice. It is part of a larger effort by the World Bank to provide open access to its research and make a contribution to development policy discussions around the world. Policy Research Working Papers are also posted on the Web at http://www.worldbank.org/prwp. The authors may be contacted at Landres@worldbank.org. The Policy Research Working Paper Series disseminates the findings of work in progress to encourage the exchange of ideas about development issues. An objective of the series is to get the findings out quickly, even if the presentations are less than fully polished. The papers carry the names of the authors and should be cited accordingly. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors. They do not necessarily represent the views of the International Bank for Reconstruction and Development/World Bank and its affiliated organizations, or those of the Executive Directors of the World Bank or the governments they represent. Produced by the Research Support Team A Multiple-Arm, Cluster-Randomized Impact Evaluation of the Clean India (Swachh Bharat) Mission Program in Rural Punjab, India Luis Andrés, Saubhik Deb, George Joseph, María Isabel Larenas, and Jonathan Grabinsky Zabludovsky JEL Classification: I12, L20, O18, Keywords: Cluster-randomized control trial, Swachh Bharat sanitation. 1. Introduction Poor sanitation has been identified as one of the major causes of malnutrition (Briend 1990; Prüss- Üstün and Corvalan 2006; Humphrey 2009). Following up on the United Nations’ Sustainable Development Goals (SDGs), put forward in 2015, there is a global effort to end open defecation by 2030 by providing universal access to adequate and equitable sanitation and hygiene (United Nations 2016). In line with this effort, the Government of India launched the Clean India Mission for Villages (most commonly known as the Swachh Bharat Mission–Gramin; hereafter, SBMG) on October 2, 2014, with the aim to achieve universal sanitation coverage and eradicate the practice of open defecation in rural India by 2019. Completed on October 2, 2019, the SBMG emphasized a community-based approach with a focus on raising awareness and encouraging collective behavior change, and thus generating demand for toilets in rural areas. It also provided an incentive of Rs. 12,000 to eligible households for the construction and use of toilets (Government of India 2017). Punjab, with a population of 27.7 million living in 22 districts, is one of the richest states of India. Even before the initiation of the SBMG, it had made great strides in implementing water supply, sanitation, and hygiene (WASH) reforms in rural areas, while delivering services appropriate to the specific needs of local communities. Punjab was perhaps the first state in India to provide safe water supply to all its 12,258 villages. According to the 2011 Census, rural sanitation coverage was impressive, at about 71.9 percent (the average across India was 32.7 percent), mainly because of state government efforts to prioritize sanitation. Yet, despite this high coverage rate, before the initiation of the SBMG, only 1 percent of all Gram Panchayats (GPs; “village councils”) in the state had received the Government of India’s Nirmal Grama Puraskar (“Clean Village Award”) for the achievement of a 100 percent open defecation free (ODF) status. Though Punjab ranked 7th out of 28 states for toilet coverage, it ranked 19th for the number of GPs winning the award, and 25th for the percentage of total awards granted. Of 47 GPs in Punjab that won the “Clean Village Award” in the years 2009–11, only 17 percent were found to still be ODF in 2014 (World Bank 2016). So, by the time the SBMG was launched, it was not just toilet construction but also the promotion of toilet use, and the achievement and maintenance of ODF status, that were critical priorities in Punjab. The World Bank-assisted Punjab Rural Water and Sanitation Sector Improvement Project (PRWSSIP) supported Punjab’s Department of Water Supply and Sanitation (DWSS) in implementing the SBMG across all villages in Punjab, with the objectives of 100 percent toilet coverage and 100 percent toilet use. Its main goal was to eradicate open defecation and facilitate the achievement and sustenance of ODF communities. An ODF community is one in which all human excreta are safely disposed and all 2 persons use an “improved” toilet 1 at all times. A community-led total sanitation (CLTS) approach was adopted by the DWSS to motivate communities to attain ODF status. The central pillar of this approach is a behavior change communication (BCC) campaign that focuses on raising awareness and demand for health, hygiene, and sanitation; mobilizing collective action toward behavioral change; and generating peer pressure through the creation of community-based committees that monitor neighborhoods and encourage sanitary practices. The project also supported the construction of toilets in households across the state. As an incentive, Rs. 15,000 was offered to eligible beneficiaries to cover the full cost of constructing twin leach pit latrines. It is expected that project interventions will have positive effects on people’s awareness and practice of household hygiene and sanitation, resulting in improved health and nutritional outcomes. The project promotes handwashing with soap and safe disposal of child feces, and encourages households to construct and use toilets. The use of toilets will lead to a reduction in the fecal contamination of soil and groundwater, thus improving water quality at the point of extraction and reducing intestinal worm infections. While project impacts on hygienic and sanitary practices, including toilet construction and use, are expected to be observable in the short run, positive health and nutritional outcomes will take longer to materialize. A multiple-arm, cluster-randomized impact evaluation was designed to measure the impact of the SBMG in Punjab. This reports the results from a midline survey, focusing on the project’s short-term impacts on hygiene awareness and related practices and toilet construction and use. An end-line survey, planned for October 2020, will capture the project’s impacts on children’s health and nutritional outcomes. This study provides evidence of the project’s success in triggering behavior change and promoting toilet construction and use. Specifically, the impact evaluation sought answers to the following research questions: i) Did the various project interventions influence households’ decisions to construct toilets? ii) Did the project interventions lead to a reduction in open defecation rates in beneficiary communities? iii) How did the BCC campaign affect hygiene awareness and related practices? iv) Did school programs focused on raising students’ awareness of hygienic practices effectively boost such practices, toilet construction, and toilet use? 1 An improved toilet is designed to hygienically separate excreta from human contact. 3 v) What effects did the project’s intensive follow-up efforts have on hygiene awareness and related practices, toilet construction, and toilet use? The study finds that project interventions led to significant improvement in the coverage of “safely managed” toilets, 2 a reduction in open defecation among project beneficiaries, and greater awareness of handwashing among adults and children. However, impacts on the use of soap and other hygienic practices were limited if observable at all. This is one of the first rigorous impact evaluations of the SBMG, and its findings are likely to inform policy discussions on the future implementation of similar programs. The evaluation also contributes to the literature on the effectiveness of the community-led approach in large-scale sanitation programs. 2. Description of Project Interventions The World Bank-assisted PRWSSIP—which runs from March 24, 2015, to June 30, 2021—is supporting the DWSS of the Punjab state government in addressing many of the challenges facing the WASH sector in rural Punjab. The project aims to improve water and sanitation service levels, reduce open defecation, and strengthen service delivery arrangements in targeted villages. Of a total project cost of $354 million, the World Bank Group’s International Development Association has financed $248 million, leaving $106 million to be financed by the government and beneficiary communities. The PRWSSIP supported the implementation of the SBMG in every village in Punjab, with the aims of 100 percent toilet coverage and 100 percent toilet use. The cost of this component was $60 million. The SBMG featured a participatory, decentralized approach. Dedicated units focused on rural sanitation were set up at the state and district levels. These were composed of subject matter experts in behavior change communication, planning and monitoring, capacity building, and sanitation technology. At the district level, activities were coordinated by a District Sanitation Committee, which focused on rural sanitation exclusively. The committee developed a core team of motivators and master motivators for the program. Motivators were expected to work in one or more GPs, as needed. They were in turn supervised and supported by master motivators. In addition, there were District Resource Groups and Block Resource Groups, composed of social development experts and communications specialists who worked in tandem with the motivators to support GPs in planning, implementing, and monitoring their progress toward the ODF goal. 2 The SDGs focus on improving access to “safely managed” water and sanitation services. A safely managed toilet is not shared among households and separates its users from fecal content, which is then disposed of in such a way as to avoid the contamination of soil or water resources (Joint Monitoring Programme for Water Supply and Sanitation, 2017). 4 2.1 Behavior Change Communication (BCC) BCC is core to the project’s interventions geared toward generating demand for toilets and creating awareness of the linkages between sanitation, hygiene, and health. The ultimate goal of the BCC campaign is to mobilize communities to collectively strive for ODF status. BCC activities in Punjab have been focusing on the following critical actions: (i) construction and usage of toilets, (ii) handwashing with soap, and (iii) safe disposal of child feces. BCC activities have been led by the motivators and master motivators, who in turn identify, sensitize, and support sanitation “champions” at the GP level from local government institutions, cooperatives, schools, health care facilities, women’s groups, community-based organizations, self-help groups, etc., during a phase called pre-triggering. These sanitation champions spearhead the campaign at the community level. Following pre-triggering, the motivator, along with local sanitation champions, makes door-to-door visits identifying and preparing a list of households that do not have toilets and are eligible to receive incentive money for toilet construction under the SBMG program. The list is vetted and approved by officials at the GP, block, and district levels. Households’ first exposure to BCC occurs at that initial visit, when a motivator and sanitation champion discuss the ill effects of open defecation and the importance of using toilets. At this point, the time and venue of a so-called triggering meeting is communicated to the household. The triggering is held in a public place and led by the motivator. Villagers are asked to draw a map of their community, identifying their homes and the places commonly used for open defecation. Following this mapping exercise, villagers are taken for a walk to one of the open defecation sites. They are asked to not cover their noses. The objective is for the participants to experience the way open defecation is polluting the village environment. An important part of the triggering process is the “dirty fly” demonstration. The motivator offers participants a glass of clean water to drink, which most people gladly accept. Then the motivator pulls out a hair, touches feces with that hair, and dips the hair back into the water. Nobody is willing to drink the water now. This is a very effective way of communicating how flies transmit contamination from exposed feces through food to the human body, and how open defecation implies that people are consuming one another’s feces. Triggering activities are meant to convey: (i) the link between exposed feces and fecal contamination of food; (ii) the importance of washing hands with soap; and (iii) the need for constructing and using toilets that can effectively separate human excreta from the human environment. For the day-to-day monitoring of open defecation, Nigrani Samitis (Vigilance Committees) have been set up in each GP. These committees comprise volunteers from among the local sanitation champions, who carry out morning visits to places commonly used for open defecation. The purpose is to identify 5 people who defecate in the open and convince them to use a toilet—or to construct a toilet if they do not have one. People without access to a toilet are asked, in the meantime, to cover their feces with dirt. Also, under this program, Swachhata (“cleanliness”) Clubs have been reactivated in primary schools. These were formed in all primary schools in 2014 under an Education Department initiative to promote good hygiene among school students, but many such clubs stopped functioning over time. Under the auspices of the SBMG, motivators restarted these clubs and discussed good practices related to hygiene and sanitation with students. These clubs, headed by students in the 5th standard, oversee and ensure fellow students’ personal hygiene, including washing hands with soap before meals, and the cleanliness of classrooms and surroundings. 2.2 Construction of Toilets It was hoped that BCC activities would spur local demand for toilets. Once this had been accomplished, motivators, along with DWSS engineers, would provide technical support in choosing the location and technology of new toilets. Also, beneficiary communities shared information via social media on material and labor costs, helping households make cost-effective choices. The SBMG laid out specific eligibility criteria for the incentive money offered under the program. However, the DWSS decided that all households without toilets were eligible, and had been actively promoting the construction of twin leach pit latrines. According to the SBMG guidelines, the incentive money was supposed to be transferred to households only once a toilet had been completed and its use verified. However, many households did not have the financial resources to pay the up-front costs of construction. Therefore, the DWSS decided to release the money in three tranches of Rs. 5,000 each. The first tranche was released after the twin pits were dug—which could be done by beneficiary household members themselves. The second tranche was released after completion of the superstructure, and the final installment was released after the toilet (including a door) was completed and its use had been verified by the motivator and by district and block officials. For households opting for more expensive toilets with septic tanks, the DWSS required that soak pits be constructed as well. Once all toilets have been completed in a village, motivators ensure that morning vigils continue for a month after construction. 2.3 Additional Activities In addition to the project interventions discussed above, the DWSS has been undertaking intensive awareness campaigns in schools in one set of GPs, and an intensive follow-up campaign in another set. The awareness campaigns have been carried out in both primary and middle schools, and involved the following activities: (i) School triggering. “Catch them young” is the main aim. Students were told about the ill effects of open defecation and the importance of using toilets and washing hands with soap 6 before eating meals and after defecation. All students were encouraged to ensure that they had a toilet in their house, used by all their family members. All teachers as well as school support staff were involved in this effort. (ii) WASH training sessions. These focused on handwashing and also provided guidance on personal hygiene. Adolescent boys and girls were separated into two groups, and guided in maintaining good health and hygiene. Menstrual hygiene is an important issue that was discussed with the girls. (iii) School sanitation program. On three consecutive days, for two hours each, motivators and master motivators led middle school students in interactive games and the preparation of sketches focused on water and sanitation issues. After a communal discussion of key issues, students were asked to fill a questionnaire relating to water and sanitation issues. A motivator also filled out a survey based on his/her personal observation of the physical conditions of the water and sanitation infrastructure in the school. Finally, the report of the school was discussed with all school members—teachers, students, and staff. A special training manual for this three-day program was prepared by the DWSS. The intensive follow-up campaigns in select villages have involved the following activities: (i) Frequent morning vigils. All the motivators as well as master motivators participated in morning vigils in select GPs three times a week (instead of twice a week, as under the regular project intervention). (ii) Female mohalla (community) committees. The formation of these committees, comprising 15–20 women volunteers, was meant to make morning vigil campaigns more impactful. Each committee included representatives from all segments of society, including the marginalized and vulnerable, who carried out the following activities: (a) conducting morning vigils in the GP; (b) encouraging open defecators to construct toilets and use them; (c) facilitating the toilet construction process; (d) promoting the construction of bath-cum- toilets; and (e) encouraging women’s involvement in the decision-making process, including in the selection of a toilet’s location, superstructure, and accessories, and in the consideration of issues relevant to users’ safety. 3. Theory of Change CLTS was first developed and implemented in Bangladesh in 1999 by Dr. Kamal Kar, who was at the time working with Water Aid Bangladesh and its local partner organization, the Village Education Resource Centre. CLTS is a participatory approach that aims to motivate communities toward collective action to eradicate open defecation by highlighting its consequences for public health and the 7 environment, and creating a sense of collective shame and disgust around it. The approach has been adopted in 58 countries around the globe, including in South Asia (e.g., Afghanistan, Bangladesh, India, Pakistan, Nepal); East Asia and the Pacific (e.g., Cambodia, Indonesia, the Philippines, Vietnam); East and Southern Africa (e.g., Ethiopia, Kenya, Mozambique, Uganda, Tanzania); West and Central Africa (e.g., Benin, Burkina Faso, Cameroon, Ghana, Mali, Nigeria); and Latin America and the Caribbean (e.g., Bolivia, Guatemala, Haiti) (Institute of Development Studies 2018). Depending on local conditions and policy priorities, CLTS has been combined with supply-side interventions and/or subsidies for the construction of household toilets. Supply-side interventions facilitate the availability of raw materials and trained masons in CLTS communities, whereas subsidies mostly target poor households without the means to finance the costs of construction. Though CLTS has been widely adopted in developing countries worldwide, empirical evidence of its effectiveness is limited. While the available literature indicates that CLTS has been successful in promoting toilet ownership and reducing open defecation (Pattanayak et al. 2009; Patil et al. 2014; Borja-Vega 2014; Godfrey et al. 2014; Guiteras, Levinsohn, and Mobarak 2015; Dickinson et al. 2015; Pickering et al. 2015; Gertler et al. 2015; Crocker et al. 2016), the size of the effect varies widely within and across countries depending on preexisting local conditions and the nature and intensity of the interventions. One multicountry, cluster-randomized study that compared the effectiveness of CLTS interventions in India, Indonesia, Mali, and Tanzania (Gertler et al. 2015) observed that interventions differed across countries. A stand-alone CLTS intervention (without complementary efforts) was implemented in Mali with monthly follow-ups for one year. In India, there was no follow-up after CLTS triggering, but a subsidy was made available to poor households to construct toilets. In Indonesia and Tanzania, there was one follow-up after triggering, and no subsidy. Moreover, except in Mali, the CLTS interventions were accompanied by supply-side interventions. The study finds that access to toilets expanded in beneficiary communities by 39 percentage points in Mali, 23.4 percentage points in India, 13.4 percentage points in Tanzania, and 7.6 percentage points in Indonesia. Except for Indonesia, where improved access resulted from a mix of new construction and the extension of shared facilities, the increase in toilet coverage came through the construction of private toilets. Mali, where a pure CLTS approach was implemented, registered the greatest reduction in open defecation rates. Open defecation rates fell by 33 percentage points in Mali, 13 percentage points in Tanzania, and less than 10 percentage points in India and Indonesia. Except in Mali, which saw a reduction of 21 percentage points in open defecation rates among households with toilets, no significant effect was found among this group (Gertler et al. 2015). The results of this study highlight the importance of community mobilization and repeated follow-ups in CLTS interventions. The results also indicate that while subsidies work to expand toilet access, they do not lead to a proportionate decline in open defecation, and that behavior 8 change is mostly limited to those households without toilets at the start. Thus, the results support an argument put forth by the proponents of CLTS that any subsidy is going to be counterproductive in “spurring genuine household demand for private toilets” and eradicating open defecation (Kar and Chambers 2008). The success of CLTS interventions in promoting toilet construction and use have been further documented by impact evaluations in Mali (Pickering et al. 2015) and Ghana (Crocker et al. 2016). A cluster-randomized trial of CLTS interventions in the Koulikoro region of rural Mali reported a 32 percentage point increase in latrine ownership among households in the treatment villages, and a decrease in open defecation by 24 and 23 percentage points among men and women, respectively, and by 43 percentage points among children 10 years or younger (Pickering et al. 2015). In Ghana, a study of the effectiveness of stand-alone CLTS interventions relative to those that included the training of “natural leaders” in beneficiary communities found that the training of these leaders resulted in a decline in open defecation 19.9 percentage points greater than in those villages that received only CLTS interventions (Crocker et al. 2016). The study highlights the importance of creating local champions for the success of CLTS interventions. On the other hand, the effectiveness of subsidies is supported by a multiple-arm, cluster-randomized study in Bangladesh that compares (i) CLTS alone, (ii) CLTS plus supply-side market access, and (iii) CLTS with subsidies for poor households. The study finds that subsidies increased toilet ownership by 22 percentage points among eligible households and 8.5 percentage points among noneligible households, and reduced open defecation by 14 percentage points. The study finds no significant effects from CLTS alone or CLTS plus supply-side interventions (Guiteras, Levinsohn, and Mobarak 2015). Similar results have been reported by cluster-randomized studies of CLTS interventions with subsidies in Orissa (Pattanayak et al. 2009; Dickinson et al. 2015) and Madhya Pradesh (Patil et al. 2014) in India. Pattanayak et al. (2009) report an increase in toilet ownership of 29 percentage points in the treatment population (34 percentage points among people eligible for a subsidy and 21 percentage points among noneligible households), and Dickinson et al. (2015) report a 26 percentage point increase in toilet construction and 17 percentage point increase in toilet use. Patil et al. (2014) find that subsidies played a pivotal role in household decisions to construct toilets. Below poverty line (BPL) households that received a subsidy were much more likely to construct toilets than non-BPL households that did not receive a subsidy. To summarize, the literature suggests that sustained follow-up and the engagement of local champions are important to the success of CLTS interventions. The CLTS approach, in principle, does not advocate any particular type of toilet technology. In fact, toilets built under such programs could be of inferior quality (Crocker et al. 2016). With the current focus on improved and safely managed toilets (as guided 9 by SDG Target 6.2 3 and, specifically, Indicator 6.2.1 4), subsidies and supply-side interventions are effective complements to CLTS interventions to promote toilet construction and use, especially among the poorer segments of a community. Poor sanitation is associated with a wide range of diseases, including diarrhea (Waddington et al. 2009) and soil-transmitted helminth (STH) infections (Ziegelbauer et al. 2012). Diarrhea, defined as the passage of three or more loose or liquid stools per day within 24 hours, is most frequently associated with bacterial, viral, and parasitic intestinal infections. However, it is not specific to these types of pathology, since it can be provoked by other causes such as chemical irritation and noninfectious inflammation. It is an acute and self-limited symptom in most cases, so the use of biomarkers in nonacute periods is very difficult. Sanitation interventions that ensure adequate and good-quality water supply, along with hygiene awareness campaigns, are likely to reduce the incidence of diarrhea, since 88 percent of diarrheal disease is caused by unsafe water supply and inadequate sanitation and hygiene conditions (WHO 2004). STH, or an intestinal worm, infection is caused by a group of helminths entering the human body by the intake of eggs found in feces-contaminated soil. A stage of the worms’ life cycle has to take place in the soil, either as eggs or larvae or adults. Eggs can enter the human body, then, via water, food, or contaminated hands (especially among children). Although helminthiasis can affect all populations, notably high-risk groups include children of preschool age (2 to 5 years) and school age (6 to 12 years), teenagers, and women of gestational age. Diagnosis is made by stool tests or through the identification of eggs in soil samples. Helminthiasis can cause severe diarrhea, malnutrition, anemia, and thus a growth deficit, especially in young children. According to the World Health Organization (WHO) estimates, 50 percent of malnutrition is associated with repeated diarrhea or intestinal worm infections (Prüss-Üstün et al. 2008). Humphrey (2009) documents that repeated fecal contamination can result in chronic environmental enteropathy, which reduces the nutrient absorption capacity of the small intestine while increasing the small intestine’s permeability to pathogens—thus causing malnutrition, stunting, and cognitive deficits without necessarily manifesting as diarrhea. Additionally, the STH infections can have a negative effect on cognitive development in school-age children, creating learning gaps (Hadidjaja et al. 1998). In spite of the link between poor sanitation and hygiene practices and diarrhea, many studies of the impact of CLTS interventions on health outcomes find no significant reduction in diarrheal disease 3 “By 2030, achieve access to adequate and equitable sanitation and hygiene for all and end open defecation, paying special attention to the needs of women and girls and those in vulnerable situations” (https://sustainabledevelopment.un.org/sdg6). 4 “Proportion of population using safely managed sanitation services, including a hand-washing facility with soap and water” (https://sustainabledevelopment.un.org/sdg6). 10 (Patil et al. 2014; Dickinson et al. 2015; Pickering et al. 2015). Studies that do find any significant relationship either focus on CLTS programs accompanied by water-supply interventions (Godfrey et al. 2014) or find the reduction in only a specific subgroup of project beneficiaries (Borja-Vega 2014). The empirical literature, however, indicates that CLTS interventions have a positive impact on nutritional outcomes in children under five. In their study of rural Orissa, India, Dickinson et al. (2015) find that mid-upper-arm circumference increased by two standard deviations in treatment villages relative to control villages. In Mali, children under five in treatment villages were taller and less likely to be severely underweight than their counterparts from control villages. The effect was more pronounced among children under two years (Pickering et al. 2015). A similar result is reported for Mali by Gertler et al. (2015), where CLTS interventions led to a 0.17 standard deviation increase in height-for-age Z scores (HAZ). The authors, however, find no significant effect on HAZ in India and Indonesia. Using pooled village-level data from India, Indonesia, and Mali, the study estimates that in a village where everyone practices open defecation, the complete eradication of open defecation would lead to a 0.44 standard deviation increase in HAZ. However, a modest reduction in open defecation or any further reduction where the rates of open defecation are already low, is unlikely to have any detectable impact on HAZ (Gertler et al. 2015). The project interventions in Punjab have adopted a CLTS approach, with the BCC campaign as a central pillar. The BCC campaign was geared toward both changing personal behavior and creating demand for toilets. It intended to make open defecation repulsive by making people understand that by defecating in the open they end up eating each other’s feces and risking their lives as well as the lives of their children and neighbors. The campaign took a multipronged approach. Daily morning vigils were meant to prevent people from defecating in the open by creating a sense of shame. Toilets were also being presented as a status symbol. A hygiene and cleanliness program first put forward by the Education Department was revived to promote good hygiene practices among school students. Students were informed about the ill effects of open defecation, and the importance of hygiene. To the extent a child can influence the behavior of other household members, awareness programs in schools also sought to promote household decisions to construct and use toilets. The morning vigils also sought to help form beneficial habits. Importantly, the BCC campaign has been spearheaded by motivators and master motivators who are members of the local community, specially trained in BCC by experts hired by DWSS. As suggested by the literature (Crocker et al. 2016), the continuous involvement of local motivators and champions throughout project implementation is likely to have a positive impact on turning public opinion against open defecation and promoting collective action to achieve ODF status. Moreover, the project in Punjab involves a holistic look at hygiene and sanitation, and is not focused on toilets alone. It promotes handwashing with soap and educates community members on how to safely dispose of child feces. The incentive money offered to eligible households for the construction of new 11 toilets is electronically transferred to the bank accounts of beneficiaries, reducing the chances of corruption. The project interventions are likely to expand toilet coverage and reduce open defecation in Punjab. This will reduce the fecal contamination of soil and water, which in turn will reduce the possibility of diarrheal and STH infections and have a positive effect on children’s nutritional outcomes. It is important to note, however, that these expected health and nutritional benefits take time to materialize and capture. So, the expected benefits of the project can be categorized into two groups based on their time horizons. In the short run, we expect an improvement in people’s awareness and practice of hygienic behaviors, an increase in the number of households with toilets, and a reduction in the number of people defecating in the open. In the medium to long run, we expect a decrease in cases of diarrhea and an improvement in nutritional outcomes (that is, a decrease in stunting, wasting, and being underweight) in children younger than five years. In this study, we will explore the short-term impacts of the project. 4. Evaluation Design and Methodology The evaluation used a multiple-arm cluster-randomization design with three treatment arms and one control group to establish causal impacts of the project interventions. The project is delivered at the GP level and the project interventions are aimed at influencing hygiene and sanitation behavior as well as health and nutritional outcomes of the entire community. So, the cluster randomization was done at the GP level. Considering the District Sanitation Committee’s pivotal role in project implementation, the randomization has been stratified at the district level. Of the three treatment arms, treatment arm 1 included GPs that received regular project interventions. In GPs in treatment arm 2, intensive hygiene and sanitation awareness campaigns were carried out in schools (alongside regular project interventions). Treatment arm 3 included GPs where there was an intensive follow-up campaign (in addition to the regular project interventions). Project interventions were withheld in the control GPs. The evaluation used surveys at the household, community, and school levels to collect data on both the project’s beneficiaries and its implementation. Baseline data are from before the start of project’s intervention, and these are compared with midline data, collected after the completion of project interventions, to assess the short-term outcomes of the project. A follow-up survey is expected to be carried out in 2021, toward the end of the project, to assess its medium-term impacts. 4.1 Sample Size and Sampling Strategy As per the original design, there were 50 GPs per arm or group, and 24 households per GP, leading to a total sample size of 200 GPs and 4,800 households. However, there is a distinct possibility that some of the control GPs could have, in fact, received interventions (most likely for political reasons), while 12 some of the treatment GPs could have seen them withdrawn due to a shortage of funds. The attrition of control GPs was thought to be more likely than the attrition of treatment GPs. Accordingly, it was decided to sample 60 GPs from each of the treatment arms and 80 GPs from the control arm. So, the final sample had 260 GPs of 24 households each, for a total number of 6,240. 4.2 Sampling Strategy for GPs Baseline SBMG data on GP-level toilet coverage were used to select the GPs in the sample. Of the 12,786 GPs from Punjab listed in the SBMG data set, those excluded (i) had already received interventions under the SBMG (Tranche 1 and 2); (ii) were going to benefit from improvements in water service delivery; (iii) had water quality problems that were going to be addressed in the near future under the project or the National Rural Water Development Program; (iv) were GPs where political interests might make it difficult to withhold interventions, as identified by the officials of the DWSS; and (v) lacked data on toilet coverage. Once we excluded these GPs, the total number of GPs in our target population was reduced to 7,764. Further, to ensure that a full-fledged BCC campaign would be undertaken in the sample GPs, a construction requirement of at least 25 toilets was set as a minimum threshold for being selected. Similarly, to ensure that the project interventions would be completed within six months, GPs where the number of households without individual latrines exceeded 300 were excluded from the sample. After imposing these conditions, the remaining 4,868 GPs were identified as our baseline population from which the samples were drawn. A computer program was used to draw random samples stratified at the district level and maintain proportional representation of GPs in districts in each of the treatment and control arms similar to the baseline population. 4.3 Sampling Strategy for Households Up to 250 households were listed in each of the selected GPs. Basic information on these was then collated: the total number of household members, number of children below 5 years of age, number of children aged 6 to 14, and toilet ownership. All the households were listed in GPs of 250 or fewer. For larger GPs, households were listed by ward until the maximum of 250 was reached. 13 Figure 1. Intervention Arms, Household Clusters, and Participants at Each Stage of the Study Note: GP = Gram Panchayat; OD = open defecation; WASH = water supply, sanitation, and hygiene. 14 For sampling purposes, only households with children were included. The listing data were stratified into two categories—households with children below 5 years and households with children aged 6 to14 years. Each of these was further stratified into households with toilets and without toilets. So, altogether four strata were created, and six households were randomly drawn from each of the four strata. 4.4 Data Collection Data on the selected sample were collected using household, community, and school surveys. The following is a brief description of the various survey instruments designed for the study. (i) Household surveys. These collected information on the number and demographic profiles of household members, their occupations, the ownership of assets (including toilets), access to water supply and sanitation, usage of toilets by household members, hygiene awareness and hygiene behavior, and incidence of water-related diseases (including diarrhea). Within the survey, a separate module for children aged 6 to 14 collected data on hygiene awareness and behavior. In addition, anthropometric measurements of children under age 5 were also carried out. (ii) Community survey. The sarpanch (head of the GP) was interviewed. The survey collected information on GP characteristics like the presence of schools, primary health care centers, electricity connections, and implementation of water and sanitation programs. The survey also collected personal information on the sarpanch. Baseline data were collected from September 25, 2016, to October 28, 2016. A follow-up midline survey of the same households was undertaken from November 2, 2017, to January 15, 2018. A total of 6,067 households from 260 GPs were surveyed at baseline, and 5,275 of these households, from 251 GPs, were followed up with during the midline survey. The project interventions were implemented from November 2016 to the first week of November 2017, when data collection for the midline survey started. So, none of the health- and nutrition-related impacts would have materialized by then. As has been noted, a follow-up survey has been planned for 2021 to measure these impacts. The same household and community questionnaires were used for both the baseline and midline surveys, though the midline survey included some additional questions to assess the implementation of the project interventions. A school survey was included at midline. The community survey and the school survey were used mostly to assess implementation. 4.5 Measurement of Outcomes The main indicators of interest for this study are hygiene awareness and hygienic behaviors, toilet construction, and toilet use. All these outcomes of interest were measured using data collected from the household survey. A brief description of the indicators used to measure these outcomes follows. 15 Toilet construction. Toilet construction was measured using households’ self-reported ownership of toilets, and toilet technology as observed by the survey team. In line with the Joint Monitoring Programme (JMP) for Water Supply and Sanitation, coordinated by the World Health Organization and United Nations Children’s Fund, we have defined toilets in three categories. Safely managed toilets are those involving piped sewer systems, septic tanks (with or without soakage pits), and leach pit latrines. Basic facilities include safely managed toilets as well as pit latrines with a slab. Limited facilities are improved toilets shared among several households. We also included data on toilets under construction. Toilet use. Toilet use was measured based on the self-reported use of survey respondents. Respondents were asked whether some members of their household practiced open defecation. So, our measurement of open defecation implies open defecation by any member of a household. Hygiene awareness and hygienic behavior. Hygiene awareness was measured using respondents’ correct identification of the critical times when handwashing is required, the benefits of using soap, and the risks of defecating in the open. Hygienic behavior was measured using the following: (i) percentage of critical times that the respondent washes hands; (ii) percentage of critical times soap is used; (iii) whether the respondent washes hands with soap after defecation and before eating; (iv) the availability of soap in the household; (v) the treatment of water for drinking; and (vi) the disposal of child feces (in a toilet). Similar hygiene awareness and behavior outcomes were measured among children aged 6 to 14 years. 4.6 Design Validation We compared the baseline characteristics of the three treatment arms and the control arm to check for any imbalances in the observed characteristics. Since we had randomized the selection of GPs as well as of households, we expect any imbalances in baseline characteristics to be purely due to chance. We did not test for significance in these baseline differences. As has been argued by various authors (Senn 2013; De Boer et al. 2015), significance tests are not suitable for detecting meaningful differences in baseline characteristics that can lead to confounding. Confounding occurs when certain differences in baseline characteristics can predict the outcomes. For covariates that are highly correlated with the outcomes, even a small difference that is statistically insignificant can be far more important than large significant differences in covariates that are otherwise uncorrelated with the outcomes. So, following Imbens and Wooldridge (2009), we reported normalized differences in means, defined as follows: − ∆ = 2 � 2 + Where w = T, C 16 2 ( − )2 =� = − 1 Here, X is the covariate of interest and N refers to the number of observations. As a rule of thumb, a normalized mean difference of 0.25 or less indicates good balance, whereas a normalized mean difference exceeding unity implies a severe imbalance that cannot be handled using standard regression techniques (Rubin 2001; Imbens and Wooldridge 2009). The baseline socioeconomic and demographic profiles of households, along with their normalized mean differences across various treatment arms and the control arm, are reported in table 1. We have reported the weighted means with weights based on ownership of toilets to derive population estimates. A more detailed comparison of the baseline characteristics of households as well as their GP-level characteristics for both weighted and unweighted data is presented in tables A.1 and A.2 in the appendix. Our results indicate that our sample is well balanced. The absolute value of the maximum normalized mean differences of household baseline characteristics is 0.13 in the unweighted data and 0.15 in the weighted data and that of village-level characteristics is 0.2, all indicating a good baseline balance in the sample. We also looked into the impact of attrition on baseline balance. Attrition in our data comes from two sources—attrition of GPs and attrition of households. The attrition of GPs occurred either due to the census reclassification of GPs into towns (meaning they were no longer eligible for inclusion in the project) or due to the implementation of the project in control GPs. Attrition of households was due to migration, a split in a household, or a lack of availability at the time of the interview. Table A.3 reports attrition for the three treatment arms and control arm. The overall attrition rate for our sample was 13.1 percent. It varied between 10.9 percent for treatment arm 3 and 14.3 percent for the control arm. A 10 percent attrition rate was incorporated during the power calculations at the design stage. Moreover, during sample selection we included 50 additional GPs (10 each in the three treatment arms and 20 in the control arm) to account for possible attrition during project implementation, so the attrition in our sample is unlikely to affect the power of our estimates. A comparison of baseline characteristics for households in various treatment and control arms, post attrition, shows a balance similar to the sample without attrition (table A.4). So, our sample remained well balanced even after attrition. We also compared the characteristics of the households who were present at midline with those who were lost due to attrition (table A.5). We did not find any significant differences between these two groups across a large majority of characteristics. But there were significant differences in characteristics such as asset ownership, occupation of the household head, and toilet access. Households with no land, mobile phone, or access to toilets, and for which the household head’s primary occupation was listed as either cultivation or salaried work, were more likely to be absent at midline. To somewhat account for these 17 differences, we analyzed the data separately for households with and without access to toilets at baseline. 18 Table 1. Baseline Balance (weighted)—Mean and Normalized Mean Differences of Selected Variables Control Arm 1 Arm 2 Arm 3 Normalized Mean Differences Number of GPs 80 60 60 60 Control- Control- Control- Arm 1- Arm 1- Arm 2- Number of households 1,872 1,406 1,394 1,395 Arm 1 Arm 2 Arm 3 Arm 2 Arm 3 Arm 3 A. Household characteristics Number of members in the household All 5.31 5.236 5.298 5.19 .0256 .004 .0432 -.0219 .0172 .0397 Children less than 5 years .6453 .5897 .6826 .6663 .0522 -.0336 -.0191 -.0861 -.0718 .0147 Caste/social category of the household General .3286 .2913 .3443 .3143 .057 -.0235 .0217 -.0805 -.0353 .0451 Scheduled caste/scheduled tribe .5039 .5282 .4641 .5459 -.0344 .0564 -.0595 .0909 -.0251 -.1161 Economic category Below poverty line (BPL) .5042 .5166 .5499 .5136 -.0175 -.0647 -.0132 -.0472 .0043 .0515 Above poverty line (APL) .3404 .2677 .2444 .2489 .1122 .1501 .1427 .0378 .0304 -.0073 Asset ownership Mobile phone .9724 .9621 .9695 .9683 .0408 .012 .017 -.0289 -.0239 .005 Toilet .7989 .7296 .7461 .7377 .1159 .0892 .1028 -.0266 -.013 .0135 Education of the head of household Secondary .2316 .1919 .1968 .2199 .0687 .06 .0197 -.0086 -.0489 -.0403 College/graduate/postgraduate .1061 .1087 .1077 .1034 -.006 -.0037 .0062 .0023 .0122 .0099 Illiterate .317 .3504 .3513 .3377 -.0501 -.0514 -.0312 -.0013 .0189 .0202 Primary occupation of the head of household Cultivation .1723 .1661 .2181 .1928 .0117 -.0817 -.0376 -.0934 -.0492 .0442 Agricultural labor .08015 .1248 .1135 .08566 -.1043 -.0799 -.0141 .0245 .0903 .0659 Nonagricultural labor .3154 .344 .3341 .3294 -.043 -.0283 -.0213 .0148 .0218 .007 Salaried work .1526 .136 .121 .1186 .0335 .0651 .0704 .0316 .0369 .0054 Business .0907 .0829 .06481 .09183 .0196 .0684 -.0028 .0489 -.0224 -.0712 19 4.7 Determining Program Impacts: Econometric Model We used a difference-in-differences (DID) estimation to assess the impact of project interventions. The analysis was done at the household level for all outcome indicators except those related to health and nutrition, for which the analysis was conducted at the individual level. In a DID setup, the first difference (i.e., the difference in outcomes between the periods before and after the intervention) corrects for any remaining fixed effects (i.e., time-invariant differences between treatment and control groups, since we are comparing the same group to itself). The second difference within groups corrects for any time-varying external factors, unrelated to the treatment, that affect the target population during the interval of analysis. Assuming outcomes display equal trends in the absence of treatment (i.e., outcomes in the treatment group would have moved in tandem with the outcomes in the control group in the absence of the intervention), the second difference isolates the true causal effect of the intervention. The following DID specification has been used for the purposes of estimation: = + 1 1 + 2 2 + 3 3 + 4 + 5 ∗ 1 + 6 ∗ 2 + 7 ∗ 3 + + + Where is the outcome of household i in the GP g and district d at time t, before and after the intervention; 1 , 2 , 3 are the intervention indicators for the three treatment arms, respectively; are the household- and GP-level characteristics at the baseline; is the district indicator capturing district fixed effects, since randomization was done at the district level; and is the error term. Coefficients 5 , 6 , 7 are the DID estimates of the impact of the program interventions for treatment arms 1, 2, and 3, respectively. Accordingly, (6 − 5 ) estimates the incremental impact of the school interventions and (7 − 5 ) estimates the incremental impact of the intensive follow-up campaigns. We have estimated both the unadjusted and adjusted model. In the unadjusted model, the household- and GP-level characteristics, , were omitted from the specification. In the adjusted model, for household specifications, we have included the following covariates: GPs where the majority of residents are members of a scheduled caste (SC) or scheduled tribe (ST), households where at least one member has a college degree, SC/ST households, and BPL households. The regression specifications have been estimated using ordinary least squares (OLS) with Huber-White robust standard errors clustered at the GP level. Since we oversampled households without toilets, population weights have been used in all specifications involving the full sample. In addition to the DID specification, we have also used the analysis of covariance (ANCOVA) 20 estimation method. It has been argued that ANCOVA is more efficient than DID (Frison and Pocock 1992), and can lead to improvement in power so long as the autocorrelation is not equal to 1 (McKenzie 2012). We have used the following specification for ANCOVA: = + 1 1 + 2 2 + 3 3 + + + Where and are the outcomes of household i in GP g and district d after and before the intervention. Here, coefficients 1 , 2 , 3 are the ANCOVA estimates of the impact of the program interventions for treatment arms 1, 2, and 3, respectively; and (2 − 1 ) estimates the incremental impact of the school interventions, and (3 − 1 ) estimates the incremental impact of the intensive follow-up campaigns. The model has been estimated using OLS with Huber-White robust standard errors clustered at the GP level. 5. Project Implementation Project activities in the treatment GPs were implemented between November 2017 and the first week of November 2018. The BCC campaigns in treatment GPs started from December 2017 and continued until the completion of project interventions. During the implementation phase, eight GPs were dropped from the sample due to administrative reasons. So, the final sample for the study was reduced to 252 GPs – 58 GPs each in treatment arms 1 and 2, 59 GPs in treatment arm 3, and 77 GPs in the control group. It was expected that project activities would be completed by the first week of April 2018. However, state assembly elections in Punjab in February 2017 resulted in the suspension of all new project activities from December 2016 onward. After the elections, a new government came to power and a temporary budget (vote-on-account) was passed at the end of March 2017, that would finance government activities from April to June but not any new project activities. A full budget was passed by the assembly in June 2017, but it was only in the first week of August 2017 that all districts received funds for the incentive money to support toilet construction in the treatment GPs. This lack of funds substantially delayed toilet construction in the treatment GPs. The situation was further complicated by a political commitment made by the new government to declare Punjab “open defecation free” by March 2018. This left too little time and not enough funds to ensure that all households in Punjab owned a toilet. So, there was a shift in strategy at the government level, and focus was put on improving access to toilets. Many rural households in Punjab live in a joint-family setup and have access to shared toilets. The DWSS focused on those people without access to any toilet. Though the World Bank evaluation team had an understanding with the government that Punjab could be declared “open defecation free” minus the control GPs, the evaluation team feared the possibility of contamination if the control GPs were withheld for too long. In a meeting with the DWSS, it was 21 decided that all remaining work in the treatment GPs would be wrapped up by October 30, 2017, and all project personnel would be withdrawn and no further work undertaken until the completion of the midline surveys. However, even by the end of October, the project activities in the treatment GPs were not over. So, it was decided to first survey those districts where efforts had been completed. Thus, the midline surveys were conducted in five batches. It should be noted that motivators and master motivators were engaged in the treatment GPs right after the completion of the baseline surveys, and the BCC activities were being carried out from December 2016 onward, even though there was no incentive money available for the construction of toilets. However, there were some prominent departures from the plan. Intensive awareness campaigns in schools could not get in full swing until July 2017 because of the long summer vacation. Moreover, because of delays in implementation, the morning vigils planned to follow the completion of toilets could not be carried out in some GPs. During an evaluation readiness mission in October 2017, it was observed that some of the GPs receiving regular interventions (treatment arm 1) were also included in activities specific to raising awareness in schools (treatment arm 2) and intensive follow-up (treatment arm 3). In some cases, it was found that the intensity of the school awareness campaign was greater in regular-intervention GPs compared with some of the treatment arm 2 GPs. Though the evidence is anecdotal, it does indicate some fundamental inconsistencies between the project’s design and implementation. 6. Estimation Results 6.1 Summary Statistics Summary statistics of our outcomes of interest are presented in tables A.6 and A.7. Since a stratified sampling of households was carried out based on toilet ownership, households without toilets were overrepresented in our sample. So, we used weights for all toilet-related variables as well as for hygiene awareness and hygienic behaviors among adult survey respondents to derive population estimates of these outcomes. No weights were used for child-related outcomes or for those variables that were defined for a subpopulation, such as toilets under construction (i.e., applicable only to households without toilets), and safe disposal of feces (i.e., applicable only to households with toilets). Table A.6 reports the summary statistics of outcomes without weights and table A.7 reports the weighted summary statistics. Discrepancy between unweighted and weighted means in the summary statistics tables reveals the overrepresentation of households without toilets in our sample in general, and in the control group in particular. In the unweighted data, 56 percent of households in the control arm and around 58 percent of households in the three treatment arms had access to toilets during the baseline survey. After the project’s implementation, access to toilets increased to 68 percent for the control group and between 72 22 and 73 percent for the treatment GPs. In the weighted data, access to toilets in the control GPs increased from 80 percent of households at the baseline to 84 percent after the completion of project interventions. A relatively larger improvement was noticed in the treatment arms, where access to toilets improved from around 74 percent of households at the baseline to around 82–83 percent of households after implementation. Improvement in access in treatment GPs was mostly due to the expanded coverage of safely managed facilities, which increased from around 59–61 percent at the baseline to 66–68 percent after project completion. There was also an increase in “limited” sanitation facilities—that is, toilets shared among households—in the treatment GPs after completion. For the control GPs, most of the improvement in access seen between the baseline and midline is due to limited sanitation facilities, whose coverage increased from 6 to 11 percent. Coverage of basic and safely managed sanitation facilities in the control GPs mostly remained unaltered (table A.7). A relatively larger proportion of households initially without toilets in the treatment GPs also reported having toilets under construction during the midline compared with the baseline. At the baseline, 4.3 percent of households without toilets in arm 1, 2.3 percent in arm 2, and 7.3 percent in arm 3 reported having toilets under construction. The respective percentages increased to 10.2 percent, 12.2 percent, and 19 percent at the time of the midline. In contrast, the percentage of households initially without toilets that reported having toilets under construction in control GPs declined from 2.8 percent at baseline to 1.2 percent at midline. In the unweighted data, we observed a reduction in open defecation, as reported by any member of a household, across the treatment and control groups. Reduction in open defecation was relatively larger for the treatment arms (ranging from 8 to 10 percentage points) compared with control GPs, where open defecation declined from 42.6 percent at the baseline to 39.6 percent after project completion. In the weighted data, the percentage of households in treatment GPs reporting open defecation by any member declined from 27–30 percent at the baseline to 24–25 percent during the midline. Surprisingly, in the control GPs, we observed an increase in open defecation from 24.6 percent at baseline to 30 percent at midline. This could imply that a larger share of households with toilets, and that were assigned larger weights due to their underrepresentation in the sample, reported open defecation during the midline compared with the baseline. The households in our sample displayed a high degree of awareness of hygiene and sanitation issues. Baseline survey respondents, both adults and school-going children, were asked whether they had soap at home, and whether they thought that handwashing with soap was a better option than without. Almost all answered yes. A majority of these respondents correctly identified the need for using soap. Close to 99 percent of the adult respondents were also aware of the ill effects of open defecation on children and the community. 23 Baseline data also revealed awareness of handwashing before eating and after defecation among a majority of the adult population in Punjab. Almost 80 percent of the respondents were aware of the importance of handwashing at the baseline. Large improvements were noticed across treatment and control groups after project implementation. In the weighted data, awareness of the importance of handwashing after defecation increased to 91 percent of the adult respondents for the control group and between 95 and 96 percent for the three treatment arms. Similarly, 88 percent of the respondents from the control arm and between 92 to 95 percent of the respondents from the treatment arms reported awareness of the importance of handwashing before eating at the midline. The use of soap before eating in both treatment and control arms was relatively low at the baseline and improved considerably post implementation. Use of soap in the control arm increased from 56 percent of adult respondents at baseline to 71 percent at midline—an improvement of 15 percentage points. The corresponding improvements in the three treatment arms were between 22 to 23 percentage points post implementation. In contrast, use of soap after defecation was relatively high at the baseline. Ninety-two percent of respondents in the control arm and 84 to 88 percent of respondents in the treatment arms reported using soap after defecation at the baseline. Increases in the use of soap after defecation were modest post implementation. While the use of soap increased by 2 percentage points in the control arm and by around 4 percentage points in arm 3, improvements in arms 1 and 2 were relatively higher, at 9 percentage points and 7 percentage points, respectively. The unweighted summary statistics relating to hygiene awareness and hygienic behaviors among adults were very similar to the weighted ones. In the baseline survey, around 18 to 20 percent of households from the treatment and the control arms reported the treatment of drinking water, which increased by 2 to 5 percentage points post implementation. So, the impact of the project on households’ decision to treat drinking water was limited. Moreover, safe-disposal practices of child feces in households with toilets seem to have deteriorated post completion. In the control arm, 68 percent of households at baseline reported using safe practices to dispose of child feces, which declined to around 65 percent at the midline. A similar pattern was observed in the treatment arms as well, though the magnitudes of the decline were much larger—around 6 percentage points for arm 1, 15 percentage points for arm 2, and 17 percentage points for arm 3. Around 81 percent of school-going children in the treatment arms and 83 percent in the control arm were aware of the importance of handwashing before eating at the baseline. In the control arm, this awareness increased to 87 percent at midline. Larger improvements were noticed in the treatment arms, where between 95 and 96 percent of school-going children reported being aware of the importance of handwashing before eating, post completion. Awareness of the importance of handwashing after defecation also followed almost identical patterns before and after the project in both control and 24 treatment groups. Similarly, larger proportions of children reported using soap before eating and after defecation in the treatment arms compared with the control arm after project completion. Use of soap before eating among school-going children increased from 61 to 69 percent in the control arm, whereas in the treatment arms it increased from 51–56 percent at the baseline to 73–78 percent at the midline. Around 83 percent of children from various treatment arms and 88 percent of children from the control group reported using soap after defecation at baseline. After the project’s completion, the use of soap after defecation increased by 3 percentage points in the control group and by 7 to 10 percentage points in the three treatment arms. 6.2 Results from DID Estimations Toilet Construction Table 2 reports the impact of project interventions on the construction and use of toilets, based on the unadjusted DID specifications. The coverage of basic facilities increased by 6.7 percentage points in GPs that received regular project interventions compared with control GPs. GPs in treatment arm 2, where intensive awareness campaigns were conducted in schools, also saw a 4.2 percentage point increase in basic toilet coverage. GPs with intensive follow-up campaigns in addition to the regular project interventions saw an increase in basic coverage of 5.5 percentage points over the control. Table 2. Toilet Construction and Use—DID Unadjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 midline)Beta5 midline)Beta6 midline)Beta7 Beta6# Beta7# Access 10,550 251 .0814 .0291** .0392*** .0396*** .50 .45 (.0115) (.012) (.0135) (.482) (.501) Limited 10,550 251 .0272 -.0217 .0101 -.00145 2.04 .71 (.0212) (.0213) (.0231) (.154) (.401) Basic 10,550 251 .0581 .0667*** .0417* .0553** .95 .18 (.023) (.0228) (.0239) (.33) (.669) Safely 10,550 251 .0765 .0537** .0347 .0596** .48 .04 managed (.0254) (.0234) (.0251) (.489) (.837) Toilets under 3,787 247 .059 .082*** .119*** .134*** .89 1.17 construction (.0254) (.0327) (.0426) (.345) (.281) Open 10,550 251 .0667 -.105*** -.0902*** -.0833*** .25 .68 defecation (.027) (.03) (.0266) (.62) (.409) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. The project interventions had a significant impact on the ownership of safely managed facilities in intervention GPs in arms 1 and 3, where overall coverage increased between 5 and 6 percentage points compared with control GPs. Coverage of “safely managed toilets in arm 2 increased by 3.5 percentage points compared with control GPs, though the improvement was not statistically significant. Increases in the coverage of basic and safely managed facilities resulted in an overall increase in access to toilets in the intervention GPs. Households with access to toilets increased significantly, by around 3 percentage points in arm 1 and around 4 percentage points in arms 2 and 3 compared with control GPs. 25 Since the project’s financial incentives for toilet construction were meant only for households without toilets, we reported the results separately for households without access to toilets at the baseline (table 3) and for households with toilets (table A.9). In the subsample of households without toilets at baseline, improvement in the coverage of basic and safely managed toilet facilities was higher in arms 2 and 3 than in arm 1. Households with basic toilets increased by around 9 percentage points in arms 2 and 3, compared with 6 percentage points in arm 1. Coverage of safely managed facilities expanded by 10.6 percentage points in arm 3, 8.7 percentage points in arm 2, and 5.3 percentage points in arm 1 compared with the control GPs. Though the GPs receiving intensive follow-up campaigns registered the maximum gain, followed by the GPs receiving the intensive school awareness campaigns, the differences between these GPs and GPs receiving regular project interventions were not statistically significant. Similarly, access to toilets improved by 10.6 percentage points in arm 3 and 10.4 percentage points in arm 2 compared with control GPs. Improvement in access in GPs in arm 1 was relatively modest, at 6 percentage points, compared with the control group and not statistically significant. Access to limited facilities remained mostly unaltered in treatment GPs compared with the control group. Limited facilities expanded by 1 to 2 percentage points in various treatment arms compared with the control arm—and, again, these results were not statistically significant. Table 3. Toilet Construction and Use (Household without Toilets at Baseline)—DID Unadjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 midline)Beta5 midline)Beta6 midline)Beta7 Beta6# Beta7# Access 4,510 247 .226 .0597 .104** .106** .64 .83 (.0456) (.0517) (.0461) (.426) (.364) Limited 4,510 247 .0512 .012 .0166 .0239 .03 .22 (.0223) (.0224) (.0216) (.861) (.643) Basic 4,510 247 .171 .0595* .0942** .0895** .67 .67 (.034) (.0423) (.0366) (.415) (.415) Safely 4,510 247 .149 .0532* .0865** .106*** .72 2.22 managed (.0315) (.0384) (.0347) (.396) (.138) Toilets under 3,787 247 .059 .082*** .119*** .134*** .89 1.17 construction (.0254) (.0327) (.0426) (.345) (.281) Open 4,510 247 .0863 -.00305 -.0425 -.0603 .48 1.21 defecation (.0489) (.0511) (.0456) (.489) (.273) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. We also considered the project’s effects on toilets under construction in households without previous access. Toilets under construction increased by 8.2 percentage points in arm 1, 11.9 percentage points in arm 2, and 13.4 percentage points in arm 3 compared with control GPs. Though both arms 2 and 3 had a substantially larger impact on toilets under construction compared with arm 1, the differences were not statistically significant. When we used the adjusted DID model, the above results remained mostly unchanged (table A.8). We also compared the increase in toilet coverage between households with and without access to toilets at the baseline (tables 3 and A.9). As expected, the increase in coverage in the intervention GPs was driven 26 by households lacking access to toilets at the baseline; these were the major beneficiaries of the program. However, even among the households with access to toilets at the baseline, we would expect a decline in households that had access to limited facilities (i.e., toilets shared among households) and that were to be provided with their own toilets under the project. In the subsample of households with access to toilets at the baseline, we observed almost no impact on those with limited facilities in arm 2 and, consequently, the coverage of basic and safely managed facilities remained mostly unaltered. In arm 3, the coverage of limited facilities declined by around 1 percentage point and the coverage of basic and safely managed facilities expanded by around 3 percentage points compared with the control group. However, none of these coefficients was statistically significant. In arm 1, basic coverage expanded by 5.3 percentage points compared with the control group and was significant at the 10 percent level. We also observed a 3.5 percentage point decline in the coverage of limited facilities in arm 1 compared with the control group, though it was not statistically significant. Open Defecation Survey respondents were asked if any member of their household went out in the open to defecate. So, the results for open defecation reported in table 2 indicate open defecation by any member of a household. Open defecation decreased significantly across all intervention arms. In GPs that received regular project interventions, reported open defecation declined by 10.5 percentage points compared with control GPs. A similar reduction was observed in arm 2 and arm 3 GPs, where open defecation declined by 9 percentage points and 8.3 percentage points, respectively, relative to control GPs. The differential impacts of the intensive school awareness campaigns and intensive follow-up campaigns were on the negative side and not significant. We also reported the results from the adjusted model (see table A.8 in the appendix). The results are very similar to the unadjusted model with similar levels of significance. We also compared changes in the defecation practices of households with and without access to toilets at the baseline (table 3 and table A.9). Households with access to toilets at the baseline saw a statistically significant reduction in open defecation. Open defecation declined by 12 percentage points in arm 1, by 8.7 percentage points in arm 2, and by 7.2 percentage points in arm 3 compared with the control arm. For the subsample of households without access to toilets at the baseline, project interventions had no effect on open defecation behavior in arm 1. In arm 2 and arm 3, open defecation declined by 4.3 and 6 percentage points, respectively, relative to the control group. None of these coefficients was statistically significant. Hygiene Awareness and Hygienic Behavior Table 4. Adult Hygiene Awareness and Behavior—DID Unadjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 midline)Beta5 midline)Beta6 midline)Beta7 Beta6# Beta7# Handwashing knowledge Knowledge 10,550 251 .06 .0645 .0654 .0935* 0 .35 27 before eating (.0465) (.0422) (.0504) (.981) (.552) Knowledge 10,550 251 .0646 .0692* .091** .102** .24 .45 after (.0408) (.0405) (.0458) (.623) (.503) defecation Practice Treatment of 10,550 251 .0396 -.00565 .0304 .0061 2.23 .27 drinking (.021) (.0241) (.0225) (.136) (.602) water Soap used 10,550 251 .07 .0799 .0805 .0693 0 .03 before eating (.0645) (.0607) (.0662) (.991) (.868) Soap used 10,550 251 .0175 .0711** .0483 .016 .38 2.29 after (.0301) (.0302) (.0293) (.539) (.131) defecation Safe disposal 1,768 247 .0833 -.0288 -.131 -.151 1.59 1.77 of feces (.0803) (.0838) (.0939) (.209) (.185) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. Adults Table 4 reports the project’s impact on the hygiene awareness and hygienic behaviors of adult survey respondents. We mostly focused on responses that were not unanimously correct at the baseline. The survey respondents were asked an open-ended question regarding the critical times for handwashing. The proportion of respondents who thought that handwashing is important before eating went up by 9.4 percentage points relative to the control group in arm 3, and the estimate was significant at the 10 percent level. We also observed an increase in awareness related to handwashing before eating in arms 1 and 2 by around 6.5 percentage points relative to the control group. But these results were not statistically significant. However, the project had a statistically significant impact on adult awareness of the importance of handwashing after defecation across different treatment arms. The adult respondents who thought that handwashing after defecation is important increased relative to the control group by 6.9 percentage points in arm 1, 9.1 percentage points in arm 2, and 10.2 percentage points in arm 3. The project’s impact on improving hygienic behaviors among adults was limited. Use of soap among adults before eating went up between 7 and 8 percentage points across various treatment groups compared with the control group. But none of these coefficients was significantly different from zero. Nonsignificant impacts were also observed on the use of soap after defecation in arms 2 and 3. However, soap use after defecation rose significantly by 7.1 percentage points relative to the control group in GPs receiving regular project interventions. There was no significant impact on the treatment of drinking water or the safe disposal of child feces in the intervention households. Safe disposal of child feces has a negative coefficient across all intervention arms (though not a significant one), implying that a smaller percentage of treatment households were practicing the safe disposal of child feces relative to the control group. The result is puzzling. 28 The adjusted DID model has results similar to those of the unadjusted model (table A.10). A comparison of outcomes between households with and without access to toilets at the baseline (tables A.12 and A.11) showed that the impact of the program was stronger among households that had access to toilets to start with. For example, an increase in adults’ awareness of the importance of handwashing before eating among households with access to toilets at the baseline ranged from 6 to 12 percentage points over the control group across various treatment arms (though it was statistically significant only in arm 3). The impact among households without access to toilets at the baseline ranged from 1 to 7 percentage points (and none was statistically significant). Awareness of the importance of handwashing after defecation among households with access to toilets at the baseline increased relative to the control group by 8.6 percentage points in arm 2, and 11.3 percentage points in arm 3—both significant at the 5 percent level. For households without access to toilets at the baseline, the impact on handwashing after defecation is only significant at the 10 percent level for arm 2, where awareness increased by 10.5 percentage points relative to the control group. We also did not observe any significant impact on hygiene practices in these two subgroups except for the use of soap after defecation in arm 1. The use of soap in GPs receiving regular project interventions increased by 5.9 percentage points and 10.7 percentage points, respectively, among households with and without access to toilets at the baseline. Children Aged 6–14 Years The hygiene awareness and sanitary practices of school-going children between ages 6 and 14 are reported in table 5. Awareness of the importance of handwashing before eating increased relative to the control group by 10.4 percentage points in arm 1, 10.7 percentage points in arm 2, and 10.6 percentage points in arm 3. All the coefficients were significant at the 5 percent level. Awareness of handwashing after defecation among school-going children also improved in the treatment arms compared with the control group by 5 to 7 percentage points—from 4.7 percentage points in arm 1 to 7.3 percentage points in arm 3. However, none of these positive impacts was statistically significant. The use of soap before eating among school-going children increased significantly relative to the control group by 13.8 percentage points in arm 1, 13.3 percentage points in arm 2, and 13.7 percentage points in arm 3. The coefficients were significant at the 5 percent level. The practice of handwashing with soap after defecation among children, however, showed no statistically significant improvement. That said, the impacts observed in all treatment arms were positive, varying between 4.1 percentage points in arm 3 to 6.4 percentage points in arm 2. We also did not find any significant differential impact of intensive school awareness campaigns and intensive follow-up campaigns across households on the handwashing knowledge or practices of school-going children. Table 5. Children’s Hygiene Awareness and Behavior—DID Unadjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = 29 Clusters R^2 midline)Beta5 midline)Beta6 midline)Beta7 Beta6# Beta7# Handwashing knowledge Important 4,674 250 .0592 .104** .107** .106** .01 0 before eating (.0448) (.0418) (.0496) (.924) (.959) Important after 4,674 250 .0398 .0473 .0545 .0733 .03 .39 defecation (.0418) (.0455) (.0444) (.867) (.534) Practice Soap used 4,674 250 .0131 .048 .064 .0405 .12 .02 after (.0416) (.0433) (.045) (.735) (.878) defecation Soap used 4,674 250 .0549 .138** .133** .137** .01 0 before eating (.0651) (.0609) (.0643) (.93) (.984) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. The results of the adjusted DID specification reported in table A.13 are similar to those of the unadjusted model. When we compared results for subgroups of children from households with and without access to toilets at the baseline (tables A.15 and A.14), we observed a large positive impact on awareness of the importance of handwashing before eating in both subgroups, though not statistically significant across all arms. Similarly, the project’s impact on awareness of the importance of handwashing after defecation was positive in both subgroups, but statistically significant only for arm 3 in the subgroup of children from households with toilets at baseline. The use of soap before eating among children from these households also increased significantly, by 15 to 18 percentage points, across treatment arms relative to the control arm. However, the impact on use of soap after defecation was relatively small and statistically insignificant in arms 2 and 3, and significant at the 10 percent level in arm 1. For children belonging to households without access to toilets at the baseline, the use of soap before eating increased between 9 and 12 percentage points relative to the control group across treatment arms, but the coefficients were not statistically significant. The project’s impact on the use of soap after defecation in this sub-group was relatively small and insignificant in arms 1 and 3, but was found to be significant at the 5 percent level in arm 2, which witnessed a 13 percentage points’ improvement relative to control post-completion of the project. 6.3 Results from the ANCOVA Estimations Estimates from the ANCOVA specifications are reported in table 6. We also estimated the model for the two subsamples: households with and without access to toilets at the baseline. The results are reported in tables A.16 and A.17, respectively. Since ANCOVA specifications used baseline values of the outcome variables as regressors, access to toilets as well as outcome variables that were conditioned on access to toilets could not be estimated for the subsamples. 30 Toilet Construction and Use ANCOVA estimates for outcomes related to the construction and use of toilets were generally smaller in magnitude than the DID estimates. For the full sample, unlike DID estimates, no significant impact was observed on the coverage of basic facilities across treatment arms or access to toilets in arm 1. In arms 2 and 3, access improved significantly relative to the control group, by around 2 percentage points, compared with 4 percentage points estimated under DID. Estimated effects on the coverage of safely managed facilities, toilets under construction, and open defecation also had significance levels similar to DID estimates but smaller in magnitude. As per ANCOVA estimates, open defecation declined in the treatment arms relative to the control group by around 7 to 8 percentage points, and households without initial access but reporting construction of toilets increased by 5.9 percentage points in arm 1, 7 percentage points in arm 2, and 12 percentage points in arm 3. For the subsamples of households without access to toilets at baseline, we observed a significant impact of the project on the coverage of basic and safely managed facilities. The estimated coefficients were very similar to those of DID estimates. Impacts on open defecation across treatment arms were also similar. Open defecation declined by 1.2 percentage points in arm 1, 3.8 percentage points in arm 2, and 6.5 percentage points in arm 3. However, unlike DID estimates, in which all the coefficients were non-significant, the impact on arm 3 was found to be significant at the 10 percent level. For the subsample of households with access to toilets at the baseline, we found no significant impact on basic coverage. The estimated impacts on safely managed facilities were also similar to DID, except that the impact on arm 1 was significant at the 10 percent level. We also found large reductions in open defecation across treatment arms for this subgroup, which is in line with the findings from the DID analysis. Hygiene Awareness and Hygienic Behaviors Adults Based on the ANCOVA estimates, awareness of the importance of handwashing, both before eating and after defecation, improved significantly among adults across all treatment arms compared with the control group. All the coefficients were found to be significant at least at the 5 percent level. Awareness of the importance of handwashing after defecation increased by 4 to 5 percentage points, which is less than that shown by the DID estimates. Moreover, unlike the DID estimates, which found a statistically significant impact on the awareness of handwashing before eating only in arm 3, the ANCOVA results suggest an improvement of 5 and 7 percentage points across all treatment arms. Table 6. Impact of Project Interventions: ANCOVA Unadjusted Model N No. of Clusters Adj. R^2 Treatment 1 Treatment 2 Treatment 3 31 Toilets Construction and Use Access 5,275 251 .652 .00956 .0237*** .0224** (.00889) (.00913) (.00986) Limited 5,275 251 .115 -.00891 .0158 .00242 (.0154) (.0169) (.0176) Basic 5,275 251 .401 .0308 .0155 .0293 (.0187) (.019) (.0203) Safely managed 5,275 251 .435 .0392* .0219 .0455** (.0213) (.022) (.0217) Toilets under construction 2,255 247 .0577 .0594*** .0701*** .12*** (.0143) (.0181) (.0232) Open defecation 5,275 251 .233 -.0775*** -.0732*** -.0746*** (.0227) (.0251) (.0205) Adult Hygiene Awareness and Behaviors Knowledge Handwashing before eating 5,275 251 .0284 .07*** .059*** .0464** (.0209) (.0214) (.0203) Handwashing after defecation 5,275 251 .0228 .0407** .0549*** .0423** (.0163) (.0145) (.017) Practice Treatment of drinking water 5,275 251 .329 -.000311 .0321 .0152 (.0175) (.0212) (.0208) Soap used before eating 5,275 251 .0244 .0419 .0575 .0091 (.0368) (.0379) (.0378) Soap used after defecation 5,275 251 .0187 -.00708 -.00859 -.0303* (.0136) (.0152) (.0173) Children’s Hygiene Awareness and Behaviors Knowledge Handwashing before eating 2,337 250 .0316 .0765*** .0824*** .0719*** (.0245) (.0244) (.0251) Handwashing after defecation 2,337 250 .0197 .0607** .0638*** .0622*** (.0246) (.0225) (.0233) Practice Soap used after defecation 2,337 250 .0145 -.000526 .00654 -.00968 (.0262) (.0207) (.0255) Soap used before eating 2,337 250 .0209 .0434 .0843** .0361 (.0438) (.039) (.0416) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. Standard errors reported in parentheses. ANCOVA = analysis of covariance. Similar to the findings of the DID analysis, the ANCOVA results suggest that the program had no statistically significant impact on motivating more people to use soap for handwashing or to treat their drinking water. Coefficients from the ANCOVA estimates of soap use after defecation were negative, though close to zero, and nonsignificant for arms 1 and 2. However, this estimate was negative and significant at the 10 percent level for arm 3. In contrast, the DID estimates suggested positive impacts across treatment arms, but these are statistically significant only for arm 1. A comparison of results for households with and without access to toilets at the baseline showed statistically significant improvements in awareness among those with access, across the three treatment arms. For households without access to toilets, the impacts on the awareness of handwashing before eating across treatment arms, though positive, were smaller in magnitude and not statistically significant. However, significant positive impacts on the awareness of handwashing after defecation were observed in arms 1 and 2 for the subsample of households without toilets at baseline. Finally, no 32 significant effect on handwashing practices was observed in any treatment arm in either of these subsamples. Children Aged 6–14 Years Awareness of handwashing among school-going children showed significant improvement across all treatment arms. All the coefficients were significant at the 1 percent level. Awareness of handwashing before eating in the treatment arms improved relative to the control group by 7 to 8 percentage points, which was slightly smaller than the 9 to 10 percentage points derived from the DID estimates. Awareness of handwashing after defecation improved across treatment arms by around 6 percentage points. In contrast, DID analysis found significant improvement only in arm 3. However, the program had little impact on the use of soap after defecation. The coefficients were close to zero and not significant. Moreover, though we found a positive impact on the use of soap before eating, the impact was significant only in arm 2 GPs, where intensive awareness campaigns were conducted in schools. The results of the DID analysis were mostly similar but larger in magnitude. Along with arm 2, DID analysis also showed a large, positive impact (significant at the 10 percent level) on the use of soap before eating in arm 3. When we compared the results for the two subsamples—households with and without access to toilets at the baseline—significant improvements in awareness of handwashing before eating were observed in both the subsamples. Awareness of handwashing after defecation also improved by 6 to 8 percentage points across treatment arms in households with access to toilets at baseline. In contrast, for the subgroup without access to toilets, a statistically significant impact was observed only in arm 2, where awareness improved by 7 percentage points relative to control GPs. The project’s impact on the use of soap in either of the subgroups (i.e., with and without access to toilets) was limited. Use of soap before eating increased by around 8 percentage points in arm 2 in both subgroups, and use of soap after defecation increased by 3.4 percentage points in arm 1 for households with access at baseline. However, these coefficients were significant only at the 10 percent level. 6.4 Discussion of Results One of the main objectives of the project was to create demand for toilets. It was expected that BCC campaigns along with incentive money for toilet construction would lead to an increase in toilet coverage across the intervention GPs. Our results indicate that the project was successful in increasing ownership of safely managed facilities in intervention GPs, especially among households that did not have access to toilets earlier. This is in line with the project’s design, which financed the construction of only safely managed facilities. Universal coverage of individual household latrines was also made implicit in the project design by defining all households without individual toilets as beneficiaries. So, 33 we would expect a decline in limited facilities and an increase in safely managed facilities even in those households with access to toilets at the baseline. We would also expect a proportional increase in the coverage of basic facilities in the treatment GPs since “safely managed” facilities constitute a subset of “basic” facilities. However, our results indicate that for the subsample of households with access to toilets at the baseline, the ownership of toilets both individual and shared was not impacted in arm 2. In the other two treatment arms, while the coverage of safely managed and limited facilities moved in the expected direction, the magnitudes of the impact were small and statistically insignificant. There was also an expansion of limited facilities in intervention GPs in the subsample of households without toilets at baseline. Moreover, summary statistics indicate that basic facilities increased less than what would be proportionate, compared with safely managed facilities, and the proportion of households with limited facilities also increased in the treatment GPs after the completion of project interventions. During project implementation, the government decided that covered pit latrines with slabs (basic facilities, according to the JMP’s definition), were unacceptable and would be destroyed and replaced by safely managed facilities. Subsequently, during the latter part of implementation, when the project ran into financial constraints, the focus shifted from providing all households with safely managed facilities to concentrating on those households that did not have access and also encouraging households to share toilets with their extended families. The combined effect of these decisions by the project management could explain some of our findings. Our results also suggest that the project significantly increased the number of toilets under construction. A large proportion of households without access at the baseline, and across treatment arms, reported having toilets under construction at the time of the midline survey. So, the project’s long-term benefits, in terms of providing access to toilets as well as expanding coverage of safely managed facilities, might be higher than was observed in the short term. Our results indicate that the BCC campaign undertaken throughout the implementation of the project had a significant impact on reducing open defecation. Constructing more toilets is a relatively easy objective. However, convincing people to stop the practice of open defecation and actually use toilets is one of the biggest challenges facing sanitation programs across the developing world. As discussed earlier, most related studies have found the reduction in open defecation due to CLTS programs to be less than proportionate to the construction of toilets under these same programs. The project in Punjab, on the other hand, achieved a reduction in open defecation that was greater than the increase in the coverage of basic facilities across intervention GPs. More interestingly, the reduction in open defecation came through the increased use of toilets among members of households that already had toilets at the baseline. This shows that the project was successful in changing the behaviors of people who had previously chosen to defecate in the open in spite of having easy access to a toilet. The nonsignificant 34 impact on open defecation rates in households without toilets at the baseline, and that are the major beneficiaries of the project, might be because such changes take time to materialize, especially considering project delays in the construction of new toilets. Since the midline survey was undertaken right after the completion of the project interventions, some households with brand new toilets might not have gotten accustomed to using them. In Punjab, both adults and school-going children surveyed at the baseline displayed high levels of awareness of basic hygiene and sanitation issues. Almost all households reported having soap, and a large majority of baseline survey respondents were aware of the reasons for using soap as well as the ill effects of open defecation on communities’ health in general and children’s health in particular. After the completion of the project interventions, we observed large improvements in hygiene knowledge and sanitary practices among both adults and school-going children—and in the control GPs as well. This was mainly due to statewide information and education campaigns undertaken by the India’s central government as well as the Punjab state government through television, radio, and social media to reinforce the messages of the BCC campaign. Our estimation techniques eliminated these time-varying fixed effects to capture the true impact of the project. Our results indicate that the BCC campaign had a positive and significant impact in raising awareness of the importance of handwashing before eating and after defecation among adults across all treatment arms. The project’s impact appeared to be strongest on households that had access to toilets at the baseline. For households without access to toilets at the baseline, the project’s impact on adults’ awareness of handwashing before eating seemed mostly insignificant, whereas significant improvement in awareness of handwashing after defecation among adults was restricted to GPs receiving regular project interventions and the intensive school awareness campaigns. The BCC campaign was also very successful in raising awareness of handwashing among school-going children in all treatment arms. Significant improvements in awareness of handwashing before eating were also observed among subgroups of children from households with and without access to toilets at the baseline. Awareness of handwashing after defecation also improved significantly across all treatment arms among households with access to toilets at the baseline. For households without such access, however, a significant improvement was seen only in GPs where intensive school awareness campaigns were conducted. While the project was mostly successful in raising awareness of the importance handwashing among adults, it had no significant effect on mobilizing more people to use soap, treat their drinking water, or use safe methods for the disposal of child feces. Similarly, the project’s impact in promoting improved hygiene and sanitation practices among subgroups with and without access to toilets was mostly insignificant. 35 The project also had limited impact on improving handwashing practices among school-going children. We found no systematic impact of the BCC campaign on promoting the use of soap after defecation. GPs where intensive school campaigns were conducted showed positive significant improvements in use of soaps before eating in the full sample as well as in both sub-samples of households with and without access to toilets. However, the BCC campaign’s impact on using soap before eating on other treatment arms was mostly insignificant. That said, DID estimates indicate that the project, overall, had a positive significant impact on the use of soap before eating, especially among households with access to toilets at the baseline. Our results also indicate a possible incremental impact of intensive school awareness campaigns and intensive follow-up campaigns, though we did not find any statistically significant differential impact of either of these interventions. Awareness of the importance of handwashing before eating and after defecation was relatively higher among school-going children in GPs where intensive school awareness campaigns had been conducted. A significantly larger proportion of children from these GPs also reported using soap before eating. GPs that received the intensive follow-up campaign also witnessed the largest increase in safely managed facilities, and larger proportion of households without initial access to toilets in these GPs reported having toilets under construction. While a reduction in open defecation was mostly observed among households who had access to toilets at the baseline, GPs receiving intensive follow-up campaigns also saw a reduction in open defecation among households without access to toilets at the baseline. 7. Conclusion The present study is one of the first rigorous impact evaluations of India’s flagship sanitation program, the Swachh Bharat Mission–Gramin. The study used a multiple-arm, cluster randomized control design to assess the short-run effects of the program as implanted in rural Punjab, India on the construction of toilets, the practice of open defecation, and beneficiaries’ hygiene-related awareness and practices. The study found that the program was successful in increasing the coverage of safely managed toilets and led to a decline in open defecation among rural households in project intervention areas. A significant reduction in open defecation was observed among households that already had toilets. The effect was less pronounced among households without toilets, which were also the primary targets of the program. Since the midline survey was conducted immediately after project completion, many households whose toilets had just been completed might not yet have had time to get habituated to using them. Moreover, many other households were still in the process of seeing their toilets constructed. So, the potential impact of the program on toilet construction and open defecation is likely to increase over time. Interestingly, GPs with intensive follow-up campaigns achieved a significant reduction in open 36 defecation even among households without access to toilets at baseline, and also had a relatively larger impact on expanding the coverage of safely managed facilities as well as access. The program had a positive impact on raising awareness of the importance of handwashing among adults and school-going children. The program’s impact on raising awareness of handwashing among adults appears to be strongest among households with access to toilets at the baseline. GPs with intensive awareness campaigns in schools also had a relatively larger impact on raising awareness of handwashing among school-going children and promoting the use of soap before eating. Otherwise, the program’s impact in promoting the use of soap among children and adults was mostly limited. We also found no significant impact on motivating households to treat drinking water, or use safe practices for the disposal of child feces. At the time of the midline survey, the DWSS was planning to continue the BCC campaigns in the treatment GPs until October 2019, the target end date of the SBMG. Since the program has already shown promise in raising hygiene awareness and discouraging open defecation, more intensive follow- ups are likely to result in better outcomes. The positive impacts found at the midline evaluation of the program promise that positive health and nutritional outcomes associated with better sanitation practices are very likely to materialize over the long term. A follow-up survey and evaluation planned for 2021 will be able to capture these impacts. References Borja-Vega, Christian. 2014. “The Effects of the Total Sanitation and Sanitation Marketing Programme on Gender and Ethnic Groups in Indonesia.” Waterlines 33 (1): 55–70. Briend, André. 1990. “Is Diarrhoea a Major Cause of Malnutrition among the Under-Fives in Developing Countries? A Review of Available Evidence.” European Journal of Clinical Nutrition 44 (9): 611–28. Crocker, Jonny, Elvis Abodoo, Daniel Asamani, William Domapielle, Benedict Gyapong, and Jamie Bartram. 2016. “Impact Evaluation of Training Natural Leaders during a Community-Led Total Sanitation Intervention: A Cluster-Randomized Field Trial in Ghana.” Environmental Science & Technology 50 (16): 8867–75. https://doi.org/10.1021/acs.est.6b01557. De Boer, Michiel R., Wilma E. Waterlander, Lothar D. Kuijper, Ingrid H. Steenhuis, and Jos W. Twisk. 2015. “Testing for Baseline Differences in Randomized Controlled Trials: An Unhealthy Research Behavior That Is Hard to Eradicate.” International Journal of Behavioral Nutrition and Physical Activity 12 (4). http://doi.org/10.1186/s12966-015-0162-z. Dickinson, Katherine, Sumeet Patil, Subhrendu Pattanayak, Christine Poulos, and Jui-Hen Yang. 2015. “Nature’s Call: Impacts of Sanitation Choices in Orissa, India.” Economic Development and Cultural Change 64 (1): 1–29. Frison, Lars, and Stuart Pocock. 1992. “Repeated Measures in Clinical Trials: Analysis Using Mean Summary Statistics and Its Implications for Design.” Statistics in Medicine 11 (13): 1685–704. 37 Gertler, Paul, Manisha Shah, Maria L. Alzua, Lisa Cameron, Sebastian Martinez, and Sumeet Patil. 2015. “How Does Health Promotion Work? Evidence from the Dirty Business of Eliminating Open Defecation.” NBER Working Paper 20997, National Bureau of Economic Research, Cambridge, MA. Godfrey, Samuel, Matteus Van der Velden, Americo Muianga, Melinda Vigh, Jan W. Gunning, and Chris Elbers. 2014. “Impact Study of the One Million Initiative Rural Water and Sanitation Programme in Mozambique.” Waterlines 33 (1): 35–44. Government of India. 2017. “Guidelines for Swachh Bharat Mission (Gramin).” Ministry of Drinking Water and Sanitation, Government of India, New Delhi. Guiteras, Raymond, James Levinsohn, and Ahmed M. Mobarak. 2015. “Encouraging Sanitation Investment in the Developing World: A Cluster-Randomized Trial.” Science 348 (6237): 903– 06. Hadidjaja, Pinardi, Engelina Bonang, M. Arifin Suyardi, S. Alisah Abidin, I. Suhariah Ismid, and Sri S. Margono. 1998. “The Effect of Intervention Methods on Nutritional Status and Cognitive Function of Primary School Children Infected with Ascaris Lumbricoides.” The American Journal of Tropical Medicine and Hygiene 59 (5): 791–95. Humphrey, Jean H. 2009. “Child Undernutrition, Tropical Enteropathy, Toilets, and Handwashing.” The Lancet 374 (9694): 1032–35. doi:10.1016/S0140-6736(09)60950-8. Imbens, Guido W., and Jeffrey M. Wooldridge. 2009. “Recent Developments in the Econometrics of Program Evaluation.” Journal of Economic Literature 47 (1): 5–86. Institute of Development Studies. 2018. “Countries.” Community-Led Total Sanitation, April 27. http://www.communityledtotalsanitation.org/where. Joint Monitoring Programme for Water Supply and Sanitation (JMP). 2017. Progress on Drinking Water, Sanitation and Hygiene: 2017 Update and SDG Baselines. Geneva: World Health Organization (WHO) and the United Nations Children’s Fund (UNICEF). Kar, Kamal, and Robert Chambers. 2008. Handbook on Community-Led Total Sanitation. Brighton: Institute of Development Studies. McKenzie, David. 2012. “Beyond Baseline and Follow-up: The Case for More T in Experiments.” Journal of Development Economics 99 (2): 210–21. Patil, Sumeet, Benjamin Arnold, Alicia Salvatore, Bertha Briceño, Sandipan Ganguly, John Colford Jr., and Paul Gertler. 2014. “The Effect of India’s Total Sanitation Campaign on Defecation Behaviors and Child Health in Rural Madhya Pradesh: A Cluster Randomized Controlled Trial.” PLoS Medicine 11 (8): e1001709. https://doi.org/10.1371/journal.pmed.1001709 . Pattanayak, Subhrendu, Jui-Chen Yang, Katherine Dickinson, Christine Poulos, Sumeet Patil, Ranjan Mallick, Jonathan Blitstein, and Purujit Praharaj. 2009. “Shame or Subsidy Revisited: Social Mobilization for Sanitation in Orissa, India.” Bulletin of the World Health Organization 87 (8): 580–87. Pickering, Amy J., Habiba Djebbari, Carolina Lopez, Massa Coulibaly, and Maria L. Alzua. 2015. “Effect of a Community-Led Sanitation Intervention on Child Diarrhoea and Child Growth in Rural Mali: A Cluster-Randomised Controlled Trial.” The Lancet Global Health 3 (11): e701– 11. 38 Prüss-Üstün, Annette, and Carlos Corvalán. 2006. Preventing Disease through Healthy Environments: Towards an Estimate of the Environmental Burden of Disease. Geneva: World Health Organization. Prüss-Üstün, Annette, Robert Bos, Fiona Gore, and Jamie Bartram. 2008. Safer Water, Better Health: Costs, Benefits and Sustainability of Interventions to Protect and Promote Health. Geneva: World Health Organization. Rubin, Donald B. 2001. “Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation.” Health Services and Outcomes Research Methodology 2 (3–4): 169–88. Senn, Stephen. 2013. “Seven Myths of Randomisation in Clinical Trials.” Statistics in Medicine 32 (9): 1439–50. doi: 10.1002/sim.5713. United Nations. 2016. “Transforming Our World: The 2030 Agenda for Sustainable Development.” https://sustainabledevelopment.un.org/post2015/transformingourworld. Waddington, Hugh, Birte Snilstveit, Howard White, and Lorna Fewtrell. 2009. Water, Sanitation and Hygiene Interventions to Combat Childhood Diarrhoea in Developing Countries. New Delhi: International Initiative for Impact Evaluation. WHO (World Health Organization). 2004. Evaluation of the Costs and Benefits of Water and Sanitation Improvements at the Global Level. Geneva: World Health Organization. World Bank. 2016. “How Sustainable Are Sanitation Outcomes in Clean Village Prize Winners? Findings of a Large-Scale Rapid Assessment in India.” Water and Sanitation Program Learning Note, World Bank, Washington, DC. Ziegelbauer, Kathrin, Benjamin Speich, Daniel Mäusezahl, Robert Bos, Jennifer Keiser, and Jürg Utzinger. 2012. “Effect of Sanitation on Soil-Transmitted Helminth Infection: Systematic Review and Meta-Analysis.” PLoS Medicine 9 (1): e1001162. 39 Table A.1 Baseline Balance (Weighted) Control Arm 1 Arm 2 Arm 3 Normalized Mean Differences (Mean) (Mean) (Mean) (Mean) Number of Gram Panchayats (GPs) 80 60 60 60 Control- Control- Control- Arm 1- Arm 1- Arm 2- Number of households 1,872 1,406 1,394 1,395 Arm 1 Arm 2 Arm 3 Arm 2 Arm 3 Arm 3 A. Household characteristics Number of members in the household All 5.31 5.236 5.298 5.19 .0256 .004 .0432 -.0219 .0172 .0397 Children less than 5 years .6453 .5897 .6826 .6663 .0522 -.0336 -.0191 -.0861 -.0718 .0147 Children between 6–14 years 1.065 1.054 1.011 1.02 .0074 .0361 .0303 .0289 .0229 -.0064 Caste/social category of the household General .3286 .2913 .3443 .3143 .057 -.0235 .0217 -.0805 -.0353 .0451 Scheduled caste/scheduled tribe (SC/ST) .5039 .5282 .4641 .5459 -.0344 .0564 -.0595 .0909 -.0251 -.1161 Religion of the head of household Hindu .2392 .2287 .2244 .2495 .0174 .0248 -.017 .0074 -.0345 -.0418 Sikh .7084 .7195 .727 .6986 -.0174 -.0291 .0152 -.0118 .0326 .0444 Economic category Below poverty line (BPL) .5042 .5166 .5499 .5136 -.0175 -.0647 -.0132 -.0472 .0043 .0515 Above poverty line (APL) .3404 .2677 .2444 .2489 .1122 .1501 .1427 .0378 .0304 -.0073 Landholding by category Small and marginal farmer .2273 .2183 .2876 .2557 .0153 -.0978 -.0471 -.1132 -.0624 .0507 No land .7032 .711 .638 .6895 -.0122 .0983 .021 .1105 .0332 -.0772 Asset ownership Own house .9782 .9779 .974 .9735 .0014 .0194 .0213 .0179 .0199 .002 Radio .03606 .02933 .05012 .03702 .0268 -.049 -.0036 -.0754 -.0304 .0454 Color television .9089 .8407 .8948 .8807 .1466 .0337 .0651 -.1133 -.0819 .0314 Gas stove .8787 .8176 .8504 .8709 .1208 .0585 .0166 -.0625 -.1043 -.0418 Refrigerator .8375 .7866 .8446 .8221 .0922 -.0138 .0289 -.1061 -.0633 .0428 40 Table A.1 Baseline Balance (Weighted) Control Arm 1 Arm 2 Arm 3 Normalized Mean Differences (Mean) (Mean) (Mean) (Mean) Number of Gram Panchayats (GPs) 80 60 60 60 Control- Control- Control- Arm 1- Arm 1- Arm 2- Number of households 1,872 1,406 1,394 1,395 Arm 1 Arm 2 Arm 3 Arm 2 Arm 3 Arm 3 Tractor .1168 .1138 .1584 .1087 .0067 -.0855 .0181 -.0922 .0114 .1036 Mobile phone .9724 .9621 .9695 .9683 .0408 .012 .017 -.0289 -.0239 .005 Toilet .7989 .7296 .7461 .7377 .1159 .0892 .1028 -.0266 -.013 .0135 Education of the head of household Secondary .2316 .1919 .1968 .2199 .0687 .06 .0197 -.0086 -.0489 -.0403 College/graduate/postgraduate .1061 .1087 .1077 .1034 -.006 -.0037 .0062 .0023 .0122 .0099 Illiterate .317 .3504 .3513 .3377 -.0501 -.0514 -.0312 -.0013 .0189 .0202 Primary occupation of the head of household Cultivation .1723 .1661 .2181 .1928 .0117 -.0817 -.0376 -.0934 -.0492 .0442 Agricultural labor .08015 .1248 .1135 .08566 -.1043 -.0799 -.0141 .0245 .0903 .0659 Nonagricultural labor .3154 .344 .3341 .3294 -.043 -.0283 -.0213 .0148 .0218 .007 Salaried work .1526 .136 .121 .1186 .0335 .0651 .0704 .0316 .0369 .0054 Business .0907 .0829 .06481 .09183 .0196 .0684 -.0028 .0489 -.0224 -.0712 B. Village characteristics SC/ST majority village .4594 .4154 .4333 .5104 .0628 .0371 -.0722 -.0256 -.1353 -.1095 Village head w/college degree .086 .1309 .08321 .0509 -.1023 .0071 .0985 .1093 .1986 .0915 Village head w/high school degree .1368 .1351 .1786 .1663 .0033 -.0813 -.0583 -.0847 -.0616 .023 41 Table A.2 Baseline Balance (Unweighted) Control Arm 1 Arm 2 Arm 3 Normalized Mean Differences (Mean) (Mean) (Mean) (Mean) Number of gram panchayats (GPs) 80 60 60 60 Control- Control- Control- Arm 1- Arm 1- Arm 2- Number of households 1,872 1,406 1,394 1,395 Arm 1 Arm 2 Arm 3 Arm 2 Arm 3 Arm 3 A. Household characteristics Number of members in the household All 5.167 5.144 5.215 5.111 .0082 -.0173 .0204 -.0261 .0123 .039 Children less than 5 years .6245 .5597 .6722 .643 .0605 -.0425 -.0169 -.1036 -.0785 .0262 Children between 6–14 years 1.096 1.09 1.042 1.025 .0043 .0356 .0478 .0316 .0438 .0118 Caste/social category of the household General .297 .2738 .3199 .2903 .0363 -.0351 .0104 -.0714 -.0259 .0455 Scheduled caste/scheduled tribe (SC/ST) .5438 .542 .5043 .5749 .0026 .056 -.0443 .0533 -.0469 -.1004 Religion of the head of household Hindu .2473 .2724 .2453 .2695 -.0404 .0033 -.0359 .0437 .0046 -.0391 Sikh .6918 .6728 .7052 .6817 .0288 -.0206 .0153 -.0494 -.0134 .036 Economic category Below poverty line (BPL) .5422 .5334 .5796 .5369 .0124 -.0533 .0075 -.0658 -.0049 .0608 Above poverty line (APL) .2997 .2553 .2188 .2595 .0701 .131 .0634 .0608 -.0067 -.0675 Landholding by category Small and marginal farmer .2051 .2041 .2532 .2222 .0018 -.081 -.0295 -.0828 -.0312 .0515 No land .7366 .7269 .6851 .7226 .0156 .0805 .0224 .0649 .0068 -.0581 Asset ownership Own house .9658 .9737 .9699 .9749 -.0325 -.0163 -.0379 .0163 -.0055 -.0217 Radio .03579 .03485 .04591 .03584 .0036 -.0362 -.0002 -.0397 -.0038 .036 Color television .8734 .8364 .8766 .8774 .0743 -.0069 -.0086 -.0812 -.0829 -.0017 Gas stove .8344 .7952 .8128 .8459 .0715 .0401 -.0221 -.0314 -.0936 -.0623 Refrigerator .797 .7703 .8042 .8022 .0459 -.0127 -.0091 -.0586 -.055 .0036 42 Table A.2 Baseline Balance (Unweighted) Control Arm 1 Arm 2 Arm 3 Normalized Mean Differences (Mean) (Mean) (Mean) (Mean) Number of gram panchayats (GPs) 80 60 60 60 Control- Control- Control- Arm 1- Arm 1- Arm 2- Number of households 1,872 1,406 1,394 1,395 Arm 1 Arm 2 Arm 3 Arm 2 Arm 3 Arm 3 Tractor .09348 .09673 .1234 .1004 -.0078 -.0681 -.0164 -.0603 -.0086 .0517 Mobile phone .9578 .9566 .9613 .9663 .0041 -.0124 -.0315 -.0166 -.0356 -.0191 Toilet .5897 .6053 .5947 .5957 -.0224 -.0071 -.0086 .0153 .0138 -.0015 Education of the head of household Secondary .2014 .1821 .1923 .2122 .0347 .0162 -.0188 -.0184 -.0535 -.0351 College/graduate/postgraduate .09241 .1017 .09254 .09247 -.0222 -.0003 -.0001 .0219 .022 .0002 Illiterate .3595 .3606 .3594 .3477 -.0016 .0002 .0175 .0018 .0191 .0173 Primary occupation of the head of household Cultivation .1496 .1479 .1829 .1606 .0032 -.0634 -.0215 -.0666 -.0247 .0419 Agricultural labor .09562 .1095 .1212 .09032 -.0324 -.0583 .0129 -.0259 .0453 .0711 Nonagricultural labor .3595 .3848 .3737 .3677 -.037 -.0209 -.0121 .0161 .0249 .0088 Salaried work .1341 .1302 .1176 .1183 .0082 .035 .0336 .0268 .0255 -.0014 Business .0812 .07966 .05811 .09104 .004 .0642 -.0248 .0602 -.0288 -.0888 B. Village characteristics SC/ST majority village .4594 .4154 .4333 .5104 .0628 .0371 -.0722 -.0256 -.1353 -.1095 Village head w/college degree .086 .1309 .08321 .0509 -.1023 .0071 .0985 .1093 .1986 .0915 Village head w/high school degree .1368 .1351 .1786 .1663 .0033 -.0813 -.0583 -.0847 -.0616 .023 43 Table A.3 Attrition Total Households Not Found at Attrition Rates at Baseline Midline (%) Control 1,872 267 14.3 Arm 1 1,406 198 14.1 Arm 2 1,394 175 12.6 Arm 3 1,395 152 10.9 Full sample 6,067 792 13.1 44 Table A.4 Baseline Balance (Weighted) with Attrition Control Arm 1 Arm 2 Arm 3 Normalized Mean Differences (Mean) (Mean) (Mean) (Mean) Number of gram panchayats (GPs) 77 58 58 58 Control- Control- Control- Arm 1- Arm 1- Arm 2- Number of households 1,605 1,208 1,219 1,243 Arm 1 Arm 2 Arm 3 Arm 2 Arm 3 Arm 3 A. Household characteristics Number of members in the household All 5.38 5.326 5.345 5.21 .0187 .0121 .0602 -.0066 .0422 .0485 Children less than 5 years .6546 .5978 .6923 .6761 .0529 -.0337 -.0195 -.0866 -.073 .0145 Children between 6–14 years 1.066 1.054 1.004 1.02 .0083 .0426 .0314 .0343 .023 -.0116 Caste/social category of the household General .3427 .3032 .346 .2981 .0598 -.005 .0677 -.0648 .0079 .0726 Scheduled caste/scheduled tribe (SC/ST) .4882 .5243 .446 .562 -.051 .06 -.1047 .1112 -.0535 -.1652 Religion of the head of household Hindu .2342 .2314 .2206 .2546 .0047 .023 -.0336 .0183 -.0383 -.0566 Sikh .7139 .715 .7256 .6891 -.0017 -.0185 .0384 -.0168 .04 .0569 Economic category Below poverty line (BPL) .4938 .4854 .5502 .5288 .0119 -.08 -.0495 -.0919 -.0614 .0304 Above poverty line (APL) .3516 .2844 .244 .2503 .1024 .1675 .1571 .0648 .0544 -.0103 Landholding by category Small and marginal farmer .2384 .2283 .2969 .2432 .017 -.0936 -.008 -.1106 -.0249 .0856 No land .6884 .6921 .6242 .6969 -.0056 .0958 -.013 .1014 -.0074 -.1088 Asset ownership Own house .9871 .9893 .9814 .9774 -.0144 .0327 .0519 .0469 .0658 .0195 Radio .03624 .03165 .04603 .03787 .0179 -.0349 -.0061 -.0527 -.024 .0288 Color television .9158 .8622 .8949 .8816 .1211 .0506 .0802 -.0708 -.0412 .0297 Gas stove .8942 .8369 .8588 .8714 .119 .0761 .0501 -.0431 -.0691 -.026 Refrigerator .8564 .8051 .8463 .8194 .097 .0201 .071 -.0769 -.026 .0509 45 Table A.4 Baseline Balance (Weighted) with Attrition Control Arm 1 Arm 2 Arm 3 Normalized Mean Differences (Mean) (Mean) (Mean) (Mean) Number of gram panchayats (GPs) 77 58 58 58 Control- Control- Control- Arm 1- Arm 1- Arm 2- Number of households 1,605 1,208 1,219 1,243 Arm 1 Arm 2 Arm 3 Arm 2 Arm 3 Arm 3 Tractor .1242 .1272 .1641 .1138 -.0066 -.0805 .0226 -.0739 .0292 .1031 Mobile phone .9711 .9652 .9708 .9649 .0238 .0012 .0249 -.0226 .0011 .0237 Toilet .7965 .7386 .7431 .743 .0972 .0899 .09 -.0072 -.0072 .0001 Education of the head of household Secondary .2366 .1896 .1948 .2138 .0812 .0718 .0386 -.0094 -.0427 -.0333 College/graduate/postgraduate .1063 .1093 .1096 .1038 -.007 -.0075 .0057 -.0006 .0127 .0132 Illiterate .3139 .3552 .3566 .3354 -.062 -.064 -.0325 -.002 .0294 .0315 Primary occupation of the head of household Cultivation .1837 .1754 .2246 .1835 .0152 -.0718 .0003 -.087 -.0149 .0721 Agricultural labor .08021 .1051 .1158 .08909 -.0608 -.0849 -.0226 -.0242 .0383 .0624 Nonagricultural labor .2978 .3441 .3281 .3345 -.0703 -.0463 -.0559 .0239 .0144 -.0095 Salaried work .1444 .1354 .119 .1152 .0183 .0531 .0614 .0348 .0432 .0083 Business .0933 .0831 .06091 .09174 .0255 .086 .0038 .0607 -.0216 -.0822 B. Village characteristics SC/ST majority village .4498 .4015 .4159 .5101 .0692 .0484 -.0853 -.0207 -.155 -.134 Village head w/college degree .09097 .1291 .08778 .04988 -.0864 .0079 .1139 .0942 .1982 .1061 Village head w/high school degree .1452 .12 .1641 .1521 .0524 -.037 -.0137 -.0893 -.0661 .0233 46 Table A.5 Comparison of Households Present and Not Present at Midline Variables Without Weights With Weights Number of members in the household -0.012*** -0.012*** (0.003) (0.004) Number of children less than 5 years 0.002 0.000 (0.008) (0.010) Number of children between 6–14 years of age 0.004 0.005 (0.005) (0.007) General caste 0.013 0.028 (0.019) (0.022) Scheduled caste/scheduled tribe (SC/ST) -0.002 0.003 (0.022) (0.024) Hindu -0.014 -0.009 (0.019) (0.023) Sikh -0.006 0.009 (0.019) (0.025) Below poverty line (BPL) 0.010 0.011 (0.015) (0.023) Above poverty line (APL) -0.002 -0.016 (0.014) (0.025) Small and marginal farmer 0.025 0.032 (0.020) (0.023) No land 0.065*** 0.062** (0.023) (0.025) Own house -0.273*** -0.292*** (0.042) (0.052) Radio 0.007 0.005 (0.024) (0.025) Color television -0.015 -0.019 (0.016) (0.024) Gas stove -0.055*** -0.060*** (0.018) (0.022) Refrigerator -0.010 -0.023 (0.014) (0.018) Tractor -0.027* -0.046* (0.016) (0.026) Mobile phone 0.045* 0.072** (0.023) (0.032) Toilet 0.130*** 0.113*** (0.014) (0.026) Secondary education -0.012 0.013 (0.013) (0.025) Higher secondary education and above -0.013 -0.009 (0.017) (0.020) Illiterate 0.000 -0.000 (0.011) (0.014) Cultivation 0.032** 0.048* (0.015) (0.026) Agricultural labor 0.009 0.028 (0.019) (0.029) 47 Nonagricultural labor 0.032** 0.030* (0.013) (0.016) Salaried work 0.043*** 0.052** (0.016) (0.022) Business 0.011 0.022 (0.019) (0.022) SC/ST majority village 0.031 0.017 (0.024) (0.026) Village head w/college degree -0.013 -0.004 (0.018) (0.026) Village head w/high school degree 0.046 0.051 (0.039) (0.040) Observations 6,067 6,067 Adjusted R-squared 0.058 0.047 F-test 8.593 6.430 Prob > F 0.000 0.000 48 Table A.6 Summary Statistics of Outcomes: With Attrition and Without Weights N = 5,275 Baseline Midline Control Arm1 Arm2 Arm3 Control Arm1 Arm2 Arm3 Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD N = 1,605 N = 1,208 N = 1,219 N =1,243 N = 1,605 N = 1,208 N = 1,219 N = 1,243 Toilet construction and use Access 0.5607 0.5778 0.5751 0.5800 0.6791 0.7169 0.7317 0.7200 (0.4965) (0.4941) (0.4945) (0.4937) (0.4670) (0.4507) (0.4432) (0.4492) Limited 0.0492 0.0629 0.0492 0.0475 0.0978 0.0969 0.1091 0.1078 (0.2164) (0.2429) (0.2164) (0.2127) (0.2972) (0.2959) (0.3119) (0.3103) Basic 0.5034 0.4950 0.5135 0.5197 0.5639 0.6134 0.6185 0.6090 (0.5001) (0.5002) (0.5000) (0.4998) (0.4961) (0.4872) (0.4859) (0.4882) Safely managed 0.4530 0.4578 0.4733 0.4739 0.5153 0.5704 0.5800 0.5696 (0.4979) (0.4984) (0.4995) (0.4995) (0.4999) (0.4952) (0.4938) (0.4953) Toilets under construction 0.0284 0.0431 0.0232 0.0728 0.0117 0.1023 0.1223 0.1897 (0.1661) (0.2034) (0.1506) (0.2601) (0.1074) (0.3035) (0.3282) (0.3926) Open defecation (OD) 0.4262 0.4197 0.4044 0.3934 0.3963 0.3187 0.3167 0.3130 (0.4947) (0.4937) (0.4910) (0.4887) (0.4893) (0.4662) (0.4654) (0.4639) Hygiene awareness and behavior (adult) Adult handwashing knowledge 0.8131 0.8005 0.8130 0.7731 0.8872 0.9429 0.9319 0.9276 before eating (0.3900) (0.3998) (0.3901) (0.4190) (0.3164) (0.2322) (0.2520) (0.2593) Adult handwashing knowledge 0.8150 0.8030 0.7982 0.7747 0.9115 0.9520 0.9598 0.9493 after defecation (0.3885) (0.3979) (0.4015) (0.4179) (0.2841) (0.2139) (0.1965) (0.2194) Handwashing with soap better 0.9701 0.9702 0.9811 0.9598 0.9882 0.9983 0.9910 0.9944 (0.1704) (0.1701) (0.1361) (0.1966) (0.1082) (0.0407) (0.0946) (0.0749) Need for using soap correctly 0.9994 0.9992 0.9992 0.9984 0.9988 1.0000 0.9975 1.0000 identified (0.0250) (0.0288) (0.0286) (0.0401) (0.0353) (0.0000) (0.0496) (0.0000) Adult soap used before eating 0.5751 0.5008 0.5463 0.4851 0.7072 0.7425 0.7711 0.7257 (0.4945) (0.5002) (0.4981) (0.5000) (0.4552) (0.4374) (0.4203) (0.4464) Adult soap used after defecation 0.9246 0.8502 0.8581 0.8729 0.9340 0.9354 0.9319 0.9131 (0.2641) (0.3571) (0.3491) (0.3332) (0.2484) (0.2459) (0.2520) (0.2818) OD puts children at risk 0.9882 0.9859 0.9836 0.9879 0.9888 0.9967 0.9975 0.9984 (0.1082) (0.1178) (0.1271) (0.1092) (0.1053) (0.0575) (0.0496) (0.0401) OD puts community at risk 0.9863 0.9851 0.9877 0.9855 0.9882 0.9975 0.9975 0.9984 (0.1163) (0.1212) (0.1103) (0.1195) (0.1082) (0.0498) (0.0496) (0.0401) 49 Table A.6 Summary Statistics of Outcomes: With Attrition and Without Weights N = 5,275 (Continued) Baseline Midline Control Arm1 Arm2 Arm3 Control Arm1 Arm2 Arm3 Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD N = 1,605 N = 1,208 N = 1,219 N =1,243 N = 1,605 N = 1,208 N = 1,219 N = 1,243 Treatment of drinking water 0.1439 0.1573 0.1526 0.1585 0.1570 0.1747 0.2067 0.1866 (0.3511) (0.3642) (0.3597) (0.3653) (0.3639) (0.3798) (0.4051) (0.3898) Safe disposal of feces 0.6779 0.7168 0.7814 0.7382 0.6472 0.6569 0.6318 0.5702 (0.4684) (0.4519) (0.4144) (0.4408) (0.4786) (0.4757) (0.4834) (0.4961) Soap at home 0.9913 0.9868 0.9951 0.9944 0.9919 0.9934 0.9959 0.9936 (0.0930) (0.1144) (0.0700) (0.0749) (0.0897) (0.0811) (0.0639) (0.0800) Hygiene awareness and behavior (school-going children) Handwashing knowledge before eating 0.8333 0.8088 0.8109 0.8025 0.8732 0.9522 0.9582 0.9484 (0.3729) (0.3936) (0.3919) (0.3985) (0.3330) (0.2135) (0.2004) (0.2214) Handwashing knowledge after 0.8077 0.8203 0.8164 0.7972 0.8732 0.9331 0.9364 0.9359 defecation (0.3944) (0.3843) (0.3875) (0.4025) (0.3330) (0.2501) (0.2443) (0.2451) Need for using soap correctly identified 1.0000 0.9962 0.9927 0.9964 0.9986 0.9981 0.9873 1.0000 (0.0000) (0.0618) (0.0850) (0.0596) (0.0377) (0.0437) (0.1122) (0.0000) Handwashing with soap better 0.9729 0.9866 0.9873 0.9698 0.9915 0.9866 0.9873 0.9929 (0.1624) (0.1150) (0.1122) (0.1714) (0.0921) (0.1150) (0.1122) (0.0841) Soap at home 0.9957 1.0000 0.9964 0.9982 0.9943 0.9943 0.9945 0.9982 (0.0653) (0.0000) (0.0602) (0.0422) (0.0753) (0.0756) (0.0737) (0.0422) Soap used before eating 0.8803 0.8298 0.8218 0.8256 0.9145 0.9120 0.9200 0.9004 (0.3248) (0.3761) (0.3830) (0.3798) (0.2798) (0.2835) (0.2715) (0.2998) Soap used after defecation 0.6054 0.5182 0.5636 0.5125 0.6909 0.7419 0.7818 0.7349 (0.4891) (0.5001) (0.4964) (0.5003) (0.4625) (0.4380) (0.4134) (0.4418) 50 Table A.7 Summary Statistics of Outcomes: With Attrition and With Weights N = 5,275 Baseline Midline Control Arm1 Arm2 Arm3 Control Arm1 Arm2 Arm3 Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD N = 1,605 N = 1,208 N = 1,219 N =1,243 N = 1,605 N = 1,208 N = 1,219 N = 1,243 Toilet construction and use Access 0.7965 0.7386 0.7431 0.7430 0.8439 0.8151 0.8298 0.8301 (0.4026) (0.4394) (0.4370) (0.4370) (0.3629) (0.3882) (0.3759) (0.3755) Limited 0.0626 0.0785 0.0623 0.0631 0.1101 0.1044 0.1200 0.1092 (0.2422) (0.2690) (0.2417) (0.2432) (0.3130) (0.3057) (0.3249) (0.3119) Basic 0.7181 0.6380 0.6639 0.6613 0.7178 0.7044 0.7052 0.7162 (0.4499) (0.4806) (0.4724) (0.4733) (0.4501) (0.4563) (0.4560) (0.4508) Safely managed 0.6395 0.5920 0.6132 0.6076 0.6548 0.6610 0.6632 0.6825 (0.4802) (0.4915) (0.4870) (0.4883) (0.4755) (0.4734) (0.4726) (0.4655) Toilets under construction 0.0284 0.0431 0.0232 0.0728 0.0117 0.1023 0.1223 0.1897 (0.1661) (0.2034) (0.1506) (0.2601) (0.1074) (0.3035) (0.3282) (0.3926) Open defecation (OD) 0.2461 0.2960 0.2829 0.2654 0.2998 0.2449 0.2465 0.2358 (0.4308) (0.4565) (0.4504) (0.4416) (0.4582) (0.4301) (0.4310) (0.4245) Hygiene awareness and behavior (adult) Adult handwashing knowledge 0.8087 0.8155 0.8036 0.7626 0.8762 0.9474 0.9364 0.9236 before eating (0.3933) (0.3879) (0.3973) (0.4255) (0.3294) (0.2231) (0.2440) (0.2657) Adult handwashing knowledge 0.8295 0.8005 0.7926 0.7695 0.9076 0.9477 0.9617 0.9498 after defecation (0.3761) (0.3997) (0.4055) (0.4212) (0.2897) (0.2226) (0.1920) (0.2183) Handwashing with soap better 0.9706 0.9627 0.9792 0.9605 0.9890 0.9993 0.9917 0.9930 (0.1689) (0.1894) (0.1428) (0.1948) (0.1043) (0.0259) (0.0908) (0.0831) Need for using soap correctly 0.9989 0.9993 0.9990 0.9996 0.9992 1.0000 0.9978 1.0000 identified (0.0328) (0.0263) (0.0318) (0.0196) (0.0274) (0.0000) (0.0468) (0.0000) Adult soap used before eating 0.5612 0.5184 0.5385 0.5004 0.7132 0.7503 0.7710 0.7218 (0.4963) (0.4997) (0.4985) (0.5000) (0.4523) (0.4329) (0.4202) (0.4481) Adult soap used after defecation 0.9225 0.8449 0.8674 0.8773 0.9435 0.9370 0.9367 0.9143 (0.2674) (0.3620) (0.3392) (0.3282) (0.2308) (0.2431) (0.2435) (0.2800) OD puts children at risk 0.9912 0.9888 0.9823 0.9923 0.9928 0.9981 0.9967 0.9975 (0.0931) (0.1055) (0.1320) (0.0873) (0.0845) (0.0440) (0.0578) (0.0502) OD puts community at risk 0.9888 0.9889 0.9867 0.9890 0.9921 0.9985 0.9967 0.9975 (0.1054) (0.1047) (0.1146) (0.1045) (0.0883) (0.0389) (0.0578) (0.0502) 51 Table A.7 Summary Statistics of Outcomes: With Attrition and With Weights N = 5,275 (Continued) Baseline Midline Control Arm1 Arm2 Arm3 Control Arm1 Arm2 Arm3 Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD Mean/SD N = 1,605 N = 1,208 N = 1,219 N =1,243 N = 1,605 N = 1,208 N = 1,219 N = 1,243 Treatment of drinking water 0.1797 0.1828 0.1818 0.1962 0.2033 0.2008 0.2358 0.2259 (0.3839) (0.3865) (0.3857) (0.3971) (0.4025) (0.4006) (0.4245) (0.4182) Safe disposal of feces 0.6779 0.7168 0.7814 0.7382 0.6472 0.6569 0.6318 0.5702 (0.4684) (0.4519) (0.4144) (0.4408) (0.4786) (0.4757) (0.4834) (0.4961) Soap at home 0.9902 0.9851 0.9945 0.9923 0.9924 0.9894 0.9972 0.9940 (0.0983) (0.1211) (0.0742) (0.0875) (0.0866) (0.1023) (0.0532) (0.0775) Hygiene awareness and behavior (school-going children) Handwashing knowledge before eating 0.8333 0.8088 0.8109 0.8025 0.8732 0.9522 0.9582 0.9484 (0.3729) (0.3936) (0.3919) (0.3985) (0.3330) (0.2135) (0.2004) (0.2214) Handwashing knowledge after 0.8077 0.8203 0.8164 0.7972 0.8732 0.9331 0.9364 0.9359 defecation (0.3944) (0.3843) (0.3875) (0.4025) (0.3330) (0.2501) (0.2443) (0.2451) Need for using soap correctly identified 1.0000 0.9962 0.9927 0.9964 0.9986 0.9981 0.9873 1.0000 (0.0000) (0.0618) (0.0850) (0.0596) (0.0377) (0.0437) (0.1122) (0.0000) Handwashing with soap better 0.9729 0.9866 0.9873 0.9698 0.9915 0.9866 0.9873 0.9929 (0.1624) (0.1150) (0.1122) (0.1714) (0.0921) (0.1150) (0.1122) (0.0841) Soap at home 0.9957 1.0000 0.9964 0.9982 0.9943 0.9943 0.9945 0.9982 (0.0653) (0.0000) (0.0602) (0.0422) (0.0753) (0.0756) (0.0737) (0.0422) Soap used after defecation 0.8803 0.8298 0.8218 0.8256 0.9145 0.9120 0.9200 0.9004 (0.3248) (0.3761) (0.3830) (0.3798) (0.2798) (0.2835) (0.2715) (0.2998) Soap used before eating 0.6054 0.5182 0.5636 0.5125 0.6909 0.7419 0.7818 0.7349 (0.4891) (0.5001) (0.4964) (0.5003) (0.4625) (0.4380) (0.4134) (0.4418) 52 Table A.8 Toilet Construction and Use—DID-Adjusted Model N No. of Adj. (Treatment1 (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 * Midline)Beta6 Midline)Beta7 Beta6# Beta7# Midline)Beta5 Access 10,550 251 .129 .0291** .0392*** .0396*** .50 .45 (.0116) (.012) (.0135) (.482) (.501) Limited 10,550 251 .0311 -.0217 .0101 -.00145 2.04 .71 (.0213) (.0213) (.0231) (.154) (.401) Basic 10,550 251 .11 .0667*** .0417* .0553** .95 .18 (.023) (.0228) (.0239) (.33) (.669) Safely 10,550 251 .127 .0537** .0347 .0596** .48 .04 managed (.0254) (.0234) (.0251) (.489) (.837) Toilets under 3,787 247 .0588 .0817*** .12*** .134*** .92 1.21 construction (.0254) (.0327) (.0425) (.339) (.273) Open 10,550 251 .104 -.105*** -.0902*** -.0833*** .25 .68 defecation (.0271) (.03) (.0266) (.62) (.409) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. 53 Table A.9 Toilet Construction and Use (Households with Toilets at Baseline)—DID-Unadjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 Midline)Beta5 Midline)Beta6 Midline)Beta7 Beta6# Beta7# Limited 6,040 250 .0263 -.0345 .00707 -.0111 2.47 .62 (.0261) (.0248) (.0284) (.117) (.433) Basic 6,040 250 .0382 .0532* .00884 .0287 2.25 .56 (.0281) (.0254) (.029) (.135) (.455) Safely 6,040 250 .121 .0417 .00562 .0323 1.16 .06 managed (.0319) (.0268) (.0308) (.284) (.8) Open 6,040 250 .0402 -.12*** -.0872** -.0719** 1.06 3.26* defecation (.032) (.0343) (.0298) (.304) (.072) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. 54 Table A.10 Adult Hygiene Awareness and Behavior—DID-Adjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 Midline)Beta5 Midline)Beta6 Midline)Beta7 Beta6# Beta7# Handwashing knowledge Knowledge 10,550 251 .0615 .0645 .0654 .0935* 0 .35 before eating (.0465) (.0422) (.0504) (.981) (.552) Knowledge 10,550 251 .0672 .0692* .091** .102** .24 .45 after defecation (.0409) (.0405) (.0458) (.623) (.503) Practice Treatment of 10,550 251 .113 -.00565 .0304 .0061 2.23 .27 drinking water (.021) (.0241) (.0225) (.136) (.602) Soap used 10,550 251 .0712 .0799 .0805 .0693 0 .03 before eating (.0645) (.0608) (.0662) (.991) (.868) Soap used after 10,550 251 .019 .0711** .0483 .016 .38 2.29 defecation (.0301) (.0302) (.0293) (.54) (.132) Safe disposal of 1,768 247 .0936 -.0208 -.117 -.146 1.39 1.87 feces (.0803) (.0835) (.0935) (.24) (.173) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. 55 Table A.11 Adult Hygiene Awareness and Behavior (Households without Toilets at Baseline)— DID-Unadjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 Midline)Beta5 Midline)Beta6 Midline)Beta7 Beta6# Beta7# Handwashing knowledge Knowledge 4,510 247 .0511 .065 .0465 .0104 .09 .82 before eating (.0682) (.056) (.0559) (.758) (.365) Knowledge after 4,510 247 .072 .0599 .105* .0698 .46 .02 defecation (.0569) (.0585) (.0581) (.496) (.881) Practice Treatment of 4,510 247 .0113 -.011 .0295 .00857 2.7 .57 drinking water (.0206) (.0192) (.0207) (.102) (.45) Soap used before 4,510 247 .0755 .00504 .0437 .00685 .24 0 eating (.0832) (.0823) (.0869) (.627) (.983) Soap used after 4,510 247 .0313 .107** .08 .0162 .22 2.9* defecation (.0501) (.0523) (.0478) (.641) (.09) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. 56 Table A.12 Adult Hygiene Awareness and Behavior (Households with Toilets at Baseline)— DID-Unadjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 Midline)Beta5 Midline)Beta6 Midline)Beta7 Beta6# Beta7# Handwashing knowledge Knowledge 6,040 250 .0664 .0622 .0701 .12** .04 1.22 before eating (.0468) (.0448) (.0564) (.844) (.271) Knowledge 6,040 250 .0649 .0719 .0856** .113** .08 .62 after (.045) (.0421) (.048) (.771) (.433) defecation Practice Treatment of 6,040 250 .0562 -.00171 .0325 .00712 1.35 .11 drinking water (.0254) (.0298) (.0276) (.246) (.746) Soap used 6,040 250 .0692 .102 .0895 .0872 .04 .05 before eating (.0698) (.0641) (.0695) (.839) (.826) Soap used 6,040 250 .0142 .0591* .038 .0166 .29 1.18 after (.0311) (.0322) (.0318) (.592) (.278) defecation Safe disposal 1,585 244 .0707 -.0443 -.108 -.174* .57 1.87 of feces (.0833) (.088) (.0981) (.449) (.173) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. 57 Table A.13 Child Hygiene Awareness and Behavior—DID-Adjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 Midline)Beta5 Midline)Beta6 Midline)Beta7 Beta6# Beta7# Handwashing knowledge Knowledge 4,674 250 .0601 .104** .107** .106** .01 0 before eating (.0448) (.0418) (.0496) (.924) (.959) Knowledge 4,674 250 .0405 .0473 .0545 .0733 .03 .39 after (.0418) (.0455) (.0445) (.867) (.534) defecation Practice Soap used 4,674 250 .0139 .048 .064 .0405 .12 .02 after (.0417) (.0434) (.045) (.735) (.878) defecation Soap used 4,674 250 .0584 .138** .133** .137** .01 0 before eating (.0652) (.061) (.0643) (.93) (.984) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. 58 Table A.14 Child Hygiene Awareness and Behavior (Households without Toilets at Baseline)— DID-Unadjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 Midline)Beta5 Midline)Beta6 Midline)Beta7 Beta6# Beta7# Handwashing knowledge Knowledge 2,132 230 .0673 .122** .105** .0742 .13 .82 before eating (.0537) (.0531) (.058) (.724) (.366) Knowledge 2,132 230 .0368 .0479 .0672 .0165 .11 .29 after (.0592) (.0578) (.0573) (.741) (.589) defecation Practice Soap used 2,132 230 .023 .0193 .128** .0292 2.52 .02 after (.0635) (.0629) (.0632) (.114) (.886) defecation Soap used 2,132 230 .0513 .0857 .0983 .123 .03 .18 before eating (.079) (.0687) (.0804) (.871) (.668) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. 59 Table A.15 Child Hygiene Awareness and Behavior (Households with Toilets at Baseline)— DID-Unadjusted Model N No. of Adj. (Treatment1 * (Treatment2 * (Treatment3 * Beta5 = Beta5 = Clusters R^2 Midline)Beta5 Midline)Beta6 Midline)Beta7 Beta6# Beta7# Handwashing knowledge Knowledge 2,542 248 .0598 .0859 .11** .133** .24 .67 before eating (.0529) (.0524) (.0598) (.627) (.414) Knowledge 2,542 248 .0416 .0457 .0461 .121** 0 2.4 after (.0476) (.0552) (.0516) (.995) (.123) defecation Practice Soap used 2,542 248 .0109 .0731* .0146 .0503 1.44 .21 after (.0427) (.0443) (.0453) (.231) (.647) defecation Soap used 2,542 248 .0611 .184** .162** .149** .09 .23 before eating (.0736) (.0736) (.072) (.768) (.629) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. # F-values and P-values (reported in parentheses). DID = difference-in-differences. 60 Table A.16 Impact of Project Interventions (Households without Toilets at Baseline): ANCOVA Unadjusted Model N No. of Clusters Adj. R^2 Treatment 1 Treatment 2 Treatment 3 Toilet construction and use Limited 2,255 247 .0323 .00293 .0132 .018 (.0189) (.0196) (.0194) Basic 2,255 247 .0998 .0694*** .0949*** .0905*** (.0256) (.0285) (.0287) Safely managed 2,255 247 .0773 .0675** .0897*** .104*** (.0271) (.0271) (.0273) Open defecation 2,255 247 .0895 -.0125 -.0384 -.0652* (.039) (.0441) (.0371) Adult hygiene awareness and behavior Knowledge Handwashing knowledge before eating 2,255 247 .0217 .0399 .0341 .0218 (.0274) (.0301) (.029) Handwashing knowledge after defecation 2,255 247 .00912 .0426* .0581*** .0267 (.022) (.02) (.023) Practice Treatment of drinking water 2,255 247 .0209 .0043 .0327** .0118 (.0129) (.0149) (.014) Soap used before eating 2,255 247 .0254 .0214 .0635 -.0311 (.0473) (.0424) (.0524) Soap used after defecation 2,255 247 .0331 .00856 .00863 -.0224 (.0208) (.0232) (.0236) Children’s hygiene awareness and behavior Knowledge Knowledge before eating 1,066 230 .0598 .0747*** .086*** .0719** (.0277) (.0273) (.0282) Knowledge after defecation 1,066 230 .0213 .0522 .0704** .0395 (.0347) (.0288) (.0324) Practice Soap used after defecation 1,066 230 .0154 -.0435 .0123 -.0224 (.0419) (.0321) (.0397) Soap used before eating 1,066 230 .0159 .0025 .0832* .0312 (.0532) (.0438) (.0517) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. Standard errors reported in parentheses. ANCOVA = analysis of covariance. 61 Table A.17 Impact of Project Interventions (Households with Toilets at Baseline): ANCOVA Unadjusted Model N No. of Adj. Treatment Treatment Treatment Clusters R^2 1 2 3 Toilet construction and use Limited 3,020 250 .127 -.0116 .0193 .00314 (.0197) (.0206) (.0214) Basic 3,020 250 .147 .0233 -.00555 .0118 (.0204) (.0202) (.0212) Safely managed 3,020 250 .29 .0438* .009 .0337 (.0238) (.0243) (.0238) Open defecation 3,020 250 .0442 -.11*** -.0957*** -.0947*** (.0237) (.0264) (.0232) Adult hygiene awareness and behavior Knowledge Handwashing knowledge before eating 3,020 250 .0316 .0781*** .0646*** .0534** (.0226) (.023) (.0215) Handwashing knowledge after defecation 3,020 250 .026 .038** .0525*** .0466** (.017) (.0157) (.0185) Practice Treatment of drinking water 3,020 250 .339 .0123 .0416 .027 (.0218) (.0258) (.0245) Soap used before eating 3,020 250 .0243 .0516 .0552 .0256 (.0386) (.0412) (.038) Soap used after defecation 3,020 250 .0186 -.00619 -.0106 -.0265 (.0147) (.0157) (.018) Children’s hygiene awareness and behavior Knowledge Knowledge before eating 1,271 248 .0223 .0793** .086*** .0777** (.0318) (.0315) (.0315) Knowledge after defecation 1,271 248 .0176 .0675*** .0602** .0814*** (.024) (.0248) (.0234) Practice Soap used after defecation 1,271 248 .0208 .0337* -.0000112 .00121 (.0199) (.0201) (.0235) Soap used before eating 1,271 248 .0242 .0719 .0872* .0356 (.0474) (.0466) (.0458) Note: * significance at the .1 level, ** significance at the .05 level, *** significance at the .01 level. Standard errors reported in parentheses. ANCOVA = analysis of covariance. 62