June 2023 FY 2023 Mongolia Country Opinion Survey Report ECR Business Intelligence Team Acknowledgements The Mongolia Country Opinion Survey is part of the County Opinion Survey Program series of the World Bank. This report was prepared by the Business Intelligence (BI) team, led by José De Buerba (Senior External Affairs Officer). Yulia Danilina, Jessica Cameron, Nan Lin, and Sofya Gubaydullina oversaw the design, reporting, and analysis of the survey results. Noreen Wambui and Irina Popova provided data support. BI acknowledges the significant contribution from the Mongolia Country Team and the independent field agency, MAXIMA. In particular, the BI team is grateful for the support from Javkhlan Bold Erdene (External Affairs Associate) and Gantuya Paniga (Operations Analyst) who coordinated the survey-related activities from Ulaanbaatar, Mongolia. Contents Objectives Overall Context World Bank Group’s Support for Development Areas Overall Attitudes Toward the World Bank Group World Bank Group’s Work and Engagement on the Ground World Bank Group’s Knowledge Work and Activities The Future Role of the World Bank Group in Mongolia Communications and Outreach Sample Demographics Methodology 3 Objectives This survey was designed to assist the World Bank Group (WBG) in gaining a better understanding of how stakeholders in Mongolia perceive the WBG. The survey explored the following questions: 1. What opinion do key stakeholders have of the WBG when it comes to its effectiveness, relevance, alignment with Mongolia’s development priorities, and other key indicators? Are opinions improving or declining? 2. What areas of development are perceived to be the most important? Have the priorities changed over the past three years? 3. How the WBG is perceived as a development partner? Are opinions improving or declining? 4. What do key stakeholder value the most and the least when it comes to the WBGs work at the country level? What are the priorities looking forward? 5. What opinion do key stakeholders have of the WBG knowledge products and their quality? Are opinions improving or declining? 6. What are the preferred communication channels and which channels are reported to be used the most? Are there differences among stakeholder groups in terms of preferred channels? 7. What key topics the WBG communicates around do stakeholders recall? Is there a relationship between message recall and views of the WBG’s work? 4 Overall Context “Focus on increasing the results and effectiveness of the assistance provided to the beneficiaries in Mongolia” Academia Respondent Q In your opinion, what is the most important thing the World Bank Group could do to help increase its effectiveness in Mongolia? 5 Respondents are Split over Mongolia’s General Direction Country direction 2023 In fiscal year (FY) 2023, around half of the respondents believe that Mongolia is headed in the right direction. Respondents from the government and bilateral / multilateral agencies are more positive about Mongolia’s direction compared to other stakeholder The right direction groups. 51% Although 83% of the respondents from high government offices agree that Mongolia is headed in the right direction, only 19% of respondents from the media concur. At the same time, a majority The wrong (over 40%) of respondents from the private sector and civil society direction say that the country is moving in the wrong direction. 26% Respondents in Mongolia show greater pessimism this year. Not sure By comparison, in FY20, only 10% were pessimistic or very pessimistic about the country’s direction, whereas 76% were very 23% optimistic or somewhat optimistic. FY23: In general, would you say that Mongolia is headed in ... ? (N=301) Q FY20: When you think about the future in Mongolia, are you … ? (Very pessimistic, Somewhat pessimistic, Somewhat optimistic, Very optimistic, 6 Not sure) (N=263) Familiarity with The World Bank Group Mean Familiarity Rating 1 2 3 4 5 6 7 8 9 10 Comparison of FY20 and FY23: Respondents All respondents 6.4 in this year’s Country Survey report significantly lower levels of familiarity with the World Bank Other Government Institutions/ 7.6 Group than in FY20: Organizations Office of the President/PM/ Mean familiarity: FY23 = 6.4 7.5 Minister FY20 = 7.1 Local Government 6.3 This decrease in familiarity in FY23 is primarily due to lower levels of familiarity among those Bilateral/ Multilateral Agency 6.3 who don’t collaborate with the WBG. The levels of familiarity among collaborators are similar in Office of a Parliamentarian 6.2 the two survey years and they are significantly higher compared to those of non-collaborators. Civil Society 5.8 Mean familiarity: Media 5.5 WBG collaborators = 7.5 (7.4 in FY20) Private 5.1 Non-collaborators = 5.3 (6.4 in FY20) Sector Academia 5.1 How familiar are you with the work of the World Bank Group in Mongolia? Q Scale: 1-10 (1: Not familiar at all – 10: Extremely familiar) 7 Trust in Institutions 1 Mean Trust Rating 2 3 4 5 6 7 8 9 10 Bilateral organizations (e.g., JICA, GIZ, KOICA)* 7.7 7.1 The United Nations (UN) 7.7 7.5 Bilateral organizations, regional development 7.5 banks, and the United Nations (UN) are among Regional development banks (e.g., ADB, EBRD)* 6.4 the most trusted institutions in Mongolia, 7.4 according to the respondents. Private sector*^ 6.8 The trust rating for the World Bank Group has not The World Bank Group 7.3 7.2 changed significantly since FY20. However, respondents reported significantly higher ratings of The International Monetary Fund 7.0 6.9 trust in bilateral organizations and regional development banks in FY23. Academia/think tanks/research institutions 6.8 Local government, the media, and the Parliament are 6.6 Civil society (e.g., NGOs, CBOs)*^ the least trusted institutions among those studied, 6.0 according to the respondents. 6.3 The government 6.1 6.0 FY23 Mongolia’s Central Bank (The Bank of Mongolia) 6.1 FY20 Parliament/legislative branch 5.6 Note: ADB= Asian Development Bank; CBO= Community-based Media*^ 5.6 Organization; EBRD= European Bank for Reconstruction and 5.0 *significantly different Development; GIZ= German Society for International Cooperation; JICA= between years Japan International Cooperation Agency; KOICA= Korea International Local government 5.5 Cooperation Agency; NGO= Non-governmental Organization. ^The mean trust score of the private sector in the FY23 survey was compared with an average score of the international private sector and domestic private sector from the FY20 survey; similarly, civil society was To what extent do you trust each of the following groups to do what is compared with the average score of international civil society and domestic civil society; and media was Q right? Scale: 1-10 (1: To no degree at all – 10: To a very significant compared with the average trust score of domestic traditional media and their web presence, internal media and their web presence, and web-based media. 8 degree) World Bank Group’s Support for Development Areas “Focus its [WBG’s] operations and support on specific issues, such as governance, poverty reduction and so on – without trying to be engaged in all sectors and themes.” Bilateral / Multilateral Organization Respondent Q In your opinion, what is the most important thing the World Bank Group could do to help increase its effectiveness in Mongolia? 9 Areas for the WBG Education Vs FY20 41% +6 Private sector development 40% +16 to Prioritize Health 39% +23 Economic diversification 34% NA Energy / Extractives 29% +21 In FY23, stakeholders would like the WBG to focus its Water supply and sanitation infrastructure 29% +24 resources on their top priorities: Education, Private Sector Macroeconomic stability 25% NA Development, and Health. Public sector governance 24% +2 Although Education and Private Sector Development remain Job creation / employment 23% +6 the top two areas for the WBG since FY20, Health rose in prominence in FY23 (+23 percentage points). Transport 20% +16 Agriculture and food security 19% +4 Several other areas also rose in prominence in FY23: Water supply and sanitation infrastructure (+24 percentage Gender equity 16% +14 points); Energy / Extractives (+21 percentage points); and Climate change 16% +12 Transport (+16 percentage points). Social Inclusion 16% +6 Note: The overall increase in percentages is partially attributable to the +6 change in the methodology: In FY20, respondents were offered the Environment / Natural resource management 16% option of selecting up to three priorities, whereas in FY23, they could Digital Development 15% +10 select up to five priorities. In addition, two major cross-cutting areas — Economic Growth and Poverty Reduction— were removed from the list of Urban development 15% +9 options in FY23. Debt sustainability 13% NA Social protection 9% +5 Regional integration 9% +14 FY23: Which areas should the World Bank Group prioritize in its work Q in Mongolia to have the most impact on development results in the Trade 8% +12 country? (Choose no more than 5) (N=287) NA Heating provision 6% FY20: When thinking about how the World Bank Group can have the most impact on development results in Mongolia, in which sectors do Crime and violence 5% +4 you believe the World Bank Group should focus most of its resources (financial and knowledge services) in Mongolia? (Choose no more Disaster risk management 3% +2 than THREE) (N=261) Effectiveness of WBG’s Sectoral Support The WBG’s work in the area of digital development in Mongolia received the highest effectiveness rating. The overall ratings of the WBG’s effectiveness across sectoral areas were similar to those of the FY20 survey. Mean Level of Effectiveness Mean Level of Effectiveness 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 6.9 6.5 Digital development Heating provision 6.7 6.8 6.5 Macroeconomic stability Climate change 6.3 6.8 6.5 Gender equity Private sector development 6.2 6.8 6.8 6.5 Public sector governance Job creation / employment 6.3 6.8 6.8 6.4 Energy / Extractives Health 6.8 6.5 6.7 6.4 Agriculture and food security Urban development 6.1 6.4 Environment / Natural resource 6.7 Social protection 6.4 management 6.3 6.6 6.6 6.4 Debt sustainability Regional integration 6.4 6.6 6.4 Economic diversification Social Inclusion 6.2 6.6 6.4 Water supply and sanitation infrastructure Trade 6.3 6.6 6.4 Education FY23 Disaster risk management 6.4 6.8 FY20 5.5 Transport 6.6 Crime and violence 6.5 How EFFECTIVE do you believe the World Bank Group is in terms of the work it does in the following areas of development Q in Mongolia? (If you have NO exposure to/experience in working in any of the sectors listed below, please respond “Don’t know”), 11 Scale: 1-10 (1: Not effective at all – 10: Very effective) Air Pollution is the Main Concern for Respondents in Relation to Climate Change A large majority (89%) of respondents are very concerned about air pollution when it comes to the potential impacts of climate change in Mongolia. About two-thirds are very concerned about unsafe drinking water (63%); the adverse effects on public health (61%); and land and forest degradation (60%). Not at all A little Somewhat concerned Very concerned Air pollution (urban air quality) 89% Unsafe drinking water 63% Effects on public health 61% Land and forest degradation 60% Diminished water supply for people and the economy 55% More frequent and severe droughts / heatwaves 51% Decreased crop yields/food insecurity 48% Extinction of plant/animal species 47% Increase in natural disasters 46% Forest fires 39% Loss of jobs 36% Climate-driven migration 35% More frequent and severe floods 27% Increase erosion of shoreline 8% Q What is your level of concern for each of the potential impacts of climate change as it affects your country? (N=~295) 12 Overall Attitudes toward The World Bank Group 13 Key Performance Indicators In FY23, there was a slight, non-significant improvement in the perception of the WBG‘s alignment with Mongolia’s development priorities. Around half of respondents gave the WBG high ratings (9 or 10 on a 10-point scale) for alignment, as well as for effectiveness in achieving development results. FY23 FY20 Mean Mean Relevance 35% 37% 27% 7.1 7.1 Alignment 31% 43% 25% 7.2 7.0 Effectiveness in achieving results^ 29% 44% 27% 7.2 7.2 Influence 38% 38% 24% 6.9 7.2 Helps end extreme poverty 40% 33% 27% 6.9 NA Low (1-6) Medium (7-8) High (9-10) How effective has the World Bank Group been in achieving development results in Mongolia? Scale: 1-10 (1: Not effective at all– 10: Very effective) Q To what extent does the World Bank Group influence the development agenda in Mongolia? Scale: 1-10 (1: To no degree at all– 10: To a very significant degree) To what extent do you agree/disagree with the following statements about the World Bank Group’s work in Mongolia?: Scale: 1 -10 (1: Strongly disagree – 10: Strongly agree) The World Bank Group currently plays a relevant role in development in Mongolia. The World Bank Group’s work is well aligned with what I consider the development priorities for Mongolia. The World Bank Group’s work helps end extreme poverty in Mongolia. ^ To calculate the mean for this indicator for FY23, a mean score of the two questions asked in the FY20 survey was calculated: “Overall, please rate your impression of the World Bank Group’s effectiveness in Mongolia.” Scale: 1 -10 (1: Not effective at all– 10: Very effective); “To what extent does the World Bank Group’s work help to achieve 14 development results in Mongolia?” Scale: 1-10 (1: To no degree at all– 10: To a very significant degree) Comparison of Key Performance Indicators The mean ratings for Alignment, Effectiveness in achieving development results, and Relevance in Mongolia were somewhat lower than in other East Asia and Pacific (EAP) countries surveyed in FY22. However, they were higher than for those in other International Bank for Reconstruction and Development (IBRD) countries surveyed in FY22 (please refer to the footnote for the country lists). The rating for Influence was slightly higher in Mongolia than in other EAP or IBRD countries. 7.2 Aligned with 7.4 Priorities 6.8 Effectiveness in 7.2 achieving 7.5 results*** 7.0 7.1 Mongolia FY23 Relevance 7.5 EAP FY22* 7.0 Other IBRD FY22** 6.9 Influence 6.8 6.7 1 2 3 4 5 6 7 8 9 10 Mean Rating * EAP countries surveyed in FY22 included: China, the Philippines, and Thailand. ** IBRD countries surveyed in FY22 included: Angola, Bolivia, Botswana, Bulgaria, Colombia, Ecuador, Eswatini, Guatemala, Jordan, Mauritius, Peru, and Thailand. *** The means for EAP and IBRD countries represent a mean score of the two questions asked in the FY22 survey: “Overall, plea se rate your impression of the World Bank Group’s effectiveness in Xxxx.” Scale: 1-10 (1: Not effective at all– 10: Very effective); “To what extent does the World Bank Group’s work help to achieve d evelopment results in Xxxx? 15 Scale: 1-10 (1: To no degree at all– 10: To a very significant degree) Overall Ratings for Indicator Questions: Respondents from Government Institutions are the Most Positive Mean Rating 1 2 3 4 5 6 7 8 9 10 All Stakeholder Groups 6.8 Respondents from government institutions gave the highest mean ratings for the aggregated responses to Government Institutions 7.8 the eighteen Country Opinion Survey (COS) indicator questions, whereas respondents from academia and the private sector had significantly lower mean ratings Local Government 7.7 (see the figure on the right). Office of the President / Prime 7.1 Minister / Minister Collaboration: Respondents who collaborate with the Office of a Parliamentarian 6.9 WBG had significantly higher mean ratings for the aggregated responses to the same eighteen indicator Bilateral / Multilateral Agency 6.8 questions as compared to respondents who do not collaborate with the WBG: Civil Society Organization 6.4 World Bank Group collaborators = 7.4 Non-collaborators = 6.5 Media 6.2 Private Sector 6.1 Academia 6.1 Mean Ratings for the eighteen COS Indicator Questions by Stakeholder Groups on a Scale from 1 to 10. Q These selected indicators are listed at the end of this report. 16 World Bank Group’s Work and Engagement on the Ground “Support and cooperate with the initiatives of civil society organizations and grassroots organizations. I think your work is not enough in this regard.” Civil Society Respondent Q In your opinion, what is the most important thing the World Bank Group could do to help increase its effectiveness in Mongolia? 17 Greatest Value Percentage of Respondents In the FY23 survey, respondents stressed the Providing financial resources 47% importance of the WBG’s financial resources (47%), whereas only 27% selected this option in FY20. Providing advisory services and analytics to support design or implementation of policies 32% The WBG’s advisory services in support of policy design or implementation continue to be valued Producing research on global development by about one-third of the respondents. issues 30% Notably, more respondents in FY23 indicated that the Bringing together different stakeholder WBG’s convening power to bring together different groups to support Mongolia’s development 27% stakeholder groups in support of Mongolia’s efforts development efforts is a valuable activity. Twenty- seven percent selected this option in FY23. By Providing data and statistics 26% contrast, only 4% selected this option in FY20. Capacity building and training have decreased in Capacity building and training 18% priority since the last survey. In FY20, 29% considered it a priority, making it the second most- valued activity. However, in FY23, only around 18% Mobilizing third-party financial resources 10% gave it a priority. When thinking about the World Bank Group’s role in Mongolia, which activity do you VALUE the most? (Choose no more than 2) ( FY23 N=290) 18 Q In FY20, the option was “Capacity development related to the WBG -supported projects” The WBG as a Development Partner Mean Level of Agreement 1 2 3 4 5 6 7 8 9 10 8.1 Perceptions of the WBG as a development partner have improved significantly since FY20. This is Being a long-term partner* 6.2 particularly true for the rating of the WBG as a long- 7.3 term development partner in Mongolia. Indeed, the ratings increased by nearly 2 points, with the mean rating being 6.2 in FY20 and 8.1 in FY23. 7.3 Access to WBG staff and experts* 6.2 Compared to other EAP countries surveyed in FY22, Mongolia had notably higher FY23 ratings, which 7.1 were also significantly higher than the FY20 survey results for Mongolia. Mongolia FY23 7.2 Mongolia FY20 Responsiveness to needs* 6.0 EAP FY22^ 6.9 7.0 Flexibility when circumstances 5.9 change* 6.8 • Significantly different between Mongolia FY23 and Mongolia FY20 To what extent is the World Bank Group an effective development partner in Mongolia, in terms of each Q of the following?, Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) 19 ^ EAP countries surveyed in FY22 included: China, the Philippines, Thailand The WBG Should Collaborate More with the Government and Private Sector Percentage of Respondents A majority of respondents suggest that the WBG The government 65% should collaborate more with the national government (65%) and the private sector (43%). Private sector 43% However, respondents from various stakeholder groups called for increased collaboration: Academia/think tanks/research institutions 35% Civil society (e.g., NGOs, CBOs) 31% “Partnerships with United Nations agencies to diversify its mode of engagement, depending [on the] development agenda.” Local government 25% Bilateral / Multilateral Organization Respondent Parliament/legislative branch 17% “Ensure multi-stakeholder participation, especially [of] CSOs; strengthening the methodology and capacity for external monitoring.” Media 16% Civil Society Respondent “Close cooperation with policy research organizations is needed.” Regional development banks (e.g., ADB, EBRD) 15% Academia Respondent Youth organizations 12% “Increase cooperation with development research organizations and groups, expand activities aimed at disseminating policy research results, and increase their use and application” Other donors and development partners 10% Civil Society Respondent The United Nations 7% The International Monetary Fund 5% Q Which THREE of the following groups should the WBG collaborate with more in Mongolia? (Choose no more than 3) (N=298) 20 WBG as a Development Partner: Collaborating with Various Stakeholder Groups Mean rating 1 2 3 4 5 6 7 8 9 10 The International Monetary Fund 7.7 The WBG received the highest mean ratings for its collaboration with international organizations, including 7.5 The United Nations the International Monetary Fund (IMF) and the UN. Regional development banks (e.g., 7.2 The mean ratings for collaborating with other donors ADB, EBRD) and development partners and with the government Other donors and development 7.2 have improved significantly (by over 1 point) compared to partners* 6.2 the FY20 findings. The government* 7.2 The WBG receives relatively lower ratings for its 6.1 collaboration with the private sector, academia, and civil 6.4 Parliament society, with no change in perceptions since FY20. However, it should be noted that these were the 6.3 groups with whom respondents believe the WBG Local government should collaborate more. Academia/think tanks/research 6.1 institutions Respondents from the media were the most critical of the WBG’s collaboration with various stakeholder groups Private sector 6.1 5.9 (mean across all groups = 5.2). Civil society (e.g., NGOs, CBOs) 6.0 “Be more open and engaging with all development partners to have a 6.1 concerted and coordinated approach.” Media 6.0 Bilateral / Multilateral Organization Respondent Top three groups the WBG should To what extent is the WBG an effective development partner in Mongolia, in terms of FY23 FY20 collaborate more with Q collaborating with the following groups: (1-To no disagree at all, 10-To a very significant degree) * Statistically significant difference between years 21 WBG as a Development Partner in Terms of Collaboration with WBG as development partner in collaboration with … 1 2 3 4 5 6 7 8 9 10 Various Stakeholder 7.2 The national/federal government* Groups 7.9 Compared to other EAP countries surveyed in FY22**, 7.2 Other donors and development respondents in Mongolia ranked the WBG significantly partners* lower on its collaboration with all key stakeholder 7.8 groups. 6.1 Private sector* “[The WBG] would be more effective if it cooperated with and 7.0 supported representatives of civil society organizations and the women's movement, and this is always needed. There has always been and still is a need to make the participation of CSOs more meaningful [ ]. The results will be achieved by ensuring 6.0 Mongolia FY23 multilateral cooperation and equality...” Civil society* 6.9 Civil Society Respondent EAP FY22 * Significantly different between Mongolia FY23 and EAP FY22 To what extent is the WBG an effective development partner in Mongolia, in terms of collaborating with the following Q groups: (1-Strongly disagree, 10-Strongly agree) 22 **EAP FY22 included: China, Philippines, and Thailand WBG’s Financial Mean Rating Instruments 1 2 3 4 5 6 7 8 9 10 8.1 Perceptions of the WBG’s financial instruments The WBG insists on accountability through 7.6 its lending.* have improved in FY23. Rankings across all questions have improved significantly compared to the FY20 survey. They are also significantly higher than in other EAP countries surveyed in FY22.** 7.9 The conditions of the WBG’s financing are competitive compared to markets. 7.9 The WBG provides financial support in a 7.0 timely manner.*^ Mongolia 7.0 FY23 EAP FY22 7.6 Mongolia The WBG’s financial instruments meet the FY20 7.3 needs of Mongolia.* 7.3 To what extent do you agree/disagree with the following statements Q about the World Bank Group in Mongolia? Scale: 1-10 (1: Strongly • Significantly different between Mongolia FY23 and EAP FY22 / Mongolia FY20 disagree– 10: Strongly agree) ^ In FY22 and in FY20, the option was “The World Bank Group’s approvals and reviews are done in a timely fashion” 23 ** EAP FY22 included: China, Philippines, Thailand World Bank Group’s Knowledge Work and Activities “Increase cooperation with development research organizations and groups, expand activities aimed at disseminating policy research results and increase their use and application.” Civil Society Respondent Q In your opinion, what is the most important thing the World Bank Group could do to help increase its effectiveness in Mongolia? 24 WBG’s Knowledge Work Over half of the respondents (52%) report using the WBG’s Use of the WBG’s Advisory advisory services and analytical work (knowledge work). Services and Analytics Responses differed significantly by stakeholder group. Whereas 74% of respondents from government institutions and 59% of respondents from bilateral / 14% multilateral agencies report using the WBG’s knowledge work, only 28% of respondents from the private sector report using it. Furthermore, about 25% of respondents from the media report using the WBG’s knowledge work. 52% 34% Yes No Not sure Q Have you used the WBG’s advisory services and analytics in the past? (N=305) 25 WBG’s Knowledge Work Mean Rating 1 2 3 4 5 6 7 8 9 10 (continued) I anticipate using the WBG's advisory services 8.2 and analytical work in the future. Almost all respondents, apart from those from the private sector and academia, have given high ratings to the quality of the WBG’s The World Bank Group’s publications are 7.8 6.6 knowledge work in Mongolia (with means higher than 7.0). They translated enough into local language(s)* 7.3 have also expressed their willingness to continue using the WBG's advisory services and analytics in the future (mean=8.2). The World Bank Group’s publications include 7.8 appropriate level of stakeholder involvement 7.1 during preparation 7.5 Furthermore, the ratings for comparable questions have improved in FY23 (please see the chart on the right); in some questions, they The WBG brings global expertise to Mongolia as 7.8 were higher than those of other EAP countries surveyed in FY22.** part of its advisory services and analytical 7.5 work.*^ 7.9 I am satisfied with the quality of the WBG’s 7.7 Mongolia “Having a good understanding of Mongolia's characteristics, actual conditions and advisory services and analytical work in FY23 situation, guiding the implementation of measures that will help to solve timely and urgent Mongolia. problems in the long term.” Mongolia 7.7 FY20 The WBG’s advisory services and analytical Academia Respondent 7.2 work are timely.* 7.6 EAP22 “Research, evaluation, and conclusions, and aligning one's own policy and strategy with the development policy of Mongolia” 7.7 Contribution to development results 8.0 Civil Society Respondent 7.6 7.6 To what extent do you agree/disagree with the following statements? Scale: 1-10 (1: Strongly The WBG’s advice and recommendations are Q disagree– 10: Strongly agree) tailored to Mongolia’s context.*^^ 6.8 7.5 How significant a contribution do you believe the World Bank Group's knowledge work and activities make to development results in Mongolia? 7.1 Scale: 1-10 (1: Not significant at all– 10: Very significant) The World Bank Group’s publications are ^ In FY20, this option was “In Mongolia, to what extent do you believe that the World Bank Group’s 6.7 adequately disseminated knowledge work and activities: Are source of relevant information on global good practices”; 7.5 Scale: 1-10 (1: To no degree at all– 10: To a very significant degree) ^^ In FY20, this option was “In Mongolia, to what extent do you believe that the World Bank Group’s knowledge work and activities: Are adaptable to Mongolia’s specific development challenges and * Significantly different between country circumstances”; Scale: 1-10 (1: To no degree at all– 10: To a very significant degree) Mongolia FY23 and Mongolia FY20 26 ** EAP FY22 included: China, Philippines, Thailand The Future Role of the World Bank Group in Mongolia “[The WBG should] prepare well and get a better feel for what the government wants. Also, speed up the period of issuing any loan and [providing] assistance, and adjust them correctly to the needs of the government and to the speed of operations.” Respondent from an Office of the President, Prime Minister, or Minister Q In your opinion, what is the most important thing the World Bank Group could do to help increase its effectiveness in Mongolia? 27 What the World Bank Group Could Do to Help Increase its Effectiveness in Mongolia In their responses to the qualitative question about what the WBG could do to help increase its effectiveness in Mongolia, about 41% identified what they believe should be the key areas for the WBG; 33% of respondents commented on the WBG’s operational work; 16% stressed the importance of collaboration; and some 10% commented on the communication aspects of the WBG’s work.^ Focus areas: Respondents highlighted some of the key focal areas that they consider important for the WBG. These included (i) public sector governance, including capacity development and the empowerment of citizens to participate in governance; support for institutional transparency and budget accountability; (ii) energy and climate change solutions, particularly putting an emphasis on renewable energy and addressing air pollution and climate change; (iii) macroeconomic stability and support for private sector and innovations; and (iv) data and knowledge sharing. “Emphasis should be placed on improving state institutions and capabilities, and I think that the instability and capabilitie s of state institutions affect the effective functioning of the World Bank. I think it would be good if the decision-making and finalization process was speeded up a bit..” Civil Society Respondent “Investment lending to address air pollution in Ulan Bator, traffic congestion and climate change.” Civil Society Respondent “In my opinion, the most important thing the WBG could do to help increase its effectiveness in Mongolia is to support innova tion and startup development, [including the] … financing in various fields, with more focus on technological [and] scientific innovations and other areas essential to economic diversification and social development.” Private Sector Respondent “Create a database by conducting frequent surveys in the social and economic sectors and deliver it to policymakers and the p ublic.” Respondent from an Office of the President, Prime Minister, or Minister In your opinion, what is the most important thing the World Bank Group could do to help increase its Q effectiveness in Mongolia? (Please be specific) (N=51) 28 ^ Importantly, only respondents who answered the survey via an online platform were asked to answer this question, while those filling out paper surveys – were not. What the World Bank Group Could Do to Help Increase its Effectiveness in Mongolia (continued) Operations: Respondents stressed the need for the WBG to work with greater speed and a better understanding of the country’s needs and priorities. Respondents welcome the widening of the scope of operations in Mongolia. They see the need for more capacity building (particularly for the government), implementation support, and results orientation. Some respondents expressed the need for closer monitoring of the WBG projects, as well as for greater transparency in its work, including wider publication of project information. “[The WBG needs] to have a good understanding of Mongolia's characteristics, actual conditions, and situation, guide the implementation of measures that will help to solve timely and urgent problems in the long term.” Academia Respondent “[The WBG should] cooperate on implementing projects and programs that are very necessary for Mongolia, provide internationally recognized research and information, and strengthen … capacity.” Respondent from an Office of a Parliamentarian Collaboration and Communication: Responses mainly focused on the need for more effective collaboration with various stakeholder groups (CSOs, research organizations, the UN, and other development partners), as well as the wider sharing of project information. These responses are quoted, and they are for the most part covered in other sections of this report as well. Q In your opinion, what is the most important thing the World Bank Group could do to help increase its effectiveness in Mongolia? (Please be specific) (N=51) 29 Communications and Outreach “[The WBG needs] to share with others the information [pertaining to the organization of ] …an activity in a comprehensive manner. For example, I was looking for the information in the field of education. I don't know what kind of activities are conducted [by the WBG] at all.” Government Institution Respondent Q In your opinion, what is the most important thing the World Bank Group could do to help increase its effectiveness in Mongolia? 30 General Information Sources Percentage of Respondents Respondents report using a variety of sources to Research papers / Official obtain information about socioeconomic development statistics 68% issues in Mongolia. However, a majority relies on research papers / official statistics (68%) and Social media 54% social media (54%). In FY23, the number of respondents who report using e-Newsletters 44% social media as their preferred information source tripled (that is, from 18% in FY20 to 54% in FY23). Television (TV) 44% There were significant differences among stakeholder groups. Whereas respondents from academia and Newspapers (Print or online) 36% civil society strongly prefer research papers (over 80%), respondents from the local government report a stronger preference for television (67%). Podcasts 7% Other 6% Blogs 3% Radio 2% How do you get most of your information about economic and social Q development issues in Mongolia? (Choose no more than 3) (N=297) 31 Preferred WBG Information Sources Percentage of Respondents Respondents report a preference for a variety of e-Newsletters 55% channels regarding the receipt of information about the WBG and its work. The e-newsletters, the WBG website, and events continue to be the most Website 54% preferred channels. However, other channels are almost of equal Event/conference/ seminar/workshop 52% importance for some stakeholder groups. For instance, respondents from the media identified interviews and press conferences as an important Social media 37% information source (52%). Social media is a preferred channel for respondents from the Office of a Parliamentarian (56%), academia (57%), and civil Direct contact with staff 28% society (56%). Interviews and press conferences 24% “Disseminate information to non-governmental participants, cooperate with civil society organizations on a broad scale, and pay attention to delivering information to them.” Direct messaging 12% Civil Society Respondent Podcasts 6% How would you prefer to receive information about the World Bank Group and its work? Q (Choose no more than 3) (N=300) 32 Recent Interactions with the WBG A total of 58% of respondents recall hearing or seeing something about the WBG in the last 30 days. Most respondents (45%) report seeing WBG-related information in research papers / official statistics and in e- newsletters (38%). Among those who selected “Social media”, most respondents report seeing something on Facebook (79%), followed by Twitter (41%). The 17% of respondents who selected “Other” mentioned personal contacts with the WBG staff, consulting the WBG website, as well as events and international media sources. Percentage of Respondents Research papers / Official statistics 45% e-Newsletters 38% 79% Social media 32% Newspapers (Print or online) 24% Television (TV) 20% 41% Other 17% 18% Direct message 9% 12% 9% 8% 3% Blogs 2% Podcasts 1% Where do you recall seeing or hearing this information? (Check all that apply) (N=173) Q What social media platforms do you recall seeing this information on? (Check all that apply) (FY23 N=78) 33 Topic Recall in the Last 30 Days Percentage of Respondents The WBG’s global economic forecasts (57%) and WBG global economic forecasts 57% the WBG’s work or research on climate change (24%) were the top two topics that respondents recalled seeing or hearing about in relation to the WBG work or research on climate change 24% WBG in the last 30 days. (mitigation, adaptation) WBG work to provide debt relief for 19% developing countries WBG research and/or work in support of 19% education systems in developing countries WBG work or research on energy (increasing energy supply, reducing 16% dependence of fossil fuels) WBG work or research on food insecurity 16% Other 16% Q What topics were included in what you saw or heard? (Check all that apply) (N=167) 34 Message Recall and Perceptions of the WBG’s Work Mean Level of Agreement 1 2 3 4 5 6 7 8 9 10 Those respondents who recall seeing or hearing something about the WBG in the last 30 days also tend to give The World Bank provides support to improve 7.7 the access to and quality of education in significantly higher rankings to the key areas of the WBG’s developing countries* 7.0 work (see the figure on the right). They also report a significantly higher perceived level of familiarity with the WBG (mean = 7.4) as compared to those who reported not hearing or The WBG helps countries boost climate 7.6 seeing anything about the WBG recently (mean=5.3). resilience and mitigate the effects of climate challenge 7.0 Those who collaborate with the WBG were significantly more likely to recall messages about the WBG (73%) than those who The WBG supports countries in ensuring the 7.4 do not collaborate (39%). There were differences in message transition to more diversified and cleaner recall among stakeholder groups: respondents from the sources of energy* 6.7 private sector (29%) and from academia (36%) were the least likely to recall messages related to the WBG. These groups Heard about the were also among those that reported the least familiarity with The WBG is committed to comprehensive 7.3 WBG in the last the work of the WBG. debt solutions that bring significant benefits to 30 days people in poor countries* 6.5 Have not heard These findings suggest that respondents who are more about the WBG in frequently exposed to the information about the WBG, or The WBG helps address the current food 7.2 the last 30 days who actively engage with the WBG’s channels (website, crisis and enables greater preparedness to manage future food security crises* *denotes significant social media, and so on), are also more likely to hold more 6.2 difference positive views about the WBG’s work. Do you recall seeing or hearing anything about the WBG in the last 30 days? Q To what extent do you agree with the following statements: Scale: 1-10 35 (1: To no degree at all – 10: To a very significant degree) Frequency of Engagement Matters for Message Recall Respondents who recall hearing something about the WBG in the last 30 days tend to have much more frequent interactions with the institution across ALL channels, including personal interactions with the WBG staff. They are also more likely to visit the WBG’s website, its social media channels, and/or hear about the WBG in the national media. Respondents who do not recall the WBG’s messages tend to hear about the institution in the national media and occasionally read the WBG’s publications and e-newsletters. They are not very engaged through any other channels. Do you recall seeing or hearing anything about the WBG in the last 30 days? Yes (N=~152) No (N=~116) Every few days/weeks Every few months Every few days/weeks Every few months Read a WBG post / tweet on social media Read or heard a story about the 53% 20% 15% 31% WBG in national or local media Visited a WBG website Read some, or all, of a WBG 53% 32% 12% 39% research paper or publication Read or heard a story about the WBG in 51% 27% Read a WBG e-newsletter 9% 26% national or local media Had an exchange with WBG staff Read or heard a story about the 47% 32% 5% 12% WBG in international media Read some, or all, of a WBG research Read a WBG post / tweet on social 44% 42% 3%11% paper or publication media Read or heard a story about the WBG in 44% 33% Attended a WBG event 4% international media Attended a WBG event 34% 46% Visited a WBG website 15% Read a WBG e-newsletter 14% 33% Had an exchange with WBG staff 15% Q Over the past SIX MONTHS, on average how often did you do any of the following related to the World Bank Group (WBG)? (N=~273) 36 Sample Demographics 37 Respondent Profile: Affiliation, Specialization, Status Current Affiliation Specialization % of Respondents % of Respondents Government Institution 33% Other 11% Finance and markets 11% Civil Society Organization 14% Public sector governance, anti-corruption 10% Education 9% Private Sector 12% Macroeconomics, fiscal management 8% Local Government Office or Staff 10% Communications, public affairs 8% Health 6% Bilateral or Multilateral Agency 9% Social protection, labor policies, jobs 6% Media 7% Generalist 6% Agriculture and food security 3% Office of a Parliamentarian 5% Gender 3% Self-identified Energy / Extractives 3% Academia/Research Institute/Think Tank 5% status Environment / Natural resource management 3% Office of the President, Prime Minister, Office of 4% Urban development 2% a Minister Junior level 3% None of the above 2% Other 2% Law/Justice 2% Mid-level staff 23% Transport 2% Mid-level decision-maker Digital development 1% / manager 24% Trade 1% Senior level 50% Statistics 1% Climate change 1% Water, sanitation 0% Q Which of the following best describes your current affiliation? (Select only 1 response) (N=302) Please identify the primary specialization of your work. (Select only 1 response) (N=295) 38 Respondent Profile: Collaboration with the WBG Collaboration with the WBG Collaboration Institution The World Bank (IBRD/IDA) 89% Yes 45% 55% No The International Finance Corporation (IFC) 11% Currently, do you professionally collaborate/work with the World Bank Q Group (IBRD, IFC, MIGA, ICSID) in your country? (N=296) Which of the following agencies of the World Bank Group do you primarily collaborate/work with in Mongolia? (Select only 1 response) 39 (N=151) Respondent Profile: Demographics Gender Age 25 and under 5% Female 26-35 18% 47% 53% Male 36-45 35% 46-55 33% 56 and above 10% Location Ulaanbaatar 95% Other 5% What’s your gender? (N=307) Q What’s your age (N=307) 40 Which best represents your geographic location? (N=304) Methodology 41 Methodology From March to May 2023, a total of 424 stakeholders of the WBG in Mongolia were invited to provide their opinions about the WBG’s work in the country. They did so by participating in a Country Opinion Survey (COS). Participants were drawn from the Office of the President or Prime Minister; the Office of a Minister; the Office of a Parliamentarian; national government institutions; local governments; bilateral / multilateral agencies; the private sector; civil society organizations; academia, research institutes, think tanks; and the media. A total of 307 stakeholders participated in the survey (72% response rate). Respondents completed the questionnaire either through an online platform, or through completing a paper questionnaire, which was delivered to them via mail, email, or during a personal interview. Every country that engages in the COS must include specific indicator questions. Several of them are aggregated for the World Bank Group’s annual Corporate Scorecard (please refer to the Indicator questions section of this report. 42 Comparison of FY20 Percentage of Respondents Office of the President, Prime Minister, Office FY 2020 FY 2023 5% 4% of a Minister and FY23 Office of a Parliamentarian (The State Great Khural) 7% 5% The results of this year’s Country Survey were Government Institution: Employee of a Ministry / Ministerial Department / Project compared to those of the Country Survey conducted in Implementation Unit / Independent FY20 (with a response rate of 65%, N=269). 29% 33% Government Institution (for example, The Bank of Mongolia, Regulatory or Oversight Agency) Comparing responses across Country Surveys reflects / Judiciary /State-Owned Enterprise changes in attitudes over time, as well as changes in respondent samples and changes to the survey instrument Local Government Office or Staff 12% 10% itself. To reduce the influence of the latter factor, only those questions with similar response scales/options are analyzed. Bilateral or Multilateral Agency (for example, embassy, development organization, 6% 9% The distribution of the stakeholder groups in the final development bank, UN agency) samples for the FY20 and FY23 country surveys are listed in the table on the right. Civil Society Organizations: (Local and Regional NGOs; Community-Based Organizations; Private Foundations; 16% 14% Professional / Trade Associations, Faith- Based Groups, and Youth Groups) Private Sector: Private Company / Financial 11% 12% Sector Organization / Private Bank Media 9% 7% Academia/Research Institute/Think Tank 5% 5% Total Number of Respondents 267 302 43 Statistical Analysis Groups No. Percentage To classify respondents into different stakeholder groups, their self-reported responses to the question “Which of the Office of the President / Prime Minister / Minister 13 3% following best describes your current affiliation?” were used. Respondents who selected “Other” or who have not provided an answer to this question (n=10) were included in Office of a Parliamentarian 16 6% descriptive statistics, but not in the stakeholder analysis. Breakdowns for individual questions by stakeholder group Government Institutions 99 28% can be found in the “Mongolia COS FY23 Tables with data breakdowns.xlsx” file, which was published in the WBG Microdata Library, along with the survey microdata and this Local Government 29 17% report. Bilateral / Multilateral Agency 27 8% Scale bucketing: When mentioning Low, Medium, and High in the scales Civil Society Organization 42 11% throughout the report: 1-6 is low, 7-8 is medium, and 9-10 is high. Private Sector 36 13% Statistical significance: Key statistically significant findings are denoted with an asterisk (*) throughout the report or discussed in the Academia / Research Institute / Think Tank 14 8% descriptions of the charts. Significance is measured at p-value < .05. Media 21 6% Total 297 100% 44 Qualitative Analysis Regarding the qualitative part of the questionnaire, respondents were invited to share their thoughts Summary of the Main Themes about the ways in which the WBG could help in Qualitative Comments increase its future effectiveness in Mongolia. “In your opinion, what is the most important thing the Focal Areas for the WBG 41% World Bank Group could do to help increase its effectiveness in Mongolia? (Please be specific).” Operations 33% A total of 51 responses were received. They varied in length from a few words to a few sentences. The comments were broadly categorized into four groups Colalboration 16% based on their main theme (please see the figure to the right) and summarized in the relevant section of “The Future Role of the World Bank Group in Communication 10% Mongolia”. Individual quotes were used throughout the report in relevant sections to illustrate the quantitative data. 45 Indicator Questions A2_5. To what extent do you trust the World Bank Group to do what is right? Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) A3. How effective has the World Bank Group been in achieving development results in Mongolia? A4. The World Bank Group currently plays a relevant role in development in Mongolia, Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) A5. The World Bank Group’s work is aligned with what I consider the development priorities for Mongolia, Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) A6. To what extent does the World Bank Group influence the development agenda in Mongolia? Scale: 1-10 (1: To no degree at all– 10: To a very significant degree) A7. How significant a contribution do you believe the World Bank Group's knowledge work and activities make to development results in your country?, Scale: 1-10 (1: Not significant at all – 10: Very significant) To what extent is the World Bank Group an effective development partner in Mongolia, in terms of each of the following? – Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) C2. Responsiveness to needs, C3. Access to WBG staff and experts, C4. Flexibility when circumstances change, C5. Being a long-term partner, To what extent is the WBG an effective development partner in Mongolia, in terms of collaborating with the following groups: – Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) C7_1.Collaboration with the national government C7_5.Collaboration with the private sector C7_6.Collaboration with civil society C7_7.Collaboration with other donor and development partners C8_1 To what extent do you agree/disagree with the following statement? – The WBG’s financial instruments meet the needs of Mongolia (i.e., investment lending, Development Policy Loan, Trust Funds), Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) C8_4. To what extent do you agree/disagree with the following statement? – The WBG provides financial support in a timely manner., Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) C10_1.To what extent do you agree/disagree with the following statements about the World Bank Group in Mongolia? I am satisfied with the quality of the WBG’s advisory services and analytical work in Mongolia. Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) C10_5.To what extent do you agree/disagree with the following statements about the World Bank Group in Mongolia? The WBG’s advice and recommendations are tailored to Mongolia’s context. Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) 46 Note: Corporate Scorecard questions are highlighted RED