FY 2023 Montenegro Country Opinion Survey Report ECR Business Intelligence Team | December 2023 Acknowledgements The Montenegro Country Opinion Survey is part of the County Opinion Survey Program series of the World Bank Group. This report was prepared by the Business Intelligence (BI) team, led by José De Buerba (Senior External Affairs Officer) and Svetlana Markova (Senior External Affairs Officer). Yulia Danilina, Jessica Cameron, Nan Lin, and Sofya Gubaydullina oversaw the design, reporting, and analysis of the survey results. Noreen Wambui and Irina Popova provided data support. BI acknowledges the significant contribution of the Montenegro Country Team. In particular, BI is grateful for the support from Dragana Varezic (Senior Program Assistant) who coordinated the survey-related activities from Podgorica, Montenegro. Contents Objectives Methodology Overview Overall Context Overall Attitudes Toward the World Bank Group World Bank Group’s Work and Engagement on the Ground in Montenegro Communication and Outreach Sample Demographics and Detailed Methodology 3 Objectives This survey was designed to assist the World Bank Group (WBG) in gaining a better understanding of how stakeholders in Montenegro perceive the WBG. The survey explored the following questions: 1. Overall Context: How familiar are they with the WBG? How much do they trust the WBG? 2. Key Indicators: What opinion do key stakeholders have of the WBG when it comes to its effectiveness, relevance, alignment with Montenegro’s development priorities, and other key indicators? Are opinions improving or declining? 3. Engagement and Work on the Ground: How is the WBG perceived as a development partner? Are opinions improving or declining? 4. Communication and Outreach: What are the preferred communication channels and which channels are reported to be used the most? Are there differences among stakeholder groups in terms of preferred channels? 5. Message Recall: What key topics that the WBG communicates do stakeholders recall? Is there a relationship between message recall and views of the WBG’s work? 4 Methodology Overview Government Institution 31% ▪ Fielded May 2023 through July 2023 ▪ 347 potential participants were asked to complete a mostly Civil Society Organization 18% quantitative survey ▪ Respondents completed the questionnaires online Bilateral / Multilateral Agency 16% ▪ List of names provided solely by the WBG country team ▪ The online survey platform is monitored and managed by the Office of a Parliamentarian 7% COS team ▪ 95 participants (27% response rate) Academia 6% ▪ 43% currently collaborate with the WBG Media 6% ▪ Compared to FY19 Country Survey Office of the President / Prime Minister ▪ 177 participants (50% response rate) / Minister 5% ▪ Respondents received the questionnaire via courier or email and returned it accordingly. Local Government 5% ▪ 43% collaborated with the WBG Private Sector 5% Click here for details of the Sample Demographics and Methodology Q Which of the following best describes your current affiliation? (Select only 1 response) (Percentage of Respondents, N=95) 5 6 Overall Context Familiarity with the World Bank has Improved ▪ Year comparison: Respondents in this year’s Country Survey reported significantly higher levels of familiarity with All Respondents 6.9 the WBG compared to FY19: Mean familiarity: FY23 = 6.9 FY19 = 6.1 Government Institutions^ 7.7 ▪ Collaboration with the WBG: Respondents who collaborate with the WBG reported significantly higher levels of familiarity with the institution’s work: Government Principals 7.2 Mean familiarity: Collaborate with WBG = 8.2 Do not collaborate = 5.9 Bilateral /Multilateral Agency 6.9 ▪ Stakeholder Analysis: Respondents from government institutions reported the highest levels of familiarity with the WBG’s work (mean = 7.7), whereas civil society respondents indicated significantly lower levels of familiarity (mean = 5.9) Civil Society 5.9 How familiar are you with the work of the World Bank Group in Montenegro? 1 2 3 4 5 6 7 8 9 10 Q Scale: 1 Not familiar at all – 10 Extremely familiar (N=95) Mean Rating of Familiarity ^ Government Principals included respondents from the Office of the President, Prime Minister, Minister, and Office of a Parliamentarian (National Assembly, Legislative body); Significantly different between stakeholder groups Government Institutions included respondents from government institutions and local government offices; Civil society included respondents from civil society organizations, the private sector, academia, and the 7 media. The World Bank is the Most The World Bank Group* 7.0 7.9 Trusted Institution in 7.6 Montenegro The United Nations (UN) * 7.0 7.4 The International Monetary Fund* The WBG remained the most trusted institution in Montenegro 6.5 among those studied. The United Nations (UN) and the International Monetary Fund (IMF) were also among the top 6.6 trusted institutions. In contrast, the media, the national Private sector* 5.9 government, and the local government were the least trusted among the institutions studied. 6.5 Civil society* ▪ Ratings of trust in the WBG, the UN, the IMF, the private 5.7 FY23 sector, civil society, and Montenegro’s Central Bank were FY19 significantly higher in FY23 than in the FY19 survey. 6.2 However, the trust rating in the national government Montenegro’s Central Bank* 5.3 decreased significantly in FY23. 5.4 Media 5.1 5.2 The national government* 6.6 5.1 Local government To what extent do you trust each of the following groups to do what is right? 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 Q Scale: 1 To no degree at all – 10 To a very significant degree (FY23 N=~89; FY19 N = ~144) Mean Rating of Trust 8 *Significantly different between years 9 Overall Attitudes toward the World Bank Group Perceptions of the Bank’s Alignment with the Country’s Development Alignment with the development 7.5 priorities* 6.5 Priorities have Improved 7.2 Effectiveness in achieving results^ In FY23, respondents ranked the WBG’s alignment with 6.9 the development priorities in Montenegro significantly higher compared to FY19. Perceptions on other key performance indicators remained consistent with FY19. 6.9 Relevance FY23 6.6 FY19 6.8 Influences the development agenda 6.8 The WBG’s work is aligned with what I consider the development priorities for Montenegro. Q Scale: 1 Strongly disagree – 10 Strongly agree How effective has the WBG been in achieving development results in Montenegro? 6.7 Scale: 1 Not effective at all – 10 Very effective End extreme poverty The WBG currently plays a relevant role in development in Montenegro. Scale: 1Strongly disagree – 10 Strongly agree To what extent does the WBG influence the development agenda in Montenegro? Scale: 1 To no degree at all – 10 To a very significant degree 1 2 3 4 5 6 7 8 9 10 The World Bank Group’s work helps end extreme poverty in Montenegro. Mean Rating Scale: 1 Strongly disagree – 10 Strongly agree ^Compared to a mean score of the two questions asked in FY19: "Overall, please rate your *Significantly different between years impression of the WBG’s effectiveness in Montenegro. Scale: 1 Not effective at all – 10 Very effective; To what extent does the WBG’s work help to achieve development results in Montenegro? Scale: 1 To no degree at all – 10 To a very significant degree 10 Government Stakeholders Have Significantly More Positive 8.7 8.5 Trust* Perceptions of the World Bank 8.4 6.8 Respondents from government institutions tended to 7.2 have the most positive perceptions of the WBG and its Alignment with the 8.2 work, followed by respondents from bilateral and development 7.6 multilateral agencies. In contrast, civil society priorities Government respondents were significantly less positive, and they 6.8 Principles also reported the lowest levels of familiarity with the WBG. 7.0 7.7 Government Relevance Institutions 7.1 6.1 Bilateral / 6.7 Multilateral Agency Effectiveness in 8.2 achieving results* 7.6 Civil Society 6.3 To what extent do you trust the WBG to do what is right? Q Scale: 1 To no degree at all – 10 To a very significant degree 6.5 The WBG’s work is aligned with what I consider the development priorities for Montenegro. Scale: 1 Strongly disagree – 10 Strongly agree Influences the 7.9 The WBG currently plays a relevant role in the development in Montenegro development agenda* 7.1 *Significantly different Scale: 1 Strongly disagree – 10 Strongly agree among stakeholder 5.8 groups How effective has the WBG been in achieving development results in Montenegro? Scale: 1 Not effective at all – 10 Very effective To what extent does the WBG influence the development agenda in Montenegro? 1 2 3 4 5 6 7 8 9 10 Scale: 1 To no degree at all – 10 To a very significant degree Mean Rating 11 12 World Bank Group’s Work and Engagement on the Ground in Montenegro Ratings for Most Indicator Questions Mean Rating Remain Consistent 1 2 3 4 5 6 7 7.9 8 9 10 Trust* 7.0 Year comparison: Respondents in this year’s Country Contribution of the WBG's knowledge work to 7.7 Survey reported statistically similar levels of aggregated development results in Montenegro* 7.1 mean ratings for the indicator questions as in FY19: 7.5 Alignment with Montenegro's development priorities* Mean overall ratings: FY23 = 7.0 6.5 FY19 = 6.7 Collaboration with the national/federal government 7.4 7.9 7.2 Effectiveness in achieving development results Collaboration with the WBG: Respondents who 6.9 collaborate with the WBG gave significantly higher 7.0 ratings across the aggregated indicator questions Responsiveness to needs 6.9 compared to respondents who do not collaborate with the WBG. 6.9 Relevance 6.6 Mean rating: Collaborate with WBG = 7.9 6.8 Access to WBG staff and experts 7.3 Do not collaborate = 6.3 6.8 Influence on the development agenda 6.8 Stakeholder analysis: Respondents from government Collaboration with other donors and development 6.7 institutions (mean = 7.9) had significantly higher mean partners 6.9 ratings of the aggregated responses to the twelve COS 6.3 indicator questions, whereas respondents from civil Collaboration with private sector FY23 6.0 society had the lowest mean ratings (mean = 6.0). FY19 6.2 Collaboration with civil society 6.1 Mean Ratings for the twelve COS Indicator Questions by Stakeholder Groups on a Scale from 1 to 10. *significantly different between years Q These selected indicators are listed at the end of this report. 13 Respondents from the Government and Bilateral / 7.5 Multilateral Agencies Rank The National/Federal Government 8.0 8.2 Highly WBG’s Collaboration 6.4 6.3 with the Government and Other donors and 7.1 development partners 7.9 other Development Partners 6.0 Government Principals 7.3 6.9 Respondents from government institutions and Media Government 6.2 bilateral/multilateral agencies gave relatively high 5.9 Institutions ratings for the Bank’s collaboration with the government and with other development partners. 6.9 Bilateral / 6.9 Respondents from civil society tended to give Private sector Multilateral 6.8 consistently lower ratings for the World Bank’s 5.4 Agency collaboration with all stakeholder groups, although the difference in their ratings compared to other groups was Civil Society 6.1 not statistically significant. 6.8 Civil society 6.6 5.6 1 2 3 4 5 6 7 8 9 10 Mean Rating To what extent is the WBG an effective development partner in Montenegro, in terms of collaborating with the Q following groups? Scale: 1 To no degree at all – 10 To a very significant degree 14 15 Communication and Outreach Two-thirds of Respondents Engaged with the WBG in the Last 30 Days 67% of respondents recalled hearing or seeing something about the WBG in the last 30 days. Half of the respondents reported seeing that information on television. Additionally, respondents frequently recall messages from events and newspapers. Among respondents who selected “social media”, respondents most commonly reported seeing something on Facebook and X (Twitter). Television (TV) 50% Event / conference / seminar 41% Newspapers (Print or online) 40% Direct contact with WBG staff 34% 35% Social media 29% 29% WBG Website 22% 24% e-Newsletters 5% 18% 18% Radio 3% 12% Direct messaging 3% Facebook Twitter Instagram LinkedIn Other WhatsApp Blogs 2% Podcasts 0% Q Do you recall seeing or hearing anything about the WBG in the last 30 days? (N=86) Where do you recall seeing or hearing this information? (Check all that apply) (Percentage of Respondents, N=58) 16 What social media platforms do you recall seeing this information on? (Check all that apply) (Percentage of Respondents, N=17) WBG Global Economic Forecasts was the Most Commonly Recalled Topic Respondents most frequently recalled WBG’s global economic forecasts and its work on debt relief. global economic forecasts 66% work to provide debt relief for developing countries 40% work or research on creating more and better jobs 29% work or research on climate change (mitigation, adaptation) 24% work or research on energy (increasing energy supply, 17% reducing dependence of fossil fuels) work or research on food insecurity 10% work or research on improve gender equity and empowerment 10% of women and girls Other 10% research or work in support for education systems in 7% developing countries 17 Q What topics were included in what you saw or heard? (Check all that apply) (Percentage of Respondents, N=58) Climate Change Communications can be More Impactful when Related to Stakeholders’ Top Concerns: Forest Fires and Air Pollution Two-thirds of the respondents were very concerned about forest fires when it comes to the potential impacts of climate change in Montenegro. Over half of all respondents were also very concerned about air pollution, effects of the climate change on public health, and land and forest degradation. These key areas of concern should be taken into consideration to make communications about climate change more impactful in Montenegro. Not at all A little Somewhat concerned Very concerned Forest fires 66% Air pollution 60% Effects on public health 53% Land and forest degradation 52% More frequent and severe droughts / heatwaves 44% Extinction of plant/animal species 43% Decreased crop yields/food insecurity 38% Unsafe drinking water 34% Diminished water supply for people and the economy 33% Loss of jobs 33% More frequent and severe floods 29% Increase erosion of shoreline 20% Increase in natural disasters 15% Climate-driven migration 14% Q What is your level of concern for each of the potential impacts of climate change as it affects your country? (Percentage of Respondents, N=86) 18 Message Recall is Associated with Greater Message Agreement The World Bank Group… Respondents who recalled seeing or hearing is committed to comprehensive debt solutions 7.4 something about the WBG in the last 30 days that bring significant benefits to people in poor countries 6.2 tended to give higher ratings on the key messages related to the WBG’s work and commitments. supports countries to ensure transition to more 7.3 diversified and cleaner sources of energy 6.6 is improving gender equity and inclusion for 7.2 women and girls 6.6 Heard about the WBG in helps countries boost climate resilience and 7.2 last 30 mitigate the effects of climate challenge* days 5.8 provides support to improve access and quality 6.7 of education in developing countries. 5.9 Did not hear removes bottlenecks that prevent firms from 6.7 about the creating more and better jobs.* WBG in 5.5 last 30 days helps address the current food crisis and 6.5 enables greater preparedness to future food security crises 5.9 1 2 3 4 5 6 7 8 9 10 Mean Rating Do you recall seeing or hearing anything about the WBG in the last 30 days? *Significantly different between recall yes/no Q To what extent do you agree with the following statements: Scale: 1 To no degree at all – 10 To a very significant degree 19 20 Sample Demographics and Detailed Methodology Sample Demographics Which of the following best describes your current affiliation? (N=95) Government Institution 31% Civil Society Organization 18% Bilateral / Multilateral Agency 16% What’s your gender? (N=95) Office of a Parliamentarian 7% Academia 6% Media 6% Male 44% Female Office of the President / Prime Minister / Minister 5% 56% Local Government 5% Private Sector 5% 21 Sample Demographics Currently, do you professionally collaborate/ work Which of the following agencies of the WBG do with the WBG in your country? (N=95) you primarily collaborate/work with in Montenegro? (N=41) World Bank 90% (IDA) Yes 43% No 57% IFC 10% 22 Detailed Methodology Percentage of Respondents FY 2019 FY 2023 From May 2023 to July 2023, a total of 347 stakeholders of the WBG in Montenegro were invited to provide their opinions about the WBG’s work in the country by participating in a Country Opinion Government Principals: Office of the Survey (COS). Participants were drawn from the Office of the President, Prime Minister, Minister, President, Prime Minister, Minister; Office of 9% 12% a Parliamentarian (National Assembly, Office of a Parliamentarian (National Assembly, Legislative body), Government Institutions, Local Legislative body) Governments, Bilateral/ Multilateral Agencies, Private Sector, Civil Society, Academia, and the Media. Government Institutions: Employee of a Ministry, Department, Project Implementation Unit, Independent 32% 31% A total of 95 stakeholders participated in the survey (27% response rate). Respondents Government Institution, Judiciary, completed the questionnaire via an online platform. The results of this year’s survey were State-Owned Enterprise compared to the FY19 COS survey with a response rate of 50% (N=177). Local Government 8% 5% Comparing responses across Country Surveys reflects changes in attitudes over time, but also changes in respondent samples, changes in methodology, and changes to the survey instrument Bilateral/Multilateral Agency: Embassy, Development Organization, Development 5% 16% itself. To reduce the influence of the latter factor, only those questions with similar response Bank, UN Agency scales/options were analyzed. Additionally, this year, the COS project utilized a Pulse survey format, a shorter version conducted online by the BI team at the WBG. The list of respondents was Civil Society: NGOs, Community-Based identified and provided solely by the country team, while in the previous survey, up to 20% of the Organization, Private Foundation, 11% 18% Professional / Trade Association, respondents were provided by a local fielding agency. Thus, this year’s survey saw an increased Faith-Based Group, Youth Group outreach to and response from stakeholders from bilateral and multilateral agencies and a decrease in the number of private-sector respondents. These differences in stakeholder Private Sector: Private Company, Financial 15% 5% composition between the two years should be considered when interpreting the results of the past- Sector Organization, Private Bank year comparison analyses. Academia/Research Institute/Think Tank 8% 6% Key statistically significant findings (tested at the research standard of p < .05) are noted Media 7% 6% throughout the report. Breakdowns for individual questions by stakeholder group can be found in the “Montenegro COS Other 6% 0% FY23 Appendices with data breakdowns.xlsx” file published in the WBG Microdata Library, along Total Number of Respondents 171 95 with the survey microdata and this report. 23 Indicator Questions A1_3. To what extent do you trust the World Bank Group to do what is right? Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) A2. How effective has the World Bank Group been in achieving development results in Montenegro? A3. The World Bank Group currently plays a relevant role in development in Montenegro, Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) A4. The World Bank Group’s work is aligned with what I consider the development priorities for Montenegro, Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) A6. To what extent does the World Bank Group influence the development agenda in Montenegro? Scale: 1-10 (1: To no degree at all– 10: To a very significant degree) A7. How significant a contribution do you believe the World Bank Group's knowledge work and activities make to development results in your country? Scale: 1-10 (1: Not significant at all – 10: Very significant) To what extent is the World Bank Group an effective development partner in Montenegro, in terms of each of the following? – Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) B1. Responsiveness to needs, B2. Access to WBG staff and experts, To what extent is the WBG an effective development partner in Montenegro, in terms of collaborating with the following groups: – Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) B3. Collaboration with the national government B4.Collaboration with the private sector B5.Collaboration with civil society B6. Collaboration with other donor and development partners Note: Corporate Score questions are highlighted in RED 24 Thank you For more information about this report or the Country Opinion Survey program, please contact: countrysurveys@worldbankgroup.org