April 2023 FY 2023 North Macedonia Country Opinion Survey Report ECR Business Intelligence Team Acknowledgements The North Macedonia Country Opinion Survey is part of the County Opinion Survey Program series of the World Bank Group. This report was prepared by the Business Intelligence (BI) team, led by José De Buerba (Senior External Affairs Officer). Yulia Danilina, Jessica Cameron, Nan Lin, and Sofya Gubaydullina oversaw the design, reporting, and analysis of the survey results. Dania Mendoza, Noreen Wambui, and Irina Popova provided data support. BI acknowledges the significant contribution from the North Macedonia Country Team and independent field agency, Publik DOO. In particular, BI is grateful for the support from Anita Bozinovska (Senior External Affairs Assistant) who coordinated the survey related activities from Skopje, Republic of North Macedonia. Disclaimer The boundaries, colors, denominations, and other information shown on any map in this work do not imply any judgment on the part of the World Bank concerning the legal status of any territory or the endorsement or acceptance of such boundaries. Contents Objectives Overall Context Overall Attitudes Toward the World Bank Group World Bank Group’s Support for Development Areas World Bank Group’s Work and Engagement on the Ground World Bank Group’s Knowledge Work and Activities The Future Role of the WBG in the Republic of North Macedonia Communication and Outreach Sample Demographics Methodology 3 Objectives This survey was designed to assist the World Bank Group (WBG) in gaining a better understanding of how stakeholders in North Macedonia perceive the WBG. The survey explored the following questions: 1. What opinion do key stakeholders have of the WBG when it comes to its effectiveness, relevance, alignment with North Macedonia’s development priorities, and other key indicators? Are opinions improving or declining? 2. What areas of development are perceived to be the most important? Have the priorities changed over the past three years? 3. How the WBG is perceived as a development partner? Are opinions improving or declining? 4. What do key stakeholder value the most and the least when it comes to the WBGs work at the country level? What are the priorities looking forward? 5. What opinion do key stakeholders have of the WBG knowledge products and their quality? Are opinions improving or declining? 6. What are the preferred communication channels and which channels are reported to be used the most? Are there differences among stakeholder groups in terms of preferred channels? 7. What key topics the WBG communicates around do stakeholders recall? Is there a relationship between message recall and views of the WBG’s work? 4 Overall Context “[The WBG should provide] support for the development and implementation of a long-term vision for progress (economic and societal [aspects]).” Civil Society Respondent “Increased sharing of advice on how to enhance economic development and reduce poverty” Media Respondent 5 Respondents are Split over North Macedonia’s General Direction Respondents in North Macedonia have significantly Country direction varying opinions about their country’s general 2023 direction. Whereas 83% of the respondents from high government offices agree that North Macedonia is headed in the right direction, only 40% The right direction 17% of respondents from civil society do. Notably, over one-third of the respondents are not sure about the country’s direction, and in some stakeholder groups (private sector, civil society, The wrong 20% academia, media), up to half are unsure. direction In FY19, most respondents (51%), including civil society stakeholders, tended to be “somewhat Not sure optimistic”, which suggests growing pessimism. 39% FY23: In general, would you say that North Macedonia is headed in ... ? (N=216) Q FY19: When you think about the future in FYR Macedonia, are you … ? (Very pessimistic, Somewhat pessimistic, Somewhat optimis tic, 6 Very optimistic, Not sure) (N=183) Familiarity with The World Bank Group Mean Familiarity Rating Comparison of FY19 and FY23: Respondents 1 2 3 4 5 6 7 8 9 10 in this year’s Country Survey report similar levels All Respondents 7.2 of familiarity with the World Bank Group as in Office of the President / Prime Minister / FY19: 8.0 Minister Mean familiarity: FY23 = 6.8; Government Institutions 7.3 FY19 = 6.9. Academia 7.3 Collaboration: Respondents who collaborate with the WBG report significantly higher levels of Media 7.2 familiarity with the institution’s work : Bilateral / Multilateral Agency 7.1 Mean familiarity: WBG collaborators = 7.6 Non-collaborators = 5.9 Local Government 6.8 Office of a Parliamentarian 6.2 Private Sector 5.8 Civil Society Organization 5.8 How familiar are you with the work of the World Bank Group in North Q Macedonia? Scale: 1-10 (1: Not familiar at all – 10: Extremely familiar) 7 Trust in Institutions Mean Trust Rating 1 2 3 4 5 6 7 8 9 10 The WBG, along with regional development The World Bank Group 7.2 7.1 banks, bilateral organizations, and North 7.0 Macedonia’s Central Bank, continue to be the Bilateral organizations (e.g., GIZ, USAID) most trusted institutions in North Macedonia from 6.9 North Macedonia’s Central Bank among those studied. 6.7 Regional development banks (e.g., EBRD, EIB, 6.9 At the same time, the Parliament, the national KfW)* 6.5 government, and the media are the least trusted 6.7 The International Monetary Fund institutions, according to the respondents. 6.3 The United Nations (UN) 6.5 6.2 Private sector 6.2 Institutions of the European Union (EU) 5.9 Academia/think tanks/research institutions 5.6 Civil society (e.g., NGOs, CBOs) 5.5 FY23 Local government 5.0 FY19 4.7 Media 4.9 The national government 4.8 5.1 *significantly different Q To what extent do you trust each of the following groups to do what is right? Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) Parliament/legislative branch 4.4 between years Note: CBO= Community-based Organization; EIB= European Investment Bank; EBRD= European Bank for Reconstruction and Development; GIZ= German Society for International Cooperation; KfW= German Reconstruction Credit Institute; NGO= Non-governmental Organization; USAID= United States Agency for 8 International Development. World Bank Group’s Support in Development Areas “Budget allocations for routine and periodic maintenance of infrastructure. Affordable options for childcare or elder care, appropriate transportation, flexible work agreements. Programs for energy efficiency and the use of more efficient heating stoves… [as well as the] transition to cleaner fuels, such as wood pellets or natural gas.[Also,] improvements in urban transportation management.” Government Institution Respondent “Reforms in education at all levels, Improvement of governance, and raising institutional capacities.” Academia Respondent 9 Development areas for the WBG to focus Vs FY19 Education and skills 65% +34 In FY23 stakeholders would like the WBG to focus its Judiciary reform 51% +33 resources on: Education and skills, Judiciary reform, and Health. All three areas significantly increased in Health 44% +31 priority since FY19. Whereas Education and Health are top Private sector development 35% +18 priorities across all stakeholder groups, Judiciary reform was a significantly higher priority for respondents from the Anti-corruption 32% +20 Parliament (86%), local government (65%), the media Job creation / employment 28% +10 (62%), and academia (61%). Digital Development 28% +24 • Respondents who identified their primary specialization of work as “education” (14% of the sample) were significantly more likely to Public sector governance 26% +1 indicate that “education” was a top development priority (93%) compared to respondents from other sectors (61%). Environment / Natural resource management 23% NA Transport 22% +10 In FY23, Digital development (in FY19, referred to as information and communication technologies or ICT), Anti- Energy / Extractives 16% + 11 corruption, and Private sector development grew in Agriculture and food security 15% +3 prominence, with more than twice as many respondents selecting them from among the top development priorities Social protection 13% +2 as compared to FY19. Climate change 12% +9 Note: The overall increase in percentages in the chart is partially Water supply and sanitation infrastructure 12% +9 attributable to the change in the methodology: In FY19, respondents were offered to select up to three priorities, whereas in FY23, they Urban development 8% +3 could choose up to five priorities. In addition, two major cross-cutting areas — Economic Growth and Poverty Reduction (#1 and #4 in Debt sustainability 7% NA FY19) — were removed from the list of options in FY23 Equality of opportunity 7% +2 FY23: Which areas should the World Bank Group prioritize in its work Q in North Macedonia to have the most impact on development results Regional integration 7% = in the country? (Choose no more than 5) (N=216) Trade and exports 6% +4 FY19: When thinking about how the World Bank Group can have the most impact on development results in North Macedonia, in which Gender equity 6% +6 sectors do you believe the World Bank Group should focus most of its resources (financial and knowledge services) in North Macedonia? Disaster risk management 4% +3 (Choose no more than THREE) (N=170) Effectiveness of WBG’s Sectoral Support The WBG’s work in the areas of transport and gender equity in North Macedonia received the highest effectiveness ratings. However, the overall ratings of the WBG’s effectiveness across several sectoral areas were significantly lower in FY23 compared to FY' 19. Most notably, the ratings for effectiveness vis-à-vis anti-corruption declined. Mean Level of Effectiveness Mean Level of Effectiveness 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 6.8 Public sector governance* 6.2 Transport 7.3 7.0 6.6 Agriculture and food security* 6.1 Gender equity 6.8 6.8 6.5 Job creation / employment 6.1 Debt sustainability 6.3 6.4 Health 6.1 Private sector development 6.3 5.9 6.4 Trade and exports 6.0 Equality of opportunity* 7.2 6.6 Water supply and sanitation 6.4 Climate change* 5.9 infrastructure 6.7 6.4 Energy / Extractives* 5.9 Education and skills* 7.1 6.6 6.3 Disaster risk management 5.9 Social protection* 7.0 6.2 FY23 Environment / Natural resource 6.3 Urban development* 5.8 management FY19 6.5 6.2 Anti-corruption* 5.2 Regional integration 6.7 *significantly different 7.3 between years 6.2 Judiciary reform 5.1 Digital Development 6.7 5.5 How EFFECTIVE do you believe the World Bank Group is in terms of the work it does in the following areas of development in North Macedonia? Q (If you have NO exposure to/experience in working in any of the sectors listed below, please respond “Don’t know”), 11 Scale: 1-10 (1: Not effective at all – 10: Very effective) Air Pollution is the Main Concern for Respondents in Relation to Climate Change A large majority (76%) of respondents are very concerned about air pollution when it comes to the potential impacts of climate change in North Macedonia. Over half (57%) are very concerned about the potential effects on public health. Decreased crop yields, land and forest degradation, and more frequent and severe droughts / heatwaves are the impacts that respondents are “somewhat concerned” about (43%-50%), whereas increased erosion of shorelines is the issue of least concern (13%). Not at all A little Somewhat concerned Very concerned Air pollution 76% Effects on public health 57% Decreased crop yields/food insecurity 43% Unsafe drinking water 41% Diminished water supply for people and the economy 37% More frequent and severe droughts / heatwaves 35% Forest fires 34% Loss of jobs 33% Land and forest degradation 33% More frequent and severe floods 30% Extinction of plant/animal species 28% Increase in natural disasters 25% Climate-driven migration 23% Increase erosion of shoreline 13% Q What is your level of concern for each of the potential impacts of climate change as it affects your country? (N=~212) 12 Overall Attitudes toward The World Bank Group “Engage early with [a] wide range of stakeholders in thematic areas; help support long-term planning; support planning of budgeting and management of public finances; help with value-for-money criteria and cost-benefit analysis; and support capacity for long-term planning and implementation of policies.” Bilateral / Multilateral Agency Respondent 13 Key Performance Indicators In FY23, there was a slight, non-significant improvement across the key indicator questions. About one-third of respondents gave the WBG high ratings (9 or 10 on a 10-point scale) for alignment with North Macedonia’s development priorities and for relevance. About one-quarter of respondents gave high ratings for the WBG’s effectiveness in achieving development results, as well as for its ability to influence the development agenda in North Macedonia. Percentage points change from FY19 FY 23 FY 19 Mean Mean -5 +7 -2 Relevance 28% 42% 30% 7.4 7.2 -9 +15 -5 Alignment 26% 44% 30% 7.4 7.2 -19 +21 -2 Effectiveness in achieving results 29% 48% 23% 7.1 7.1* -8 +9 -1 Influence 27% 50% 23% 7.3 7.0 Low (1-6) Medium (7-8) High (9-10) The World Bank Group’s work is aligned with what I consider the development priorities for North Macedonia, Scale: 1 -10 (1: Strongly disagree – 10: Strongly agree) How effective has the World Bank Group been in achieving development results in North Macedonia? Scale: 1-10 (1: Not effective at all– 10: Very effective) To what extent does the World Bank Group influence the development agenda in North Macedonia? Scale: 1-10 (1: To no degree at all– 10: To a very significant degree) To what extent do you agree/disagree with the following statements about the World Bank Group’s work in North Macedonia?: Sc ale: 1-10 (1: Strongly disagree – 10: Strongly agree) Q The World Bank Group currently plays a relevant role in development in North Macedonia. The World Bank Group’s work is well aligned with what I consider the development priorities for North Macedonia. *A mean score of the two questions asked in FY19: Overall, please rate your impression of the World Bank Group’s effectiveness in North Macedonia. Scale: 1-10 (1: Not effective at all– 10: Very effective); To what extent does the World Bank Group’s work help to achieve development results in North Macedonia ? Scale: 1-10 (1: To no degree at all– 10: To a very 14 significant degree) Comparison of Key Performance Indicators The mean ratings for Relevance, Alignment, Effectiveness in achieving development results, and Influence in North Macedonia were significantly higher than for those in other IBRD countries surveyed in FY22. The ratings are on par with ECA countries surveyed in FY22 (please refer to the footnote for the country lists). The exception is for Effectiveness in achieving development results, which was significantly lower in North Macedonia than in other ECA countries. 7.4 Relevance 7.4 7.0 7.4 North Macedonia Aligned with 7.4 FY23 Priorities 6.8 ECA FY22* 7.1 Effectiveness in 7.4 achieving results Other IBRD FY22** 7.0 7.3 Influence 7.3 6.7 1 2 3 4 5 6 7 8 9 10 Mean Rating Q *ECA FY'22 included: Bulgaria, Tajikistan, Kosovo Other IBRD, FY'22 included: Angola, Botswana, Eswatini Mauritius, Thailand, Bulgaria, Bolivia, Colombia, Ecuador, Guatemala, Peru, Jordan 15 Overall Ratings for Indicator Questions: Ratings for Government Institutions are the Most Positive Mean Rating 1 2 3 4 5 6 7 8 9 10 Respondents from government institutions gave the highest mean ratings for the aggregated All Stakeholder Groups 7.2 responses to the eighteen Country Opinion Survey (COS) indicator questions, whereas Government Institutions 7.7 respondents from civil society had significantly lower mean ratings (see the chart on the right). Office of a Parliamentarian 7.5 Media 7.3 Collaboration: Respondents who collaborate with the WBG had significantly higher mean Local Government 7.2 ratings for the aggregated responses to the same eighteen indictor questions compared to Office of the President / Prime 7.2 respondents who do not collaborate with the Minister / Minister WBG: Academia 7.2 World Bank collaborators = 7.6; Non-collaborators = 6.8. Bilateral / Multilateral Agency 7.1 Private Sector 6.6 Civil Society Organization 6.6 Mean Ratings for the nineteen COS Indicator Questions by Stakeholder Groups on a Scale from 1 to 10. Q These selected indicators are listed at the end of this report. 16 World Bank Group’s Work and Engagement on the Ground “Through continuous and effective collaboration with central and local government, civil society, and other international organizations, help improve the quality of services, raise standards, and create value in the country.” Local Government Respondent “Creating mechanisms for ongoing social dialogue among the main relevant stakeholders in the country's development processes.” Academia Respondent 17 Greatest Value Financial resources continue to be the most valued activity of the WBG in North Macedonia, along with advisory services in support of policy design / implementation. % of Respondents The rating for the perceived value of the WBG to bring Providing financial resources 64% together different groups of stakeholders has increased in FY23 (28%), from just 8% in FY19. It is particularly valued by Providing advisory services and analytics Significantly more important for respondents from local government (43%) and academia to support design or implementation of 37% the private sector, Office of the policies President /PM/ Minister (44%). Bringing together different stakeholder However, the rating for Capacity building and training* groups to support North Macedonia’s 28% Significantly more important for decreased from 41% in FY19 to 27% in FY23. local government, academia development efforts Regarding the qualitative comments, respondents called for easier access to financing and for more financing for big capital Capacity building and training 27% projects, as well as for direct financing of local organizations and non-governmental organizations (NGOs): Producing research on global development issues 13% “To simplify the procedures for obtaining grants and to reduce interest rates on loans for investments in infrastructure projects.” Local Government Respondent Providing data and statistics 12% “Long-term loans for capital investments with low interest rates.” Respondent from an Office of a Parliamentarian Mobilizing third-party financial resources 12% “To provide grant funds to civil society organizations in local communities (outside of Skopje) that work directly with local authorities. To avoid centralization and allow citizens and local authorities to make their own decisions without imposed ideas.” Local Government Respondent 18 Q When thinking about the World Bank Group’s role in North Macedonia, which activity do you VALUE the most? (Choose no more th an 2) (FY23 N=216) In FY19, the option was “Capacity development related to the WBG -supported projects” The WBG as a Development Partner Mean Level of Agreement 1 2 3 4 5 6 7 8 9 10 8.3 The WBG is seen as a responsive, long-term partner in North Macedonia. Perceptions of the Being a long-term partner* 7.9 institution’s flexibility when circumstances 8.3 change have significantly improved compared to the FY19 results. They are now on par with other ECA countries surveyed in FY'22^. 7.3 Responsiveness to needs 7.2 Perceptions about the WBG as a long-term partner are significantly higher in North Macedonia 6.8 compared to other ECA countries. The improvement in perceptions of responsiveness 7.0 NM FY23 is close to a significance level (p-value = 0.06) and is ECA FY22 Staff accessibility* 7.3 also on par with other ECA countries. NM FY19 7.2 “To continue to be a partner to North Macedonia as it has been until now.” 7.0 Government Institution Respondent Flexibility when circumstances change** 7.1 “Increase employee [WBG staff] availability.” 6.5 Government Institution Respondent * Significantly different between NM FY23 and ECA FY'22 ** Significantly different between NM FY23 and NM FY19 To what extent is the World Bank Group an effective development partner in North Macedonia, in terms Q of each of the following?, Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) ^ ECA FY'22 included: Bulgaria, Tajikistan, Kosovo 19 The WBG Should Collaborate More with the National and Local Governments and the Private Sector A majority of respondents suggest that the WBG % of Respondents should collaborate more with the national government (60%), local government (53%), and the The national government 60% private sector (45%), which is consistent with the Local government 53% FY19 findings. Private sector 45% However, respondents from various stakeholder groups called for more collaboration as well: Civil society 23% “We would welcome stronger collaborative ties with the United Nations.” Regional development banks 18% Bilateral / Multilateral Agency Respondent Academia/think tanks/research institutions 17% “Direct contact with local government and NGOs and other organizations, [including] local civic association[s] (community forums).” Parliament/legislative branch 13% Local Government Respondent Media 13% “Greater and more frequent collaboration with academic institutions” Academia Respondent Other donors and development partners (e.g.EU) 10% “Greater collaboration with NGOs, [the] media, as well as greater Youth organizations 10% control of cooperation with central and local government.” Bilateral organizations 9% Media Respondent North Macedonia’s Central Bank 8% The United Nations (UN) 5% The International Monetary Fund 2% Note: EU = European Union 20 Q Which THREE of the following groups should the WBG collaborate with more in North Macedonia? (Choose no more than 3) (N=216) WBG as a Development Partner: Collaborating with Various Stakeholder Groups 1 2 3 4 5 6 7 8 9 10 The WBG received the highest mean ratings for its Regional development banks 7.3 collaboration with the regional development banks, the national government and the Central Bank of North 7.3 The national/federal government* Macedonia (mean = 7.3), 7.8 North Macedonia’s Central Bank 7.3 The FY23 mean rating for collaborating with the national government has dropped significantly compared to FY19. 7.2 The International Monetary Fund The WBG receives relatively lower ratings for its Bilateral organizations 6.9 collaboration with other key stakeholder groups, particularly local government, civil society, and the private Other donors and development partners (e.g. 6.9 sector. Respondents from bilateral / multilateral agencies EU) 7.1 were the most critical of the WBG’s collaboration with 6.8 The United Nations (UN) various stakeholder groups (mean across all groups = 5.5). Local government 6.6 FY23 “Involvement of relevant stakeholders in decision-making processes. 6.1 Coordination with other donors and with the central government.” Civil society FY19 6.5 Government Institution Respondent 5.9 Private sector 6.4 “More discussions [are needed] with middle management and individuals involved in creating and monitoring sectoral policies, and with those Academia/think tanks/research institutions 5.9 involved in policy coordination.” Media 5.8 Government Institution Respondent Parliament/legislative branch 5.6 Q To what extent is the WBG an effective development partner in North Macedonia, in terms of collaborating with the following groups: (1-Strongly disagree, 10-Strongly agree) 21 WBG as a Development Partner and Collaborator WBG as development partner in collaboration with … 1 2 3 4 5 6 7 8 9 10 Compared to other ECA countries surveyed in FY22**, 7.3 respondents in North Macedonia ranked the WBG The national/federal government* significantly lower on its collaboration with all key 8.0 stakeholder groups. 6.9 Other donors and development partners “Increasing collaboration between the World Bank and local (e.g. EU)* 7.8 governments will increase efficiency and implementation of planned investment projects, … [whereas] local governments, with their support, can contribute to improving the lives of citizens and achieving the planned program. On the other hand, 6.1 Civil society* in addition to local governments, the World Bank should deepen 6.9 [its] collaboration with the private sector, [especially] in terms of greater technical support, advisory services and training, as well NM FY23 as the … simplification of procedures, applications, and access to various programs.” 5.9 ECA22 Private sector* Private Sector Respondent 6.8 * Significantly different between NM FY23 and ECA FY'22 To what extent is the WBG an effective development partner in North Macedonia, in terms of collaborating with the Q following groups: (1-Strongly disagree, 10-Strongly agree) 22 ** ECA FY22 included: Bulgaria, Tajikistan, Kosovo WBG’s Financial Instruments Mean Rating 1 2 3 4 5 6 7 8 9 10 Respondents gave the highest ratings for the WBG’s insistence on accountability through its lending process, as well as for the competitiveness of its 8.0 The World Bank insists on accountability financing conditions. 7.8 through its lending Ratings for the timeliness of its financial support have improved compared to FY19. Indeed, they are significantly higher than in other ECA countries 7.9 surveyed in FY22.** The conditions of the World Bank’s financing are competitive compared to markets. Ratings regarding the ability of the WBG’s financial instruments to meet the needs of North Macedonia have improved significantly compared to FY19, 7.7 although were still significantly lower than those in The World Bank provides financial support in a 6.9 other ECA countries. timely manner.*^ NM FY23 7.4 ECA FY22 NM FY19 7.1 The World Bank’s financial instruments meet 7.4 the needs of North Macedonia* 6.5 * Significantly different between NM FY23 and ECA FY'22 To what extent do you agree/disagree with the following statements about the World Bank Group in North Macedonia? Q Scale: 1-10 (1: Strongly disagree– 10: Strongly agree) ^ In FY'22 and in FY19, the option was “The World Bank Group’s approvals and reviews are done in a timely fashion” 23 ** ECA FY'22 included: Bulgaria, Tajikistan, Kosovo World Bank Group’s Knowledge Work and Activities “The World Bank's competitive advantage is [in its] analytics, and this should be used more and put … [at the] disposal … [of] other development partners…” Bilateral / Multilateral Agency Respondent “Continuous independent research should be conducted, followed by joint action with institutions to take concrete steps in a specific area, using experts who have proven themselves in these fields with real-world experience.” Government Institution Respondent 24 WBG’s Knowledge Work Almost half of the respondents (47%) report using the WBG’s advisory services and analytical work (knowledge work). Responses differed significantly by stakeholder group. Whereas 83% of respondents from the Office of the Use of the WBG’s advisory President, Prime Minister, Minister and 77% of respondents services and analytics from government institutions report using the WBG’s knowledge work, only 15% of respondents from the private sector report using it. Furthermore, just about a quarter of respondents from Civil society, the Office of a 11% Parliamentarian, and Local government report using the WBG’s knowledge work. 47% 42% Yes No Not sure Q Have you used the WBG’s advisory services and analytics in the past? (N=216) 25 WBG’s Knowledge Work (continued) Mean Rating Almost all stakeholder groups, except for civil 1 2 3 4 5 6 7 8 9 10 society, tend to give rather high rankings for the 8.1 quality of the WBG’s knowledge work in North The WBG brings global expertise to North Macedonia as part of its advisory services and Macedonia. They suggest that they will keep using analytical work. the WBG’s advisory services and analytics in the future. 8.0 I anticipate using the WBG's advisory services and analytical work in the future. Ratings in FY23 have improved for comparable questions (please see the chart on the right). They 7.9 I am satisfied with the overall quality of the WBG’s were significantly higher than those in other ECA advisory services and analytical work in North countries surveyed in FY22.** Macedonia. 7.8 The WBG’s advice and recommendations are 7.2 “[The WBG should] include as many local experts as possible in their tailored to North Macedonia’s context*^ 7.1 analyses and research, because only local experts can bring the local context. In order for the services of local experts to be more effective 7.8 and of higher quality, activities need to be linked to specific reforms The WBG’s advisory services and analytical work 7.2 and policies … to be implemented, rather than just analyzed.” are timely.* NM FY23 7.0 Civil Society Respondent The WBG’s advisory services and analytical work 7.6 ECA22 “…Specific policy proposals (instead of general ones)…” include appropriate level of stakeholder 7.1 involvement during preparation* 7.2 Academia Respondent NM FY19 7.4 Contribution to development results 7.4 7.5 * Significantly different between NM FY23 and ECA FY'22 To what extent do you agree/disagree with the following statements? Scale: 1-10 (1: Strongly disagree– 10: Strongly agree) Q How significant a contribution do you believe the World Bank Group's knowledge work and activities make to development results in North Macedonia? Scale: 1-10 (1: Not significant at all– 10: Very significant) ^ In FY19, this option was “Are adaptable to Macedonia’s specific development challenges and country circumstances* 26 ** ECA FY'22 included: Bulgaria, Tajikistan, Kosovo The Future Role of the World Bank Group in North Macedonia “[The WBG should support] radical reforms in education and healthcare, in short, in human capital.” Academia Respondent 27 The WBG Should Take the % of Respondents Human capital (education, health, social Lead in Human Capital, protection) 48% Improving livelihoods 43% Improving Livelihoods, Public financial management 41% Public Financial Capacity of state institutions 40% Management, and Jobs 16% Crisis response 14% Building of Capacity in Social cohesion 13% State Institutions Support domestic resource mobilization 13% When asked about the areas where the WBG should Access to justice systems 10% take a lead among other development partners in Crisis preparedness 9% North Macedonia, respondents identified Human Access to basic services 9% capital, the Improvement of livelihoods, Public Food security 8% financial management, and the Capacity of the state Social safety nets 7% institutions as the key focus areas for the WBG. Security mechanisms 4% Stimulating dialogue to promote peace and 3% stability Conflict resolution mechanisms 3% Reducing gender-based violence 2% Which THREE areas below would benefit most from the World Bank Group playing a leading Q role among international partners in North Macedonia? (Choose no more than 3) (N=216) 28 What the World Bank Group Could Do to Help Increase its Effectiveness in North Macedonia In their responses to the qualitative question about what the WBG could do to help increase its effectiveness in North Macedonia, about 46% of respondents identified a number of areas: 32% commented on the WBG’s operational work; around 14% stressed the importance of collaboration, and 7% commented on the communication aspects of the WBG’s work. Focus areas: Respondents highlighted some of the key focal areas that they consider important for the WBG. These included (i) human capital—particularly support for youth; (ii) public sector governance – including support for long-term planning, public resource management, and anti-corruption; (iii) support for effective institutions – judiciary and government regulators; (iv) support for capital projects and infrastructure building and maintenance; (v) sustainable development, environmental protection and coping with the effects of climate change; (vi) energy, energy efficiency, and water treatment technologies. “Support for the financial functioning of the state, better budgeting, and improvement of systems for education, health, and child protection. Support for the development of human capital and continuous measurement of results and influence on their improvement is the most important work that will provide the foundation for a better state in the future.” Civil Society Respondent “Conditioning of credit loans to North Macedonia with partial/full investment in sustainable projects that are part of a long -term development program, expressed through appropriate indicators of success.” Government Institution Respondent “…Resources should be directed toward public finance and improving many laws in the financial sector. Too many laws, too much overlap, too little integrity. We are a legalistic society, with very bad laws and no code and integrity. Funds must be found for regulators. Not a single regulator in the financial sphere is functioning properly (except maybe the National Bank of Macedonia), and there are no public finances… …A quality business climate [is lac king]… [We cannot have] a fair society without quality, professional, and ethical regulators….” Private Sector Respondent In your opinion, what is the most important thing the World Bank Group could do to help Q increase its effectiveness in North Macedonia? (Please be specific) (N=215) 29 What the World Bank Group Could Do to Help Increase its Effectiveness in North Macedonia (continued) Operations: Respondents stressed the importance of transparency and accountability in WBG-funded projects, calling for acknowledgement of corruption, as well as the need for closer monitoring and evaluation of the results. Respondents welcome more financing (including direct financing), easier access to funds and a reduction in bureaucratic barriers. Some suggested that the Bank should share more data and information about the economy and ecology of the country and ensure the uptake of its knowledge work. “…Deadlines for construction/implementation must be respected, and supervision must be accounted for to prevent corruption an d ensure that the effects of the projects are truly felt. Supervision is a crucial tool that must be appropriately strengthened and supported.” Local Government Respondent “Monitoring the implementation of projects to improve and react in a timely manner when difficulties arise [is important].” Government Institution Respondent “Greater transparency [is needed[ in operations and goals.” Academia Respondent “Implementation of the conclusions and advice arising from the analyses [is important and must be] made. Implementation of pr ojects [should include a role for] … the non-governmental sector in connection with the strategies and policies of the government. [The] involvement of the private and non-governmental sector in the implementation of municipal projects financed by the World Bank [is necessary].” Government Institution Respondent Collaboration and Communication: Responses mainly focused on the need for more effective collaboration with various stakeholder groups as well as effective communication with the media and the public. These responses are for the most part covered in respective sections of this report. In your opinion, what is the most important thing the World Bank Group could do to help Q increase its effectiveness in North Macedonia? (Please be specific) (N=215) 30 Communications and Outreach “Increase media coverage of the projects.” The Office of the President / PM / Minister Respondent “The World Bank should communicate better with the public in Macedonia.” Media Respondent 31 General Information Sources % of Respondents Respondents report using a variety of sources to Social media 61% obtain information about socioeconomic Television (TV) 53% development issues in North Macedonia, but a majority relies on social media (61%) and Research papers / Official 43% television (53%). statistics There were significant differences among Newspapers (Print or online) 39% stakeholder groups. Respondents from e-Newsletters 18% bilateral/multilateral agencies preferred research papers (77%) and newspapers (65%). Other 2% Respondents from academia – preferred research papers (67%) and e-Newsletters (39%). Radio 2% Government institutions (67%), local government (70%), and the private sector (70%) had the Blogs 2% strongest preference for social media. Podcasts 2% How do you get most of your information about economic and social development issues in North Macedonia? Q (Choose no more than 3) (N=216) 32 Preferred WBG Information Sources Respondents report a preference for a variety of % of Respondents channels when it comes to receiving information about the WBG and its work. The WBG website Website 43% and events continue to be most preferred, but other channels are almost of equal importance for some stakeholder groups. Thus, respondents Event/conference/ seminar/workshop (in 42% form bilateral/multilateral agencies and academia person or online) prefer publications (over 50%). Respondents from the private sector and civil society prefer social media (over 52%). Respondents from local e-Newsletters 38% governments prefer direct contacts with the WBG staff (57%). Direct contact with staff (e.g., in person, 36% Interviews and press conferences were mostly virtually, phone, email) important for respondents from the media (54%). “More contacts with the media in the format of organized briefing meetings or initiatives for the development and analysis on Social media (e.g., Facebook, Twitter) 31% [various] topics [is needed].” Media Respondent “More precision, specificity, and directness when answering Publications and other written materials 31% journalist questions, clear explanations of the missing information.” Media Respondent Interviews and press conferences 9% Q How would you prefer to receive information about the World Bank Group and its work? (Choose no more than 3) (N=216) 33 Recent interactions with the WBG A total of 55% of respondents recall hearing or seeing something about the WBG in the last 30 days. Most respondents (45%) report seeing that information on social media channels and on television (40%). Among those who selected “Social media”, most respondents report seeing something on Facebook (81%), followed by LinkedIn (28%). % of Respondents Facebook 81% 81% LinkedIn 28% Instagram 19% 28% YouTube 9% 19% Facebook LinkedIn Instagram Twitter 7% Other 2% Where do you recall seeing or hearing this information? (Check all that apply) (N=119) Q What social media platforms do you recall seeing this information on? (Check all that apply) (FY23 N=54) 34 Topic Recall in the Last 30 days Global economic forecasts (46%) and the WBG’s % of Respondents work or research on energy (30%) were the top WBG global economic forecasts 46% two topics that respondents recalled seeing or WBG work or research on energy 30% hearing about in relation to the WBG in the last 30 days. WBG work or research on human capital 25% WBG work to support North Macedonia’s health system to help mitigate the impact of 24% the COVID-19 pandemic WBG work or research on climate change 24% WBG work to provide debt relief for 15% developing countries WBG work or research on pandemic 14% prevention, preparedness, and response WBG work or research on food insecurity 11% Other 8% WBG work or research on improve gender 5% equity and empowerment of women and girls Q What topics were included in what you saw or heard? (Check all that apply) (N=119) 35 Message Recall and Perceptions of the WBG’s Work Mean Level of Agreement Those respondents who recall seeing or hearing 1 2 3 4 5 6 7 8 9 10 something about the WBG in the last 30 days also tend The WBG supports countries to address the health impacts of the COVID-19 7.9 to give significantly higher rankings to the key areas pandemic and increase vaccination 6.8 of the WBG’s work (see the bar chart on the right). They rates* also report a significantly higher perceived level of The WBG is committed to familiarity with the WBG (mean = 7.4), compared to comprehensive debt solutions that bring 7.8 those who reported not hearing or seeing anything significant benefits to people in poor 6.9 countries* about the WBG recently (mean=6.0). The WBG supports countries to strengthen their human capital through 7.7 Those who collaborate with the WBG, were significantly improving health care, nutrition, 6.8 more likely to recall messages about the WBG (73%) education, jobs, and skills* than those who do not collaborate (27%).There were The WBG supports countries to ensure 7.7 significant differences among stakeholder groups. transition to more diversified and cleaner sources of energy* 6.7 Respondents from civil society, the private sector, and the Office of the President / Prime Minister / The WBG is improving gender equity 7.7 Minister were the least likely to recall messages related and inclusion for women and girls* 6.8 to the WBG (~30% in each of these groups). Heard about the These findings suggest that respondents who are The WBG helps countries boost climate 7.6 WBG in the last resilience and mitigate the effects of more frequently exposed to the information about 6.8 30 days climate challenge* the WBG, or who actively engage with the WBG’s staff and knowledge work (read research papers, The WBG supports countries to help 7.5 Havent heard build stronger health systems that are about the WBG in etc.) are also more likely to hold more positive views 6.5 the last 30 days more resilient to pandemics* about the WBG’s work. The WBG helps address the current food crisis and enables greater 7.2 *denotes significant preparedness to future food security difference 6.5 crises* Do you recall seeing or hearing anything about the WBG in the last 30 days? Q To what extent do you agree with the following statements: Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) 36 Frequency of Engagement Matters for Message Recall Respondents who recall hearing something about the WBG in the last 30 days tend to have more frequent interactions with the institution across all channels, including personal interaction with the WBG staff. They are also more likely to visit the WBG’s website, its social media channels, and/or read a research paper. Both groups are very likely to encounter information about the WBG in the media, both international and local. Do you recall seeing or hearing anything about the WBG in the last 30 days? Yes (N=~111) No (N=~93) Every few days/weeks Every few months Every few days/weeks Every few months Read or heard a story about the World Visited a World Bank website 47% 37% 23% 30% Bank in international media Read or heard a story about the Read or heard a story about the World 46% 31% 22% 36% World Bank in international media Bank in national or local media Read or heard a story about the Read some, or all, of a World Bank 46% 39% 21% 29% World Bank in national or local media research paper or publication Read some, or all, of a World Bank Read a World Bank post / tweet on social 42% 42% 17% 26% research paper or publication media Had an exchange with World Bank 42% 32% Visited a World Bank website 15% 32% staff Read a World Bank post / tweet on 39% 28% Had an exchange with World Bank staff 13% 32% social media Attended a World Bank 22% 48% Read a World Bank e-newsletter 10% 16% event/conference/seminar/workshop Attended a World Bank Read a World Bank e-newsletter 22% 36% 7% 34% event/conference/seminar/workshop Q Over the past SIX MONTHS, on average how often did you do any of the following related to the World Bank Group (WBG)? (N=~204) 37 Sample Demographics 38 Respondent Profile: Affiliation, Specialization, Status Current Affiliation Specialization % of Respondents % of Respondents Finance and markets 15% Government Institution 28% Education 14% Other 8% Local Government Office or Staff 17% Macroeconomics, fiscal management 6% Generalist (specialize in multiple sectors) 6% Private Sector 13% None of the above 6% Social protection, labor policies, jobs 5% Civil Society Organization 11% Environment / Natural resource management 5% Communications, public affairs 5% Academia / Research Institute / Public sector governance, anti-corruption 4% 8% Think Tank Energy / Extractives 3% Law/justice 3% Bilateral or Multilateral Agency 8% Self-identified status Transport 3% Digital development 3% Office of a Parliamentarian 6% Senior level 43% Statistics 3% Mid-level decision-maker Tourism 2% Media / manager 31% 6% Agriculture and food security 2% Mid-level staff 24% Urban development 2% Office of the President / Prime Minister / 3% Gender 2% Minister Junior level 2% Trade 1% Climate change 1% Health 1% Q Which of the following best describes your current affiliation? (Select only 1 response) (N=216) Please identify the primary specialization of your work. (Select only 1 response) (N=214) 39 Respondent Profile: Collaboration with the WBG Collaboration with the WBG Collaboration Institution The World Bank (IBRD) 81% Yes 45% IFC 10% 55% No None of the above, I do not currently collaborate with the 8% World Bank Group MIGA 1% Q Currently, do you professionally collaborate/work with the World Bank Group (IBRD, IFC, MIGA, ICSID) in your country? (N=215) Which of the following agencies of the World Bank Group do you primarily collaborate/work with in North Macedonia? (Select only 1 response) 40 (N=111) Respondent Profile: Demographics Gender Age 26-35 11% Female 47% 36-45 35% 53% Male 46-55 39% 56 and above 14% Location Skopje 70% Outside Skopje 30% What’s your gender? (N=213) Q What’s your age (N=213) 41 Which best represents your geographic location? (N=213) Methodology 42 Methodology From December 2022 to February 2023, a total of 413 stakeholders of the WBG in North Macedonia were invited to provide their opinions on the WBG’s work in the country by participating in a Country Opinion Survey (COS). Participants were drawn from the Office of the President or Prime Minister; the Office of a Minister; the Office of a Parliamentarian, national government institutions; local governments; bilateral / multilateral agencies; the private sector; civil society organizations; academia, research institutes, and think tanks, and the media. A total of 216 stakeholders participated in the survey (52% response rate). Respondents completed the questionnaire via an online platform. Every country that engages in the COS must include specific indicator questions; several of them are aggregated for the World Bank Group’s annual Corporate Scorecard (please refer to the Indicator questions section of this report. 43 Comparison of FY19 and FY23 % of Respondents FY 2019 FY 2023 The results of this year’s Country Survey were High-level government offices: Office of compared to those of the Country Survey conducted the President, Office of Prime Minister, 10% 9% in FY19 (with a response rate of 54%, N=183). Office of a Minister, Office of a member of Parliament / legislative body Comparing responses across Country Surveys reflect Government Institutions: Employee of a changes in attitudes over time, but also changes in Ministry / Ministerial Department / Project respondent samples and changes to the survey Implementation Unit / Independent instrument itself. To reduce the influence of the latter 41% 28% Government Institution (e.g., Central Bank, factor, only those questions with similar response Regulatory or Oversight Agency) / Judiciary scales/options are analyzed. / State-Owned Enterprise The distribution of the stakeholder groups in the final Local government 14% 17% samples for the FY19 and FY23 country surveys are Bilateral/multilateral agency: embassy, listed in the table on the right. diplomatic, military, UN, regional 4% 8% development bank This year’s survey saw an increased outreach to and response from bilateral/multilateral agencies, civil Civil Society Organizations (CSO): NGOs/community-based organizations, society, and the private sector. However, there was a private foundations, faith-based groups, 8% 11% decrease in outreach to and response from the professional/trade associations, and youth government institutions. These differences in the groups; Media stakeholder composition between the two years should Private Sector: private sector be taken into consideration when interpreting the results organizations and financial sector/private 8% 13% of the yearly comparisons and analyses. banks Academia/Research Institute/Think Tank 5% 8% Media 8% 6% Other 2% 0% Total Number of Respondents 182 216 44 Statistical analysis To attribute respondents to different stakeholder groups, Groups n % their self-reported responses to the question “Which of the following best describes your current affiliation?” were used. Office of the President / Prime Minister / Minister 6 3% Breakdowns for individual questions by stakeholder group can be found in the “North Macedonia COS FY23 Office of a Parliamentarian 14 6% Tables with data breakdowns.xlsx” file, which was published in the WBG Microdata Library, along with the survey microdata and this report. Government Institutions: 61 28% Scale bucketing: When mentioning Low, Medium, and High in the scales Local Government 37 17% throughout the report: 1-6 is low, 7-8 is medium, and 9- 10 is high. Bilateral / Multilateral Agency 17 8% Statistical significance: Key statistically significant findings are denoted with an asterisk (*) throughout the report or discussed in the Civil Society Organization 23 11% descriptions to the charts. Significance is measured at p-value < .05 Private Sector 27 13% Academia/Research Institute/Think Tank 18 8% Media 13 6% Total 216 100% 45 Qualitative Analysis Regarding the qualitative part of the questionnaire, respondents were invited to share their thoughts about Summary of the Main Themes the ways in which the WBG could help increase its in Qualitative Comments effectiveness in North Macedonia in the future: Areas for the WBG to focus 46% “In your opinion, what is the most important thing the World Bank Group could do to help increase its Operations 33% effectiveness in North Macedonia? (Please be specific)” Colalboration 14% A total of 125 responses were received. They varied in length from a few words to a few sentences. The Communication 6% comments were broadly grouped into four categories based on their main theme (please see the chart to the right) and summarized in the relevant section “The Future Role of the World Bank Group in North Macedonia”. Individual quotes were used throughout the report in relevant sections to illustrate the quantitative data. 46 Indicator questions A2_5. To what extent do you trust the World Bank Group to do what is right? Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) A3. How effective has the World Bank Group been in achieving development results in North Macedonia? A4. The World Bank Group currently plays a relevant role in development in North Macedonia, Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) A5. The World Bank Group’s work is aligned with what I consider the development priorities for North Macedonia, Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) A6. To what extent does the World Bank Group influence the development agenda in North Macedonia? Scale: 1-10 (1: To no degree at all– 10: To a very significant degree) A7. How significant a contribution do you believe the World Bank Group's knowledge work and activities make to development results in your country?, Scale: 1-10 (1: Not significant at all – 10: Very significant) To what extent is the World Bank Group an effective development partner in North Macedonia, in terms of each of the following? – Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) C2. Responsiveness to needs, C3. Access to WBG staff and experts, C4. Flexibility when circumstances change, C5. Being a long-term partner, To what extent is the WBG an effective development partner in North Macedonia, in terms of collaborating with the following groups: – Scale: 1-10 (1: To no degree at all – 10: To a very significant degree) C7_1.Collaboration with the national government C7_5.Collaboration with the private sector C7_6.Collaboration with civil society C7_7.Collaboration with other donor and development partners C8_1 To what extent do you agree/disagree with the following statement? – The WBG’s financial instruments meet the needs of North Macedonia (i.e., investment lending, Development Policy Loan, Trust Funds), Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) C8_4. To what extent do you agree/disagree with the following statement? – The WBG provides financial support in a timely manner., Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) C10_1.To what extent do you agree/disagree with the following statements about the World Bank Group in North Macedonia? I am satisfied with the quality of the WBG’s advisory services and analytical work in North Macedonia. Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) C10_5.To what extent do you agree/disagree with the following statements about the World Bank Group in North Macedonia? The WBG’s advice and recommendations are tailored to North Macedonia’s context. Scale: 1-10 (1: Strongly disagree – 10: Strongly agree) 47 Note: Corporate Scorecard questions are highlighted RED