Policy Research Working Paper 10565 Identifying Skills Needs in Vietnam The Survey of Detailed Skills Julia Granata Harry Moroz Nga Thi Nguyen Social Protection and Jobs Global Practice September 2023 Policy Research Working Paper 10565 Abstract This paper describes a new survey designed to collect com- occupational crosswalks yields inaccurate results. The prehensive and granular information about required skills Survey of Detailed Skills is among the first surveys to collect and tasks for detailed occupations in Vietnam. The Survey detailed O*NET-type information at the detailed occupa- of Detailed Skills asks workers in Vietnam about their skills tional level in a developing country setting. The collection and tasks for a set of 30 occupations that are in demand of information about detailed skills means that these skills or of strategic importance for economic growth. In doing can be flexibly grouped into different categories (for exam- so, the survey generates practical, detailed information at ple, socioemotional skills, digital skills, routine skills, and the occupation level that policy makers and practitioners interpersonal skills) as needed. The use of a consistent scale can use to inform their efforts to build skills in Vietnam. anchored to the time spent using or performing a skill or The Survey of Detailed Skills makes several contributions. task creates clarity for respondents while also yielding a Most existing efforts to profile occupational skills and tasks measure of skill and task importance that is easily inter- in developing countries draw on data from other countries, preted. The Survey of Detailed Skills requires outlays on most frequently the Occupational Information Network administering the survey, and inclusion of all occupations (O*NET) in the United States. However, recent research in Vietnam with regular updating would require ongoing has shown that translating these data across countries via investment. This paper is a product of the Social Protection and Jobs Global Practice. It is part of a larger effort by the World Bank to provide open access to its research and make a contribution to development policy discussions around the world. Policy Research Working Papers are also posted on the Web at http://www.worldbank.org/prwp. The authors may be contacted at hmoroz@worldbank.org. The Policy Research Working Paper Series disseminates the findings of work in progress to encourage the exchange of ideas about development issues. An objective of the series is to get the findings out quickly, even if the presentations are less than fully polished. The papers carry the names of the authors and should be cited accordingly. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors. They do not necessarily represent the views of the International Bank for Reconstruction and Development/World Bank and its affiliated organizations, or those of the Executive Directors of the World Bank or the governments they represent. Produced by the Research Support Team Identifying Skills Needs in Vietnam: The Survey of Detailed Skills1 Julia Granata, Harry Moroz, and Nga Thi Nguyen 2 The World Bank JEL code: J24, O15, I25 Keywords: Socioemotional skills, digital skills, routine skills, interpersonal skills, remote work, employment, Vietnam, O*NET, PIAAC, STEP 1 We are grateful to the Second Australia-World Bank Group Strategic Partnership (ABP2) in Vietnam for financing part this work. We are grateful to the General Statistics Office and the Ministry of Labor, Invalids, and Social Affairs of Vietnam for their collaboration. The team benefited significantly from inputs, comments, and assistance from Josefina Posadas, Aylin Isik-Dikmelik, Abla Safir, JJ Naddeo, Cristian Camilo Sanin Camargo, Van Cam Nguyen, and Corinne Bernaldez. The team is also grateful to Quang Hong Doan, Jacques Morisset, Lieu Ngoxuan, Shawn W. Tan, Trang Thu Tran, and Judy Yang for their assistance. 2 Authors are available at m.julia.granata@gmail.com, hmoroz@gmail.com, and nnguyen26@worldbank.org. Introduction Skills development is a key component of Vietnam’s future growth, but key elements of the skills development system need to be strengthened. Vietnam’s labor market faces challenges as the continued growth of knowledge-based industries, digitization and automation, an urgent need to facilitate climate-friendly development, and population aging alter the types of skills that are demanded, the speed at which skills demands change, and the workers available to meet these demands. Recent research has highlighted the important role of skills development in Vietnam’s future growth (Cunningham and Pimhidzai 2018). But key elements of Vietnam’s skills development system must be strengthened. One foundational area that recent diagnostic work has revealed as a weakness is Vietnam’s labor market information (Mazza et al. 2019; Moroz, Nguyen, and Chu 2019b; Cunningham and Pimhidzai 2018). Vocational education and training institutions and providers of employment services lack the detailed information on in-demand skills that they need to develop curricula, advise students, and put jobseekers on the path to the right jobs. The Survey of Detailed Skills (SDS) is a first step in filling the gap in information on detailed skills in Vietnam. Efforts in developing countries to profile occupational skills and tasks often draw on data from other countries, most frequently the United States’ Occupational Information Network (O*NET). However, using the O*NET database outside the United States requires the assumption that the occupational characteristics described in O*NET are consistent across countries. Research has shown that this assumption does not hold due to differences in tasks, skills, and production technologies, particularly in low- and middle-income economies (Caunedo, Keller, and Shin 2021; Lewandowski et al. 2021; Lo Bello, Sanchez-Puerta, and Winkler 2019; Alatas, Granata, and Posadas 2020). To avoid this, the SDS draws on O*NET and other proven methodologies and takes a country- specific approach. The SDS asks workers in Vietnam about their tasks and skills for a set of occupations that are either in-demand or that are of strategic importance for economic growth. In doing so, the SDS seeks to generate practical, detailed information at the occupation level that policy makers and practitioners can use to inform their efforts to build skills in Vietnam. This report explains the SDS’s methodology, provides summary results for the 30 occupations targeted by this round of the SDS, and presents an example of a detailed occupational profile for one of these 30 occupations, Nursing Associate Professionals. The SDS has also spurred further investigation of skills in Vietnam, particularly those needed for green jobs (Doan et al. 2023). The SDS makes several contributions. First, the SDS provides a comprehensive but also in-depth portrait of skill, task, and educational requirements for a set of detailed occupations in Vietnam. The SDS is among the first surveys to collect this information at the detailed occupational level in a developing country setting. This is an important step beyond relying on data collected in other (developed) countries. The collection of information about detailed skills means that these skills can be flexibly grouped into different categories (for example, socioemotional skills, digital skills, routine skills, interpersonal skills) as needed. The use of a consistent scale anchored to the time spent using or performing a skill or task yields a measure of skill and task importance that is easily interpreted. The SDS approach also has some advantages over collection of skill and task data via online job vacancy data, which has become common in recent years. In developing country contexts, online vacancy data tends to be biased towards higher-skilled digital-intensive occupations and jobs at firms that use the internet (CSC 2019; World Bank 2021). The SDS avoids this bias by selecting the occupations of interest, including low-skilled jobs, first and using a sampling frame based on Vietnam’s Labor Force Survey. Still, the SDS has some weaknesses. The SDS requires outlays on administering a survey. Initial data collection covered only 30 of the hundreds of occupations in Vietnam. Inclusion of all occupations with regular updating would require ongoing investment. 2 Complementing the SDS with online job vacancy data, which can be collected frequently at relatively low cost, could help achieve sustainability in the longer run. SDS Antecedents The SDS draws on several well-known approaches to examining the skills and task content of occupations, as well as pilot occupational skills surveys undertaken in Vietnam and Indonesia. The SDS is modeled primarily on O*NET, but also draws from the Programme for the International Assessment of Adult Competencies (PIAAC) and the Skills Toward Employability and Productivity (STEP) survey. The current version of the SDS also reflects lessons learned from pilot occupational skills surveys in Vietnam and Indonesia that replicated several O*NET modules. The O*NET content model O*NET is an occupational database that provides quantitative and qualitative information on nearly one thousand occupations in the United States. The O*NET content model is the conceptual framework that organizes the data for each occupation. The model contains six modules that are either job-oriented or worker-oriented at the occupational and cross-occupational levels (Figure 1). For example, the “worker requirements” module contains worker-oriented data on skills, knowledge, and education requirements while the “occupation-specific information” module contains job-oriented data specific to the occupation such as job descriptions, tasks, and technologies and tools used for the job. 3 Figure 1. O*NET Content Model Source: O*NET. 3 For more information on O*NET, see Dierdorff and Norton (2011) and DOL (2018). 3 Data for each module come from a variety of sources. The program pools together existing information in the United States’ labor market information system 4 and collects additional data through 7 specific questionnaires: education and training (6 items), knowledge (32 items), work activities (41 items), work context (57 items), work styles (14 items), abilities (52 items), and skills (35 items). The questionnaires use a set of scales to measure the requirements. Many of them use an importance scale, which goes from 1 (not important) to 5 (extremely important), and a level scale, which goes from 1 (basic) to 7 (sophisticated). To avoid burdening respondents, O*NET mostly uses occupational analysts for questions containing more abstract concepts (i.e., abilities and skills) and occupational experts for occupations for which workers are difficult to find (Fleisher and Tsacoumis 2012; Rivkin, Lewis, and Cox 2001). However, a study comparing skills ratings across a large sample of occupations found minimal differences between ratings provided by job incumbents and those provided by occupational analysts. 5 The O*NET content model is attractive for replication for several reasons. First, the O*NET content model describes occupations at a level of detail not found elsewhere, with the information included ranging from tasks and activities performed to tools and technologies to skills and abilities required to perform a job well. Second, the model has a modular format that allows for replication of individual modules of interest (e.g. on tasks or skills) with the potential to build sophistication as capacity develops. Third, O*NET is a globally recognized database widely used by academics, policy makers, and end users. Finally, O*NET questionnaires are publicly available. PIAAC and STEP The SDS also draws on two other skill measurement efforts the Programme for the International Assessment of Adult Competencies (PIAAC) and the Survey Toward Employability and Productivity (STEP). 6 The OECD carries out PIAAC in more than 40 high-income countries. The World Bank carries out STEP in selected low- and middle-income countries. Both household surveys have a module capturing the frequency of a set of skills used at work to assess the skills the workforce needs to sustain a productive working life. The surveys also assess key information-processing skills (literacy, numeracy, and problem solving). 7 Neither PIAAC nor STEP have been adopted by countries for regular implementation and, although these surveys collect job titles to standardize them into the International Standard Classification of Occupations (ISCO), neither has been used to inform occupational and skills profiling at a disaggregated level. For instance, the STEP database is publicly available at the sub-major group (2-digit ISCO). Therefore, 4 For example, the components on Technology Skills and Tools come from big data analyses, and the Occupational Profiles and Labor Market Information data come from data collected by the Bureau of Labor Statistics. 5 However, analysts were preferred for practical considerations (i.e., time, costs, and convenience ) (Tsacoumis and Van Iddekinge 2006). 6 Two previous international initiatives aimed at measuring adult skills in 22 OECD countries: the International Adult Literacy Survey, carried out between 1994 and 1998, and the Adult Literacy and Life Skills Survey (ALL), carried out between 2003 and 2008. Based on these surveys, UNESCO began the Literacy Assessment and Monitoring Programme in 2003, which aimed to measure the literacy and numeracy skills of youth and adults in developing countries (OECD 2016a). PIAAC and STEP modules are based on the Skills, Technology, and Management Practices survey, which was developed for the U.S. based on the Current Population Survey and the National Adult Literacy Survey. 7 STEP has two surveys: a housheold survey and a firm survey. The household survey includes a direct reading assessment and an indirect (self-reported) assessment of other competencies and job-relevant and behavioral skills (Pierre et al. 2014). The firm module asks about the skills gap that employers perceive at an aggregated occupational level (management, professionals, and technicians and associate professionals). 4 although the initiatives have led to rich academic papers and policy reports, they have not yet proven useful to inform occupational skills profiling, qualification frameworks, curricula, and other decisions about human capital investments. Occupational skills pilots in Vietnam and Indonesia The SDS’s methodology also builds on previous efforts to profile occupations in Vietnam and Indonesia. Both efforts piloted an adaptation of the O*NET content model to gather detailed skills information on in-demand occupations using surveys. In Vietnam, 7 occupations were selected for a survey replicating O*NET’s skills, tasks, and education and experience modules (Moroz, Nguyen, and Chu 2019). The questionnaire asked respondents questions about the importance of the 35 skills in O*NET’s skills module. Questions about a skill’s level of sophistication, which are included in O*NET, were omitted given the correlation between these measures (Handel 2016). The questionnaire also asked about the task and education and experience requirements of each occupation. Respondents included both workers in the selected occupations and “occupation experts” who were individuals with significant knowledge about a given occupation. 8 Workers and occupation experts were identified through capstone contacts given resource constraints. In Indonesia, a pilot (Indotask) adapting similar O*NET modules targeted 51 occupations (Alatas, Granata, and Posadas 2020). The pilot also asked about task requirements, education and experience requirements, and respondent characteristics. Both job incumbents and occupation experts were included as respondents. Respondents were identified through an earlier firm-based survey of occupational demand. A comparison of results between Indotask and O*NET showed significant differences in skills use for comparable occupations. Lessons learned from these pilots are reflected in the design of the SDS, and discussed in the methodology section. Methodology The SDS adapts existing skills surveys to the country context and the objective of obtaining a comprehensive but also detailed picture of occupations in Vietnam. The SDS builds on O*NET in particular, but makes significant adjustments based on country context, lessons learned from the pilots carried out in Vietnam and Indonesia, and a review of other global skills measurement initiatives. The SDS instrument The level of analysis of the SDS is occupations at the 4-digit level as defined in the Vietnam Standard Classification of Occupation (VSCO) handbook. 9 In Vietnam, 4-digit occupations are the most detailed occupational aggregation above the level of job titles. The instrument comprises four modules. The complete survey instrument is available in Appendix 2. Module I. Module I is based on the tasks component of the O*NET Occupation-Specific Information module. For O*NET, a task is the smallest unit of activity with a meaningful outcome. The SDS task module is unique to each occupation surveyed: the instrument includes all tasks listed in the VSCO 8 The O*NET program relies on occupation experts when occupations have low employment, are new or emerging, lack industry data, or are located in remote or difficult-to-access areas. 9 Vietnam created VSCO based on the International Standard Classification of Occupations 2008 (ISCO-08), which is a 4-level hierarchically structured system classifying and aggregating occupational information . Each 4-digit occupation has a description, task statements, and examples of job titles. For more information, see GSO (2008). 5 handbook for the specific occupation. Each occupation has between 4 and 9 tasks, and the majority has 6 or more. The module requests that respondents rate each of the tasks according to the frequency with which they are performed ranging from 1 for “Never” to 7 for “Hourly or more often.” The SDS task module differs from O*NET in two ways. First, the SDS uses task statements from the VSCO handbook rather than from O*NET. Second, the SDS uses a different rating scale. O*NET asks a yes/no question about the relevance of an occupation and about its importance on a 5-point scale ranging from 1 “Not important” to 5 “Extremely important.” The Vietnam and Indonesia pilots found that the relevance and importance scales tended to be subjective and duplicative, and so the SDS replaces these with the question about performance. The pilots also asked respondents to add relevant tasks that were not included in the list generated from the national occupational classification system (that is, VSCO in the case of Vietnam and Klasifikasi Baku Jabatan Indonesia 2014 (KBJI-2014) in the case of Indonesia). Given respondents’ lack of clarity and detail responding to this question, this free text option was found not to be useful either to validate task statements or generate new ones., The SDS drops this option from the instrument. Module II. Module II adapts the skills component of the O*NET Worker Requirement module. For O*NET, skills are the procedures or ways of working given acquired knowledge. Skills can be acquired on the job – in the same occupation or not – or through formal or informal education. The SDS skills module asks detailed questions about 9 types of skills: reading (5 items), writing (3 items), math (4 items), social (6 items), physical (3 items), problem-solving (6 items), technical (6 items), management (4 items), and digital (13 items). The questionnaire also pilots questions related to environmental skills (4 items) and the ability to work from home (1 item). The module requests that respondents rate each of the skills according to the frequency with which they are performed ranging from 1 for “Never” to 7 for “Hourly or more often.” The SDS skills module was redesigned after carefully reviewing O*NET and other skills measurement surveys, particularly PIAAC and STEP, and taking into consideration experience from the Vietnam and Indonesia pilots. The module also reflects issues raised in the literature about the vagueness and complexity of O*NET wording and responses (Handel 2016). Appendix 1 provides a comparison of the O*NET and SDS skills instrument. Several important changes were made. • Additional skills. The SDS instrument includes 56 skills while O*NET includes 35. Changes were made after reviewing the skills concept and the PIAAC and STEP’s skills at work modules, which collect data on 46 and 56 skills, respectively). The SDS instrument adds complexity levels (for example, 4 levels of math), removes or merges highly related skills to prioritize and reduce the number of questions (for example, active listening), and adds skills that are growing in importance due to trends reshaping the skill and task content of work (for example, digital, environmental, and care skills). • Simplified language. O*NET skills concepts may be difficult to understand and interpret for workers not accustomed to thinking in terms of skills taxonomies and concepts. To avoid misinterpretations that could result in measurement error, the Vietnam and Indonesia pilots introduced plain language definitions to each skills definition. However, this substantially increased the length of the survey. Therefore, based on the PIAAC and STEP instruments, the SDS questionnaire switched from using skills definitions to specific questions on how frequently a skill is applied coupled with examples of each of the skills. For example, O*NET’s question on the importance of “Understanding written sentences and paragraphs in work- 6 related documents” was replaced with several questions on reading comprehension including “How often does your job involve reading letters, memos, or e-mails?” • Different rating scale. O*NET uses two rating scales for each skill: the importance scale, ranging from 1 “Not important” to 5 “Extremely important,” and the level scale, ranging from 1 “Basic” to 7 “Sophisticated.” The importance scale is subjective, relying on a respondent’s experience or understanding of the job. The level scale attempts to measure complexity by including anchors or examples, though these are not divided into equal intervals (for example, there is a tendency to have extreme examples for the highest levels of sophistication), do not measure a single concept/skill, require a high level of abstraction (since the examples are not always applicable to the occupation), and are not exclusive. The SDS, instead, uses a rating scale that captures the frequency with which the skill is applied. This provides more clarity to the respondent about how to rank the skill. The SDS also asks about multiple skill levels (for example, simple reading and advanced reading) rather than asking about the level of a skill. This allows for the inclusion of more specific examples. For example, the example provided for basic reading is “reading letters, memos, or e-mails” while the example provided for advanced reading is “reading books, professional journals, or scholarly publications.” Module III. Module III adapts the Education and Training questionnaire of the O*NET Worker Requirement module. The module asks respondents about the qualifications needed to perform the job, including the level of education, related work experience, on-the-job training, and job-related professional certifications. The SDS modifies the Education and Training questionnaire in several ways. The SDS uses the Vietnam’s education classification taxonomy, asks for field of studies required for the job, shortens the length scales used for work experience and training, and removes the question about apprenticeships given their infrequent use in Vietnam. Module IV. Module IV collects demographic information on respondents, including age, gender, education, experience, and type of employer. Targeted occupations The SDS survey selected occupations that are in-demand and/or relevant for the growth of strategic sectors of Vietnam’s economy. While in the long run it would be ideal to survey all occupations in Vietnam, given resource constraints the SDS pilot focused on 30 occupations. . The 30 selected occupations represent 31 percent of 2018 employment. . Occupations selected for the SDS had to meet several selection criteria. • Minimum sample. Occupations had to have a minimum sample of 20 respondents in the latest rounds of the Labor Force Survey (March and September 2021) in Vietnam’s major employment centers (Ha Noi, Ho Chi Minh City, Da Nang, Vinh Phuc, and Dong Nai). • Exclusion of residual occupations. Occupations could not be “residual occupations,” that is, an occupation with “not elsewhere classified” in its title. 10 These occupations tend to have vague descriptions. 10 This is all 4-digit occupations ending in 9. 7 • In-demand. Occupations had to have an employment level above the first quartile and have non-negative 1- and 3-year employment growth. 11 These criteria were relaxed in some cases for occupations considered to be strategic to Vietnam’s economic development. In the VSCO, 111 4-digit occupations met these requirements. To narrow this to the 30 occupations that could be surveyed given resource constraints, several additional criteria were used. • Digital transformation. Vietnam has prioritized digital transformation as one of the pillars of its development strategy for the next 10 years. This digital transformation may impact jobs either by increasing the demand for digital skills within existing jobs or by creating (destroying) jobs as the country adopts new technologies (World Bank 2022). Drawing on research on digital skills in Vietnam, jobs likely to be affected by digital transformation are selected (World Bank 2021; Cunningham, et al. 2022). Education-related occupations that may influence the transfer of digital skills to workers were also selected. • Megatrends. Occupations that may be affected by megatrends influencing Vietnam’s growth trajectory were also included. These megatrends include green growth, the fourth industrial revolution and automation (), and aging (Cunningham and Pimhidzai 2018; World Bank 2021b; Frey and Osborne 2017). • Strategic sectors. Occupations relevant to strategic sectors for economic growth, particularly based on exports, were included. These sectors include electronics, textiles, and, to a lesser extent, machinery. For example, the electronics sector represented 38 percent of Vietnam’s 2019 export basket. 12 The sector’s exports grew 2,363 percent in the last decade (from $4.75B to $117.5B). The Textile sector represented 22 percent of the 2019 export basket, and its exports grew 283 percent in the last decade (from $17.8B to $68.2B). The machinery sector represented 8 percent of the export basket, and its exports grew 529 percent (from $3.85B to $24.2B). Table 1 lists the selected occupations. 11Given data availability, employment indicators were constructed using 2018 as the base year. 12 See Harvard University Growth Lab’s Atlas of Economic Complexity available at https://atlas.cid.harvard.edu/. 8 Table 1. Occupations selected for inclusion in the SDS Growth (%) Code Name Employed Selection criteria 1-year 3-year 2142 Civil engineers 112,731 -8 -11 Green growth 2144 Mechanical engineers 42,451 -8 8 Strategic sector. Automation 2151 Electrical engineers 72,826 11 19 Strategic sector. Green growth 2311 University and higher education teachers 59,519 -6 -19 Digital transformation (skills transfer) 2332 Secondary education teachers 173,954 5 5 Digital transformation (skills transfer) 2411 Accountants and related professionals 563,646 -7 3 Automation 2421 Organizational and management analysts 238,712 2 26 Digital transformation 2431 Advertising and marketing specialist 138,994 -11 11 Digital transformation 2512 Software developers 26,023 19 73 Digital transformation 3113 Electrical engineering technicians 76,935 29 46 Strategic sector. Green growth 3221 Nursing associate professionals 181,126 11 1 Population aging 3313 Accounting associate professionals 208,445 12 8 Automation 5211 Stall and market salespersons 3,863,663 6 2 Digital transformation 5221 Shop owner 32,305 -3 -29 Digital transformation 5223 Shop sales assistants 2,678,116 3 21 Digital transformation 7111 House builders 1,994,563 6 29 Green growth 7212 Welders and flame cutters 448,178 10 30 Automation 7231 Motor vehicle mechanics and repairers 354,800 10 -2 Green growth. Digital transformation 7412 Electrical mechanics and fitters 99,080 19 19 Strategic sector. Automation. Green growth 7543 Product graders and testers 89,528 38 38 Automation 8153 Sewing machine operators 1,444,261 5 31 Automation 8156 Shoemaking and related machine operators 482,780 13 10 Strategic sector. Automation 8183 Packing, bottling, and labeling machine operators 135,667 1 8 Automation 8201 Mechanical machinery assemblers 32,226 4 40 Strategic sector. Automation 8202 Electrical and electronic equipment assemblers 407,966 19 100 Strategic sector. Automation. Green growth 8321 Motorcycle drivers 355,464 2 7 Digital transformation. Automation 8322 Taxi and van drivers 727,132 6 21 Digital transformation. Automation 8332 Heavy truck and lorry drivers 497,271 7 13 Digital transformation. Automation 9313 Building construction laborers 1,308,041 8 47 Automation. Green growth 9333 Freight handlers 509,490 5 8 Automation Source: Authors. 9 Implementation design and sampling frame The SDS implementation design was adjusted to the local context in Vietnam in several ways. • Respondents. The SDS relied only on job incumbents as respondents and did not use occupation experts. O*NET, in contrast, uses occupational analysts to fill in the skills questionnaire given the abstract nature of skills concepts. However, occupational analysts are not widely available in Vietnam. Given the minimal differences in ratings between analysts and incumbents in the United States and between experts and incumbents in the Indonesia pilot and given the fact that the SDS simplified the questionnaire language, job incumbents were used as respondents (Alatas, Granata, and Posadas 2020). 13 Respondents were selected based on their occupation as stated in previous rounds of the Vietnam Labor Force Survey. • Number of respondents. The SDS targeted 20 respondents per occupation. 14 O*NET’s minimum acceptable sample size per occupation is 10, although this varies widely depending on the questionnaire and respondent type. The SDS aimed to have a balanced sample of respondents from the most economically active areas in the country (Ha Noi, Ho Chi Minh City, Da Nang, Vinh Phuc, and Dong Nai). In addition, to address the tendency of female underrepresentation in the previous pilots, the SDS designed a sampling frame in which the share of female respondents approximated the share of employment in the occupation at the national level. • Data collection strategy. The SDS was a supplement to the December 2021 round of Vietnam’s Labor Force Survey, which is administered by Vietnam’s General Statistics Office, which also oversaw collection of the SDS. This created significant administrative and cost benefits because separate survey collection infrastructure did not need to be created. • Sample. Adding the SDS to the Labor Force Survey also permitted the use of the Labor Force Survey’s sampling frame, which includes information about respondents’ occupation at the VSCO 4-digital level. The sampling frame was drawn from the March and September rounds of the Labor Force Survey. In total, 543 workers answered the survey. Out of the 30 occupations selected, 15 had a sample size larger than 20 and only 6 smaller than 10. • Data collection mode. The SDS survey was conducted in-person and through telephone interviews. Due to the COVID-19 pandemic, 67 percent of interviews were conducted in- person and the remainder through phone calls. These delivery methodologies were preferred to a web-based instrument (as in previous pilots) given the availability of a sampling frame and to improve the survey’s ability to capture lower-skilled occupations. 15 13 However, analysts were preferred for practical considerations (i.e., time, costs, and convenience) (Tsacoumis and Van Iddekinge, 2006). 14 For example, the skills data have a sample of 8 analysts across all occupations, while the tasks data have a range of sample sizes from occupations answered by 3 experts to occupations answered by 247 job incumbents. 15 For cost efficiency in the case of Vietnam and because of precautions necessitated by the COVID-19 pandemic in Indonesia, the pilot surveys were carried out using web-based forms. Web-based instruments may not be suitable for collecting data related to low-skilled occupations given the possibility that less-skilled workers have less access to digital technologies and low digital literacy. 10 Results Though limited by the occupations covered, the SDS can offer some general insights into the kinds of skills that are currently in demand in Vietnam. The primary objective of the SDS is to provide detailed profiles of the tasks, skills, and education and experience requirements of specific occupations in Vietnam. The following section includes an example of these profiles. This section summarizes the results of the SDS to provide a general picture of the kind of insights available from the SDS. Importantly, however, these summary results refer to the 30 occupations sampled and so are not representative of Vietnam’s labor market at large. Education. Forty-three percent of occupations require at least a secondary degree but not higher education (Figure 2). These are occupations that are more technical in nature (for example, technicians, assemblers, machine operators, heavy trucks drivers). A third of occupations require less than a secondary degree. These occupations are related to sales (for example, shopkeepers and stall and market salespersons), require operating simple machines (for example, sewing machine operators, motorcycle drivers), or involve performing elementary tasks (for example, building construction laborers, freight handlers). Twenty-three percent of occupations require bachelor’s degree or above. All of these occupations are professional occupations (for example, engineers, teachers, analysts). Still, educational requirements vary significantly within occupational groupings (Figure 3). For example, fairly large shares of Plant and Machine Operators and Assemblers report needing secondary education or vocational training (about 25 percent each), though most report needing only less than secondary education. About a third of occupation require certifications (Figure 2). These occupations are mostly high-skilled (e.g., mechanical engineers, software developers, teachers, associate professionals), although some are semi-skilled machine operators (for example, drivers who need driver’s licenses). Figure 2: Education requirements of the SDS’s 30 occupations Share of occupations with at least half of workers reporting the level of education or certification is required (%) 50% 45% 40% 35% 30% 25% 20% 15% 10% 5% 0% Less than secondary Secondary Bachelors or more Certification Source: SDS. 11 Figure 3: Education requirements of the SDS’s 30 occupations by skill level Share of workers reporting the level of education is required (%) Low Elementary occupations Plant and machine operators and assemblers Mid Craft and related trades workers Service and sales workers Technicians and associate professionals High Professionals 0% 10% 20% 30% 40% 50% 60% 70% 80% 90%100% Less than secondary Secondary Certificate I-II VT Certificate III-IV VT College Bachelors Masters Note: Certificate 1-II VT and Certificate III-IV VT refer to secondary-level vocational training. College refers to tertiary-level vocational training. Source: SDS. Field of study. Engineering, manufacturing, and construction is a cross-cutting field of study important at all skills levels: a third of occupations covered by the SDS require this field (Figure 4). These are mostly engineers (professionals), electrical technicians, and technical craft and related workers (for example, assemblers, repairers, and fitters). In general, field of study requirements depend on the specific field of specialization of the occupation. For example, health and welfare are important to nursing associate professionals and elementary occupations such as freight handlers and construction laborers. However, 20 percent of occupations do not require a field of study. These are mostly less-skilled occupations such as elementary occupations, drivers, and sales workers. Figure 4: Field of study requirements of the SDS’s 30 occupations Share of occupations with at least half of workers reporting the field of study is required (%) None Services Health and welfare Agriculture and veterinary Engineering, manufacturing, and construction Natural science and environmental knowledge Science, mathematics, and computing Social sciences, business, and law Humanities and arts Education 0% 5% 10% 15% 20% 25% 30% 35% Source: SDS. 12 Work experience: The majority of occupations do not require substantial related work experience: 77 percent require up to 1 year of experience while almost all of the remainder require between 1 and 5 years. In general, semi- and low-skilled workers require less than 6 months of related work experience, while most higher-skilled workers require between 1 and 3 years (Figure 5). University and higher education teachers, software developers, and civil engineers are the occupations requiring the most experience (3 or more years). Figure 5: Work experience requirements of the SDS’s 30 occupations by skill level Share of workers reporting the level of work experience is required (%) Low Elementary occupations Plant and machine operators and assemblers Semi Craft and related trades workers Service and sales workers Technicians and associate professionals High Professionals 0% 10% 20% 30% 40% 50% 60% 70% 80% 90%100% Less than 6 months 6 months to 1 year 1 year to 3 years 3 years to 5 years 5 years to 10 years 10 years or more Source: SDS. Digital tools. Most occupations require the use of smartphones (77 percent), while a smaller share (40 percent) require the use of computers (Figure 6). Smartphones are widely used at work across all skill levels except for occupations involved with a production line (for example, machine operators and assemblers) (Figure 7). Computers are used in high-skilled occupations (for example, professionals and technicians and associate professionals). A third of these occupations also require the use of specific software such as AutoCAD for Civil Engineers and MISA accounting software for accountants. 13 Figure 6: Smartphone and computer use requirements of the SDS’s 30 occupations Share of occupations with at least half of workers reporting use of a smartphone or computer is required (%) 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Use smartphone Use computer Source: SDS. Figure 7: Smartphone and computer use requirements of the SDS’s 30 occupations by skill level Share of workers reporting the use of a smartphone, computer, or specialized software is required (%) Low Elementary occupations Plant and machine operators, and assemblers Semi Craft and related trades workers Service and sales workers Technicians and associate professionals High Professionals 0% 20% 40% 60% 80% 100% 120% Specific software is used Smartphone is used Computer is used Source: SDS. Work from home. Given the widespread use of computers in high-skilled occupations, workers in these occupations are also the most likely to be able to work from home if internet and computers are available (Figure 8). University, higher education, and secondary school teachers are the occupations with the largest share of workers saying that their jobs could be effectively carried out from home. 14 Figure 8: Work-from-home potential of the SDS’s 30 occupations by skill level Share of workers reporting being able to work from home given access to a computer and internet connection (%) Low Elementary occupations Plant and machine operators, and assemblers Semi Craft and related trades workers Service and sales workers Technicians and associate professionals High Professionals 0% 10% 20% 30% 40% 50% 60% 70% Source: SDS. Skills. As described in the methodology section, the SDS’s individual skills can be categorized into several summary skills groups. Here, we focus on 9 skill groups representing 45 detailed skills. Most occupations use physical skills frequently (Figure 9). This is true across all skills levels, although lower-skilled occupations tend to use physical skills more frequently (Figure 10g). The importance of the physical skills group is driven by fine-motor skills (using hands and fingers): for more than half of the occupations at least two-thirds of workers say they use fine-motor skills on a daily basis (Figure 11). Mechanical Machinery Assemblers and Nursing associate professional are the occupations that use fine-motor skills the most, while Accounting Associate Professionals and Shop Sales Assistants use it the least. Similarly, more than half of occupations use problem solving skills frequently (Figure 9). The higher the skill level, the more likely workers are to use it on a daily basis (Figure 10e). However, most occupations require workers to use simple problem solving (solving problems that take less than 5 minutes) (Figure 11). For more than half of occupations, more than 60 percent of workers say they use this skill on a daily basis. Social skills, which include many socioemotional skills, are also common, including across skill levels (Figure 9 and Figure 10d). A high percentage of workers in all occupations use the detailed social skill collaboration on a daily basis (Figure 11). For more than half of occupations, 75 percent of workers use the skill on a daily basis. Nursing Associate Professionals and Packing, Bottling, and Labelling Machine Operators are the occupations that use it the most, while Motorcycle Drivers and Stall and Market Salespersons use it the least. About one-third of occupation require math skills to be used frequently with this requirement more common among higher-skilled occupations (Figure 9 and Figure 10c). Only basic math skills are generally required. Half of the occupations have at least two-thirds of workers using simple math (multiplication and division) on a daily basis (Figure 11). Financial math (calculating prices, creating budgets) is the second-most frequently required math skills: half of the occupations have at least 25 15 percent of their workers using financial math on a daily basis. Those that use financial math the most are Stall and Market Salespersons and Motorcycle Drivers. Moderate math (fractions and percentages) is used even less often. The occupations that use it the most are Accountants and Software Developers. Advanced math (algebra, trigonometry, and regressions) is rarely used. The occupation that uses it the most is Secondary Education Teachers (though only 30 percent of workers report using it on a daily basis). Around one-quarter of occupations use digital skills frequently (Figure 9). While digital skills are more commonly required among more highly skilled workers, even low-skilled occupations sometimes require daily use of digital skills (Figure 10i). Conditional on using a computer or a smartphone at work, internet search, spreadsheets, social media, computer writing, and e-mail are the most commonly used individual skills (Figure 11). Technical skills are not widely required (Figure 9). For most occupations (75 percent), few workers (at most a third) use technical skills like designing or adapting equipment or software, installing equipment or software, or maintaining and repairing equipment on a daily basis (Figure 11). Still, some occupations use technical skills such as monitoring equipment or quality control intensively. For example, two-thirds of Product Graders and Testers say they use quality control skills on a daily basis and nearly two-thirds of Welders and Flamecutters report monitoring equipment on a daily basis. Figure 9: Skill group requirements of the SDS’s 30 occupations Share of occupations for which the skills group is in the top 3 skill groups (%) 100% 80% 60% 40% 20% 0% Source: SDS. 16 Figure 10: Skill group requirements of the SDS’s 30 occupations by skill level Share of workers reporting how frequently the skill group is used (%) a. Reading b. Writing c. Math 0 50 100 0 50 100 0 50 100 Professionals High Technicians and associate professionals Service and sales workers Craft and related trades Semi workers Plant and machine operators, and assemblers Low Elementary occupations d. Social e. Problem solving f. Technical 0 50 100 0 50 100 0 50 100 Professionals High Technicians and associate professionals Service and sales workers Craft and related trades Semi workers Plant and machine operators, and assemblers Low Elementary occupations g. Physical h. Management i. Digital 0 50 100 0 50 100 0 50 100 Professionals High Technicians and associate professionals Service and sales workers Craft and related trades Semi workers Plant and machine operators, and assemblers Low Elementary occupations Note: Rarely is never or less than once a month. Sporadically is at least once a week to at least once a month. Daily is every day from once a day to hourly. Source: SDS. 17 Figure 11: Detailed skill requirements of the SDS’s 30 occupations Median and interquartile ranges of share of workers reporting the detailed skill is used daily (%) Note: Digital skills are conditional on a worker reporting the use of a computer or smartphone at work. Source: SDS. 18 Occupation Profiles How to read the profiles Title and description. This section provides a summary of the occupation’s main activities. Tasks. This section lists the tasks performed in the occupation. The figures show the percentage of workers in the occupation who report that they do a task daily, sporadically, and rarely. Comparing occupations on this metric provides an indication of which tasks are more important. Education and experience requirements. This section shows the percentage of workers in the occupation who report that a given level of education, a given field of study, or a certification are required for the occupation. The section also shows the percentage of workers in the occupation who think that work experience of different lengths is needed. Use of digital tools. This section shows the percentage of workers in the occupation who report using computers and smartphones in their jobs. The section also shows the percentage who use specialized software and the percentage who believe that, given access to a computer and internet connection, they could efficiently work from home. General skills. This section summarizes the skills needs of the occupation by grouping individual skills into broader categories. The section shows the percentage of workers in the occupation who report using a given broad skills category daily. Detailed skills. This section provides information about the requirements of the occupation for detailed skills. The section shows the percentage of workers in the occupation who report using a detailed skill daily, sporadically, and rarely. 19 20 21 22 23 24 Conclusion The SDS makes several contributions. First, the SDS provides a comprehensive but also in-depth portrait of skill, task, and educational requirements for a set of detailed occupations in Vietnam. The SDS is among the first surveys to collect this information at the detailed occupational level in a developing country setting. The collection of information about detailed skills means that these skills can be flexibly grouped into different categories (for example, socioemotional skills, digital skills, routine skills, interpersonal skills) as needed. The use of a consistent scale anchored to the time spent using or performing a skill or task yields a measure of skill and task importance that is easily interpreted. The SDS approach also has some advantages over collection of skill and task data via online job vacancy data, which has become common in recent years. In developing country contexts, online vacancy data tends to be biased towards higher-skilled digital-intensive occupations and jobs at firms that use the internet (CSC 2019; World Bank 2021). The SDS avoids this bias by selecting the occupations of interest, including low-skilled jobs, first and using a sampling frame based on Vietnam’s Labor Force Survey. Finally, the information generated can be easily compiled into profiles that can be shared with labor market stakeholders in order to inform career and workplace decisions. Still, the SDS has some weaknesses. The SDS requires outlays on administering a survey, and initial data collection covered only 30 of the hundreds of occupations in Vietnam at single point in time. Ensuring the sustainability of occupational profiling efforts will require ongoing investment. To be useful to students, employers, training institutions, policy makers, and other labor market stakeholders, labor market information must be both comprehensive and updated. This means that the SDS would need to be expanded to eventually cover all occupations in Vietnam. Plans would also need to be made to periodically review occupations already covered by the SDS. These efforts would require investment in survey administration, analysis of data collected, and dissemination of the results. Complementing the SDS with online job vacancy data could help offset some of the costs of frequently updating the occupational information collected by the SDS. Online vacancy data on skills and tasks could help keep occupational profiles fresh in between rounds of data collection, which could likely take place at greater intervals if complemented with online vacancy data. For example, O*NET uses online job postings to identify tools and technologies, to inform task statement taxonomies, and to identify new job titles to update occupational profiles. Incorporating additional data sources into occupational profiles is also important to ensure that a complete picture is created. Labor Force Survey data, firm surveys, consultations with employers and other labor market stakeholders, and many other sources are useful complements to the SDS and online vacancy data. The SDS is thus part of a labor market information ecosystem with the comparative advantage of producing comprehensive, granular information about occupational skills and tasks. 25 References Alatas, Hamidah, Julia Granata, and Josefina Posadas. 2020. “Indonesia’s Occupational Tasks and Skills: From Occupational Employment Demand to Tasks and Skills Requirements.” World Bank, Washington, D.C. Caunedo, J., E. Keller, and Y. Shin. 2021. “Technology and the Task Content of Jobs across the Development Spectrum.” NBER Working Paper 28681, National Bureau of Economic Research, Cambridge, MA. CSC (Critical Skills Monitoring Committee). 2019. Critical Occupations List 2018/2019: Technical Report. Kuala Lumpur: CSC. Cunningham, Wendy and Obert Pimhidzai. 2018. Vietnam’s Future Jobs: Leveraging Mega-Trends for Greater Prosperity. Washington, D.C.: World Bank. Cunningham, Wendy, Harry Moroz, Noël Muller, and Aivin Solatorio. 2022. “The Demand for Digital and Complementary Skills in Southeast Asia.” World Bank, Washington, D.C. Dierdorff, E., and J. Norton. 2011. Summary of Procedures for O*NET Task Updating and New Task Generation. Report created and presented to the National Center for O*NET Development. Doan, Dung, Trang Luu, Nga Thi Nguyen, and Abla Safir. 2023. “Green Jobs: Upskilling and Reskilling Vietnam’s Workforce for a Greener Economy.” World Bank, Washington, D.C. DOL (United States Department of Labor). 2018. “O*NET Data Collection Program: Office of Management and Budget Clearance Package Supporting Statement Part A: Justification.” Washington, DC. Fleisher, Matthew and Suzanne Tsacoumis. 2012b. “O*NET Analyst Occupational Skills Ratings: Procedures Update,” Human Resource Research Organization, Alexandria. Frey, Carl Benedikt and Michael A. Osborne. 2017. “The Future of Employment: How Susceptible Are Jobs to Computerisation?” Technological Forecasting & Social Change 114:254-80. GSO (General Statistics Office). 2008. List of Occupations 2008 . Hanoi: GSO. Handel, Michael J. 2016. “The O*NET content model: strengths and limitations,” Journal of Labour Market Research 49(2):157-76. Harvard’s Growth Lab’s. Atlas of Economic Complexity. Available at https://atlas.cid.harvard.edu/countries/239/export-basket ILO (International Labour Organization). 2012. International Standard Classification of Occupations: ISCO-08. Volume I. Geneva: ILO. Lewandowski, P., A. Park, W. Hardy, and Y. Du. 2021. “Technology, Skills, and Globalization: Explaining International Differences in Routine and Nonroutine Work Using Survey Data. World Bank Economic Review (forthcoming). 26 Lo Bello, S., M. L. Sánchez-Puerta, and H. Winkler. 2019. “From Ghana to America: The Skill Content of Jobs and Economic Development.” World Bank Policy Research Working Paper 8758, World Bank, Washington, D.C. Mazza, Jacqueline, Wendy Cunningham, Nga Thi Nguyen, and Audrey Stienon. 2019. “Functional Review of Employment Services Centers in Vietnam: Analysis and Recommendations.” World Bank, Washington, D.C. Moroz, Harry, Nga Thi Nguyen, and JJ Naddeo. 2021. “Digital Skills in a Digitizing Vietnam: Assessing the Demand for Digital Skills in Vietnam.” World Bank, Washington, D.C. Moroz, Harry, Nga Thi Nguyen, and Lan Chu. 2019. “Skills Profiling of Priority Occupations in Vietnam.” World Bank, Washington, D.C. Moroz, Harry, Nga Thi Nguyen, and Lan Chu. 2019b. “Using Targeted Labor Market Information Tools To Improve Employment Services in Vietnam.” World Bank, Washington, D.C. OECD. 2016. The Survey of Adult Skills: Reader’s Companion. Second Edition. OECD Skills Studies. Paris: OECD Publishing. http://dx.doi.org/10.1787/9789264258075-en Peterson, N.G., M.D. Mumford, W.C. Borman, P.R. Jeanneret, and E.A. Fleishman (Eds.). 1999. An Occupational Information System for the 21st Century: The Development of O*NET. American Psychological Association. https://doi.org/10.1037/10313-000 Pierre, G., M.L. Sanchez Puerta, A. Valerio, and T. Rajadel. 2014. STEP Skills Measurement Surveys Innovative Tools for Assessing Skills. Social Protection and Labor Discussion Paper no. 1421. Washington, DC: World Bank. Rivkin, D., P. Lewis, and S. Cox. 2001. Pilot Test Results: Testing Subject Matter Expert Methodology for Collecting Occupational Information for O*NET. O*NET Center. Tsacoumis, S., and C.H. Van Iddekinge. 2006. A comparison of Incumbent and Analyst Ratings of O*NET Skills. HumRRO. World Bank. 2022. “The Impact of Digital Transformation on Outputs and Labor in Vietnam.” World Bank, Washington, D.C. World Bank. 2021. Indonesia’s Online Vacancy Outlook 2020. Technical Report: from online job postings to market intelligence. Washington, DC. World Bank. 2021b. Vietnam: Adapting to an Aging Society. Washington, D.C.: World Bank. 27 Appendix 1: Comparison between O*NET Skills module and SDS questions. The following table shows the difference between O*NET’s skills module and the SDS questionnaire. The row colors indicate the difference between the two instruments: blank indicates that O*NET and SDS are the same; grey that the skill is included in O*NET but not in SDS; green that the SDS question is slightly different from the O*NET question or that it is included under a different skill group; yellow that the SDS merged two distinct O*NET concepts; blue that the SDS added complexity levels to the skills; and red that the SDS included questions that are not included in O*NET’s skills module. ONET skills O*NET definition SDS Question SDS Skills Notes SDS skills taxonomy taxonomy "How important is …" "How often does your job involve… typology BASIC Reading Understanding written reading letters, memos, e-mails, SDS captures Reading simple content Cognitive Comprehension sentences and paragraphs in newspapers, or magazines? different work-related documents. complexity reading books, professional journals, or levels included Reading advanced content Cognitive scholarly publications? in PIAAC and STEP. reading instruction or operating Reading technical Cognitive manuals? reading bills, invoices, bank statements, Reading financial Cognitive or other financial statements? What is the longest document that you Reading length Cognitive normally read at work? Active Listening Giving full attention to what Not included in other people are saying, taking SDS nor in time to understand the points PIAAC or STEP. being made, asking questions as appropriate, and not interrupting at inappropriate times. Writing Communicating effectively in writing letters, memos, or e-mails? SDS captures Writing simple content Cognitive writing as appropriate for the filling out bills, invoices, bank statements, different Writing financial Cognitive needs of the audience. or other financial statements? complexity levels included What is the longest document that you in PIAAC and Writing length Cognitive normally write? STEP. Speaking Talking to others to convey Highly related to Speaking Cognitive information effectively. social skills questions. 28 ONET skills O*NET definition SDS Question SDS Skills Notes SDS skills taxonomy taxonomy "How important is …" "How often does your job involve… typology Mathematics Using mathematics to solve using simple math, such as multiplication SDS captures Math simple Cognitive problems. or divisions? different calculating prices, costs or budgets? complexity Math financial Cognitive levels included using or calculating fractions, decimals or Math moderate Cognitive in PIAAC and percentages? STEP. using more advanced math, such as Math advanced Cognitive algebra, trigonometry, regression techniques, etc.? Science Using scientific rules and Not included in methods to solve problems. SDS nor in PIAAC or STEP. Critical Thinking Using logic and reasoning to Highly related to identify the strengths and problem-solving weaknesses of alternative skills questions. solutions, conclusions or approaches to problems. Active Learning Understanding the learning new things? Included in Active learning Cognitive implications of new STEP. information for both current and future problem-solving and decision-making. Learning Selecting and using Not included in Strategies training/instructional SDS nor in methods and procedures PIAAC or STEP. appropriate for the situation when learning or teaching new things. Monitoring Monitoring/assessing Highly related to performance of yourself, other resources individuals, or organizations to management make improvements or take skills questions. corrective action. SOCIAL Social Being aware of others' Not included in Perceptiveness reactions and understanding SDS nor in why they react as they do. PIAAC or STEP. Coordination Adjusting actions in relation to coordinating, co-operating, or Coordination Socioemoti others' actions. collaborating with co-workers? onal 29 ONET skills O*NET definition SDS Question SDS Skills Notes SDS skills taxonomy taxonomy "How important is …" "How often does your job involve… typology Persuasion Persuading others to change persuading or influencing people? (for Persuasion Socioemoti their minds or behavior. example, selling a product, convincing a onal co-worker to change their mind) Negotiation Bringing others together and negotiating with people either inside or Negotiation Socioemoti trying to reconcile differences. outside your firm or organization? onal Instructing Teaching others how to do instructing, training or teaching people, Instruction and training Socioemoti something. individually or in groups? onal Service Actively looking for ways to communicating with people outside the SDS question is Service orientation Socioemoti Orientation help people. organization? (for example, with slightly different. onal customers, the public, government, etc.) assisting and caring for others (for Under O*NET Providing care Socioemoti example, providing personal assistance, Generalized onal medical attention, or emotional support Work Activities to customers or patients)? module. Not included in PIAAC or STEP. PHYSICAL performing physical activities that Under O*NET Gross-motor skills Physical require considerable use of your body, Generalized such as climbing, lifting, balancing, Work Activities walking, stooping, and handling module. Similar materials? question in PIAAC and STEP. operating/driving vehicles such as a car, Under O*NET Driving Physical truck, forklifts, motorbike, three-wheeler, Generalized aircraft, or watercraft? Work Activities module. Similar question in STEP. using skill or accuracy with your hands Under O*NET Fine-motor skills Physical or fingers? Abilities module. Similar question in PIAAC. PROBLEM- SOLVING 30 ONET skills O*NET definition SDS Question SDS Skills Notes SDS skills taxonomy taxonomy "How important is …" "How often does your job involve… typology simple problems that require at least 5 Similar to O*NET Simple Problem-Solving Cognitive minutes to find a good solution? troubleshooting question included under technical skills. Complex Identifying complex problems complex problems that require at least Complex Problem-Solving Cognitive Problem-Solving and reviewing related 30 minutes to find a good solution? information to develop and evaluate options and implement solutions. making decisions where you have to O*NET Judgement and Decision Cognitive consider the relative costs and benefits of judgement and making potential actions? decision-making question under Systems skills. thinking creatively to design, develop, or Under O*NET Thinking creatively Cognitive create new things or ideas? Generalized Work Activities module. Not included in PIAAC or STEP. doing short repetitive tasks? Under O*NET Repetitive Cognitive Work Context module. Included in STEP. TECHNICAL Analyzing needs and product designing or adapting equipment, SDS merged Designing and adapting Technical Operations requirements to create a machines, or software to serve user O*NET unique equipment or software Analysis design. needs? skills. Not in Generating or adapting PIAAC or STEP. Technology equipment and technology to Design serve user needs. Equipment Determining the kind of tools Highly related to Selection and equipment needed to do a managing job. material resources. Not included in PIAAC or STEP. 31 ONET skills O*NET definition SDS Question SDS Skills Notes SDS skills taxonomy taxonomy "How important is …" "How often does your job involve… typology Installation Installing equipment, installing equipment, machines, or Installing equipment or Technical machines, wiring, or programs software to make sure they are working software to meet specifications. properly? Programming Writing computer programs SDS included for various purposes. this question under digital skills sub- module. Operation Watching gauges, dials, or monitoring equipment, machine, or Monitoring equipment or Technical Monitoring other indicators to make sure software to make sure they are working software a machine is working properly. properly? Operation and Controlling operations of operating equipment or machines (other Operating equipment Technical Control equipment or systems. than computers and vehicles)? Equipment Performing routine maintain or repair equipment, machines, SDS merged Maintenance and repair Technical Maintenance maintenance on equipment or software? O*NET unique and determining when and skills. Not what kind of maintenance is included in needed. PIAAC or STEP. Repairing Repairing machines or systems using the needed tools. Troubleshooting Determining causes of SDS included a operating errors and deciding similar question what to do about it. under the problem-solving questions. Quality Control Conducting tests and conducting quality control on products, Quality control Technical Analysis inspections of products, services, or processes? services, or processes to evaluate quality or performance. SYSTEMS Judgment and Considering the relative costs SDS included Decision Making and benefits of potential this question actions to choose the most under the appropriate one. problem-solving questions. 32 ONET skills O*NET definition SDS Question SDS Skills Notes SDS skills taxonomy taxonomy "How important is …" "How often does your job involve… typology Systems Determining how a system Highly related to Analysis should work and how changes problem-solving in conditions, operations, and questions. Not the environment will affect included in outcomes. PIAAC or STEP. Systems Identifying measures or Highly related to Evaluation indicators of system problem-solving performance and the actions questions. Not needed to improve or correct included in performance, relative to the PIAAC or STEP. goals of the system. RESOURCE MANAGEMENT Time Managing one's own time and developing specific goals and plans to SDS question is Time Management Cognitive Management the time of others. prioritize, organize, and accomplish your related to work? (rather than following fixed worker's time procedures or instructions) only. Managing the time of other is included under people management question. Determining how money will determining how money will be spent to Management of Financial Cognitive Management of be spent to get the work done, get the work done? Resources Financial and accounting for these Resources expenditures. Management of Obtaining and seeing to the managing material resources such as Management of Material Cognitive Material appropriate use of equipment, equipment, facilities, and materials Resources Resources facilities, and materials needed needed to get the work done? to do certain work. Management of Motivating, developing, and planning the activities of others and/or Management of Personnel Socioemoti Personnel directing people as they work, managing people? Resources onal Resources identifying the best people for the job. As part of your job, how many employees SDS added this Management of Personnel Socioemoti do you supervise? question to Resources onal understand level of complexity. 33 ONET skills O*NET definition SDS Question SDS Skills Notes SDS skills taxonomy taxonomy "How important is …" "How often does your job involve… typology Do you use a computer in your job? Under O*NET Computer use Digital Generalized Work Activities. Included in PIAAC and STEP. Do you use a mobile phone or Not in O*NET. Smartphone use Digital smartphone in your job? Included in STEP. using email? Under O*NET E-mail Digital Work Context module. Included in PIAAC and STEP. using the internet in order to better Not in O*NET. Internet search Digital understand issues related to your work? Included in PIAAC and STEP. conducting transactions on the internet, Not in O*NET. Internet transactions Digital for example buying or selling products or Included in services, or banking? PIAAC. using a word processor, for example Not in O*NET. Writing on a computer Digital Word? Included in PIAAC and STEP. using spreadsheet software, for example Not in O*NET. Using spreadsheets Digital Excel? Included in PIAAC and STEP. using advanced formulas in spreadsheets Not in O*NET. Using advanced Digital (such as if conditions, vlookups, pivot Included in spreadsheet formulas tables, macros)? STEP. using presentation software, for example Not in O*NET. Using presentation Digital PowerPoint? Included in software STEP. using a programming language to Under O*NET Using a programming Digital program or write computer code, for technical skills. language example, Python, R, C++? Included in PIAAC and STEP. using social media applications, for Not in O*NET. Social media Digital example Instagram, Facebook, twitter? Not included in PIAAC or STEP. 34 ONET skills O*NET definition SDS Question SDS Skills Notes SDS skills taxonomy taxonomy "How important is …" "How often does your job involve… typology participating in real-time discussions on Not in O*NET. Digital communication Digital the internet, for example online Included in conferences, or chat groups? PIAAC. Do you usually use any other specific SDS added this Software Digital software? question to understand level of complexity. Included in STEP. monitoring and optimizing the use of Not in O*NET Energy use and efficiency Environme energy such as electricity, heat, and fuel? nor PIAAC not ntal STEP. reducing the creation of waste and Not in O*NET Minimizing waste and Environme materials and/or conserving natural nor PIAAC not Natural resource ntal resources (for example, by recycling or STEP. conservation reusing waste/materials, optimizing the use of inputs, monitoring water usage, and protecting ecosystems)? researching, applying, or communicating Not in O*NET Environmental knowledge Environme environmental knowledge, plans, or nor PIAAC not ntal technologies (for example, by developing STEP. a process or technology that reduces environmental impact or teaching or increasing public awareness of environmental issues)? Producing renewable energy or Not in O*NET Environmental production Environme environmentally-friendly outputs (for nor PIAAC not ntal example, building renewable energy STEP. equipment, running renewable energy production facilities, or engaging in agriculture, forestry, or aquaculture using sustainable practices) WORK FROM Assuming that you have access to a Not in O*NET Working from home Work from HOME computer and internet connection, how nor PIAAC not home frequently would you be able to STEP. efficiently perform your job from your home? 35 Appendix 2: The Survey Instrument Survey of Detailed Skills 2021 INTRODUCTION FOR JOB INCUMBENTS: The survey is being conducted by the General Statistics Office on behalf of the World Bank. The purpose of this questionnaire is to create an accurate description of your job as a [OCCUPATION TITLE] for a project that the World Bank is undertaking about working in Vietnam. Because you know your duties, responsibilities, and skills better than anyone else, we need your help to create this description. The questionnaire only asks what your job requires you to do. The questionnaire does not ask about your job performance. Please complete this questionnaire as honestly, completely, and accurately as you can. Base your answers on what you normally do in your current job, not on special projects or temporary assignments unless they are a regular part of the job. When answering the questions, imagine you are describing what you do to a neighbor, friend, or someone just hired for your position. Your responses are anonymous. All responses will be kept confidential. If you have any questions or comments, please contact our survey information center at XXXX. We appreciate your active participation in this important study. FOR OCCUPATION EXPERTS: The survey is being conducted by the General Statistics Office on behalf of the World Bank. The purpose of this questionnaire is to create an accurate description of work as a [OCCUPATION TITLE] for a project that the World Bank is undertaking about working in Vietnam. Because you are familiar with the duties, responsibilities, and skills of a [OCCUPATION TITLE], we need your help to create this description. Please complete this questionnaire as honestly, completely, and accurately as you can. Base your answers on what is normally done in this job, not on special projects or temporary assignments unless they are a regular part of the job. When answering the questions, imagine you are describing the job to a neighbor, friend, or someone just hired for the position. Your responses are anonymous. All responses will be kept confidential. If you have any questions or comments, please contact our survey information center at XXXX. We appreciate your active participation in this important study. 36 0. Main Job [JOB INCUMBENTS ONLY] 0.1 In the last 30 days, did you do any work for at least 1 hour to receive a salary or wage, engage in any productive or business activities to generate income, or do any unpaid work to generate family income? 1 YES 2 NO [STOP SURVEY] 0.2 In your main job/business, what kind of work do you do? 1 Main tasks and duties 2 ISCO code [STOP SURVEY IF MAIN JOB IS NOT RELATED TO 4-DIGIT OCCUPATION] 0.3 What is the main activity of the business or establishment where you worked? 1 Name of establishment (if any) 2 Main activity, goods, or services 3 ISIC code 0.4 How many people including you are there in the business or establishment? 1 1 person 2 2-4 persons 3 5-9 persons 4 10-19 persons 5 20-49 persons 6 50 persons and above 37 A. Tasks Performed on the Job FOR JOB INCUMBENTS: This part of the questionnaire presents a list of tasks. A task is an action or set of actions performed together to accomplish an objective. Please listen carefully to each task and rate how frequently you perform the task in your current job. Ask yourself “How often do I perform this task in my job?” The responses provide different time periods like “Hourly or more often” and “Once per year or less often” and range from less frequent to more frequent. Select “Never” if you never undertake the task at work. FOR OCCUPATION EXPERTS: This part of the questionnaire presents a list of tasks. A task is an action or set of actions performed together to accomplish an objective. Please listen carefully to each task and rate how frequently the task is performed in work as a [OCCUPATION TITLE]. The responses provide different time periods like “Hourly or more often” and “Once per year or less often” and range from less frequent to more frequent. Select “Never” if the task is never undertaken in work as a [OCCUPATION TITLE]. FOR JOB INCUMBENTS: How often do you perform Less the following tasks? At least At least Several Hourly than Once Never once a once a times a or more once a a day FOR OCCUPATION month week day often month EXPERTS: How often are the following tasks performed? A.1 Task statement 1… 1 2 3 4 5 6 7 A.2 Task statement 2… 1 2 3 4 5 6 7 A.X Task statement X… 1 2 3 4 5 6 7 38 B. Skills Used at Work FOR JOB INCUMBENTS: This part of the questionnaire asks about the skills you use in your job. A skill is the ability to perform a task well. Please listen carefully to each question and rate how frequently you use the skill in your current job. Ask yourself “How often do I use this skill in my job?” The responses provide different time periods such as “Hourly or more often” and “Once per year or less often” and range from less frequent to more frequent. Select “Never” if you never use the skill in your job. FOR OCCUPATION EXPERTS: This part of the questionnaire asks about the skills used in work as a [OCCUPATION TITLE]. A skill is the ability to perform a task well. Please listen carefully to each question and rate how frequently the skill is used in this job. The responses provide different time periods such as “Hourly or more often” and “Once per year or less often” and range from less frequent to more frequent. Select “Never” if the task is never undertaken in work as a [OCCUPATION TITLE]. 39 1. READING Frequency Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day involve… Never FOR OCCUPATION EXPERTS: How often does the job involve… B.1.1 reading letters, memos, e-mails, newspapers, or 1 2 3 4 5 6 7 magazines? B.1.2 reading books, professional journals, or scholarly 1 2 3 4 5 6 7 publications? B.1.3 reading instruction or operating manuals? 1 2 3 4 5 6 7 B.1.4 reading bills, invoices, bank statements, or other 1 2 3 4 5 6 7 financial statements? B.1.5 What is the longest document normally read at work? 1 DO NOT READ AT WORK 2 ONE PAGE OR LESS 3 2 TO 5 PAGES 4 6 TO 10 PAGES 5 11 TO 25 PAGES 6 MORE THAN 25 PAGES 40 2. WRITING Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day Never involve… FOR OCCUPATION EXPERTS: How often does the job involve… B.2.1 writing letters, memos, or e-mails? 1 2 3 4 5 6 7 B.2.2 filling out bills, invoices, bank statements, or 1 2 3 4 5 6 7 other financial statements? B.2.3 What is the longest document normally written at work? 1 DO NOT WRITE AT WORK 2 ONE PAGE OR LESS 3 2 TO 5 PAGES 4 6 TO 10 PAGES 5 11 TO 25 PAGES 6 MORE THAN 25 PAGES 41 3. MATH Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day Never involve… FOR OCCUPATION EXPERTS: How often does the job involve… B.3.1 using simple math, such as multiplication or 1 2 3 4 5 6 7 division? B.3.2 calculating prices, costs, or budgets? 1 2 3 4 5 6 7 B.3.3 using or calculating fractions, decimals, or 1 2 3 4 5 6 7 percentages? B.3.4 using more advanced math, such as algebra, 1 2 3 4 5 6 7 trigonometry, or regression techniques? 42 4. ACTIVE LEARNING Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day Never involve… FOR OCCUPATION EXPERTS: How often does the job involve… B.4.1 learning new things? 1 2 3 4 5 6 7 43 5. SOCIAL Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day Never involve… FOR OCCUPATION EXPERTS: How often does the job involve… B.5.1 coordinating, co-operating, or collaborating with 1 2 3 4 5 6 7 co-workers? B.5.2 persuading or influencing people (for example, selling a product or convincing a co-worker to change 1 2 3 4 5 6 7 their mind)? B.5.3 negotiating with people either inside or outside of 1 2 3 4 5 6 7 your firm or organization? B.5.4 instructing, training, or teaching people, either 1 2 3 4 5 6 7 individually or in groups? B.5.5 communicating with people outside the organization (for example, with customers, the public, 1 2 3 4 5 6 7 or government)? B.5.6 assisting and caring for others (for example, providing personal assistance, medical attention, or 1 2 3 4 5 6 7 emotional support to customers or patients)? 44 6. PHYSICAL Frequency Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day involve… Never FOR OCCUPATION EXPERTS: How often does the job involve… B.6.1 performing physical activities that require considerable use of your body, such as climbing, 1 2 3 4 5 6 7 lifting, balancing, walking, stooping, and handling materials? B.6.2 operating/driving vehicles such as a car, truck, forklifts, motorbike, three-wheeler, aircraft, or 1 2 3 4 5 6 7 watercraft? B.6.3 using skill or accuracy with your hands or 1 2 3 4 5 6 7 fingers? 45 7. PROBLEM-SOLVING Frequency Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day involve… Never FOR OCCUPATION EXPERTS: How often does the job involve… B.7.1 solving simple problems that require at least 5 1 2 3 4 5 6 7 minutes to find a good solution? B.7.2 solving complex problems that require at least 1 2 3 4 5 6 7 30 minutes to find a good solution? B.7.3 making decisions where you have to consider the relative costs and benefits of potential 1 2 3 4 5 6 7 actions? B.7.4 thinking creatively to design, develop, or create 1 2 3 4 5 6 7 new things or ideas? B.7.5 doing short repetitive tasks? 1 2 3 4 5 6 7 46 8. TECHNICAL Frequency Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day involve… Never FOR OCCUPATION EXPERTS: How often does the job involve… B.8.1 designing or adapting equipment, machines, or 1 2 3 4 5 6 7 software to serve user needs? B.8.2 installing equipment, machines, or software to 1 2 3 4 5 6 7 meet specifications? B.8.3 operating equipment or machines (other than 1 2 3 4 5 6 7 computers and vehicles)? B.8.4 monitoring equipment, machines, or software 1 2 3 4 5 6 7 to make sure they are working properly? B.8.5 maintain or repair equipment, machines, or 1 2 3 4 5 6 7 software? B.8.6 conducting quality control on products, 1 2 3 4 5 6 7 services, or processes? 47 9. RESOURCE MANAGEMENT Frequency Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day involve… Never FOR OCCUPATION EXPERTS: How often does the job involve… B.9.1 developing specific goals and plans to prioritize, organize, and accomplish YOUR work (rather 1 2 3 4 5 6 7 than following fixed procedures or instructions)? B.9.2 determining how money will be spent to get the 1 2 3 4 5 6 7 work done? B.9.3 managing material resources such as equipment, facilities, and materials to get the 1 2 3 4 5 6 7 work done? B.9.4 planning the activities of others and/or 1 2 3 4 5 6 7 managing people? B.9.5 As part of your job, how many employees do you supervise? [JOB INCUMBENTS ONLY] NUMERIC 48 10. DIGITAL SKILLS B.10.1 FOR JOB INCUMBENTS: Do you use a computer in your job? FOR OCCUPATION EXPERTS: Is a computer used in this job? 1 YES 2 NO B.10.2 FOR JOB INCUMBENTS: Do you use a mobile phone or smartphone in your job? FOR OCCUPATION EXPERTS: Is a mobile phone or smartphone used in this job? 1 YES 2 NO [If B.10.1=2, B.11] Frequency Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day involve… Never FOR OCCUPATION EXPERTS: How often does the job involve… B.10.3 using email? 1 2 3 4 5 6 7 B.10.4 using the internet to better understand issues 1 2 3 4 5 6 7 related to your work? B.10.5 conducting transactions on the internet (for example buying or selling products or 1 2 3 4 5 6 7 services, or banking)? [If B.10.1=2 & B.10.2=1, B.10.11] B.10.6 using a word processor, for example Word? 1 2 3 4 5 6 7 B.10.7 using spreadsheet software, for example 1 2 3 4 5 6 7 Excel? B.10.8 using advanced formulas in spreadsheets (for example, IF conditions, vlookups, pivot tables, 1 2 3 4 5 6 7 macros)? B.10.9 using presentation software (for example, 1 2 3 4 5 6 7 PowerPoint)? B.10.10 using a programming language to program or write computer code (for example, Python, R, 1 2 3 4 5 6 7 C++)? B.10.11 using social media applications (for example, 1 2 3 4 5 6 7 Instagram, Facebook, Twitter)? B.10.12 participating in real-time discussions on the internet, for example online conferences, or 1 2 3 4 5 6 7 chat groups? [If B.10.1=2 & B.10.2=1, B.11] 49 B.10.13 FOR JOB INCUMBENTS: Do you usually use any other specific software? FOR OCCUPATION EXPERTS: Is any other specific software usually used? Free text 50 11. ENVIRONMENTAL Frequency Less than once a month At least once a month Hourly or more often At least once a week Several times a day FOR JOB INCUMBENTS: How often does your job Once a day involve… Never FOR OCCUPATION EXPERTS: How often does the job involve… B.11.1 monitoring and optimizing the use of energy 1 2 3 4 5 6 7 such as electricity, heat, and fuel? B.11.2 reducing the creation of waste and materials and/or conserving natural resources (for example, by recycling or reusing 1 2 3 4 5 6 7 waste/materials, optimizing the use of inputs, monitoring water usage, and protecting ecosystems)? B.11.3 researching, applying, or communicating environmental knowledge, plans, or technologies (for example, by developing a process or technology that reduces 1 2 3 4 5 6 7 environmental impact or teaching or increasing public awareness of environmental issues)? B.1.4 Producing renewable energy or environmentally-friendly outputs (for example, building renewable energy equipment, running renewable energy 1 2 3 4 5 6 7 production facilities , or engaging in agriculture, forestry, or aquaculture using sustainable practices) 51 12. WORK FROM HOME Frequency Less than once a month At least once a month At least once a week Every day Considering all of your responses so far… Never B.12.1 FOR JOB INCUMBENTS: Assuming that you have access to a computer and internet connection, how frequently would you be able to efficiently perform your job from your home? 1 2 3 4 5 FOR OCCUPATION EXPERTS: Assuming that a worker has access to a computer and internet connection, how frequently could this job be performed from home efficiently? 52 C. Required Education and Experience FOR JOB INCUMBENTS: This part of the questionnaire asks about the education and experience requirements for your current job. Please listen carefully to each question. Consider the job, not your personal experience, and answer based on the job as it currently exists. FOR OCCUPATION EXPERTS: This part of the questionnaire asks about the education and experience requirements of a [OCCUPATIONAL TITLE]. Please listen carefully to each question. Consider the job, not your personal experience, and answer based on the job as it currently exists. C.1 If someone were being hired to perform this job, indicate the level of education that would be required (Mark one box): 1 Less than high school education 2 High school 3 Vocational school 4 Technical school 5 Vocational college 6 College 7 Bachelor’s degree 8 Master’s degree 9 Ph.D. C.2 If someone were being hired to perform this job, indicate the field of study that would be required (Check all boxes that apply): 1 Education 2 Humanities and Arts 3 Social sciences, business, and law 4 Science, mathematics, and computing 5 Natural science and environmental knowledge 5 Engineering, manufacturing, and construction 6 Agriculture and veterinary 7 Health and welfare 8 Services C.3 If someone were being hired to perform this job, how much RELATED WORK EXPERIENCE would be required? 1 Less than 6 months 2 6 months to 1 year 3 1 year to 3 years 4 3 years to 5 years 5 5 years to 10 years 6 10 years or more C.4 If someone were being hired to perform this job, how much organized training (ON-SITE OR INPLANT) provided by the employer would be required? 1 None 53 2 Less than 1 month 3 1 month to 6 months 4 6 months to a year 5 1 year to 3 years 6 3 years to 5 years 7 5 years to 10 years 8 10 years or more C.5 If someone were being hired to perform this job, would job-related professional certifications be required? 1 Yes [C.6] 2 No [D] C.6 If yes, please specify the name of any certification that would be required. Free text 54 D. Respondent Characteristics FOR JOB INCUMBENTS AND OCCUPATION EXPERTS: This final part of the questionnaire asks about your personal characteristics. Your responses to these questions will help us know that workers with different backgrounds are included. D.1 For how long have you worked at this job? [JOB INCUMBENTS ONLY] [Numeric] years [Numeric] months D.2 In your current job, are you employed by (Mark one box) [JOB INCUMBENTS ONLY] 1 Government 2 Private, for-profit company 3 State-owned enterprise 4 Nonprofit organization 5 Self-employed 6 Family business D.3 In what year were you born? [Numeric] year D.4 Are you male or female? (Mark one box) 1 Male 2 Female D.5 Indicate the highest level of education that you have completed (Mark one box) 1 Less than high school education 2 High school 3 Vocational school 4 Technical school 5 Vocational college 6 College 7 Bachelor’s degree 8 Master’s degree 9 Ph.D. 55