ACE Masters Graduate Pilot Tracer Study My COS

ACE Master’s Graduate Pilot Tracer Study My. COS Presentation ACE II Technical and Advisory Meeting Nairobi, Kenya May 14, 2019

Table of Contents I. My. COS Introduction II. Importance of Tracer Surveys III. Introduction of Basic Survey Methodology IV. Survey Results V. Collecting and Using Data VI. Share Best Practices VII. Q&A

Table of Contents I. My. COS Introduction II. Importance of Tracer Surveys III. Introduction of Basic Survey Methodology IV. Survey Results V. Collecting & Using Data VI. Share Best Practices VII. Q&A

My. COS Introduction Who We Are • Founded in 2006 • Specialized in higher education management consulting • 230 employees What We Do • Data survey & evaluation and consulting services • 1, 000+ university clients • International collaborators: OECD, Asian Development Bank, World Bank, ACBSP

Table of Contents I. My. COS Introduction II. Importance of Tracer Surveys III. Introduction of Basic Survey Methodology IV. Survey Results V. Collecting & Using Data VI. Share Best Practices VII. Q&A

Importance of Tracer Study Benefits • Data-driven understanding of graduates’ career development and their evaluation of educational experiences can be used to improve student services, career services, and alumni services. • Help to determine whether an academic program can appropriately meet a region’s labor market demand economic development. Survey results may be used to identify and improve problem areas. • Monitor the progress of educational objectives and provide hard evidence for improving teaching & learning, and research & academic offerings.

Smart Survey System Complete smart survey system

Table of Contents I. My. COS Introduction II. Importance of Tracer Surveys III. Introduction of Basic Survey Methodology IV. Survey Results V. Collecting & Using Data VI. Share Best Practices VII. Q&A

Survey Indicator Framework Satisfaction with internship Employment characteristics Internship & Industry Collaboration Challenges encountered Entrepreneurship Monthly salary Satisfaction with industry collaboration Employment Status Career services evaluation Alumni Evaluation Alumni support Job satisfaction Variable Indicators* Time to find first job Core Competencies Digital Skills Academic Research Achievement in research Satisfaction with T&L Teaching & Learning Curriculum evaluation Academic Advisor Evaluation of academic advisor guidance

Survey Process Identify problems in raw data provided Repeat Data cleaning and communication with schools Adapt cleaned data to survey database Preparation for online launch and testing Send survey invitation e -mails Data collection Survey response monitoring and problem -solving

ACE Participation - Study was mandatory for ACE II - Greater participation from ACE I - Limited ACE II participation affected data analysis 28. 3% 13 out of 46 ACEs 16. 6% 4 out of 24 ACE IIs 40. 9% 9 out of 22 ACE Is

Participating ACEs & Universities ACE I University ACE II University ACEGID - ACE for RUN - Redeemer’s ACEPHEM - ACE for Public Co. M - University of Malawi Genomics of Infectious Diseases University Health and Herbal Medicine College of Medicine CCBAD - ACE in Climate UFHB - Félix Houphouët- ACALISE - ACE for Agro- UMU - Uganda Martyrs Change and Adapted Land Use Boigny University ecology and Livelihood Systems University CERSA - ACE in the Poultry UL - University of Lomé PTRE - ACE in MU - Moi University Sciences Phytochemicals, Textiles and Renewable Energy MITIC - ACE in Science, UGB - Gaston Berger PHARMBIOTRAC -ACE for MUST - Mbarara University of Technology and Knowledge University Pharm-Biotechnology and Traditional Medicine Science and Technology PAMI - ACE in Materials Pan AUST - African University of -African Materials Institute Science and Technology RWESCK - ACE for Water KNUST - Kwame Nkrumah and Environmental Sanitation University of Science and Technology WACCBIP - ACE for Cell UG - University of Ghana Biology of Infectious Pathogens WACCI - ACE for Training Plant Breeders, Seed Scientists and Technologists 2 i. E - ACE in the Education 2 i. E - Institute for Water and Research with Water, Energy, and Environment Sciences and Technology Environmental Engineering

Customized Invitations Appealing to graduates’ importance in ACE’s improvement Appears to be from ACE center leader Student’s name ACE’s name Explain the importance of taking survey Assurance of confidentiality

Invitations Personnalisées E-mail semble envoyé de la part du chef du CEA Nom de l’étudiant Nom du CEA Explication de l’importance du sondage Assurance de la confidentialité de leurs réponses

Survey Timeline End 3 rd Reminder 2 nd Reminder 1 st Reminder Start March 4, 2019 March 25, 2019 March 30, 2019 April 4, 2019 April 18, 2019

Table of Contents I. My. COS Introduction II. Importance of Tracer Surveys III. Introduction of Basic Survey Methodology IV. Survey Results V. Collecting & Using Data VI. Share Best Practices VII. Q&A

Data Cleaning and Analysis Process Organize data & adapt to SAS Data verification Initial data processing Data cleaning Create integrated database Repeat

Background Information - ACE Submission Male Female ACE II All 75% 25% ACE II 57% 43% ACE I 70% 30%

Response Analysis 524 753 Responses from ACE I Survey responses initiated 229 139 Emails received from graduates 19 Emails requiring ACE attention Responses from ACE II 1, 830 Total email addresses received 11. 91% Invalid email addresses 21 Emails saying graduate was not part of ACE scholarship ©版权声明：麦可思公司拥有本PPT版权，没有麦可思公司预先的书面同意，本PPT不得以任何形式和手段予以复制。 0. 28% Invalid email addresses (China)

Survey Response Rates ACE Master's graduate survey China Master's graduate survey ( % 49 ) 50 44 43 47 40 31 30 30 20 1 st Stage 2 nd Stage 3 rd Stage

Survey Completion Rates ( ACE Master's graduate survey China Master's graduate survey % ) 80 70 70 68 70 67 68 65 60 50 1 st Stage 2 nd Stage 3 rd Stage

Survey Results I. Overall ACE/ACE II Results

Teaching and Learning - Satisfaction ALL ( ) 100 % ACE II 94 90 ACE I 96 80 60 40 20 0 Satisfaction How satisfied are you with the overall quality of teaching & learning at your ACE?

Teaching and Learning - Importance of ACE to Current Situation ALL ( ) 100 ACE II 98 100 ACE I 98 % 80 60 40 20 0 Importance of education How important is your ACE educational experience to your current job or academic studies/research?

Teaching and Learning - Problems ALL 0 ACE II 15 30 Access to journals/publications 27 23 25 23 Course options 22 21 22 Other Advisor assignment Advisor guidance 45 32 28 30 28 Few research topics/proj. Poor lab environment ACE I 20 6 24 17 15 16 14 17 24 34 60 (%)

Research and Academic Activity ALL 0 ACE II 20 40 ACE I 60 100 (%) 80 79 % in research proj. during 87 77 53 % in research proj. after 68 48 41 51 % publishing during 39 23 % publishing after 28 21 38 48 % with transfer/output during 35 36 % with transfer/output after 49 33

Tech Transfer/Innovation Output - ACE Support ALL ACE II ACE I ( ) 100 % 80 67 69 62 60 40 20 0 ACE support Did your ACE support you in achieving technology transfer/innovation outputs?

Research and Academic Activity - Problems ALL 0 ACE II 40 20 35 33 36 None, was satisfactory 32 Communication 29 31 Journals/publications 30 Laboratory 9 Faculty expertise Physical environment Other 24 9 8 3 7 8 6 5 7 28 13 35 40 ACE I 60 80 (%)

Internships and Industry Collaborations ALL ACE II ACE I ( ) 100 % 80 80 56 60 47 41 40 30 20 13 5 4 5 7 3 9 0 Industry collab Internship Industry collab & internship None

Internships and Industry Collaborations Satisfaction ALL ( ) 100 ACE I % 88 91 88 88 80 60 40 20 0 Satisfaction with industry Satisfaction with internship

Internships and Industry Collaborations Challenges 0 20 ACE I 60 46 47 None 13 13 Other Not prepared by coursework 11 10 Guidance not helpful 10 10 No respect for personal interests 10 10 Professional relationships 9 9 Not relevant to study 8 8 Academic pressure ALL 40 8 5 80 100 (%)

Core Skills Equipment Maintenance Technical Skills (11 skills) Active Learning Troubleshooting … Critical Thinking Mathematics Basic Skills (10 skills) Coordination Social Skills (6 skills) Monitoring Sciences … Management of Financial Resources Time Management Operation and Control Core Skills Complex Problem-Solving Skills (1 skill) Resource Management Skills (4 skills) Persuasion Complex Problem-Solving System Skills (3 skills) System Evaluation … Digital Skills

Digital Skills - Definition The ability to use digital skills and resources to complete tasks Skill Level 2 Level 4 Level 6 Digital Skills Navigate the internet, Perform basic programming Solve problems in advanced emails, basic Microsoft and use computational analytics and internet of things tools (Word, Excel and modelling and simulation using deep knowledge of Power Point) tools and techniques artificial intelligence and/or machine learning

Digital Skills ALL ACE II ACE I ( ) 100 % 83 84 82 80 71 71 71 72 73 80 85 79 71 60 40 20 0 Importance Demand Mastery > Demand

Employment - Employment Rate ALL ACE II ACE I ( ) 100 86 % 80 77 74 60 40 20 0 Rate of employment

Employment - Types ALL 0 20 40 43 Unemployed/job searching 13 10 Full time/not related 8 13 Part time 5 5 5 Self-employed/related 4 6 3 Unemployed/other Self-employed/not related 1 16 10 1 4 4 2 3 2 19 22 ACE I 60 46 Full-time/related Graduate school ACE II 55 80 100 (%)

Employment - Location ALL 0 20 ACE II 40 60 ACE I 100 (%) 80 85 My own country (within SSA) 94 81 7 Outside of my own country (within SSA) 4 8 7 Outside of my own country (outside of SSA) 1 9 1 My own country (outside of SSA) 1 2

Employment - Employer Background ALL 0 20 Private 21 19 State agency SOE Nonprofit 7 Joint venture Self-employed 17 14 17 13 6 13 13 13 Research/academia Foreign 40 4 3 4 2 2 1 3 33 38 24 29 ACE II 60 ACE I 80 100 (%)

Employment - Salary ALL ACE II ACE I ( 60 % ) 44 45 32 39 27 30 27 15 16 22 19 20 14 13 9 5 0 < $200 $201 -600 $601 -1, 000 $1, 001 -5, 000 7 6 >$5, 000

Employment - Job Satisfaction ALL ACE II ACE I ( ) 100 % 80 80 83 60 40 20 0 Job satisfaction 78

Employment - Job Turnover ALL ACE II ACE I ( ) 50 % 40 30 20 16 13 10 7 0 Job turnover Please indicate your digital skills skill level upon graduation from your ACE on a scale of 1 to 7, with 1 being the lowest level and 7 being the highest level.

Employment - Time to Find Job 0 20 ALL ACE II ACE I 40 60 80 53 Before grad 77 42 17 < 3 months 13 19 9 4 -6 months 4 12 5 7 -9 months 1 7 3 10 -12 months 0 4 13 >1 year 5 16 100 (%)

Entrepreneurship - Percentage ALL ACE II ACE I ( ) 60 % 45 38 30 22 18 15 0 % of Entrepreneurs A start-up is a newly formed entrepreneurial venture that focuses on capitalizing on a perceived market demand by developing a viable product, service, process or platform. The intention of a start-up is to grow rapidly. A start-up venture is initially financed and operated by a handful of founders or one individual. It can be forprofit or not-for-profit.

Entrepreneurship - Impact of ACE ALL ( ) 100 ACE II 95 96 ACE I 94 % 80 60 40 20 0 Impact of ACE How significant was the impact of your ACE education on your start-up efforts?

Entrepreneurship - Types ALL ACE II ACE I ( ) 100 % 80 81 76 67 60 40 33 24 19 20 0 For-profit Not-for-profit

Alumni Evaluation ALL ( ) 100 94 93 ACE II ACE I 95 % 92 85 83 80 60 40 20 0 Alumni satisfaction Please indicate your overall satisfaction with your ACE Alumni recommendation Would you recommend your friends and/or family to attend your ACE?

Alumni Evaluation - Alumni Engagement ALL 0 20 ACE II 40 ACE I 60 67 70 66 66 Participate in events Recommend ACE to others 63 54 58 53 Provide feedback 47 48 46 44 41 45 38 38 38 Rec. alumni for jobs Help uni-industry collab Recruit alumni 30 30 30 Fundraise/donate No engagement Other 80 3 2 3 2 76 100 (%)

Survey results II. ACE II 2014 -2015 vs ACE II 2016 -2018

Research and Academic Activity ACE II（2014 -2015） 0 20 ACE II（2016 -2018） 40 60 83 % in research proj. during 87 72 % in research proj. after 68 76 % publishing during % publishing after % with transfer/output during % with transfer/output after 100 (%) 80 51 48 28 34 48 41 49

Tech Transfer/Innovation Output - ACE Support ACE II（2014 -2015） ACE II（2016 -2018） ( ) 100 % 80 62 60 46 40 20 0 ACE support

Research and Academic Activity - Problems ACE II（2014 -2015） 20 40 0 55 Journals/publications 35 28 Communication 40 24 Faculty expertise 13 17 None, was satisfactory 33 17 Laboratory Physical environment Other ACE II（2016 -2018） 60 80 (%) 9 3 3 3 5

Internships and Industry Collaborations ACE II（2014 -2015） ACE II（2016 -2018） ( ) 100 % 80 80 62 60 40 20 21 14 13 4 3 3 0 Industry collab Internship Industry collab & internship None

Digital Skills ACE II（2014 -2015） ACE II（2016 -2018） ( ) 100 % 80 80 85 84 73 71 73 73 75 60 40 20 0 Importance Demand Mastery > Demand

Employment - Salary ACE II（2014 -2015） ACE II（2016 -2018） ( 60 % ) 45 33 27 30 30 32 27 15 13 17 7 9 5 0 < $200 $201 -600 $601 -1, 000 $1, 001 -5, 000 >$5, 000

Employment - Satisfaction with Current Situation ACE II（2014 -2015） ACE II（2016 -2018） ( ) 100 % 80 76 75 60 40 20 0 Satisfaction with current situation

Employment - Job Satisfaction ACE II（2014 -2015） ACE II（2016 -2018） ( ) 100 % 81 83 80 60 40 20 0 Job satisfaction

Employment - Job Turnover ACE II（2014 -2015） ACE II（2016 -2018） ( ) 50 % 40 30 20 13 10 7 0 Job turnover

Employment - Time to Find Job ACE II（2014 -2015） 20 40 0 71 Before grad 77 12 < 3 months 13 2 4 -6 months 7 -9 months 10 -12 months >1 year ACE II（2016 -2018） 60 80 4 5 1 2 0 8 5 100 (%)

Entrepreneurship - Percentage ACE II（2014 -2015） ACE II（2016 -2018） ( ) 60 % 45 36 38 30 15 0 % of Entrepreneurs

Entrepreneurship - ACE Impact ACE II（2014 -2015） ( ) 100 ACE II（2016 -2018） 100 96 % 80 60 40 20 0 Impact of ACE

Entrepreneurship - Types ACE II（2014 -2015） ACE II（2016 -2018） ( ) 100 % 83 80 67 60 40 33 17 20 0 For-profit Not-for-profit

Alumni Evaluation ACE II（2014 -2015） ( ) 100 92 93 ACE II（2016 -2018） 92 92 % 80 60 40 20 0 Alumni satisfaction Alumni recommendation

Alumni Evaluation - Alumni Engagement ACE II（2014 -2015） 0 20 ACE II（2016 -2018） 40 60 80 65 Recommend ACE to others 76 62 Participate in events 70 38 41 Help uni-industry collab 38 Provide feedback 58 31 Recruit alumni 38 31 30 Fundraise/donate 27 Rec. alumni for jobs No engagement Other 48 8 2 0 3 100 (%)

Survey Results III. Specific ACE-level results

Teaching and Learning ALL ( ) 100 % 94 90 93 ACE II ACALISE 98 100 80 60 40 20 0 Satisfaction Importance of education PTRE and PHARMBIOTRAC were not included in any ACE-level analysis due to insufficient data.

Research and Academic Activity ALL ACE II ACEPHEM ( ) 100 % 80 87 90 79 60 40 20 0 % in research proj. during

Research and Academic Activity ALL ACE II ACALISE ( ) 100 % 80 60 40 48 52 38 20 0 % with transfer/output during

Internships and Industry Collaborations ALL ACE II ACALISE ( ) 100 % 80 60 47 40 20 13 0 Internship 17

Digital Skills ALL ACE II ACALISE ( ) 100 % 80 80 85 60 40 20 0 Mastery > Demand 90

Employment - Rate of Employment ALL ACE II ACEPHEM ( ) 100 % 80 94 86 77 60 40 20 0 Rate of employment

Employment - Types ALL ACE II ACEPHEM ( ) 100 % 80 69 55 60 46 40 23 20 10 16 0 Full-time/related Full time/not related

Employment - Satisfaction with Current Situation ALL ACE II ACEPHEM ( ) 100 % 75 80 79 67 60 40 20 0 Satisfaction with current situation

Employment - Job Satisfaction ALL ACE II ACALISE ( ) 100 % 80 80 83 60 40 20 0 Job satisfaction 84

Employment - Job Turnover ALL ACE II ACALISE ( ) 50 % 40 30 20 13 10 7 0 Job turnover 7

Employment - Time to Find Job ALL ACE II ACEPHEM ( ) 100 % 91 77 80 60 53 40 20 0 Before grad

Entrepreneurship ALL ACE II ACALISE ( ) 100 % 80 60 46 38 40 22 20 0 % of Entrepreneurs

Survey Results IV. Priority Area Results

Research and Academic Activity % in research proj. during % in research proj. after % publishing during % publishing after % with transfer/output during % with transfer/output after EDUCATION was not included in any priority area analysis due to insufficient data.

Tech Transfer/Innovation Output – ACE Support 0 20 40 60 80 HEALTH 78 AGRICULTURE 67 ALL 67 STEM 64 100(%)

Research and Academic Activity - Problems None, was satisfied Communication Journals/ publications Laboratory Faculty expertise Physical environment Other ALL 35% 32% 31% 24% 9% 7% 6% HEALTH 48% 19% 12% 8% 1% 10% STEM 33% 35% 34% 27% 10% 9% 6% AGRICULTURE 28% 33% 8% 3% 3% Priority area

Internships and Industry Collaborations Internship Industry collab & internship 0 20 ALL 60 7 54 AGRICULTURE HEALTH 40 47 STEM 47 17 Industry collab 5 5 5 8 8 80 41 4 6 34 39 73 None 100 (%)

Internships and Industry Collaborations – Satisfaction with Internship 0 20 40 60 80 100(%) AGRICULTURE 95 HEALTH 95 ALL 88 STEM 87

Internships and Industry Collaborations Challenges Guidance not helpful No respect for personal interests Professional relationships Academic pressure Not relevant to study None Other Not prepared by coursework ALL 46% 13% 11% 10% 9% 8% 8% AGRICULTURE 50% 14% 9% 5% 5% 9% 9% 5% HEALTH 69% 19% 0% 4% 4% 8% 4% 0% STEM 44% 12% 11% 9% 8% 9% Priority area

Digital Skills Importance Demand Mastery > Demand

Employment - Salary ALL AGRICULTURE HEALTH STEM ( 60 % ) 45 30 15 39 39 39 27 33 27 22 22 22 15 14 28 19 17 7 8 0 < $200 $201 -600 $601 -1, 000 $1, 001 -5, 000 7 66 3 >$5, 000

Employment - Salary < $200 0 ALL $201 -600 20 14 AGRICULTURE 22 33 15 8 $1, 001 -5, 000 60 80 39 27 STEM HEALTH $601 -1, 000 40 19 27 39 39 >$5, 000 100 (%) 22 22 6 7 17 28 6 7 3

Employment – Time to Find Job Before grad ALL < 3 months 0 20 4 -6 months 40 53 HEALTH AGRICULTU RE STEM 7 -9 months 60 17 10 -12 months >1 year 80 100 (%) 9 80 50 47 20 19 5 3 13 8 34 1 4 15 11 5 3 5 10 15

Entrepreneurship - Percentage % of Entrepreneurs AGRICULTURE STEM ALL HEALTH Impact of ACE

Entrepreneurship - Types ALL HEALTH STEM ( ) 100 % 80 80 76 67 60 40 33 24 20 20 0 For-profit EDUCATION and AGRICULTURE were not included in the analysis due to insufficient data. Not-for-profit

Alumni Evaluation Alumni recommendation HEALTH ALL STEM AGRICULTURE Alumni satisfaction

Alumni Evaluation – Interest in Engaging Priority area Participate Recommend Provide in events ACE to others feedback Rec. alumni for jobs Help uniindustry collab Recruit Fundraise alumni /donate No Other engagement ALL 67% 66% 54% 47% 44% 38% 30% 3% 2% AGRICULTURE 78% 56% 53% 31% 28% 0% 6% HEALTH 69% 83% 61% 53% 44% 41% 39% 2% 0% STEM 65% 62% 52% 44% 43% 38% 28% 3% 2%

Table of Contents I. My. COS Introduction II. Importance of Tracer Surveys III. Introduction of Basic Survey Methodology IV. Survey Results V. Collecting and Using Data VI. Share Best Practices VII. Q&A

Establishing a Data Collection Systematic & Transparent • Start early: Track students before, during and after studies • Be consistent: Verify and check your data for validity • Get help: Third party objectivity and expertise • Longitudinal data collection: A full picture relies not just on one survey in time, but a continuum of data

Interpreting and Using Data Putting Data to Use • Data can be powerful, but numbers themselves only tell part of the story • An institution’s specific educational objectives and outcomes inform how data should be interpreted and used • Data should be contextualized: type of institution, local/regional environment, historical trends, etc. • Benchmarking with similar institutions • Using different types of data for a complete picture: graduate survey + employer survey • The integrity and objectivity of data must always be assured

Table of Contents I. My. COS Introduction II. Importance of Tracer Surveys III. Introduction of Basic Survey Methodology IV. Survey Results V. Collecting and Using Data VI. Share Best Practices VII. Q&A

Table of Contents I. My. COS Introduction II. Importance of Tracer Surveys III. Introduction of Basic Survey Methodology IV. Survey Results V. Collecting and Using Data VI. Share Best Practices VII. Q&A

Thank You! kate. wang@mycos. com