Graduate Tracer Studies and Benchmarking ACE Workshop May
Graduate Tracer Studies and Benchmarking ACE Workshop, May 09, 2018
Outline • Graduate Tracer Studies – Objectives – Update – Pre-survey results – Timeline • Benchmarking – Objectives – Update – Terms of Reference for participating institutions – Timeline
Graduate Tracer Studies 3
Graduate Tracer Studies: Objectives • Develop a graduate tracer study methodology (master’s and Ph. D graduates) to give an overview of the state of employability of graduates • Conduct related exercises to obtain the needed data, analysis and reporting • Facilitate capacity building workshops to discuss the reports and train universities • Work closely with the benchmarking team to ensure a holistic approach to improving quality and relevance in SSA institutions 4
Graduate Tracer Studies: Update • A pre-survey was conducted to determine: – Interest of ACEs in participating and their contact details – Whether data should be collected at ACE or Institutional level – Degree level of graduates to be targeted (undergrads, master’s, doctoral) – The type of information centers are interested in obtaining from such a survey – Best mode of survey delivery – Most attractive incentives for graduates to participate • Finalizing procedures for bringing on board My. COS 5
Graduate Tracer Studies: Pre-Survey Results • 25 out of 46 ACEs across 11 countries responded to the survey (8 ACE Is and 17 ACE IIs) 6 ACE Center Institution ACE I – Bénin SMA Institut de Mathématiques et de Sciences Physiques ACE I – Ghana RWESCK ACE I – Ghana ACE I – Nigeria WACCBIP CERHI ACEPRD ACEGID Kwame Nkrumah University of Science and Technology (KNUST) University of Ghana University of Benin, Benin City University of Jos Redeemer's University ACE I – Nigeria PAMI African University of Science and Technology ACE I – Nigeria OAU-PARK Obafemi Awolowo University
Graduate Tracer Studies: Pre-Survey Results (ACE II) 7 ACE Center Institution ACE II – Ethiopia ACE II – Kenya ACE II – Malawi ACE II – Mozambique ACE II – Rwanda ACE II – Tanzania CDT-Africa CESAAM ACEII-PTRE CEPHEM Aquafish CS-OGET ACEIo. T ACEESD ACEITLMS IRPM & BTD WISE - Futures Addis Ababa University Egerton University Moi University of Malawi Lilongwe University of Agriculture and Natural Resources Universidade Eduardo Mondlane University of Rwanda- College of Education Sokoine University of Agriculture Nelson Mandela African Inst. of Sci. & Tech. (NM-AIST) ACE II – Tanzania ACE II – Uganda CREATES SACIDS PHARMTRAC ACALISE MARCCI Nelson Mandela African Inst. of Sci. & Tech. (NM-AIST) Sokoine University of Agriculture Mbarara University of Science and Technology Uganda Martyrs University Makerere University ACE II – Zambia ACE for Sust. . Mining Copperbelt University
Graduate Tracer Studies: Pre-Survey Results • How many cohorts have already graduated from your ACE? ACE I (3 centers graduated 1 cohort; 5 centers graduated 2 cohorts); ACE II (3 centers graduated 2 cohorts; 2 centers graduated 4 cohorts; 1 center graduated 5 cohorts) 12 11 10 8 8 6 4 3 2 2 0 0 zero 8 one cohort two cohorts three cohorts 1 four cohorts five cohorts +
Graduate Tracer Studies: Pre-Survey Results • Number of graduates in each cohort ACE II ACE I [VALUE] 160 140 120 100 [VALUE] 80 80 [VALUE] [VALUE] 60 60 40 40 20 [VALUE] 2017 9 [VALUE] [VALUE] 0 0 Master's 20 2016 Ph. Ds 2017 2016 Undergraduate 2015 Master's 2014 Ph. Ds
Graduate Tracer Studies: Pre-Survey Results • If you have graduated at least one cohort, please estimate the number of graduates for each cohort who are 1) master’s 2) Ph. Ds 3) undergraduates (if applicable). 885 graduates across all ACEs (50% master’s; 6% Ph. Ds; 44% undergrads) 300 [CELLRANGE] [VALUE] 250 [CELLRANGE] [VALUE] [CELLRANGE] 200 150 [CELLRANGE] [VALUE] 100 [VALUE] [CELLRANGE] 50 [VALUE] [CELLRANGE] [VALUE] 0 2017 10 2016 Undergraduate Master's 2015 Ph. Ds 2014
Graduate Tracer Studies: Pre-Survey Results • For each cohort, please indicate the number of graduates for whom you have the contact information (email and/or phone number)? 81% or 358 out of 443 master’s graduates, and 89% or 51 out of 57 Ph. D graduates and 100% for the undergrads 250 79% ([VALUE]/260) 200 81% ([VALUE]/159) 150 100 50 89% (17/19) 85% ([VALUE]/26) 0 2017 11 2016 Master's 100% ([VALUE]/15) ([VALUE]/9) (8/8) ([VALUE]/4) 2015 Ph. Ds 2014
Graduate Tracer Studies: Pre-Survey Results • What kind of information do you wish to obtain from a tracer study? Info. Desired from Tracer Study Frequency 1. Employment status/employability 15 2 2. Skill competency/requirement/gap 3. Suggestions for/satisfaction with teaching & learning improvement 4. Salary/performance/promotion information 5. Type of employment 11 6. Additional academic training 4 7. Social/economic contributions 4 8. Current location 3 Job satisfaction Employer satisfaction/suggestions for improvement Contact/demographic information Length of job search Current position at employer Interest in continuing education at center Interest in donating Publications Entrepreneurship 12 10 6 4 2 2 1 1 1
Graduate Tracer Studies: Pre-Survey Results • What are the method(s) of survey delivery that in your opinion will have the greatest response rates from your graduates? 17 out of 25 believe emails; • What are examples of incentives you would recommend to be given to graduates who take the survey, in order to obtain the greatest response rates? (i. e. what rewards would be most attractive)? The Examples of Incentives Fellowship/scholarship/conference funding Free lectures/workshops/resources for alumni Survey results Mobile/internet top up Alumni gatherings/networking No incentive University appreciation letter Mentor current students Raffle/prize Academic transcript 13 Frequency 10 8 4 2 2 1 1 1
Graduate Tracer Studies: Proposal • Based on these results, we determined: – Data can be collected at ACE (pilot); Scale up possible at institutional level – 25 ACEs are interested; 11 have 0 graduates – Master’s degree level of graduates (2016 & 2017) to be targeted for pilot – Survey will focus on employment, skills, and evaluation of teaching & learning – Best mode of survey delivery: Emails (primary); Calls (secondary) – Most attractive incentives for graduates to participate: scholarships, center resources • Other ACES can still join, the pilot particularly those who have graduated 1 or more cohorts and have their contact details 14
Graduate Tracer Studies: Timeline • Develop the standard methodology (variable indicator system) of the graduate tracer study for both master’s and doctoral graduates. – June 2018 • Consultations on methodology with ACEs and other Higher education stakeholders- July 2018 • Survey questions translated and transferred onto online platform – Aug 2018 • Survey period for master’s graduates only (pilot with only ACEs) –Sep – Nov 2018 • Dissemination of results and regional workshops – Dec 2018/ 2019 (tbc) 15
Benchmarking 16
Benchmarking: Objectives (i) Facilitate benchmarking, graduate tracer studies, student surveys and other relevant exercises under the initiative that are relevant for the SSA higher education sector and based on global best practices; (i) Support the SSA higher education sector by providing capacity building opportunities for higher education institutions and government agencies/ministries in quality data management, including its collection, analysis, interpretation and its strategic use; and (i) Invest in key partnerships that would add value through financial, technical and/or other inkind support to the Hub’s activities, ensuring it remains relevant and sustainable. 17
Benchmarking: Update • Secured some funding to support Benchmarking host institution and technical assistance • Expressions of interest for host institution applications • Technical Assistance firm “Shanghai Ranking” have been contracted (as of last week) • Soliciting list of interested universities and national agencies. So far: – Universities: Botswana (1), Cameroon (6), DRC (6), Ethiopia (9), Gabon (? ), Ghana (5), Kenya (3), Niger (? ), Nigeria (? ), Lesotho (1), Malawi(5), Mauritania (1), Rwanda (1), Senegal (? ), Tanzania (49), Uganda (3), Zambia (2) 18
Benchmarking: Terms of Reference Eligibility Expected outcomes q Existence of a comprehensive and functional Management Information System (MIS) for the university q Evidence of trained staff that understand how to collect, analyze and use data to inform the university’s policy makers q Improvements in quality and relevance of the university’s programs evidenced by interventions that improve at least 2 indicators each year q Improvement in relevance of programs at the university as evidenced by positive outcome of graduate tracer studies in subsequent years of participation 19 v A private, public, research or teaching university based in sub-Saharan Africa v Head of University willing to sign a commitment letter for the participation of the university v Commitment to submit required data v Willingness and commitment of the university to make practical and relevant changes informed by the results from the benchmarking and graduate tracer studies exercise v Agree that the results will be made public
Benchmarking: Timeline • Update of institutional benchmarking methodology and development of a data verification scheme - May 2018 • • • Institutional Benchmarking data collection – June – August 2018 • • National system level data collection – Aug - Sept 2018 Development of national higher education system benchmarking methodology - July 2018 Consultations on national higher education system benchmarking methodology with other Higher Education stakeholders- Aug 2018 Data cleaning and verification – Sep – Oct 2018 Overall and individual reports ready and disseminated - Dec 2018/early 2019 Regional and national level workshops - 2019 20
Questions, Comments, Feedback? ebentil@worldbank. org 21
- Slides: 21