Medical Training Application Process MTAS 2008 09 revised

  • Slides: 24
Download presentation
Medical Training Application Process (MTAS) – 2008 -09 revised for 2012 EPM additions for

Medical Training Application Process (MTAS) – 2008 -09 revised for 2012 EPM additions for Dec 11 added Academic Scoring (‘Ranking’) Special Circumstances ‘Strugglers’ Referees Author - Prof David James, former Director of Medical Education Revisions – Curriculum Policy Group October 2010 Additional detail on deciles and Parallel Recruitment Exercise November 2011

Academic Scoring – Principles l l l 16 -06 -06: Initial meeting (ISC representation)

Academic Scoring – Principles l l l 16 -06 -06: Initial meeting (ISC representation) discussion of the ‘rules’ for the ranking process Wider discussion amongst the student body to reach the final agreed approach Summary of agreed ranking process: ¡ performance in Clinical Phases 1 and 2 final overall mark being derived from the following by evaluating a credit weighted mean across the 8 modules ¡ Untaken (1 st sit) assessments excluded and total credits reduced in weighted sum ¡

Academic Scoring – Overall score Credit weighted mean across the 8 modules (total out

Academic Scoring – Overall score Credit weighted mean across the 8 modules (total out of 26000) l Clinical Practice *– Total CP % (based from combined Knowledge/Skills mark in a 50/50 ratio) x 50 l CFU – CFU % x 15 l Therapeutics –Therapeutics % x 15 l Child Health – Total % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 50 l Obstetrics and Gynaecology - Total % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 50 l Health Care of the Elderly – HCE % (based on combined Knowledge/Skills mark in a 33/67 ratio) x 20 l Psychiatry – Total % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 30 l Specials - Specials % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 30 * CP Ratio is 50: 50 for those beginning CP in Feb 2011 and for those graduating in 2013; until then 70: 30 is used

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Clinical Practice 62 71 50: 50 67 50 5000 3350 CFU Theraptix Child Health O&G HCE Psyche Specials TOTAL Percent

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Clinical Practice 62 71 50: 50 67 50 5000 3350 CFU 61 - - 61 15 1500 915 Theraptix Child Health O&G HCE Psyche Specials TOTAL Percent

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Clinical Practice 62 71 50: 50 67 50 5000 3350 CFU 61 - - 61 15 1500 915 Theraptix 73 - - 73 15 1500 1095 Child Health O&G HCE Psyche Specials TOTAL Percent

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Clinical Practice 62 71 50: 50 67 50 5000 3350 CFU 61 - - 61 15 1500 915 Theraptix 73 - - 73 15 1500 1095 Child Health 69 54 50: 50 62 50 5000 3100 O&G HCE Psyche Specials TOTAL Percent

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Clinical Practice 62 71 50: 50 67 50 5000 3350 CFU 61 - - 61 15 1500 915 Theraptix 73 - - 73 15 1500 1095 Child Health 69 54 50: 50 62 50 5000 3100 O&G 74 70 50: 50 72 50 5000 3600 HCE Psyche Specials TOTAL Percent

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Clinical Practice 62 71 50: 50 67 50 5000 3350 CFU 61 - - 61 15 1500 915 Theraptix 73 - - 73 15 1500 1095 Child Health 69 54 50: 50 62 50 5000 3100 O&G 74 70 50: 50 72 50 5000 3600 HCE 44 56 33: 67 52 20 2000 1040 Psyche Specials TOTAL Percent

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Clinical Practice 62 71 50: 50 67 50 5000 3350 CFU 61 - - 61 15 1500 915 Theraptix 73 - - 73 15 1500 1095 Child Health 69 54 50: 50 62 50 5000 3100 O&G 74 70 50: 50 72 50 5000 3600 HCE 44 56 33: 67 52 20 2000 1040 Psyche 65 57 50: 50 61 30 3000 1830 Specials TOTAL Percent

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Clinical Practice 62 71 50: 50 67 50 5000 3350 CFU 61 - - 61 15 1500 915 Theraptix 73 - - 73 15 1500 1095 Child Health 69 54 50: 50 62 50 5000 3100 O&G 74 70 50: 50 72 50 5000 3600 HCE 44 56 33: 67 52 20 2000 1040 Psyche 65 57 50: 50 61 30 3000 1830 Specials 68 62 50: 50 65 30 3000 1950 TOTAL Percent

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall

Academic Scoring – Example Subject Know or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Clinical Practice 62 71 50: 50 67 50 5000 3350 CFU 61 - - 61 15 1500 915 Theraptix 73 - - 73 15 1500 1095 Child Health 69 54 50: 50 62 50 5000 3100 O&G 74 70 50: 50 72 50 5000 3600 HCE 44 56 33: 67 52 20 2000 1040 Psyche 65 57 50: 50 61 30 3000 1830 Specials 68 62 50: 50 65 30 3000 1950 26000 16880 TOTAL Percent 64. 9 %

Academic Scoring – Ranking score ¡ Whole final year are then ranked according to

Academic Scoring – Ranking score ¡ Whole final year are then ranked according to the overall percent score ¡ Academic Ranking Component of MTAS Application comprises 40% of the final score (with the other 60% coming from the non-academic component) Each medical school divides final year into quartiles according to their academic score ranking % mark out of 40 to use in the Application will be ¡ ¡ l l ¡ 40 38 36 34 for for those on 75 th centile and above on 50 th centile up to 75 th centile on 25 th centile up to 50 th centile below the 25 th centile Any resit student is automatically in the 4 th quartile

Total percent vs Rank order (328 students) 2007 data

Total percent vs Rank order (328 students) 2007 data

Total percent vs Rank order (325 students) 2010 data 80 75 70 Percent 65

Total percent vs Rank order (325 students) 2010 data 80 75 70 Percent 65 60 55 50 45 40 0 50 100 150 200 Rank Order 250 300 350

Ranking cut off points (2007 data) 68. 4% 64. 6% 61. 3%

Ranking cut off points (2007 data) 68. 4% 64. 6% 61. 3%

Ranking cut off points 2007 on Quartile 2007 2008 2009 August 2010 August 2011

Ranking cut off points 2007 on Quartile 2007 2008 2009 August 2010 August 2011 1 st 67. 56 68. 4 69. 10 68. 39 69. 43 2 nd 63. 20 64. 6 65. 80 64. 24 65. 51 3 rd 58. 47 61. 3 61. 50 60. 15 61. 71 4 th (lowest %) 37. 52 Not known 49. 52 51. 45 46. 46 2012 2013

Most subject results are correlated R = 0. 51; p<0. 0001 R = 0.

Most subject results are correlated R = 0. 51; p<0. 0001 R = 0. 37; p<0. 0001

Except with CFU R = 0. 10; p = N/S

Except with CFU R = 0. 10; p = N/S

‘Strugglers’ ¡ Identified during UG Course l l l ¡ ¡ Academic problems Medical

‘Strugglers’ ¡ Identified during UG Course l l l ¡ ¡ Academic problems Medical problems Domestic and other problems Clinical subdean involvement Liaison with Deanery with permission l l ¡ September (‘shortlist’) June (‘final shortlist’) Advice to make onscheme applications and placements before applications open

Special Circumstances - application to Foundation Programmes ¡ Significant family responsibilities - most commonly

Special Circumstances - application to Foundation Programmes ¡ Significant family responsibilities - most commonly a student who has responsibility as the primary carer for a young, school-age child or for a seriously ill partner or first degree relative. ¡ Chronic illness (physical or psychological) or disability for which local follow up is an absolute requirement as confirmed by an Occupational Health report. ¡ Terminally ill first-degree relative living locally as confirmed by a doctor's note.

Referees ¡ Two senior doctors l l l ¡ ¡ ¡ They should know

Referees ¡ Two senior doctors l l l ¡ ¡ ¡ They should know you (from any other student)! They should have been impressed by you (rapport)! Eg Consultant of firm especially if you are interested in a specific career pathway Ask them if they would be prepared to be a referee Confirm with an email and a copy of your CV (layout like on-line reference form) Let them know your choice

EPM – Deciles for December 2011 ¡ ¡ ¡ Process for calculating aggregate score

EPM – Deciles for December 2011 ¡ ¡ ¡ Process for calculating aggregate score exactly as before – same basket of assessments and weightings Whole final year are then ranked according to the overall percent score Deciles will score: 43, 42, 41, 40, 39, 38, 37 36, 35, 34 Final Year Resit students will NOT be automatically placed in former lowest score (34 in quartiles) but student retains original ranking from earlier round and decile used ISFP feeds back your decile in March 2012

Any Questions? ? Nottingham EPM/SJT Team SJT Lead - Judith. Franklin@nottingham. ac. uk SJT

Any Questions? ? Nottingham EPM/SJT Team SJT Lead - Judith. Franklin@nottingham. ac. uk SJT Lead - Giorgio. Vitale@nottingham. ac. uk EPM Lead - John. Whittle@nottingham. ac. uk