Gyngyvr Molnr SZTE Institute of Education Center for

Gyöngyvér Molnár SZTE Institute of Education Center for Learning and Instruction http: //www. staff. u-szeged. hu/~gymolnar Educational Development Initiatives at the University of Szeged: Technology, Assessment and Innovative Teaching Methods “If you can not measure it, you can not improve it. ” Kelvin edia. hu UNIVERSITY OF SZEGED

Outline • University of Szeged – the context • How does the „problem space” look like? • Where comes the „cognitive conflict” in the academic staff from? experience + data-based evidence • Problem: complex, dynamically changing, growing • Initiatives come from the Institute of Education: – Technology and Assessment – Innovative Teaching Methods edia. hu UNIVERSITY OF SZEGED

University of Szeged • 12 Faculties (from Music to Medicine, from Agriculture to Engineer, from Arts to Science and Informatics) • 21. 000 Students • More than 3000 foreign students (different challenges) • 2100 academic staff

How does the „problem space” look like? • Little number of researchers (teaching at Uni level) having teacher education degree • Drastic change in the general ability level of the students entering the Uni • Generation differences – different expectations, attitudes, motivations towards study edia. hu UNIVERSITY OF SZEGED

How does the „problem space” look like? 2 • The issue: train the trainers is not part of the tradition • Innovative teaching methods (teacher = facilitator and not the source of knowledge) – also not part of the traditions • Tradition: frontal teaching, teacher is the source of knowledge • Motivated and skilled students do not need innovative teaching methods!!! edia. hu UNIVERSITY OF SZEGED

Data-based evidence • Big differences • Within and between the different faculties • Assessment at the beginning of higher education studies – from 2015 • Student + faculty + uni level detailed feedback edia. hu UNIVERSITY OF SZEGED

Mathematics Ind. reasoning Reading Problem solv. Combin. reasoning red: indivitual, blue: faculty, green: uni- average.

Mathematics (disciplinary) -> Math. reasoning Hungarian language and lit. -> Reading History -> No English -> No Science -> No Interactive problem solving-> Learning strategies (OECD PISA) -> 2015 2016 2017 2018 Working memory Inductive reasoning -> FT Combinative reasoning -> No Learning attitudes, motivations Internet browsing efficacy (FT) Inquire skills. (FT) Note. FT: Faculty level test

Average Faculty 1: 40%, Faculty 2= 85%, Uni=63%

Sample

Year N Ratio (%) Girls (%) 2015 1468 63, 3 57, 7 Age mean (SD) (Maturation in 2015) 2016 2017 2018 2270 1682 2229 66, 5 43, 4 58, 0 55, 3 50, 9 53, 2 19, 6 (2, 39) 19, 9 (2, 52) 19, 9 (2, 05) edia. hu UNIVERSITY OF SZEGED

300 250 200 150 100 50 285 295 305 315 325 335 345 355 365 375 385 395 405 415 425 435 445 455 465 475 485 495 0 Full sample edia. hu Took part in the assessment UNIVERSITY OF SZEGED

Main results edia. hu UNIVERSITY OF SZEGED

Matriculation examination + admissions scores are uncertain Matur. ex. 2017 Hung. 2018 2017 Math. 2018 2017 History 2018 Basic Advan. Math. Read. Probl. WM Ind. r. 0, 112** 0, 403** 0, 170** 0, 492** 0, 552** 0, 577** 0, 524** 0, 517** 0, 257** 0, 401** 0, 257* 0, 376** 0, 275** 0, 317* 0, 268** 0, 473** 0, 320** 0, 249* 0, 257** 0, 255* 0, 280** 0, 373** 0, 284* 0, 330** n. s. 0, 357** 0, 299** 0, 416** 0, 286** 0, 211* 0, 102** 0, 322** 0, 090** 0, 239** n. s. 0, 233** 0, 181** 0, 393** 0, 227** n. s. 0, 261** 0, 059* 0, 180** 0, 059* 0, 306* n. s. 0, 359** 0, 401** 0, 488** 0, 295** 0, 545** 0, 153** 0, 358** 0, 111** 0, 190** Note: *: p<0, 05, **: p<0, 01, n. s. : not sign.

We can not rely on the admissions scores/ matriculation examination results by solving the problem. edia. hu UNIVERSITY OF SZEGED

Differences between Students are measurable in Years 1: Mathematics; 2: Problem solving; 3: Reading; 4: Inductive reasoning; 5: Internet browsing 6: Working memory; 7: Inquiry skills. Green: Uni level average, Thin red: student Bold red: SD

Interactive problem solving Differences between the faculties are measurable in Years (probl. ) 600 550 Empirical data Fitted curve Faculty 2 500 450 Faculty 1 400 350 300 Grade 250 2 3 4 PS: 212 -829 point 5 6 7 8 9 10 11 12 E

There is something to do at every Faculty! Green: Uni, blue: Faculty Thin red: student Bold red: SD edia. hu 1: Mathematics; 5: Internet browsing 2: Problem solving; 6: Working memory; 3: Reading; 7: Inquiry skills. 4: Inductive reasoning; UNIVERSITY OF SZEGED

Initiatives come from different institutes: • 12 different courses from 6 different faculties: • Topics: communication, teaching methods, using different software, preparing MOOC-s, preparing curricula according to the new prescriptions, mentor training • Participation • 576 colleagues edia. hu UNIVERSITY OF SZEGED

Initiatives come from the Institute of Education: • Entrance competence assessment (1 hour testing – faculty developed tests) • Courses: innovative teaching methods • Courses: testing, itemwritting, IRT analyses • Voluntary participation - diploma at the end • 50 collegues edia. hu UNIVERSITY OF SZEGED

Sum up • Problem: important, complex, changing by faculties • No common solution • Huge differences • Not easy to define and predict – who needs help (on student + teacher side) • Changing the way we (researchers) teach and assess edia. hu UNIVERSITY OF SZEGED

Thank you for your kind attention! edia. hu “If you can not measure it, you can not improve it. ” Kelvin edia. hu UNIVERSITY OF SZEGED