Learning Concepts Assessment What Do They Remember Meg

Learning Concepts Assessment: What Do They Remember? Meg Frazier and Megan Jaskowiak Cullom-Davis Library Bradley University

Who We Are Meg Frazier: MLS in 1989 from UT-Austin At Bradley since 1998 Information Literacy Librarian Liaison Areas: Engineering, Computer Science, Women’s Studies and Theatre Megan Jaskowiak: MLIS in 2013 from Kent St, Ph. D in 2003 from North Dakota St At Bradley since 2013 Science/Health Science Librarian Liaison Areas: Biology, Chemistry, Health Sciences, Mathematics, Nursing, Physical Therapy, Physics

Who We Are • Bradley University: Private, undergraduate institution with graduate programs aimed at returning professionals -- 5, 000 undergrads/ 1, 000 graduates

3 or 5 Things Learned Assessment • Concepts • Recall • What gets mentioned or What does not

Classroom Assessment • One-Minute paper • Clear Muddy

Learning Concepts Sheet • • Will Thalheimer Newness of the Concept Value of the Concept Likelihood of Using the Concept

Some analysis of open ended questions • Formulate categories • Condense the answers • Double check your categories

Our Results • Revising Searches –‘narrow’ or ‘revise’ –get better results –select a specific date range • Generalized Statements –learned about the library –learned about finding articles –learned about finding books

Our Results Themes Total % Librarian 1 Librarian 2 How to revise searches 17. 1 17. 3 16. 9 Generalized statements 16. 9 19. 9 15 I-share 14. 5 2. 6 21. 6 Where databases’ links are on library's website 11 16. 8 7. 5 Other 8. 6 4. 2 11. 3 Finding specific items (newspapers/books/articles) 8. 2 6. 8 9. 1 Using Wikipedia's Talk Page 7. 3 13. 6 3. 4 ILLiad 3. 3 1. 6 4. 4 Finding accurate or credible information 2. 9 5. 2 1. 6 Mentioned specific databases 2. 7 4. 2 1. 9 Learned nothing new 2. 2 4. 7 0. 6 2 2. 8 2 How use databases citation feature 1. 4 0. 5 1. 9 How to find specific encyclopedias 1 0. 9 1 The importance of reading the abstract 0. 6 0 0. 9 How to recognize a scholarly article 0. 4 1 0 Google Scholar

Pros and cons of closed questions • Answers easier to code • Statistical analysis more robust • Replication is easier • Takes less time • Suggest ideas • Cannot notice misinterpretations of questions • May be too simplistic • Participants may find them irritating

Standard Descriptive Statistics Mean Median Skewness Kurtosis How books are arranged in the library? 4. 063 4. 000 -0. 501 -0. 669 How to search for books in the library catalog? 4. 135 4. 000 -0. 558 What is the topic section of the catalog record? 3. 683 4. 000 -0. 296 -0. 695 How to get books and videos from other libraries? 4. 026 4. 000 -0. 343 -0. 445 Where to search for articles on the library website? 3. 817 4. 000 -0. 341 -0. 736 What kind of search tool is an article database? 4. 325 5. 000 -0. 720 -0. 397 How narrow or focus your search in an article database? 3. 976 4. 000 -0. 442 -0. 765 How to look for different kinds of articles? 4. 214 5. 000 -0. 634 -0. 400 What are the differences between these search tools: Google Scholar, the library catalog and article databases? 3. 778 4. 000 -0. 235 -0. 957

What is normal?

Pearson Correlation of values A B C D E F G H I A 1 0. 6(0) 0. 4(0) 0. 5(0) 0. 4(0) B 0. 6(0) 1 0. 6(0) 0. 5(0) 0. 3(0) C 0. 6(0) 1 0. 5(0) 0. 6(0) 0. 5(0) 0. 4(0) D 0. 4(0). 5(0) 0. 5(0) 1. 5(0) 0. 4(0) 0. 5(0) E 0. 5(0) 0. 6(0) 0. 5(0) 1 0. 8(0) 0. 7(0) 0. 5(0) F 0. 5(0) 0. 4(0) 0. 8(0) 1 0. 7(0) 0. 6(0) G 0. 5(0) 0. 7(0) 1 0. 8(0) 0. 6(0) H 0. 5(0) 0. 4(0) 0. 7(0) 0. 8(0) 1 0. 6(0) <0. 2 A= How books are arranged in the library? 0. 2 -0. 4 -0. 6 B= How to search for books in the library catalog? 0. 6 -0. 8 C= What is the topic section of the catalog record? >0. 8 D= How to get books and videos from other libraries? E= Where to search for articles on the library website? F= What kind of search tool is an article database? G= How narrow or focus your search in an article database? H=How to look for different kinds of article, I= What are the differences between these search tools: Google Scholar, the library catalog and article databases? I 0. 4(0) 0. 5(0) 0. 6(0) 0. 7(0) 1 Very weak relationship Weak relationship Moderate relationship Strong relationship Very strong relationship

Pearson Correlation of newness A A 1 B 0. 5(0) C 0. 4 D 0. 4(0) E 0. 4(0) F 0. 4(0) G 0. 3(0) H 0. 4(0) (0. 001) B C 0. 6(0) 0. 4 1 0. 5(0) 1 (0. 001) D 0. 4(0) 0. 5(0) 0. 3 I 0. 4 (0. 002) 0. 5(0) 0. 3 0. 5(0) 0. 24 0. 5(0) 0. 4(0) 0. 24 0. 5(0) 0. 3 0. 5(0) 0. 50(0) (0. 007) (0. 055) (0. 004) (0. 055) (0. 039) 1 0. 6(0) 0. 5(0) 0. 4(0) 0. 5(0) 0. 6(0) 1 0. 6(0) 0. 5(0) 0. 4 (0. 007) E 0. 4(0) 0. 5(0) 0. 2 (0. 056) F G 0. 5(0) 0. 3 0. 5(0) 0. 4(0) (0. 018) H I 0. 4(0) 0. 4 (0. 002) 0. 4(0) 0. 24 (0. 001) 0. 5(0) 0. 4(0) 0. 6(0) 0. 5(0) 1 0. 6(0) 0. 7(0) 0. 5(0) 0. 6(0) 0. 4(0) 0. 5(0) 0. 4 0. 6(0) 0. 5(0) 0. 7(0) 0. 6(0) 1 0. 5(0) 1 (0. 055) 0. 5(0) 0. 3(0) 0. 4 (0. 002) (0. 001)

Pearson Correlation Question Correlation between newness and importance How books are arranged in the library? -0. 097(0. 442) How to search for books in the library catalog? -0. 087(0. 491) What is the topic section of the catalog record? -0. 156(0. 215) How to get books and videos from other libraries? -0. 044(0. 727) Where to search for articles on the library website? -0. 282(0. 001) What kind of search tool is an article database? 0. 205(0. 107) How narrow or focus your search in an article database? -0. 221(0. 077) How to look for different kinds of articles? -0. 358(0. 001) What are the differences between these search tools: Google Scholar, the library catalog and article databases? -0. 252(0. 043)

Interpreting Results from Both Analyses • Students remembered and seemed to value finding articles/using article databases over finding books/use the library catalog.

GOING FORWARD