CS 594 Empirical Methods in HCC Course Introduction

  • Slides: 21
Download presentation
CS 594: Empirical Methods in HCC Course Introduction Dr. Debaleena Chattopadhyay Department of Computer

CS 594: Empirical Methods in HCC Course Introduction Dr. Debaleena Chattopadhyay Department of Computer Science debchatt@uic. edu debaleena. com hci. cs. uic. edu

Course Details Credit Hours Class Time Class Location Instructor's Office Hours 4 Monday &

Course Details Credit Hours Class Time Class Location Instructor's Office Hours 4 Monday & Wednesday, 4: 30 pm — 5: 45 pm ERF 2068 1135 SEO Monday & Tuesday, 11 am — 12 pm at 1135 SEO

What is human-centered computing? Human-Centered Computing (HCC) is the interdisciplinary science of designing computational

What is human-centered computing? Human-Centered Computing (HCC) is the interdisciplinary science of designing computational artifacts that better support human endeavors.

What are empirical methods? Empiricism is a branch of epistemology—how we come to know

What are empirical methods? Empiricism is a branch of epistemology—how we come to know something—that emphasizes the role of data or empirical evidence in the formation of new knowledge or ideas. In contrast to rationalism and skepticism, empiricism argues that we know something by means of our senses (sensory experience), particularly by observation and experimentation.

What are empirical methods? • Systematic study of a system/phenomenon • Results that are

What are empirical methods? • Systematic study of a system/phenomenon • Results that are replicable • Results that are (somewhat) generalizable

Type of Empirical Studies in HCI Quantitative, such as A/B testing, between-subject studies, within-subject

Type of Empirical Studies in HCI Quantitative, such as A/B testing, between-subject studies, within-subject studies, or randomized clinical trials (RCT). Qualitative, such as grounded theory, ethnography, phenomenology, contextual inquiry, or content analysis. Quantitative—more prevalent in US, while Qualitative studies are more prominently used in Scandinavian countries and Europe.

Why do we need to study computing systems? • To understand system performance •

Why do we need to study computing systems? • To understand system performance • To examine whether the system better support human endeavors? (human-centered computing system) • To find out how to develop a system to better support human endeavors? (human-centered computing system)

The long nose of innovation Sketching User Experiences, Buxton B. (2007)

The long nose of innovation Sketching User Experiences, Buxton B. (2007)

Performance testing vs. human-centered testing • Performance testing: Precision recall curve, confusion matrix, etc.

Performance testing vs. human-centered testing • Performance testing: Precision recall curve, confusion matrix, etc. • Human-centered testing: Usability testing, focus group, survey, log analysis, randomized control trial etc.

Empirical Methods in Human-Centered Computing • We will study empirical methods, not case studies

Empirical Methods in Human-Centered Computing • We will study empirical methods, not case studies or other non-empirical methods. • We will study both qualitative and quantitative empirical methods.

Basic vs. Applied research How do you distinguish basic research and applied research in

Basic vs. Applied research How do you distinguish basic research and applied research in human factors? The degree of application independence. Why do we need basic research? It is useful to identify principles that can be applied regardless of technological change.

Basic vs. Applied research (cont. . )

Basic vs. Applied research (cont. . )

Basic vs. Applied research (cont. . ) What is the relation between basic and

Basic vs. Applied research (cont. . ) What is the relation between basic and applied research? • Basic research provides the concepts and methodologies to solve specific issues. • Applied research identifies specific issues that basic research needs to address.

What will this class teach you? An understanding of the state of the art

What will this class teach you? An understanding of the state of the art of empirical methods in HCC, and (hopefully) an intuition about which methods are appropriate in various application contexts.

Course Overview • Learn 13 empirical methods commonly used in HCC research—a mix of

Course Overview • Learn 13 empirical methods commonly used in HCC research—a mix of qualitative and quantitative methods • Read research papers at the intersection of these research methods and your research interest and reflect on them. • Use one or more methods in your course project.

Course Policies Class conduct: Converse in English at all times, be courteous to peers

Course Policies Class conduct: Converse in English at all times, be courteous to peers during class discussions, disagreements and debates. Give and receive feedback during student presentations respectfully. Class correspondence: Course related doubts and queries should be posted on Piazza. Individual email queries regarding course will not receive responses. Course Assignments: Read instructions carefully. Individual assignments are to be submitted via Blackboard; email group assignments to the instructor. Grades will be posted via Blackboard.

Syllabus Review

Syllabus Review

Student Introductions • Your name, enrolled program, year of study • Your research interest

Student Introductions • Your name, enrolled program, year of study • Your research interest • Some empirical methods that you have used in the past. • What brings you to this class? What do you expect to learn from this class?

Upcoming: • CITI IRB training – DUE Sep 5, 11: 59 pm CST •

Upcoming: • CITI IRB training – DUE Sep 5, 11: 59 pm CST • More readings will be added to the syllabus, tailored to students’ research interests. Post your research introductions on Piazza. • Start thinking about your course projects.