Welcome to the Fall, 2018 Web Page for CS498 KA3/KA4: Experimental Methods for HCI and Interactive Technologies in Engineering

*Course Instructor*: Alex Kirlik.

*Instructor's Office Hours*: Tuesdays, 12:15 - 2:00 or arranged via email.

*Course Teaching Assistant (TA)*: Sebastian Rodriguez (CS HCI PhD student). Email: srodri44@illinois.edu

*TA's Office Hours and Location*: Thursdays 12:30 - 2:00 in Seibel 0207 (basement). TA's office hours begin the week the 1st homework is assigned.

*Course Description*: This course covers conceiving, designing, performing, analyzing data and reporting the results of experiments in HCI contexts and evaluating interactive technologies in engineering. Topics include defining the research question, selecting experimental objects, tasks, and participants, the ethical protection of subjects, selecting an experimental design, threats to validity, the collection and analysis of both qualitative and quantitative data and reporting experimental research in publications. Both parametric and nonparametric data analysis are covered, including the most commonly used inferential statistical tests such as repeated- and independent-measures ANOVA, post-hoc Tukey, Wilcoxon, Mann-Whitney, Kruskal-Wallis and others.

Statistical material is taught using methods and examples based on mathematical foundations rather than with a statistical analysis software language or package to provide students a rigorous and intuitive understanding of these methods to complement the conveniences these programming environments provide in everyday research practice.

A variety of contemporary, empirical methodological topics in HCI in addition to experimentation, such as ethnography, surveys, crowdsourcing, social network analysis, using sensor data streams, and eye tracking are covered in supplementary readings and class discussions. Class time includes lectures based on the e-book text available from the UI library and discussions and presentations based on the supplementary readings. Grades are based on homework, 1 class presentation done in a small student group (of 2 or 3 students) and 2 exams. Class preparation (evidence of completing each reading assignment prior to the assigned class meeting) and class participation will be considered as subjective factors when determining final course grades, especially in borderline situations.

*Course Time and Location*: Tuesdays and Thursdays, 11:00am - 12:15pm, 1131 Siebel Center for Computer Science.

*Textbook Website*: Author: H.K. Purchase, Cambridge U. Press: Experimental Human-Computer Interaction.

*Online Course Textbook*: A Free Online Version of this Textbook is Available by Logging into your UIUC Library Account.

*Other Reading (Book)*: Editors: J.S. Olson and W.K. Kellogg, Springer: Ways of Knowing in HCI.

*Other Reading*: The Olson & Kellogg book is also available as an e-book from the UI Library. One ACM "CHI" conference proceedings article on Bayesian perspectives on HCI is available for download from this site (see below).

*Course Format*: The first 3 weeks of the class (the first 6 class meetings) will primarily involve lectures based on assigned readings (see Course Schedule below, which includes information on all reading assignments, which are expected to be completed PRIOR to the date - class meeting - listed there). Beginning with the 4th week, and except for the 2 weeks in which exams will be given, the general format of this course is as follows. Each Tuesday, the instructor will lead a discussion based on an assigned reading from the course text as indicated in the course schedule. Each Thursday, class will begin with any further discussion that may be needed to gain closure on the material assigned for the previous class, and/or for any discussion or Q&A related to homework assignments. The instructor's class presentation files will be posted on this site (below) after these presentations have been made in class.

The remainder of each Thursday's class will involve either 1 or 2 graduate students enrolled in the "KA4" (4 credit hour section) conducting presentations and discussions of readings (chapters) on additional methodological topics from the supplementary "Ways of Knowing in HCI" book volume). These presentations and discussions should also draw freely upon publications cited in these chapters, especially to provide concrete examples of research to complement the more abstract discussions of this research provided within each chapter. As a rough rule of thumb, groups should plan to create a presentation file of about 25-35 slides, which should result, given Q&A with the class and instructor, in a discussion of approximately 45-60 minutes.

Finally, the Course Schedule indicates the dates on which each of the 6 homework assignments, all concerning the portion of the course devoted to statistics, and 2 exams will be given. All homework assignments will be made available from and submitted using our companion Compass site for the course: . All homework assignments are to be submitted by class time 1 week after they were assigned. More information about the nature of these assignments will be provided prior to the first such assignment.

*Evaluation and Grading*: Final course grades will be determined as follows. Undergraduate students (KA3 section): Each of the 2 exams: 35%. Each of the 6 homework assignments: 5%. Graduate Students (KA4) section: Each of the 2 exams: 30%. Each of the 6 homework assignments: 5%. Leading a class presentation/discussion: 10%. Class preparation (evidence of completing each reading assignment prior to the assigned class meeting) and class participation, will be considered as subjective factors when determining final course grades, especially in borderline situations, for ALL students, both UG and GRAD.

*Class Schedule Available for Download:*

*Other Course Files (to be added as we go):*

*Instructor's Class Presentation Files (TBD: Each Posted After In-Class Presentation):*

- Lecture 1 Slides: August 30, 2018.
- Lecture 2 Slides: September 4-6, 2018.
- Lecture 3 Slides: September 6-11, 2018.
- Lecture 4 Slides Part 1: September 13, 2018.
- Lecture 4 Slides Part 2: September 13, 2018.
- Lecture 5 Slides: September 25, 2018.
- Lecture 6 Slides: October 2, 2018.
- Lecture 7 Slides: October 9 & 11,, 2018.
- Lecture 8 Slides: October 23, 2018.
- Lecture 9 Slides: October 30, 2018.
- Lecture 10 Slides: November 6, 2018.
- Lecture 11 Slides: November 13, 2018.
- Lecture 12 Slides: November 27, 2018.
- Lecture 13 Slides: December 4, 2018. cs498-Survey-Research.pdf

*Student Group Class Presentation Files Based on Chapters/Topics from "Ways of Knowing in HCI" Volume (Each Posted After In-Class Presentation):*

- Research Ethics in HCI Student Presentation Slides.
- Ethnographic Methods in HCI Student Presentation Slides.
- Online Communities Student Presentation Slides.
- Crowdsourcing Student Presentation Slides.
- Social Network Analysis Student Presentation Slides.
- Sensor Data Streams Student Presentation Slides.
- Eye Tracking Student Presentation Slides.
- Retrospective Methods Student Presentation Slides.
- Survey Research Student Presentation Slides.

End