Welcome to the Spring, 2017 Web Page for CS598 ACK: Experimental Methods for HCI and Interactive Technologies in Engineering

Course Instructor: Alex Kirlik.

Instructor's Office Hours: Wednesdays, 12:15 - 2:00 or arranged via email.

Course Teaching Assistant (TA): Robert Deloatch (CS HCI PhD student). Email: deloatc2@illinois.edu

TA's Office Hours and Location: Tuesdays, 9-10am, Siebel Center 3107 Desk #11.

Course Description: This course covers conceiving, designing, performing, analyzing data and reporting the results of experiments in HCI contexts and evaluating interactive technologies in engineering. Topics include defining the research question, selecting experimental objects, tasks, and participants, the ethical protection of subjects, selecting an experimental design, threats to validity, the collection and analysis of both qualitative and quantitative data and reporting experimental research in publications. Both parametric and nonparametric data analysis are covered, including the most commonly used inferential statistical tests such as repeated- and independent-measures ANOVA, post-hoc Tukey, Wilcoxon, Mann-Whitney, Kruskal-Wallis and others.

Statistical material is taught using methods and examples based on mathematical foundations rather than with a statistical analysis software language or package to provide students a rigorous and intuitive understanding of these methods to complement the conveniences these programming environments provide in everyday research practice.

A variety of contemporary, empirical methodological topics in HCI in addition to experimentation, such as ethnography, surveys, crowdsourcing, social network analysis, using sensor data streams, and eye tracking are covered in supplementary readings and class discussions. Class time includes lectures based on the e-book text available from the UI library and discussions and presentations based on the supplementary readings. Grades are based on homework, 1 class presentation done in a small student group (of 2 or 3 students) and 2 exams. Class preparation (evidence of completing each reading assignment prior to the assigned class meeting) and class participation will be considered as subjective factors when determining final course grades, especially in borderline situations.

Course Time and Location: Wednesdays and Fridays, 11:00am - 12:15pm, 1131 Siebel Center for Computer Science.

Textbook Website: Author: H.K. Purchase, Cambridge U. Press: Experimental Human-Computer Interaction.

Online Course Textbook: A Free Online Version of this Textbook is Available by Logging into your UIUC Library Account.

Other Reading (Book): Editors: J.S. Olson and W.K. Kellogg, Springer: Ways of Knowing in HCI.

Other Reading: The Olson & Kellogg book is also available as an e-book from the UI Library. One ACM "CHI" conference proceedings article on Bayesian perspectives on HCI is available for download from this site (see below).

Course Format: The first 3 weeks of the class (the first 6 class meetings) will primarily involve lectures based on assigned readings (see Course Schedule below, which includes information on all reading assignments, which are expected to be completed PRIOR to the date - class meeting - listed there). Beginning with the 4th week, and except for the 2 weeks in which exams will be given, the general format of this course is as follows. Each Wednesday, the instructor will lead a discussion based on an assigned reading from the course text as indicated in the course schedule. Each Friday, class will begin with any further discussion that may be needed to gain closure on the material assigned for the previous class, and/or for any discussion or Q&A related to homework assignments. The instructor's class presentation files will be posted on this site (below) after these presentations have been made in class.

The remainder of each Friday's class will involve student-led (in small groups of 2 or 3) presentations and discussions of readings (chapters) on additional methodological topics from the supplementary "Ways of Knowing in HCI" book volume. These presentations and discussions should also draw freely upon publications cited in these chapters, especially to provide concrete examples of research to complement the more abstract discussions of this research provided within each chapter. As a rough rule of thumb, groups should plan to create a presentation file of about 25-35 slides, which should result, given Q&A with the class and instructor, in a discussion of approximately 45-60 minutes.

Finally, the Course Schedule indicates the dates on which each of the 6 homework assignments, all concerning the portion of the course devoted to statistics, and 2 exams will be given. All homework assignments will be made available from and submitted using our companion Compass site for the course. All homework assignments are to be submitted by class time 1 week after they were assigned. More information about the nature of these assignments will be provided prior to the first such assignment on Wednesday, Feb. 22nd.

Evaluation and Grading: Final course grades will be determined as follows. Each of the 2 exams: 25%. Each of the 6 homework assignments: 5%. Student (group) presentation/discussion: 20%. Again, class preparation (evidence of completing each reading assignment prior to the assigned class meeting) and class participation will be considered as subjective factors when determining final course grades, especially in borderline situations.

Class Schedule Available for Download:

  • Class Schedule.
  • Other Course Files:

    Instructor's Class Presentation Files (Each Posted After In-Class Presentation):

  • Lecture 1 Slides: Jan 20, 2017.
  • Lecture 2 Slides (Part 1 of 2): Jan 25, 2017.
  • Lecture 2 Slides (Part 2 of 2): Jan 27, 2017.
  • Lecture 3 Slides: Feb 1, 2017.
  • Lecture 4 Slides (Part 1 of 2): Feb 3, 2017.
  • Lecture 4 Slides (Part 2 of 2): Feb 8, 2017.
  • Lecture 5 Slides: Feb 8, 2017.
  • Lecture 6 Slides: Feb 15, 2017.
  • Lecture 7 Slides: Feb 22, 2017.
  • Lecture 8 Slides: March 1, 2017.
  • Lecture 9 Slides: March 8, 2017.
  • Lecture 10 Slides: March 15, 2017.
  • Lecture 11 Slides: March 29, 2017.
  • Lecture 12 Slides: April 5, 2017.
  • Lecture 13 Slides: April 12, 2017.
  • Student Group Class Presentation Files Based on Chapters/Topics from "Ways of Knowing in HCI" Volume (Each Posted After In-Class Presentation):

  • Student Presentation on Ethics in HCI Research: Feb 10, 2017.
  • Student Presentation on Ethnography: Feb 17, 2017.
  • Student Presentation on Research Involving Online Communities: Feb 24, 2017.
  • Student Presentation on Crowdsourcing: March 3, 2017.
  • Student Presentation on Social Network Analysis in HCI: March 10, 2017.
  • Student Presentation on Using Sensor Data Streams in HCI Research: March 31, 2017.
  • Student Presentation on Survey Research Methods in HCI Research: April 7, 2017.
  • Student Presentation on Eye-Tracking and Psyhcophysical Research Methods in HCI: April 14, 2017.
  • Student Presentation on Retrospective Research Methods in HCI: April 21, 2017.
  • End