, y 5 // Alee // sw // Contents // I // . 8 // I // I // I // I // I // 8 // I // â– // " // I // iH8H2 // H2 â– // // // // // // About the Authors // xvii // Acknowledgments xviii // Preface xix // 1 INTRODUCTION 1 // 1.1 Changes in topics of HCI research over time 3 // 1.2 Shifts in measurement in HCI 5 // 1.3 Inherent conflicts in HCI 9 // 1.4 Interdisciplinary nature of HCI research 11 // 1.5 Communicating your ideas 13 // 1.6 Research and usability testing 14 // Summary of Chapters 14 // Discussion Questions 15 // Research Design Exercise 16 // References 16 // 2 EXPERIMENTAL RESEARCH 19 // 2.1 Types of behavioral research 20 // 2.2 Research hypotheses 22 // 2.2.1 Null hypothesis and alternative hypothesis 23 // 2.2.2 Dependent and independent variables 25 // 2.2.3 Typical independent variables in HCI research 25 // 2.2.4 Typical dependent variables in HCI research 26 // 2.3 Basics of experimental research 27 // 2.3.1 Components of an experiment 27 // 2.3.2 Randomization 28 // 2.4 Significance tests 30 // 2.4.1 Why do we need them? 30 // 2.4.2 Type I and Type II errors 32 // 2.4.3 Controlling the risks of Type I and Type II errors 34 // 2.5 Limitations of experimental research // Summary // Discussion Questions // Research Design Exercises // References // EXPERIMENTAL DESIGN // 3.1 What needs to be considered when designing experiments? // 3.2 Determining the basic design structure // 3.3 Investigating a single independent variable // 3.3.1 Between-group design
and within-group design // 3.3.2 Choosing the appropriate design approach // 3.4 Investigating more than one independent variable // 3.4.1 Factorial design // 3.4.2 Split-plot design // 3.4.3 Interaction effects // 3.5 Reliability of experimental results // 3.5.1 Random errors // 3.5.2 Systematic errors // 3.6 Experimental procedures // Summary // Discussion Questions // Research Design Exercises // References // STATISTICAL ANALYSIS // 4.1 Preparing data for statistical analysis // 4.1.1 Cleaning up data // 4.1.2 Coding data // 4.1.3 Organizing data // 4.2 Descriptive statistics // 4.2.1 Measures of central tendency // 4.2.2 Measures of spread // 4.3 Comparing means // 4.4 T tests // 4.4.1 Independent-samples t test // 4.4.2 Paired-samples t test // 4.4.3 Interpretation of t test results // 4.4.4 Two-tailed t tests and one-tailed t tests // // Contents // 5 // .9 // cee // 2- 25 H // t-r . ece // c: // sHdse 2: // dsu // 2.3.5;. // -2 // gäeE // Analysis of variance // 4.5.1 One-way ANOVA // 4.5.2 Factorial ANOVA // 4.5.3 Repeated measures ANOVA // 4.5.4 ANOVA for split-plot design // Assumptions of t tests and F tests // Identifying relationships // Regression // Nonparametric statistical tests // 4.9.1 Chi-square test // 4.9.2 Other non-parametric tests // Summary // Discussion Questions // Research Design Exercises // Team Exercises // References // 78 // 79 // 80 // 82 // 83 // 86 // 86 // 89 // 91 // 92 // 94 // 94 // 95 // 96 // 96 // 96 // SURVEYS // 5.1 Introduction
// 5.2 Benefits and drawbacks of surveys // 5.3 Goals and targeted users for survey research // 5.4 Probabilistic sampling // 5.4.1 Stratification // 5.4.2 Response size // 5.4.3 Errors // 5.5 Non-probabilistic sampling // 5.5.1 Demographic data // 5.5.2 Oversampling // 5.5.3 Random sampling of usage, not users // 5.5.4 Self-selected surveys // 5.5.5 Uninvestigated populations // 5.6 Developing survey questions // 5.6.1 Open-ended questions // 5.6.2 Closed-ended questions // 5.6.3 Common problems with survey questions // 5.7 Overall survey structure // 5.8 Existing surveys // 5.9 Paper or online surveys? // 99 // 100 // 101 // 102 // 103 // 105 // 106 // 106 // 107 // 107 // 108 // 109 // 109 // 109 // 111 // 113 // 113 // 115 // 116 // Contents // 5.10 Testing the survey tool 118 // 5.11 Response rate 119 // 5.12 Data analysis 120 // Summary 121 // Discussion Questions 121 // Research Design Exercise 122 // References 122 // 6 DIARIES 125 // 6.1 Introduction 126 // 6.2 Why do we use diaries in HCI research? 127 // 6.3 Participants for a diary study 130 // 6.4 What type of diary? 132 // 6.4.1 Feedback diary 132 // 6.4.2 Elicitation diary 133 // 6.4.3 Hybrid feedback and elicitation diary 134 // 6.5 Data collection for the diary study 134 // 6.6 Letting participants know when to record a diary entry 136 // 6.7 Analysis of diaries 137 // Summary 138 // Discussion Questions 138 // Research Design Exercise 138 // References 139 // Appendix A Frustration Experience Form (Time Diary)
140 // Appendix B Excel Time Diary Form 141 // 7 CASE STUDIES // 7.1 // 7.2 // 7.3 // 7.4 // Introduction // Observing Sara: a case study of a case study // What is a case study? // 7.3.1 In-depth investigation of a small number of cases // 7.3.2 Examination in context // 7.3.3 Multiple data sources // 7.3.4 Emphasis on qualitative data and analysis // Goals of HCI case studies // 7.4.1 Exploration // 7.4.2 Explanation // 7.4.3 Description // 7.4.4 Demonstration // 143 // 144 // 145 // 147 // 147 // 147 // 148 // 149 // 150 // 150 // 151 // 152 // 154 // 3t // Contents // XI // // // // // // 7.5 Types of case study 156 // 7.5.1 Intrinsic or instrumental 156 // 7.5.2 Single case or multiple cases 156 // 7.5.3 Embedded or holistic 160 // 7.6 Research questions and hypotheses 161 // 7.7 Choosing cases 163 // 7.8 Data collection 164 // 7.8.1 Data sources and questions 164 // 7.8.2 Collecting data 165 // 7.9 Analysis and interpretation 167 // 7.10 Writing up the study 168 // 7.11 Informal case studies 170 // Summary 172 // Discussion Questions 174 // Research Design Exercises 174 // References 175 // 8 INTERVIEWS AND FOCUS GROUPS // 8.1 Pros and cons of interviews // 8.2 Applications of interviews in HCI research // 8.2.1 Initial exploration // 8.2.2 Requirements gathering // 8.2.3 Evaluation and subjective reactions // 8.3 Who to interview // 8.4 Interview strategies // 8.4.1 How much structure? // 8.4.2 Focused and contextual interviews // 8.5 Interviews vs focus groups // 8.6 Types
of question // 8.7 Conducting an interview // 8.7.1 Preparation // 8.7.2 Recording the responses // 8.7.3 During the interview // 8.8 Electronically mediated interviews and focus groups // 8.8.1 Telephone // 8.8.2 Online // 8.9 Analyzing interview data // 8.9.1 What to analyze // 8.9.2 How to analyze // 177 // 178 // 180 // 180 // 184 // 186 // 187 // 189 // 189 // 191 // 192 // 194 // 197 // 197 // 198 // 199 // 203 // 204 // 204 // 206 // 207 // 208 // 8.9.3 Validity 212 // 8.9.4 Reporting Results 212 // Summary 213 // Discussion Questions 214 // Research Design Exercises 214 // References 215 // 9 ETHNOGRAPHY 217 // 9.1 Introduction 218 // 9.2 What is ethnography? 219 // 9.3 Ethnography in HCI 221 // 9.4 Conducting ethnographic research 224 // 9.4.1 Selecting a site or group of interest 225 // 9.4.2 Participating: choosing a role 227 // 9.4.3 Building relationships 230 // 9.4.4 Making contact 231 // 9.4.5 Interviewing, observing, analyzing, repeating, // and theorizing 232 // 9.4.6 Reporting results 236 // 9.5 Some examples 237 // 9.5.1 Home settings 237 // 9.5.2 Work settings 238 // 9.5.3 Educational settings 239 // 9.5.4 Ethnographies of mobile and ubiquitous systems 240 // 9.5.5 Virtual ethnography 241 // Summary 246 // Discussion Questions 246 // Research Design Exercises 247 // References 248 // 10 USABILITY TESTING 251 // 10.1 What is usability testing? 252 // 10.2 How does usability testing relate to traditional research? 254 // 10.3 Types of usability testing or usability
inspections 256 // 10.3.1 Expert-based testing 256 // 10.3.2 Automated usability testing 258 // 10.4 User-based testing 260 // 10.4.1 Types of usability testing 260 // 10.4.2 Stages of usability testing 262 // gazherduk // MN // â– // *0--Rsm-Aä8S*SGEs.wM8SNMMMNSW2,•â€� g8Etede • ■• Contents xiii // 10.4.3 How many users are sufficient? // 10.4.4 Locations for usability testing // 10.4.5 Task list // 10.4.6 Measurement // 10.4.7 The testing session // 10.4.8 Making sense of the data // 10.5 Other variations on usability testing // Summary // Discussion Questions // Research Design Exercise // References // 263 // 264 // 268 // 270 // 271 // 274 // 275 // 276 // 276 // 277 // 277 // 11 ANALYZING QUALITATIVE DATA // 11.1 Introduction // 11.2 Stages of qualitative analysis // 11.3 Grounded theory // 11.4 Content analysis // 11.4.1 What is content? // 11.4.2 Why do we need to collect text or multimedia // information? // 11.4.3 Questions to consider before content analysis // 11.5 Analyzing text content // 11.5.1 Procedure // 11.5.2 Identifying coding categories // 11.5.3 Coding the text // 11.5.4 Ensuring high-quality analysis // 11.6 Analyzing multimedia content // Summary // Discussion Questions // Research Design Exercise // References // 12 AUTOMATED DATA COLLECTION METHODS // 12.1 Exploiting existing tools // 12.1.1 Weblogs // 12.1.2 Stored application data // 12.2 Using software to observe and record // 12.2.1 Web proxies // 12.2.2 Instrumented
software // 281 // 282 // 282 // 283 // 285 // 286 // 286 // 287 // 289 // 289 // 290 // 292 // 294 // 300 // 301 // 302 // 303 // 303 // 307 // 308 // 309 // 315 // 317 // 317 // 321 // 12.2.3 Custom-built software 324 // 12.2.4 Handling stored data 327 // 12.2.5 Keystroke and activity loggers 328 // 12.2.6 Analyzing log files 329 // 12.3 Hybrid data collection methods 330 // 12.4 Automated interface evaluation 333 // 12.5 Challenges of computerized data collection 333 // Summary 336 // Discussion Questions 337 // Research Design Exercises 338 // References 339 // 13 MEASURING THE HUMAN // 13.1 Eye tracking // 13.2 Physiological tools // 13.2.1 Physiological data // 13.2.2 Challenges in data collection and interpretation // 13.3 Examples of physiological research in HCI // Summary // Discussion Questions // Research Design Exercise // References // 343 // 344 // 350 // 351 // 356 // 359 // 361 // 362 // 363 // 363 // 14 WORKING WITH HUMAN SUBJECTS 367 // 14.1 Identifying potential participants 368 // 14.1.1 Which subjects? 369 // 14.1.2 How many subjects? 371 // 14.1.3 Recruiting participants 373 // 14.2 Care and handling of research participants 376 // 14.2.1 Protecting participants 376 // 14.2.2 Informed consent 381 // 14.2.3 Institutional review boards 384 // 14.2.4 Potentially deceptive research? 387 // 14.2.5 General concerns 388 // 14.3 Online research 389 // 14.3.1 Appropriate topics for online research 389 // 14.3.2 Recruiting 389 // 14.3.3 Study design 391 // // //
// // // // // // // // Contents // .. FF-- 283 // 8 ( 0 25 ( // ’ g // AR320e // 2 // 5g // ; s so // è // nce // // // // // // // 14.3.4 Ethical concerns // 14.3.5 Data collection // Summary // Discussion Questions // Research Design Exercises // References // 391 // 392 // 393 // 394 // 395 // 396 // 15 WORKING WITH RESEARCH PARTICIPANTS WITH IMPAIRMENTS // 15.1 Introduction // 15.2 How many participants? // 15.2.1 Small sample sizes // 15.2.2 Distributed research // 15.2.3 In-depth case studies // 15.3 Proxy users // 15.4 Multi-Population Studies // 15.5 Recruiting users through community partners // 15.6 Pilot studies // 15.7 Scheduling users with impairments // 15.8 Documentation for users with impairments // 15.8.1 Human subjects forms // 15.8.2 Research documentation // 15.9 Differing levels of ability // 15.10 Bringing extra computer parts // 15.11 Payment // Summary // Discussion Questions // Research Design Exercise // References // 399 // 400 // 401 // 401 // 401 // 402 // 403 // 404 // 405 // 407 // 408 // 419 // Index