Moment objectives Experimental psychology fter the moment the participants shall March 22 and 29. 2006 ogical and psychological variables are lEcturer included, which entails that they shall be able to identify different orientations within psychology Bo Schenkman be able to apply parts of experimental psychology to issues of Human- Computer Interaction. oncerning design, selection of analysis and quality, which entails that brief overview of experimental use a number of different concepts in experimental design gy and a background to experimentation in ch as dependent and independent variables, reliability, validity, factor 3. present the outlines of an own experimental study in the field of Human-Computer Interaction Carson, N, Buskist, w.& Martin, G. N. (2000). Psychology: the Science of ehaviour: European Adaptation. Chap I and 2(pp 2-63) Stencil What I shall speak about homson/Wadsworth, 6th ed, Chap 5, 7, 8, 11, 12 and 14 Stencil. Experimental psychology winer, BJ, Brown, D R.& Michaels, K M.(1991). Statistical Principles in Research methods in psychology Experimental Design. 3rd ed. Boston: McGraw-Hill. Chap 1. Introduction to design,pp1-11.Stencil Optional literature Experimental environment Sarle,wS(1996).Measurement theory: Frequently asked questions. URL: Accuracy: Reliability and validity ftp: //ftp. sas. com/pub/neural/measurement. htm Measurement: Scales Skitka L 1.& Sargis, E.G. (2006). The Internet as psychological boratory. Annual Review of Psycholog. Vol. 57, 529-555 Stencil Stemberg, R.(2005)Cognitive Psychology. Thomson/wadsworth, 4th ed Experiments in daily life Experimental psychology Research methods in psychology Experimental designs Experimental environment ccuracy: Reliability and validity Measurement: Scales
1 Experimental psychology March 22 and 29, 2006 Lecturer: Bo Schenkman Email: bosch@nada.kth.se Purpose: To give a brief overview of experimental psychology and a background to experimentation in HCI Moment objectives After the moment the participants shall 1. be able to design a basic experiment in the field of Human-Computer Interaction, where both technological and psychological variables are included,which entails that they shall be able to identify different orientations within psychology be able to apply parts of experimental psychology to issues of HumanComputer Interaction. 2. be able to analyse studies within Human-Computer Interaction concerning design, selection of analysis and quality, which entails that they shall, be able to use a number of different concepts in experimental design such as dependent and independent variables, reliability, validity, factor and control. 3. present the outlines of an own experimental study in the field of Human-Computer Interaction. Mandatory literature Carson, N., Buskist, W. & Martin, G. N. (2000). Psychology: the Science of Behaviour: European Adaptation. Chap 1 and 2 (pp 2-63). Stencil. McBurney, D.H. & White, T.L. (2004). Research methods. Thomson/Wadsworth, 6th ed. Chap 5, 7, 8, 11, 12 and 14 Stencil. Winer, B.J, Brown, D.R. & Michaels, K.M. (1991). Statistical Principles in Experimental Design. 3rd ed. Boston: McGraw-Hill. Chap 1. Introduction to design, pp. 1-11. Stencil. Optional literature Sarle, W.S. (1996). Measurement theory: Frequently asked questions. URL: ftp://ftp.sas.com/pub/neural/measurement.html Skitka; L. J. & Sargis, E.G. (2006). The Internet as psychological laboratory. Annual Review of Psychology. Vol. 57, 529-555. Stencil. Sternberg, R.J. (2005) Cognitive Psychology. Thomson/Wadsworth, 4th ed. Chap 1, pp 1 – 27. Stencil. What I shall speak about Experimentation Experimental psychology Research methods in psychology Experimental designs Experimental environment Accuracy: Reliability and Validity Measurement: Scales Experimentation Experimental psychology Research methods in psychology Experimental designs Experimental environment Accuracy: Reliability and Validity Measurement: Scales Experiments in daily life
Philosophy of science Determining causality relations Earlier: focus on theories, e.g. Hempel, Popper and Kuhn Based on common sense absence of method e. g Feyerabend We all do experiments all the time Today: emphasis on the role of experiment, e.g. Deborah Keeping some conditions controlled Is especially for scientific knowledge and its growth Essential for the scientific knowledge cf only theory based data Statistics follows logically, not an end in itself Ronald Fisher Requirements of a good experiment of m Calculation of" insecurity C make a clear and convincing test of a hypothesis created the foundations for modern statistical science (McBurney White) Some psychological pioneers psycholog gn Experimental environment ccuracy: Reliability and validity Measurement: Scales William James Sigmund Freud James Gibson B.F. Skinne
2 Experimentation Determining causality relations Based on common sense We all do experiments all the time Keeping some conditions controlled Verifying the results Essential for the scientific knowledge cf. only theory based data Statistics follows logically, not an end in itself Philosophy of science Earlier: focus on theories, e.g. Hempel, Popper and Kuhn or absence of method, e.g Feyerabend. Today: emphasis on the role of experiment, e.g. Deborah Mayo - especially for scientific knowledge and its growth Ronald Fisher “…created the foundations for modern statistical science." Requirements of a good experiment Absence of systematic errors Precision “Validity” – the capacity of making generalization Simplicity Calculation of “insecurity” (Cox) The elegant experiment : the simplest experiment that will make a clear and convincing test of a hypothesis (McBurney & White) Experimentation Experimental psychology Research methods in psychology Experimental design Experimental environment Accuracy: Reliability and Validity Measurement: Scales Some psychological pioneers William James Sigmund Freud James Gibson B.F. Skinner
Notions and relations of psychology Image colour phenomenon-induction Human Factors and ergonomics Experimental vs non-experimental psychology Divisions Aerospace Systems Human Factors and Society for General pschology Ergonomics Society etiseo engineering and Internet 5. Evaluation, Measurement, and Statistics 6. Behavioral Neuroscience and Comparative Computer Systems Perception and Performance Product Design Developmental Psychology 17. Society of Counseling Psychology Safety 19. Society for Military Psychology Forensics Professional for the Psychological Study of Social 20. Adult Development and Aging (SPSSI) System Development 21. Applied Experimental and Engineering Society for the Psychology of Aesthetics, Psychology Human Performance Modeling Test and evaluation Creativity and the Arts 12. Socety of Clinical Psychology 55. American Society for the Advancem Virtual Environments 13. Society of Consulting Psychology Object of study Scientific perspectives in modern psycholo Technical system or psychological processes? Psychodynamic Difference Human Factors- Psychology Cognitive Determines choice of and analysis of variable Socio cultural
3 Notions and relations of psychology Theoretical psychology Applied psychology Human Factors and Ergonomics Human Computer Interaction Experimental vs non-experimental psychology Clinical psychology Image colour phenomenon- induction Divisions 1. Society for General Psychology 2. Society for the Teaching of Psychology 3. Experimental Psychology 5. Evaluation, Measurement, and Statistics 6. Behavioral Neuroscience and Comparative Psychology 7. Developmental Psychology 8. Society for Personality and Social Psychology 9. Society for the Psychological Study of Social Issues (SPSSI) 10. Society for the Psychology of Aesthetics, Creativity and the Arts 12. Society of Clinical Psychology 13. Society of Consulting Psychology 14. Society for Industrial and Organizational Psychology 15. Educational Psychology 16. School Psychology 17. Society of Counseling Psychology 18. Psychologists in Public Service 19. Society for Military Psychology 20. Adult Development and Aging 21. Applied Experimental and Engineering Psychology 22………….. 55. American Society for the Advancement of Pharmacotherapy Aerospace Systems Aging Cognitive Engineering and Decision Making Communications Computer Systems Education Environmental Design Forensics Professional Health Care Human Performance Modeling Individual Differences in Performance Industrial Ergonomics Internet Macroergonomics Perception and Performance Product Design Safety Surface Transportation System Development Test and Evaluation Training Virtual Environments Object of study Technical system or psychological processes? Difference Human Factors - Psychology Determines choice of and analysis of variable Scientific perspectives in modern psychology Biological Psychodynamic Behaviouristic Cognitive Humanist Evolutionary Socio cultural
Pavlov and dog Freuds coach. now in the Freud museum. London Functional Magnetic Resonance Imaging(fMRI) HMI: Car simulator Research methods in modern psychology ital psychology Controlled laboratory experiment ychobiological research; e. g EEG, fMRI esearch methods in psychology Self-reports, verbal protocols, self-ratings, diaries Naturalistic observations; e. g in home, at work ccuracy: Reliability and validity Computer simulations Measurement: Scales Each has its advantages and disadva 4
4 Pavlov and dog Skinner box Freud´s coach, now in the Freud museum, London Functional Magnetic Resonance Imaging (fMRI) 2.6 m Night vision camera projector Test driver Screen Screen Screen Ambient world projectors HMI: Car simulator Experimentation Experimental psychology Research methods in psychology Experimental design Experimental environment Accuracy: Reliability and Validity Measurement: Scales Research methods in modern psychology Controlled laboratory experiment Psychobiological research; e.g EEG, fMRI Self-reports; verbal protocols, self-ratings, diaries Case studies Naturalistic observations; e.g in home, at work Computer simulations Each has its advantages and disadvantages
Chosing a research method in psychology Experimentation Experimental psychology xperimental control of independent variables Sample size Research methods in psychology Experimental design Ecological validity Experimental environment Information about individual differences Accuracy: Reliability and Validity Measurement: Scales Experimental Design xperimental sources oferror Design is the planning of the generation of data, Premeasurement error, e.g nervousness ction error, e.g. sensitivity chang Maturation, e.g. hunger, tiredness the aim is to obtain correct information with History, e.g. political, social change: Instrumentation acceptable accuracy, at a cost that will not supercede the value of the information Selection of test Crucial: error reduction and control Measurement occasion wrong De Treatment Dependent variables Supplementary(nuisance)variables Condition tation: ability to con a systematic manner In HCI: Which are the dependent and which
5 Chosing a research method in psychology Random assignment of subjects Experimental control of independent variables Sample size Sample representativeness Ecological validity Information about individual differences Strengths Weaknesses Experimentation Experimental psychology Research methods in psychology Experimental design Experimental environment Accuracy: Reliability and Validity Measurement: Scales Experimental Design Design is the planning of the generation of data, where the aim is to obtain correct information with acceptable accuracy, at a cost that will not supercede the value of the information. Crucial: error reduction and control Experimental sources of error Premeasurement error, e.g. nervousness Interaction error, e.g. sensitivity change Maturation, e.g. hunger, tiredness History, e.g. political, social changes Instrumentation Selection of test persons Mortality – missing cases Reactive error, e.g. artificiality of test Measurement occasion wrong Surrogate situation Design terminology Many from agriculture: Treatment Plot Condition Level Block Variables Independent variables Dependent variables Supplementary (nuisance) variables Experimentation: ability to control/manipulate variables in a systematic manner In HCI: Which are the dependent and which are the independent variables?