click below
click below
Normal Size Small Size show me how
Research Methods T1
RM Test 1
Question | Answer |
---|---|
T or F: Humans can rely solely on intuition and common sense | False |
What 3 phenomena illustrate that humans cannot rely solely on intuition and common sense? | 1) Hindsight bias 2) Judgmental overconfidence 3) Tendency to perceive patterns in random events |
What is hindsight bias? | Aka the "I-knew-it-all-along phenomenon," the tendency to believe, after learning an outcome, that we could have predicted it |
What is overconfidence in terms of the limits of intuition and common sense? | People tend to think they know more than they do |
What does perceiving order in random events have to do with limits to intuition and common sense? | People perceive patterns to make sense of their world...however, even if people preceive patterns that do not look random, these noticed patterns are not always accurate ex) World Cup guessing octopus |
What is skepticism? | Supports questions about behavior and mental processes (such as "What do you mean? How do you know?) |
What is the scientific method? | The process of testing ideas about the world by making a hypothesis based on existing theory, making observations, analyzing whether the data fits our ideas (not modifying them to fit!!!), and accepting conflicting data as a means to improve theory |
What is a theory? | An explanation using an integrated set of principles that organizes observations and predicts behaviors or events |
What is a hypothesis? | A testable prediction, often implied by a theory |
What are operational defintions? | A definition of a variable or construct in terms of exactly how it will be measured |
What is replication in terms of the scientific method? | Repeating the essence of a research study, usually with different participants in different situations, to see whether the basic fidning extends to other participants and circumstances |
What is the difference between science and pseudoscience? | Science is falsifiable, has the ability to be disproven, whereas pseudoscience is not falsifiable |
What is a measurement? | The assignment of scores to individuals so that the scores represent some characteristic of the individuals |
What is psychometrics? | The measurement of psychological variables and constructs (ex. Rosenberg's Self Esteem Scale) |
What are constructs (latent variables)? | A variable that cannot be observed directly (ex. personality traits, emotional states, attitudes, and abilities) |
T or F: Constructs need a technical, highly operational definition. | True |
What are the 3 types of measure? | 1) Self-report measures 2) Behavioral measures 3) Physiological measures |
What are self-report measures? | Participants report on their own thoughts, feelings, and behaviors |
What are behavioral measures? | Researcher observes and records some aspect of participant's behavior |
What are physiological measures? | Involves recording a physiological (biological) variable |
What are the 4 levels/scales of measurement? | 1) Nominal 2) Ordinal 3) Interval 4) Ratio |
What is the nominal level of measurement? | Involves assigning names or category labels to individuals (they do not communicate qualitative information) |
What is the ordinal level of measurement? | Involves rank ordering individuals (don't know the difference between values) (ex. Likert scales) |
What is the interval level of measurment? | Has equal intervals between values but lacks a "true zero" (ex. intelligence, personality) |
What is the ratio level of measurement? | Has equal intervals between values and has a theoretical "true zero" (ex. height, weight, money, # of siblings, test grades, etc.) |
What is reliability? | The extent to which the scores on a measure are consistent across time or across multiple items on the same measure |
What is test-retest reliability? | The extent to which scores on a measure are consistent across time for the same individual |
What is internal consistency? | The extent to which the items on a mutliple-item measure are consistent with each other |
What is split-half correlation? | A type of internal consistency, it is the correlation betweem scores based on one half of the items on a multiple-item measure with scores based on the other half of the items to ensure that they remain consistent |
What is interrater reliability? | How two raters' scores compare (how similar they are) |
What is validity? | The extent to which scores on a measure represent the variable or construct they are intended to measure |
What is face validity? | Does it look valid? (the sniff test) |
What is content validity? | Does it measure all aspects of the construct it is measuring? |
What is criterion validity? | How related are the scores on the measure to the scores on another related criteria? (ex. time studying and memory retention |
What is discriminant validity? | How dissimilar is the measure compared to other constructs' measures? (ex. openness v. extraversion) |
What is reactivity? | How people react when being measured |
What is socially desirable responding? | Respond in socially appropriate ways, such as over-reporting good behavior, and under-reporting negative behavior (ex. Do you give money to charity?) |
What are demand characteristics? | Respond to how they think the researcher wants them to behave or how they think the desired data would (behave differently) (ex. studies looking at sharing behavior in the lab |
What is a means of construct development? | Guttman's Mapping Sentence |
What is Guttman's Mapping Sentence? | It takes a theorist's statement and breaks it down into measurable components |
What is a Rasch Model? | A logistic (probabilistic) model of dichtomous outcomes (only one step between levels) |
What is a Rating Scale Model? | Involves 3 or more levels and is akin to stacking multiple Rasch models (think of a ladder with equal spaces between rungs) |
What is a Partial Credit Model? | Allows for different size steps/gaps in ability between levels (think of a ladder with different size spaces between rungs) |
What does DIF stand for? | Differential Item Functioning |
What is Differential Item Functioning? | DIF refers to the situation in which members from different groups (age, gender, race, education, culture) on the same level of the latent trait have a different probability of giving a certain response to a particular item |
What is an experiment? | A type of research stuy that looks at causal relationships by manipulating an independent variable (x) and observing its effect on a dependent varaible (y) |
What is descriptive research? | Describes a phenomenon |
What are the 3 main features of an experiment? | 1) Manipulation of the independent variable 2) All other variables are held constant 3) Random assignment to groups |
T or F: If one of the 3 features of an experiment is missing, you do not have an experiment | True |
What are the correct ways to manipulate the IV? | The researcher must systematically change the level of the IV across conditions by either having more or less of the IV across conditions (in equal increments) or it can be the presence or absence of IV across conditions |
What are extraneous variables? | Variables other than the IV and the DV |
Should extraneous variables be held constant or can they change? | Extraneous variables should be held constant or controlled |
What is a confounding variable? | When an extraneous variable changes with the IV (happens unintentionally as a weakeness/flaw of the study) |
What is the purpose of an interview? (2) | - To replicate questionnaire items in person...requires asking the same questions in the same order to the same people, - to gain qualitatively different information than you can from a questionnaire |
T or F: You can gain more information from interviews than surveys. | True |
What is a "talk-through"? | During an interview, asking the participant what they were thinking when they answered the last question (good for pilot work on questionnaires and demonstrating validity) |
What are probing questions? | During an interview, questions that can clarify the structure of reasoning used by an individual or how the individual thinks in more depth |
How to ask the right probing questions? (3) | 1) Clarify ambiguous statements 2) Clarify why a participant said what they said in a non-leading way 3) Challenge contradictions (in a non-leading/non-threatening way) |
What are nonexperimental research methods? | Research methods that do not meet all three of the criteria of an experiment |
T or F: nonexperimental research is of lower value than experimental research. | False, it serves a different purpose |
What are the different types of nonexperimental research? | single-variable research, correlational research, quasi-experimental research, and qualitative research |
What happens to the IV and is there random assignment in a correlation research study? | The IV is not manipulated and there is no random assignment |
What happens to the IV and is there random assignment in a quasi-experimental research study? | The IV is manipulated across conditions and there is no random assignment |
What is single variable research? | Description of a single variable (ex. Milgram's obedience study) |
What becomes comprimised in nonexperimental research and why? | Internal validity is comprimised because extraneous varaibles are not held constant |
Place quasi-experimental, experimental, and correlational research in order of lowest to highest internal validity. | Correlational (low), quasi-experimental (moderate), and experimental (high) |
What is correlational research? | A type of nonexperimental research, in which the researcher measures and assesses the relationship between two variables |
Why use correlational research? (2) | 1) Do not think that the relationship is causal (no manipulation of the IV) 2) Variables can be quantitative or categorical (ex. relationship between gender (categorical) and verbal fluency (quantitative) |
What are the 2 common approaches in correlational research? | 1) Naturalistic observation 2) Archival data |
What is naturalstic observation? | Making observations in a natural environment and utilizes coding |
What is coding? | Target behaviors are specified and then watched for (inter-rater reliability is key here) |
What is archival data? | Using data that has already been collected for another purpose...involves content analysis |
What does "quasi" mean? | Resembling |
What is quasi-experimental research? | When the independent variable is manipulated, but there is no random assignment...typically used when random assignment is impossible or very difficult |
What are the 2 types of quasi-experimental research designs? | 1) Nonequivalent groups design 2) Pretest-posttest design |
What is a nonequivalent groups design? | A between subjects quasi-experimental design in which participants have not been randomly assigned |
What is a pretest-posttest design? | The dependent variable is measured once before the treatment/intervention and once after (ex. students understanding of experimental psychology before (pretest) and after (posttest) taking the course) |
What are the problems with a pretest-posttest design? (4) | History, Maturation, Regression to the mean, and Spontaneous Remission |