click below
click below
Normal Size Small Size show me how
Powell
Learning_10
Question | Answer |
---|---|
concurrent schedule of reinforcement | A complex schedule consisting of the simultaneous presentation of two or more independent schedules, each leading to a reinforcer. |
bias from matching | A deviation from matching in which one alternative attracts a higher proportion of responses than would be predicted by matching, regardless of whether that alternative contains the richer versus poorer schedule. |
undermatching | A deviation from matching in which the proportion of responses on the richer schedule versus poorer schedule is less different than would be predicted by matching. |
overmatching | A deviation from matching in which the proportion of responses on the richer schedule versus poorer schedule is more different than would be predicted by matching. |
melioration theory | A theory of matching that the distribution of behavior in a choice situation shifts toward those alternatives that have higher value regardless of the long-term effect on overall amount of reinforcement. |
commitment response | An action carried out early that serves to eliminate or reduce the value of an upcoming temptation. |
self-control | Given a choice between two rewards, selecting a larger later reward over a smaller sooner reward. |
impulsiveness | Given a choice between two rewards, selecting a smaller sooner reward over a larger later reward. |
(1) alternative does't require as much responding as one is giving to get available reinforcers, (2) overindulgence results in habituation that reduces reinforcer value, (3) behavior is too strongly governed by immediate rather than delayed consequences | Problems with melioration. (3) |
matching law (Herrnstein) | The principle that the proportion of a subject's actions matches the proportion of various rewards available. |
small-but-cumulative effects model | The theory that each individual choice on a self-control task has a small but cumulative effect on our likelihood of obtaining the desired long-term outcome. |
controlling response, controlled response | Skinner's two types of responses for managing self-control. |
physical restraint, depriving and satiating, doing something else, self-reinforcement and self-punishment (Skinner) | Types of controlling responses. (4) |
undermatching, overmatching, bias from matching | Deviations from matching. (3) |
do something else, focus on abstract properties of the rewards (Mischel) | Ways to promote delay of gratification. (2) |
Ainslie-Rachlin model of self-control, hyperbolic discounting | Given two similar rewards humans show a preference for one that arrives sooner rather than later. We discount the value of the later reward. The amount of that discount increase with time. |
innate differences between species, individual differences, age (older, less impulsive), experience responding for delayed rewards, availability of other reinforcers, set up subgoals | Variables affecting the shape of a delay function. (6) |
delayed gratification task | The task of choosing between a smaller reward sooner and a larger reward later. |