click below
click below
Normal Size Small Size show me how
Intro to Learning
Term | Definition |
---|---|
Operant Behaviours | behaviours that are influenced by their consequences |
law of effect | states that behaviours leading to a satisfying state of affairs are strengthened while behaviours leading to an unsatisfying or annoying state of affairs are weakened |
Operant Conditioning | a type of learning in which the future probability of a behaviour is affected by its consequences |
Operant Behaviour | a class of emitted responses that result in certain consequences |
Reinforcer | follows a behaviour and the future probability of that behaviour increases |
Punisher | follows a behaviour and the future probability of that behaviour is decreased |
Discriminative Stimulus | is a stimulus in the presence of which responses are reinforced and in the absence of which they are not reinforced. They indicated that a response will be followed by a reinforcer |
discriminative sitmulus for punishment | signal that a response will lead to punishment |
Positive Reinforcement | consists of the presentation of a stimulus, following a response, which then leads to an increase in the future strength of that response |
Negative Reinforcement | is the removal of a stimulus following a response which then leads to an increase in the future strength of that response |
Escape behaviour | results in the termination of an aversive stimulus |
Avoidance | occurs before the aversive stimulus is presented and therefore prevents it from happening |
primary reinforcer | is an event that innately reinforceing |
secondary reinforcer | is an event that is reinforcing because it has been associated with some other reinforcer, those events we have learned to like |
generalizes reinforcer | is a type of secondary reinforcer that has been associated with several other reinforcer |
Intrinsic Reinforcement | reinforcement provided by the mere act of performing the behaviour |
Extrinsic Reinforcement | reinforcement provided by some consequence that is external to the behaviour |
Natural Reinforcer | reinforcer that typically provided for a certain behaviour that is the expected consequence of the behaviour |
Contrived reinforcer | are reinforcers that have been deliberately arraged to modify behaviour |
Shaping | is the gradual creation of a new operant behaviour through reinforcement of successive approximations to that behaviour |
schedule of reinforcement | the response requirement that must be met to obtain reinforcement |
continuous reinforcement schedule | in which each specified response is reinforced |
intermittent reinforcement schedule | one in which only some responses are reinforced |
Fixed Ratio Schedule | reinforcement is contingent upon a fixed, predictable number of response |
ratio strain | a disruption in responding due to overly demanding response requirements |
Variable Ratio Schedule | reinforcement is contingent upon a varying, unpredictable number of responses |
Fixed Interval Schedule | reinforcement is contingent upon the first response after a fixed predictable time period |
Variable interval schedule | reinforcement is contingent upon the first response after a varying, unpredicatble period of time |
Fixed Duration Schedule | the behaviour is reinforced after it is performed continuosly for a fixed predictable amount of time |
variable duration schedule | behaviour must be performed continuously for a vary, unpredictable amount of time to get reinforced |
Response-Rate schedule | reinforcement is directly contingent upon the organisms rate of response |
Differential Reinforcement of High Rates | reinforcement is contingent upon emitting at least a certain number of responses in a certain period of time |
Differential Reinforcement of Low Rates | a minimum amount of time must pass between each response before the reinforcer will be delivered |
Differential Reinforcement of Paced responding | reinforcement is contigent upon emitting a series of responses at a set rate |
Complex Schedule | consists of a combination of two or more simple schedules |
Conjunctive Schedule | a type of scheduel in which reinforcement of two or more simple schedules must be met before a reinforcer is delivered |
Adjusting Schedules | the response requirement changes as a function of the organism's peformance while responding for the previous reinforcer |
Chained Schedule | consists of a sequence of two or more simple schedules, each of which has its own discriminative stimulus and the last of which results in a terminal reinforcer |
Goal Gradient effect | is an increase in the strength and/or efficiency of responding as one draws near the goal |
Drive Reduction Theory | an event is reinforcing to the extent that it is associated with a reduction in some type of physiological drive |
Premack Principle | a high probability behaviour can be used to reinforce a low probability behaviour |
Response Deprivation Hypothesis | states that a behaviour can serve as a reinforcer when access to that behaviour is restricted and its frequency thereby falls below its preferred level of occurance |
Behaviour Bliss Point Approach | an organism with free access to alternative activities will distribute its behaviour in such a way as to maximize overall reinforcement |
Extintion | is the nonreinforcement of a previously reinforced response, the result of which is a decrease in the strength of that response |
Extinction Burst | a temporary increase in the frequency and intensity of responding when extinction first was implemented |
Resistance to Extinction | is the extent to which responding persists after an extinction procedure has been implemented |
Partial Reinforcement Effect | behaviour that has been maintained on an intermittent schedule of reinforcement will extinguish more slowly than behaviour that has been maintained on a continuous schedule |
Spontaneous Recovery | is the reappearance of an extinguished response following a rest period after extinction |
Differential reinforcement of other behaviour | reinforcement of any behaviour other than the target behaviour that is being extinguished |
Stimulus Control | which means that the presence of a discriminative stimulus reliable affects the probability of the behaviour |
stimulus generalization | tendency of an operant response to be emitted in the presence of a stimulus that is similar to a discriminative stimulus |
generalization gradient | graphic description of the strength of responding in the presence of stimuli that are similar to the discriminative stimulus and that vary along a contiuum |
Discrimination Training | involves reinforcement of responding in the presence of one stimulus and not another |
Peak Shift Effect | the peak of a generalization gradient following discrimination training will shift the discriminative stimulus to a stimulus that is further removed from the discriminative stimulus for extinction |
Multiple schedule | consists of two or more independent schedules presented in sequence each resulting in reinforcement and each having distinct discriminative stimuli |
Behavioural Contrast | occurs when changing in the rate of reinforcement on one component of a multiple schedule produces the opposite change in the rate of response on another component |
negative contrast effect | increase in the rate of reinforcement on one component and a decrease in the rate of response in the other component |
positive contrast effect | a decrease in rate of reinforcement on one component results in an increase in the rate of response on the other component |
anticipatory contrast | the rate of response varies inversely with an upcoming change in the rate of reinfrocement |
Errorless Discrimination Training | is a gradual training procedure that minimizes the number of errors and reduces many of the averse effects associated with discrimination training |
Two Process Theory of Avoidance | according to this theory two processes are involved in learning the an avoidance response, i)classically conditioning of a fear response and ii)an operant conditioning response of in which moving away from the conditioned stimulus is negatively reinforced |
Exposure and Response Prevention | a method of treating OCD that involves prolonged exposure to the anxiety arousing event while not not engaging in the compulsive behaviour patter that reduces anxiety |
Time-Out | involves the loss of access to positive reinforcers for a brief period of time following occurrence of a problem behaviour |
response cost | removal of a specific reinforcer following the occurrence of a problem behaviour |
Conditioned Suppression Theory | assumes that punishment does not weaken a behaviour instead produced an emotional response that interferes with the occurrence of the behaviour |
Avoidance Theory of Punishment | states that punishment actually involves a type of avoidance conditioning in which the avoidance response consists of any behaviour other than the behaviour being punished |
Learned Helplessness | a decrement in learning ability that results from repeated exposure to uncontrollable aversive events |
Observational Learning | the behaviour of a model is witnessed by an observer and the observer's behaviour subsequently changes |
Contagious Behaviour | is a more or less instinctive or reflexive behaviour triggered by the occurrence of the same behaviour in another individual |
stimulus enhancement | in which the probability of a behaviour is changed because an individual's attention is drawn to a particular item or location by the behaviour of another individual |
Vicarious Emotional Responses | classically conditioned emotional responses that result from seeing these emotional responses exhibited by others |
True Imitation | is a form of observational learning that involves the close duplication of a novel behaviour |
General Imitation | a tendency to imitate a new modeled behaviour with no specific reinforcement for doing so |
rule governed behaviour | in its purist form, a rule is simply a statement about a contingency |
personal rules | verbal descriptions of contingencies that we present to ourselves to influence our behaviour |
say-do correspondence | occurse when there is a close match between what we say we are going to do and what we actually do |
Personal Process Rule | personal rules that indicated the specific process by which a task is to be accomplished |
Bias from Matching | a deviation from matching in which one response alternative attracts a higher proportion of responses than would be predicted by matching, regardless of whether the alternative contains the richer vs. poorer schedule |
commitment response | An action carried out at an early point in time that serves to either eliminate or reduce the value of an upcoming temptation |
concurrent schedule of reinforcement | a complex schedule consisting of the simultaneous presentation of two or more independent schedules each leading to reinforcement |
impulsiveness | with respect the choice between two rewards, selecting the smaller sooner reward over a larger later reward |
matching law | the principle that the proportion of responses emmitted on a particular schedule matches the reinforcers obtained on that schedule |
melioration theory | theory of matching that holds that the distribution of behaviour in a choice situation shifts towards those alternatives that have higher value regardless of the long term effect on overall amount of reinforcement |
overmatching | a deviation from matching in which the proportion of responses on the richer schedule vs. poorer schedule is more different than would be predicted by matching |
self control | with respect to choice between two rewards, selecting a larger later reward over a smaller sooner reward |
small-but-cumulative effects model | each individual choice on a self control task has only a small but cumulative effect on our likelihood of obtaining the desired long term outcome |
undermatching | deviation from matching in which the proportion of responses on the richer schedule versus poor schedule is less different than would be predicted |
Activity Anorexia | an abnormally high level of activity and low level of food intake generated by exposure to restricted schedule of feeding |
Adjunctive Behaviour | An excessive pattern of behaviour that emerges as a by product of an intermittent schedule of for some other behaviour |
Autoshaping | a type of sign tracking in which a pigeon comes to automatically peck at a response key because the key light has been associated with the response-independent of food delivery |
Behaviour systems Theory | a theory of proposing that an animal's behaviour is organized into certain systems or categories with each category containing a set of relevant responses that can become activated in certain situations |
CS_US Relevance | innate tendency to easily associate certain types of stimuli with each other |
displacement activity | an apparently irrelevant activity sometimes displayed by animals when confronted by conflict |
instinctive drift | an instance of classical conditioning in which a genetically based, fixed action pattern gradually emerges and displaces a behaviour that is being operantly conditioned |
Preparedness | innate tendency for an organism to more easily learn certain types of behaviours or to associate certain types of events with others |
sign tracking | a type of elicited behaviour in which an organism approaches a stimulus that signals the presentation of an appetitive event |
taste aversion conditioning | a form of classical conditioning in which a food item that has been paired with gastointestinal illness becomes conditioned aversive stimulus |