Glossary / Lexicon

Deutsch: Variabler Quotenplan / Español: Razón Variable / Português: Razão Variável / Français: Ratio Variable / Italiano: Rapporto Variabile

Variable-Ratio refers to a type of reinforcement schedule in which rewards are given after an unpredictable number of responses. In psychology, particularly in the context of operant conditioning, this reinforcement schedule is used to encourage high and consistent rates of behaviour because the subject never knows exactly when the next reward will occur, but knows that the reward is tied to repeated behaviour.

Description

In psychology, variable-ratio (VR) schedules are a key concept in operant conditioning, first studied by B.F. Skinner. Under this type of reinforcement, the subject receives a reward after a varying number of responses, meaning the number of actions required to receive the next reinforcement is unpredictable. Unlike fixed-ratio schedules, where a set number of responses is needed for reinforcement (e.g., every 5th response is rewarded), the variable-ratio schedule creates uncertainty because the number of required responses changes each time (e.g., reinforcement might occur after 3 responses, then 7, then 5, and so on).

This unpredictability creates a powerful motivating effect, leading to high and persistent rates of behaviour. The subject continues to perform the behaviour frequently because they know that the reward is based on response frequency, but they cannot predict exactly when it will come. This makes variable-ratio schedules highly effective at promoting consistent action over time, even when reinforcement is occasional.

A well-known example of this principle is gambling. In slot machines, for instance, the player does not know how many lever pulls it will take to win, but because the possibility of a reward is always present, they continue to play. The variable-ratio schedule ensures that gambling behaviour persists despite infrequent wins because of the unpredictability of the payoff.

Application Areas

Variable-ratio schedules are used in various settings, particularly where high levels of consistent behaviour are desired:

• Behavioural psychology: VR schedules are used to study how different patterns of reinforcement affect behaviour, motivation, and learning.
• Gambling: Slot machines and other forms of gambling use variable-ratio reinforcement to keep players engaged, as wins occur unpredictably.
• Video games: Many games use VR reinforcement to keep players engaged, such as random rewards for defeating enemies or finding rare items after an unpredictable number of actions.
• Sales and marketing: Salespeople may be reinforced with bonuses or commissions after an unpredictable number of sales, encouraging ongoing effort and persistence.

Well-Known Examples

1. Slot machines: One of the most classic examples of a variable-ratio schedule, slot machines are designed to reward players after an unpredictable number of lever pulls or button presses, making the behaviour highly persistent.
2. Sales commissions: In some sales jobs, employees receive commissions based on an unpredictable number of successful sales, which encourages them to keep trying because they know a reward is coming, even if they don't know when.
3. Fishing: Similar to slot machines, fishing operates on a variable-ratio schedule because the fisherman doesn't know how many casts or attempts it will take to catch a fish, which motivates continued effort.

Risks and Challenges

While variable-ratio schedules are highly effective in promoting sustained behaviour, they also come with some challenges and risks:

• Compulsive behaviour: Due to the unpredictability of the reward, individuals may engage in the behaviour excessively, leading to compulsive actions, as seen in gambling addiction.
• Extinction resistance: Behaviour learned under a variable-ratio schedule is highly resistant to extinction. Even when rewards stop, the behaviour may continue for a long time, as the subject has learned that persistence usually pays off.
• Frustration: The uncertainty of when the next reward will occur can lead to frustration or stress in some contexts, especially if the reinforcement is too infrequent.

Similar Terms

• Fixed-ratio schedule: Reinforcement is provided after a set, predictable number of responses, leading to high rates of behaviour but with pauses after each reward.
• Variable-interval schedule: Reinforcement is given after varying amounts of time, not based on the number of responses, promoting steady but slower behaviour.
• Fixed-interval schedule: Reinforcement occurs after a fixed amount of time, often resulting in behaviour that increases as the reinforcement time approaches.
• Partial reinforcement: A broader concept where reinforcement is provided only intermittently, not after every response, which includes both ratio and interval schedules.

Summary

Variable-ratio reinforcement in psychology refers to a schedule in which rewards are given after an unpredictable number of responses. It is highly effective at promoting persistent behaviour because the subject never knows when the next reward will come, leading to consistent, high levels of engagement. Commonly seen in gambling, sales, and certain aspects of gaming, this schedule creates strong behavioural persistence but can also lead to compulsive behaviour and resistance to stopping the behaviour even when rewards cease.

--