4303 Ed/Serious Feedback and Reinforcement Feedback and - - PowerPoint PPT Presentation

4303 – Ed/Serious

Feedback and Reinforcement

Feedback and Reinforcement

• Both of them are the most important

concepts in learning.

• Any differences?

Feedback

• Feedback involves providing learners with

information about their responses

• Positive
• Negative
• Neutral (attendancy)
• External

Feedback

• Feedback helps learners to maximize their

potential at different stages of training, raise their awareness of strengths and areas for improvement, and identify actions to be taken to improve performance.

Reinforcement

• Something that happens after a behavior that

makes the behavior more likely to occur again.

• Reinforcement is defined by its effect on
• behavior. Only environmental events that

actually increase behavior are reinforcers.

• Positive (Increase the response )
• Negative (Decrease the response )
• External
• Instrinsic (Generated by the individual)

Reinforcement

• Positive reinforcement occurs when desired

behavior is strengthened by the presentation of a contingent stimulus. The attractive, behavior- increasing, contingent stimulus used during positive reinforcement is referred to as a positive

• reinforcer. A positive reinforcer is defined as any

environmental event that, when given in response to the behavior, increases the strength and frequency of that behavior. Some commonly used positive reinforcers in the classroom are praise, attention, tokens, and stickers.

Reinforcement

• Negative reinforcement occurs when desired behavior

is strengthened by the removal of a contingent

• stimulus. The aversive, behavior-increasing, contingent

stimulus that is removed during negative reinforcement is referred to as a negative reinforcer. A negative rein-forcer is defined as any environmental event that, when taken away in response to the behavior, increases the strength and frequency of that

• behavior. Some commonly used negative reinforcers in

the classroom are taking away an aversive assignment (e.g., homework), withdrawing an intrusive stare, or canceling a chore.

Reinforcement

Reinforcement

Information Processing

• Information processing theories tend to

emphasize the importance of feedback to learning since knowledge of results is necessary to correct mistakes and develop new plans.

Behavioral

• Behavioral theories focus on the role of

reinforcement in motivating the individual to behave in certain ways.

Timing

• Timing is important for both the feedback and

reinforcement.

– The length of time between the response and the feedback or reinforcement.

• In general, the more immediate the feedback
• r reinforcement, the more learning is

facilitated.

Feedback/Reinforcement in Games

• Positive feedback loops in games are mechanics

that reinforce the success or failure of the player and make future successes more probable.

• The cliche often used to explain positive feedback

loops is “the rich get richer”. Having money is

• ften a prerequisite to gaining more money: you

need capital to start a business, so the ones making money are the ones already rich.

• Examples?

Examples

• Quake II faces positive feedback loops. The

relevant mechanic is that when you die, you restart with guns that are not as good as the

• nes that can be picked up on the battlefield.

The player with the first kill then has an inherent advantage – he will have better weapons than the newly respawned player and will be more likely to kill him again, given equal skill.

Examples

• Professional baseball in America has a

somewhat muted positive feedback loop. There are no salary caps in baseball, so teams can spend as much money as they have to procure the best players. The best players (one would think) lead to the best success on the field. Success on the field leads to more money as people bid up tickets and buy

• merchandise. That money can then be fed into

buying even better players.

Feedback/Reinforcement in Games

• Negative feedback loops in games are mechanics

that cause to hinder succeeding players from further success or failing players from further failures.

• Negative feedback is dangerous because it sends

mixed signals. We direct our players to succeed – win the race, kill the bad guys etc., but at the same time our negative feedback mechanics do not agree with our stated intent.

• Examples?

Examples

• Mario Kart is a racing game where players have weapons that

they can use to speed themselves up or hinder the progress of their opponents. In a later installment, Nintendo added the Blue Shell weapon. The Blue Shell is the ultimate negative feedback

• loop. It homes in and destroys the player in first place no matter

where they are on the map. There is nothing the first place player can do to avoid this. The blue shell is almost inevitable – there is almost one in every race. It is always on the mind of the player in first. Succeeding players are punished – no one wants to be too far ahead of the pack because the blue shell will knock them back. Instead, it encourages a dynamic where players want to be in second place until the final parts of the race – safe from blue shells but also close enough to take the lead by the finish.

Examples

• Since most racing games are more interesting when you are

jockeying for position with other cars, if you do too well and leave the pack behind, the AI will cheat and make the

• pponents go supernaturally fast to catch up with player to

encourage more nail-biting racing. This punishes the player for succeeding, which goes against all the other mechanics in many of these games which are tailored to encourage the player to race well.

• Players are almost unanimously against this technique – do

a search in racing game reviews for “rubber-band AI” and you will see what I mean. Designers here are faced with a conundrum – have no “rubber banding” and let good players race off into the distance, effectively racing time trails, or have the AI cheat to make the race more exciting.

Why both Positive and Negative?

• Positive feedback loops are naturally occurring for a

simple reason: players direct themselves towards actions that make them stronger.

• Negative feedback loops are much harder to come by

because they can be simply contradictory and non-

• intuitive. We guide players to help them succeed and

then behind the scenes sabotage them with negative feedback so that succeeding is bad.

• We spend more time figuring out solutions to positive

feedback situations than negative because positive loops cause more problems:

Positive Feedback Problems

• Positive Feedback Loops
• Interest curves. What if the player spends all his

time trying to level up instead of exploring all the great content we have for him? What if the drops he gets from such leveling up make the rest of the game too easy? How can we reward the player with one hand and take it away with the

• ther such that he keeps progressing through the

game? Even single player games can fall victim to this.

Positive Feedback Problems

• Problems of balance. Multiplayer games need

to use positive feedback sparingly. If the entire game is decided by the time the first winning move enters the positive feedback loop (like the first kill in Quake II above), then why play the rest of the game? The loser will be continually beaten by the first winner, and without hope of winning himself, probably won’t be having much fun.

Positive Feedback Problems

• Endgame problems. World of Warcraft has a problem.

Players get stronger and stronger, but there is a finite amount of content they can offer. Eventually, you have to reach the strongest sword in the game. At that point, players cannot be directed to kill bigger bad guys for the purpose of better drops that have better stats. The designers there have to deal with the problem of “what to give the player that has everything”. Naturally, they’ve done a good job as they have a healthy base of players at the maximum level, but this problem only exists because of the positive feedback loops in the main gameplay.

Fix Positive Feedback Problems

• One technique to fix positive feedback getting out
• f control is to decouple what the reward affects

and what the tasks require.

• This is a fine technique and one that I

recommend, but it isn’t perfect because the player has to want a reward of something other than what will give him more power to achieve. Thus it can only be applied in some situations.

• Example?

Fix Positive Feedback Problems

• Pair positive feedback with negative ones
• RPGs do this: When you level up, monsters also

become tougher. So you get stronger, but your enemies do as well, likely at the same rate.

• Your power increase is positive feedback. Your enemy’s

increase is negative feedback. This would be noticeable to players if put that explicitly, so what we do is allow the player to really beat up on some lower-level thugs after powering-up to get them feeling more invincible before throwing their ass in front of newly souped-up baddies.