Frame for this Workshop Making the simple complicated is - - PowerPoint PPT Presentation

frame for this workshop
SMART_READER_LITE
LIVE PREVIEW

Frame for this Workshop Making the simple complicated is - - PowerPoint PPT Presentation

Frame for this Workshop Making the simple complicated is commonplace; making the complicated simple, awesomely simple, that's creativity To be playful and serious at the same time is possible, in fact it defines the ideal mental condition . (John


slide-1
SLIDE 1

Frame for this Workshop

Making the simple complicated is commonplace; making the complicated simple, awesomely simple, that's creativity To be playful and serious at the same time is possible, in fact it defines the ideal mental condition.

(John Dewey, How We Think, p. 218)

slide-2
SLIDE 2

Session Outcomes

  • Identify the role of thinking in learning (e.g., what good thinking enables

us to do better)

  • Analyse Good Thinking - the specific types of thinking and how they work

to enhance performance

  • Identify barriers to good thinking and how to mitigate negative impacts
  • Write learning outcomes to incorporate types of thinking
  • Use strategies (methods, activities and tools) for promoting good thinking
  • Produce integrated real-world performance tasks to develop and assess

good thinking

  • Evaluate a range of assessment methods for assessing thinking
  • Produce scoring systems to assess specific types of thinking in an

integrated learning experience

slide-3
SLIDE 3

Thinking: A Key Process for effective learning

“The best thing we can do, from the point of view of the brain and learning, is to teach our learners how to think” (Jenson, 1996, p.163) “Thought is the key to knowledge. Knowledge is discovered by thinking, analyzed by thinking,

  • rganized by thinking, transformed by thinking,

assessed by thinking, and, most importantly, acquired by thinking”

(Paul, 1993 vii)

Thinking is the cognitive process that builds Understanding

slide-4
SLIDE 4

Debates about the relative merits of teaching content Vs process, transmission

  • f knowledge Vs discovery learning, thinking Vs rote learning, etc, only cloud

rather than help effective pedagogy. For example, there is now virtual agreement among cognitive psychologists that effective thinking - however defined - needs an extensive and well organized knowledge base. As Resnick (1989) summarizes: Study after study shows that people who know more about a topic reason more profoundly about that topic than people who know little about it. (p.4) Similarly, Satinover (2001), drawing from recent brain research makes the case for the importance of repetition in the learning process: …these mundane chores are precisely what turns the fourth brain from a mass of randomness into a intellect of dazzling capacity. “Genius,” according to Thomas Edison, “is one percent inspiration and ninety-nine percent

  • perspiration. Of “critical thinking skills,” he had nothing to say. (p.49)

Knowledge, Rote-learning (as well as thinking) are important in effective learning

slide-5
SLIDE 5

Model of Human Memory

Sensory Memory

Sight Hearing Touch Smell Taste

Working Memory

Executive Organizing Function

Limited Capacity 5-9 bits of information

Long –Term Memory

E N V I R O N M E N T

Infinite Capacity Forgetting

Integrating –

Conscious, Subconscious & Unconscious

slide-6
SLIDE 6

Long Term memory

Long term memory is crucial for learning and the development of expertise. For example, Kircher et al (2006) point out: ...long term memory is now viewed as the central dominant structure of human

  • cognition. Everything we see, hear and think about is critically dependent on and

influenced by our long-term memory. (pp.3-4) Expert problem-solvers are able to draw on the vast knowledge bases in their long-term memory and quickly select the best approach and procedures for solving a given problem. Again Kircher et al: We are skillful in an area because our long-term memory contains huge amounts of information concerning that area. That information permits us to quickly recognize the characteristics of a situation and indicates to us, often unconsciously, what to do and how to do it. (p.4)

slide-7
SLIDE 7

Working Memory

Clark & Lyons (2004) point out: …it is in working memory that active mental work, including learning, takes place. Working memory is the site of conscious thought and processing. (p.48) While there is limited capacity in the Working Memory system, enabling only a small amount of information to be attended to at any given time, the rich connections between the memory systems – both consciously and unconsciously – make possible seamless and highly effective cognitive activity.

Central Executive

  • Consciousness & Thinking
  • Information search
  • Information processing within

capacity limitation

slide-8
SLIDE 8

Intuition

“Intuition is nothing more and nothing less than recognition”

(Herber Simon)

Everything is easy when you know how to do it

Good intuitive judgements occur when experts have learned to recognize familiar elements in a new situation and act in appropriate manner to them.

slide-9
SLIDE 9

Problems of Definition

“In schools, critical thinking has long been a buzz phrase. Educators pay lip service to its Importance, but few can tell me what they mean by the phrase

  • r how they teach and test it...” (p.16)

“For the most part, teachers haven’t been trained to teach students how to think.”

(xxiv) (Wagner, T., 2010, The Global Achievement Gap)

“... But the heart of this problem is our failure to define such terms as critical thinking, problem solving, metacognition, reasoning, and abstract thinking. Without adequate definition and training, teachers lack the knowledge and skills to teach and test for these desirable but elusive human qualities”

(Haladyna, T., 1997, Writing Test Items to Evaluate Higher Order Thinking, p.97)

slide-10
SLIDE 10

I want good Thinking on this

This involves Critical Thinking – have I seen this problem before, what are the likely causes, what information do I need to clearly interpret what’s

  • ccurring....?

Good thinking, what’s that?

slide-11
SLIDE 11

So if we really want to develop students ability to think well, we must firstly be able to…

slide-12
SLIDE 12

What is thinking?

Thinking is goal-directed mental activity (conscious and subconscious) we do in order to solve problems Good Thinking requires a particular skill set and

related ‘habits of mind’ that need cultivation and practice over time - but it is achievable and will

result in better learning – as I will demonstrate

slide-13
SLIDE 13

Find me a girlfriend – potential wife

Wife leaves me for Brad Pitt

  • What to do, lah?
slide-14
SLIDE 14

Educational Taxonomies

Bloom’s original taxonomy, 1956 Anderson & Krathwohl, revised taxonomy, 2001

slide-15
SLIDE 15

Which one is better?

Some questions to get you thinking:

  • What’s the difference between Knowledge and

Remembering?

  • Is Understanding lower than Analysis or Evaluation?

I will be assessing the quality of your thinking!

slide-16
SLIDE 16

A Model of Thinking

Metacognition

Comparison & Contrast Inference & Interpretation Evaluation Generating Possibilities Analysis

16

slide-17
SLIDE 17

Generating Possibilities

What do we do when we generate possibilities?

  • Generate many possibilities
  • Generate different types of possibilities
  • Generate novel possibilities

Meta- cognition Comparison & Contrast Inference & Interpretation Evaluation Generating Possibilities Analysis

17

All creative products involve the combining of old ideas or elements in new ways

slide-18
SLIDE 18

What is Creativity?

A product or response will be judged creative to the extent that it is novel, useful or a valuable response to the task at hand. (summarized from Amabile, 1996, p.35)

<>

One dark foggy night in Halifax, as Percy Shaw was driving home, he saw two small green lights, very close together near the edge of the road. He was curious so he stopped and saw the ‘lights’ were a pair of cats eyes reflecting the light from his head lights. This triggered off his thinking, making some new connections in his brain – subsequently he invented a small device involving two marbles placed close together in a rubber casing; this would then be set in the road at intervals between the lanes of traffic.

After a year of experiments, Percy patented the invention and then, in 1935, formed his company, Reflecting Roadstuds Ltd. (That’s Innovation & Enterprise)

slide-19
SLIDE 19

Creativity: Not Thinking out of the Box

It all happens Inside the Head, it’s just a question of what’s in there, what you do with it and how Little in there, little desire and effort to keep making new neural connections - especially across knowledge areas – expect little by way of creativity Creativity results from conscious (and subconscious) neural restructuring that results in

NEW PERCEPTIONS

slide-20
SLIDE 20

Reframing

“How your perceive something makes all the difference and you are free to see things from any perspective you wish”

(Adler, 1996, p.145)

To shift to a different frame will typically reframe one’s perspective and therefore, one’s meaning. And when we do this, our very world changes, which changes the sensory experience, hence how we feel

Slimy Pond Life

  • r

Tasty Dinner?

slide-21
SLIDE 21

Analysis

What do we do when we analyse?

  • Identify relationship of the parts to a whole in system /structure/model
  • Identify functions of each part
  • Identify consequences to the whole, if a part was missing
  • Identify what collections of parts form important sub-systems of the whole
  • Identify if and how certain parts have a synergetic effect

Meta- cognition Comparison & Contrast Inference & Interpretation Evaluation Generating Possibilities Analysis

21

slide-22
SLIDE 22

Comparison and Contrast

What do we do when we compare and contrast?

  • Identify what is similar between things -
  • bjects/options/ideas, etc
  • Identify what is different between things
  • Identify and consider what is important about both the

similarities and differences

  • Identify a range of situations when the different features

are applicable

Meta- cognition Comparison & Contrast Inference & Interpretation Evaluation Generating Possibilities Analysis

22

slide-23
SLIDE 23

Inference and Interpretation

What do we do when we make inferences and interpretations?

Meta- cognition Comparison & Contrast Inference & Interpretation Evaluation Generating Possibilities Analysis

  • Identify intentions and assumptions in

data

  • Separate fact from opinion in data
  • Identify key points, connections, and

contradictions in data

  • Make meaning of the

data/information available

  • Establish a best picture to make

predictions

23

slide-24
SLIDE 24

Evaluation

What do we do when we evaluate?

  • Decide on what is to be

evaluated

  • Identify appropriate criteria

from which evaluation can be made

  • Prioritize the importance of the

criteria

  • Apply the criteria and make

decision

Meta- cognition Comparison & Contrast Inference & Interpretation Evaluation Generating Possibilities Analysis

24

slide-25
SLIDE 25

Metacognition

What are we doing when we are metacognitive?

  • Aware that we can think in an organized

manner (and the barriers to it)

  • Actively thinking about the ways in which we

are thinking

  • Monitoring and evaluating how effective we

are thinking (including how our emotions and beliefs may be impacting the thinking process)

  • Seeking to make more effective use of the

different ways of thinking as well as any useful learning strategies, tools and resources

Meta- cognition Comparison & Contrast Inference & Interpretation Evaluation Generating Possibilities Analysis

“To be properly metacognitive...students have to be realistically aware of their own cognitive resources in relation to the task demands, and then to plan, monitor, and control those resources”

(Biggs, 1987)

slide-26
SLIDE 26

Metacognition plays a central role in learning by monitoring the quality of the

  • verall (and specific aspects) of the thinking process, our emotional

dispositions, as well as the choice and application of learning strategies and skills It operates at both conscious and sub/unconscious levels.

slide-27
SLIDE 27

Things to disrupt - “put a spanner in the works”- good thinking: what do you think they are?

slide-28
SLIDE 28

Brain Barriers to Learning (and Thinking)

Inherent Design Features of Cognition

The mind is inherently ‘lazy’ when it comes to cognitive effort and typically relies on learned associations, rather that good thinking and empirical evidence. Furthermore, incoming information automatically passes through established neural networks – hence the brain will ensure that we perceive what we have learned to see.

Restricted Working Memory & Slow processing Speed

Despite Long Term Memory having unlimited capacity for information – Working Memory can only deal with around 7 bits of information at once. Furthermore, the actual processing speed of the brain is slow compared to its capacity and organising ability.

Personality Configurations, Emotions and Conflicting Neural Structures

Whether we like it or not, ‘intelligent design’ is highly questionable; the natural state of the mind is one of internal conflict and paradox

slide-29
SLIDE 29

Our brain uses Two Thinking Systems to analyse and respond to environmental challenges:

System 1 is a fast reflexive system, essential for survival and is the default system. However, it also results in rapid stereotypical/prejudicial judgements and action. It is the price we pay for this powerful survival system. This is what we typically use in everyday life. System 2 is a slow, analytic, reflective system, that explores the more objective factual elements of a situation, compares them with previously learned elements, and then responds. However, this requires self control, effort and time, which creates cognitive strain – and is inherently lazy.

“The mind is not designed for thinking”

(Willingham, 2009, p.3)

slide-30
SLIDE 30

Visual Illusions

slide-31
SLIDE 31

Annoying

slide-32
SLIDE 32

“We forget that beliefs are no more than perceptions, usually with a limited sell by date, yet we act as though they were concrete realities”

(Adler, 1996, p.145)

... And they shape our Psychological State (attitude) to the situation we are in

Beliefs

slide-33
SLIDE 33

Perception shapes reality

“90% of errors of thinking are errors of perception” “If you want to change emotions, change perception”

Edward De Bono

“One man’s meat is another man’s poison”

Old English saying (older than me anyway)

slide-34
SLIDE 34

Pictures in Our Heads

80% of the perceptions we store in our head are visual (PICTURES)

Pre-Roswell Alien as captured New wave, trendy post in the famous film ‘Alien’ Roswell, ET ‘Grey’ Alien Are we, in more recent years, being visited by a better class of alien?

slide-35
SLIDE 35

The 3 Brain Paradox – you can’t talk to the Reptilian or Emotionally Charged brain

Far more neural filters project from our brain’s emotional centre into the logical/rational centres than the reverse Amygdala

Becomes the Default System when we are threatened Making judgements and decisions guided by feelings and likings, with little deliberation and reasoning is common – and referred to as the ‘Affect Heuristic’ by nobel prizewinner, Kahneman, 2012,

slide-36
SLIDE 36

Impact of Personality Type

Validated research supports a model of human personality in which people differ, to varying degrees, in 5 major ways:

  • introverted or extroverted
  • neurotic or stable
  • incurious or open to experience
  • agreeable or antagonistic
  • conscientious or undirected

All are hereditable, with perhaps 40-50% of the variation in a typical population tied to differences in their genes. It is no fun dealing with the unfortunate wretch who is introverted, neurotic, narrow, disagreeable and undependable

slide-37
SLIDE 37

Internal Mental Chaos

“Contrary to what we tend to assume, the normal state of the mind is chaos”

(Csikszentmihaly , 1990, p.119).

“Behaviour…comes from an internal struggle among mental modules with differing agendas and goals” (Pinker, 2002, p.40) “...everyday life, as it is experienced, is a tangled web of changing desires, perceptions, feelings, and emotions that filter in and out of awareness in a perceptual swirl”

(Apter, 2001, p.33)

slide-38
SLIDE 38

Good Thinking is…

… the ability to use Critical, Creative & Metacognitive thinking in an highly competent manner to solve problems:

This involves:

  • Using each type of thinking effectively and efficiently
  • Using them in unison and synergistically
  • Managing a WIDE range of barriers to the thinking process
slide-39
SLIDE 39

Aligned Curriculum Design Model

Learning Outcomes Instructional Strategies Assessment System

Types of Thinking

In basic terms this means that the types of thinking incorporated in the Learning Outcomes must be effectively taught through the Instructional Strategies used and accurately measured in the Assessment System.

slide-40
SLIDE 40

Connecting to Your Prior knowledge

Models of integrating curriculum (Fogarty, R., 2009)

  • Nested - Connecting content knowledge with a thinking skill
  • Threaded - Focuses on systematically infusing a key thinking

skill(s) (e.g., analysis, compare and contrast, inference and interpretation, evaluation, etc.) across a curriculum (e.g., course, module, unit)

slide-41
SLIDE 41

Infusion Approach 1 Curriculum

Compare & contrast Analysis Inference & interpretation Evaluation Generating possibilities Metacognition

slide-42
SLIDE 42

Infusion Approach 2

Curriculum

Real world applications

  • f the subject content

Specific types of thinking that underpin competent performance

slide-43
SLIDE 43

Identifying the Types of Thinking

Step 1

  • Refocus the curriculum

towards real world activities or competency

Step 2

  • Identify the types of thinking that

underpin competent performance in these real world activities through COGNITIVE MODELING

In doing this it is useful to start by asking the question:

How does a highly competent person think in the effective execution of this activity? Example from a Business Law Module:

  • Predict possible legal outcomes

in the event of a breach of contract

  • Analyse the components of a

contract

  • Compare and contrast the

expected and the actual behaviour

  • f defendants
  • Make inferences and

interpretations concerning the behaviour

  • Evaluate the possibility of specific
  • utcomes
slide-44
SLIDE 44

Identifying the Types of Thinking in Subject Context

Step 1

  • Think about what the student will be

able to do as a result of completing the module – actual real world performances/activities

Step 2

  • Identify the types of thinking that

underpin competent performance in these real world activities through COGNITIVE MODELING

In doing this it is useful to start by asking the question:

How does a highly competent person think in the effective execution of this activity? Example: from Environmental Science

Managing Pollution

  • Compare and contrast different types of

pollution in a range of contexts

  • Analyse the causes of pollution
  • Make inferences and interpretations

concerning the effects of pollution in different situations

  • Generate possibilities in terms of

managing/reducing pollutants

  • Evaluate pollution policies

Similar application for other main areas in module , e.g., Occupational Safety and Health

slide-45
SLIDE 45

Identifying the Types of Thinking in Subject Context

Step 1

  • Think about what the student will be

able to do as a result of completing the module – actual real world performances/activities Step 2

  • Identify the types of thinking that

underpin competent performance in these real world activities through COGNITIVE MODELING In doing this it is useful to start by asking the question: How does a highly competent person think in the effective execution of this activity? Example: Electrical Installation Design Use different types of wiring systems

  • Identify the attributes of wiring devices
  • Compare and contrast types of wiring

device

  • Evaluate the use of wiring devices and

EIB technology

slide-46
SLIDE 46

Writing learning outcomes

Write in direct performance terms – focusing on: the Type of Thinking or Product Outcome

  • Analyse the impact of pollution on water quality
  • Compare and contrast a range of retaining structures
  • Generate new design options for marketing a health food product
  • Predict the outcomes of specified legal scenarios
  • Conduct product packaging tests for a specified product
  • Prepare a voyage passage plan
  • Write a programme in Java script to animate a range of figures
  • Prepare a tender report

NOTE: Objectives can be written at different levels of specificity and contextualized accordingly – but the general concept of focusing on the desired performance applies

slide-47
SLIDE 47

Promoting Thinking – General but Essential Instructional Principles

  • Systematically teach and model the types of thinking, taking

students through the range of cognitive operations for each type of thinking (Direct Instruction using the Language of Thinking: Making Thinking Visible)

  • Use structured questions to direct and reinforce types of

thinking (e.g., “Lets compare & contrast these two diets”; What inferences and interpretations can be drawn from these data sources about the possible use of cloning in food production?”)

  • Involve students in real world learning tasks which necessitate

direct use of the types of thinking

  • Consistently promote dispositions (habits of mind) conducive to

good thinking and effective learning (e.g., persistence, managing impulsivity, openness, flexibility, attention to detail, good listening, humour)

slide-48
SLIDE 48

Getting students familiar with the Language of Thinking

Often used teacher language Cueing types of thinking

Comment on these two proposed solutions Lets compare and contrast these two solutions....identify what is similar and different in each....then apply our understanding to some specific situations.... Do you think this is the best option? What do you think might have happened here? What’s this data about?

slide-49
SLIDE 49

Making Good Thinking Visible

“...teachers have to make their own intellectual processes (their performances)

  • visible. This means that the teacher-expert has to make visible to learners

the otherwise invisible processes of thinking that underlie complex cognitive

  • perations ...

Teachers have to articulate and demonstrate rather than assume the thought processes they want students to learn”

(Sheppard et al, 2009, p.188)

slide-50
SLIDE 50

Making Students Thinking Visible

“We need to make thinking visible because it provides us with the information we as teachers need to plan opportunities that will take students’ learning to the next level and enable continued engagement with the ideas being explored. It is only when we understand what our students are thinking, feeling, and attending to that we can use that knowledge to further engage and support them in the process of understanding. Thus making students’ thinking visible becomes an ongoing component of effective teaching”

(Ritchhart, Church & Morrison, 2011, p.27)

slide-51
SLIDE 51

The Power of Questions

“Questions are the primary way we learn virtually everything” “Thinking itself is nothing but the process of asking and answering questions” “Questions immediately change what we focus on and, therefore, how we feel”

(Anthony Robbins, 2001, pp.179-8)

“All answers come out of the question. If we pay attention to

  • ur questions, we increase the power of meaningful learning”

Ellen Langer

slide-52
SLIDE 52

Using Questions

The effective use of questions is a powerful means of promoting specific types of thinking, for example:

  • What are the similarities and differences between Hepatitis A and HIV?
  • In what ways are these differences significant?
  • What inferences and interpretations can be drawn from the data on HIV

infection in Asia?

  • How might we evaluate the effectiveness of the present HIV prevention

programme?

  • What is the relationship between HIV infection and poverty?
  • What other ways might we make people more aware of HIV infection?
slide-53
SLIDE 53

Instructional Strategies (methods, activities, tools) for promoting thinking

  • Questioning
  • Small group activities that involve specific types of thinking

(e.g. buzz groups, rounds, poster board tours, etc)

  • Co-operative learning structures
  • Case studies
  • Projects/PBL activities
  • Role play
  • Performance tasks that involve specific types of thinking
  • Discussion/Debates
  • Thinking Tools, e.g., Mind mapping, ‘Thinking Hats’, Plus-

Minus-Interesting, Forced Associations, etc

slide-54
SLIDE 54

Ways in which meta-cognitive thinking can be developed & enhanced:

1. Make students Aware of this distinctively human capability and how it works

  • Explain and demonstrate how metacognition works
  • Illustrate with a range of examples why metacognition is so

important in learning and personal success

2. Build metacognitive thinking into specific learning activities (e.g., project work

  • Get students to reflect on and document the quality of their thinking,

identifying challenges faced in their learning and how they have gone about tackling these challenges

  • 3. Facilitate and reinforce metacognition through other ‘Teachable

Moments’

  • Whenever metacognitive thinking would be valuable to enhancing

thinking and learning

slide-55
SLIDE 55

Thinking Tools and Techniques

  • Mindmapping (A learning & thinking tool)
  • Thinking Hats (A thought management tool)
  • Plus-Minus-Interesting (A simple practical tool for identifying positives, negatives and unsure

elements in a situation)

  • Force-Field Analysis (A critical and creative thinking tool for managing change)
  • Forced Associations (A creative thinking technique to break out of traditional patterns of

perception and thinking)

  • PO (A creative thinking technique)
  • SCAMPER (A creating thinking tool)
  • Morphological Matrix (A creative thinking tool for creating multiple combinations)

Note: thinking tools and techniques don’t do the thinking, they only provide a means for organizing your thinking

slide-56
SLIDE 56

Mind Map of Edward De Bono’s Thinking Hats

Blue Hat Red Hat Black Hat Green Hat Yellow Hat

Metacognition Overview Feelings Own view Negative Logical Positive Optimistic Creative New ideas Mind Maps can promote all types of thinking as well as aid memory and learning

White Hat

Facts only No opinions

slide-57
SLIDE 57

Plus-Minus-Interesting

PLUS MINUS INTERESTING

slide-58
SLIDE 58

Force-Field Analysis

Equilibrium Forces driving change Forces resisting change

The objective is to move the balance to the right, which can be achieved by:

  • identifying forces, their causes and strength
  • planning and acting to assist the driving forces
  • planning and acting to reduce the resisting forces
  • using some of the resisting forces against each other if possible

Current Situation Desired Situation

Potency: 7 6 5 4 3 2 1 1 2 3 4 5 6 7 :Potency

slide-59
SLIDE 59

Forced Associations (Random Triggers)

Forced Associations is a technique for linking another thinking pattern into the one we are presently using. We do this by selecting a random concrete noun from a different field and combining it with the problem under consideration. For example, we might be looking at ways to make lifts quicker. By choosing a random word ‘Mirror’ could lead to installing mirrors by lifts. As we know this is a popular solution for ‘slow lifts’. The lift doesn’t go faster, but people waiting don’t notice this as they look in the mirror.

Force Associate with ‘Mirror’

slide-60
SLIDE 60

PO (Provocative Operation)

PO involves making deliberately provocative statements, which seek to force thinking out of established patterns. Examples: “Everybody should go to prison” “Lets abolish schools” Having made a provocative statement, it is then necessary to suspend judgement and use the statement to generate ideas. For example, you can generate ideas by examining:

  • The consequences of the statement
  • What the benefits could be?
  • What would need to change in order to make it a sensible statement?
  • What would happen if a sequence of events changed?
slide-61
SLIDE 61

S C A M P E R

SCAMPER is a checklist that helps to think of ways to improve existing products

  • r create new ones

Substitute Combine Adapt Magnify, Minify, Modify Put to other use Eliminate Reverse

slide-62
SLIDE 62

Morphological Matrix

This tool encourages new possibilities through combining options

X X X X X X

OPTIONS

slide-63
SLIDE 63

What are ‘Real World’ Learning Tasks?

“Central to a pedagogy that seeks to promote the development of good thinking is the systematic use of well constructed and managed learning tasks that reflect real world activity and involve the use of specific types of thinking.

(Wasserman, 1993, p.20)

Such tasks are often referred to as Performance-Tasks

as they concentrate on the thoughtful application of knowledge in real life contexts

slide-64
SLIDE 64

Rationale for using Real World Tasks

Methods which are permanently successful in formal education … go back to the types of situation which causes reflection out of school in ordinary life. They give pupils something to do, not something to learn; and the doing is

  • f such a nature as to demand thinking, or the intentional

noting of connections; learning naturally results.

(John Dewey, 1916)

slide-65
SLIDE 65

Types of Real World Tasks

  • Real work projects and tasks
  • Simulations
  • Problem solving through case studies
  • Problem-based learning (PBL) activities
  • Presentations
  • Any activity that essentially models what would be

done by people in the world of work

slide-66
SLIDE 66

Example 1: Design and conduct a small experiment to test the Halo Effect In groups of 3-4, design and conduct a small experiment to test the Halo Effect in person perception. You may choose the particular focus for the experiment, but it must:

  • Clearly test the Halo Effect in person perception
  • Be viable in terms of accessing relevant data
  • Meet ethical standards in conducting experiments with persons
  • Follow an established method and procedure
  • Produce results that support or refute the hypothesis

Once completed, the experiment should be written up in an appropriate format of approximately 2000 words. It should document the important stages of the experiment and compare and contrast the data found with existing findings on the Halo Effect.

slide-67
SLIDE 67

Example 2: Design A Food Package

Select a food product and design the packaging that you think will give it best marketability. You must be able to identify the product attributes, protection and enhancement needed to satisfy the functional and marketing requirements, and use suitable packaging material(s) and package type. The work produced should reflect the quality of your thinking in the following areas:

  • identify the criteria for evaluating the marketability of a product
  • analyze the components of a product that constitute an effective design
  • generate new ways of viewing a product design beyond existing standard

forms

  • predict potential clients response to the product given the information you

have

  • monitor the development on the group’s progress and revise strategy where
  • necessary
slide-68
SLIDE 68

Steps in designing performance tasks

Step 1: Identify clearly the knowledge, skills and processes to be incorporated into the task

For this step it is important to:

  • Choose specific topic areas in your curriculum that encompass key

underpinning knowledge (e.g., central concepts, principles, procedures) and skills essential for understanding and performance in real world applications.

  • Identify the types of thinking that are important for promoting student

understanding and subsequent competence in these topic areas. For example, generating possibilities, analysis, comparison and contrast, inference and interpretation, evaluation, etc.

  • Identify other process skills (e.g., communication, team-working, managing

learning) that are important for competent performance in the identified areas.

slide-69
SLIDE 69

Steps in designing performance tasks

Step 2: Produce the learning task

It is important that the task:

  • Clearly involves the application of the knowledge, skills and processes

identified from Step 1.

  • Is sufficiently challenging, but realistically achievable in terms of student’s

prior competence, access to resources, and time frames allocated.

  • Successful completion involves more than one correct answer or more than
  • ne correct way of achieving the correct answer
  • Clear notes of guidance are provided, which:

– Identify the products of the task and what formats of presentation are acceptable (e.g. written report, learning materials, portfolio, oral presentation, etc) – Specify the parameters of the activity (e.g. time, length, areas to incorporate, individual/collaborative, how much choice is permitted, support provided, etc) – Cue the types of thinking and other desired process skills – Spell out all aspects of the assessment process and criteria.

slide-70
SLIDE 70

Key considerations in producing a marking scheme

  • Performance areas assessed to reflect learning objectives
  • Performance criteria for each performance area
  • Marks weighting for each performance area to reflect table
  • f specifications/assessment blueprint
  • sources of Performance evidence to be used (e.g.,

written/oral questioning, product, observation, etc)

  • Format for marking scheme – checklist, rating scale/ scoring

rubric

slide-71
SLIDE 71

Marking Formats for performance assessments Marking Scheme Rubric analytic holistic Checklist

Decide on the basis of level of Inference in making assessment decision analytic or holistic rubric – what’s the difference, and on what basis would you decide?

slide-72
SLIDE 72

Decide format on the basis of whether the item involves High or Low Inference

  • Low inference items are those where the performances being tested are

clearly visible and there is a widely established correct answer (e.g., conducting a fire drill, setting up an experiment) Here a Checklist is most appropriate

  • High inference items involve performances that are less directly visible

and/or more open to subjective judgement (e.g., creative writing, managing a team) Here a rating scale/scoring rubric is most appropriate A major challenge to test design is to produce tasks that require low inference scoring systems. Unfortunately, many worthwhile student

  • utcomes reflecting higher order thinking lend themselves more to high

inference scoring.

slide-73
SLIDE 73

Scoring Rubrics (rating scale)

A scoring rubric is a prepared scoring system for assessing performance in activities where professional judgement is involved in the assessment decision.

  • There are two main types of rubrics:

– Holistic (focuses on overall assessment of a product, process or performance - without judging the component parts separately) – Analytic (assesses – scores – each individual ‘part’ of an assessment activity and then totals an overall score

There are benefits and limitations to each – what do you think they are?

slide-74
SLIDE 74

Holistic versus Analytic Rubrics

Holistic rubrics enable a focus on the overall performance and are more economical in terms of assessment time. They are typically used for summative assessment and where some variation in reliability in parts of the assessment components can be accepted, provided the overall assessment decision has good validity and reliability. In contrast, analytic rubrics enable a greater focus on the specific elements of the areas of learning involved and make possible a much better utilization of formative assessment in the assessment process. This has considerable benefits, as Gibbs (2008) highlights: Research in schools has identified that the way that teachers provide and use feedback, and engage students with feedback, makes more difference to student performance than anything else that they can do in the classroom. (p.6)

slide-75
SLIDE 75

What rubrics can and cannot do…

It is also important to remember that the rubric does not make the assessment decision; this is the responsibility of the assessing teacher

  • Rubrics provides a guiding frame for focusing attention on the key

elements/constructs (performance criteria) of the assessment area and summary descriptors of a range of performances.

slide-76
SLIDE 76

Developing a checklist

  • Identify the important components - procedures, processes or
  • perations - in an assessment activity

– for example, in conducting an experiment one important operation is likely to be the generation of a viable hypothesis

  • For each component, write a statement that identifies competent

performance for this procedure, process or operation

– in the above example, the following may be pertinent: A clear viable hypothesis is described

  • Allocate a mark distribution for each component - if appropriate

– this is likely to reflect its importance or level of complexity

Note: Checklists are most useful for low inference items –where the performance evidence is clearly agreed and there is little disagreement relating to effective or ineffective performance (e.g., observable steps)

slide-77
SLIDE 77

Assessment checklist for Assignment 1: Design and conduct a small experiment to test the Halo Effect

Performance Areas/criteria: 1. The context of the experiment is accurately described  2. A clear viable hypothesis is presented  3. The method/procedure is appropriate  4. There is no infringement on persons  5. Findings are clearly collated and presented  6. Valid inferences and interpretations are drawn from the data and comparison is made with existing data  7. The write-up of the experiment meets required conventions 

The allocation of marks for each performance area will reflect the weighting allocated in the Table of Specifications

slide-78
SLIDE 78

Developing a scoring rubric

  • Define the performance area/learning targets for an assessment

(must relate to learning outcomes)

– for example, ‘Valid inferences and interpretations are drawn from the data and comparison is made with existing data’

  • Identify and describe the key attributes that underpin competence

for each performance area (preferably observable and measurable)

– Using the above example (attributes – concept, types of thinking)

  • Validity
  • inference and interpretation
  • comparison and contrast
  • Write a concise description of performance at a range of levels from

very good to very poor

– for example, 5 = very good; 1 = very poor

Note: Rating Scales/Scoring Rubrics are most for useful for high inference items – where the performance evidence requires considerable professional judgement in making an assessment decision

slide-79
SLIDE 79

Scoring Rubric for Example 1: Valid inferences & interpretations are drawn, comparison with existing data is made

Score Description 5 All valid inferences are derived from data. Interpretations are consistently logical given the data obtained. All essential similarities and differences with existing data are identified and their significance fully emphasized. 4 Most of the valid inferences are derived from data. Interpretations are mainly logical given the data obtained. Most essential similarities and differences with existing data are identified and their main significance emphasized. 3 Some valid inferences are derived from data. Some logical interpretations are made from data obtained. Some essential similarities and differences with existing data are identified and their significance partly established. 2 Few valid inferences are derived. Interpretation of findings are limited . Comparison and contrast with existing data is partial and its significance not established. 1 Failure to make valid inferences and interpretations.

slide-80
SLIDE 80

How’s your thinking??

  • Understanding results from using the types of thinking

(especially Analysis, Compare & Contrast and Inference & Interpretation) in relation to acquired knowledge as we seek to learn in deeper ways

– Hence, Understanding is not a type of thinking, but an outcome of good thinking – It cannot, therefore, be a precursor (lower order) of analysis, evaluation, etc

  • There are not levels of complexity of types of thinking but

levels of complexity among different types of thinking So, are you still surprised why so many teachers have trouble in using Blooms taxonomy? – or why I don’t use it