Youth Music Evaluation, Learning and Impact Dr Douglas Lonie - - PowerPoint PPT Presentation

Youth Music

Evaluation, Learning and Impact

Dr Douglas Lonie Research and Evaluation Manager, Youth Music

Being Evidence Based

Why do we do what we do? How do we do what we do? What difference does what we do make? How do we do It better and support better practice in the sector?

Need Practice Impact Development

CES Outcomes Approach

Overall Aim Intended Outcomes Activities and Outputs

Embedding Evaluation: a case study

2008

• YM employs evaluation team
• Systems and processes reviewed

2010

• Consistent outcomes framework established
• Internal and external training begins

2012

• Research and reporting starts to indicate impact
• Grants and research team merge

What we do

• Outcomes/Evaluation focused application

systems

• Nvivo used to code and analyse all data
• Statistical summaries of profile statistics
• Diversity of portfolio
• Regional allocation (Index of Multiple

Deprivation)

What can we claim?

• Be realistic and confident in the extent of your
• wn impact
• Be honest, frame negative results as learning
• Don’t report statistics independently (always

require interpretation)

• Use evidence in a complementary way

How much can we realistically do?

• Do you value evaluation as an organisation?

– Who is responsible for it?

• When should I commission an ‘expert’?

– Importance of objectivity? – Done with or done to? – Action research and improvement

• Cash–starved consultants
• Language and power

Evaluation Builder

http://network.youth music.org.uk/scales/e valuation-scales

• Three c’s
• Commitment (to

projects and to learning)

• Concentration (and

task completion)

• Control (over

different aspects of their lives)

• All genre and

multi-genre

• Pop/rock most

popular

• Country not very

popular 

• 1/3 Western

Classical

• Growth of hip-hop

‘therapy’

Youth Music Network

• 3a. Thinking about your outcome indicators and sources of evidence in relation to

this goal area please provide an update on the last 12 months and the extent to which you have achieved your intended outcomes. (500 words) Goal:

• To have improved the social and personal skills of CYP in CC through participation

in high quality music-making activities Indicators:

• confidence, self esteem, more involvement from young people

Our programme this year has had a number of regular workshops that have been run as music clubs focusing as much on the social side/group interaction as the music making.. In the sessions that have run for some time such as [title], we have young people that have been coming anything from a few months up to 5 years. This brought a really good dynamic to group this year, especially as new members came along, an encouraging and supporting process takes place, instantly making those sessions a safe, non threatening environment to be in. During our observations the tutors run the sessions that makes time and space for friendships to develop and clearly show negative behaviour to each other is not acceptable in the sessions. The young people are happy to come up with ideas for songs that are being written by the group, often these will be quite personal feelings or situations that they have been in, again there is a freedom of being able to do this without feeling stupid or embarrassed.

• 1. Please describe your progress towards achieving your

project’s intended outcomes (No Word Limit) Generic outcome 1 – To improve the quality and standards

• f music delivery for young people

Indicator: Using participant's feedback and young music leaders views we will explore the quality of our music offered to children and young people.

• Evidence 1: Attached is a video showing some of the

young people from this particular workshop performing with instruments and one of our music mentors, who has attended our provision for a number of years as an MC, explaining the process of a lot of young people learning instruments to facilitate more live performances and expressing his thanks to another music mentor who has helped to develop lots of young people in the area of playing an instrument. This shows that the young people are not only recognising the development of their skills in themselves and in their peers but also that their views are listened to and will have an effect on our music offer.

Ross’s Story

http://youtu.be/PpSUFse8WzU

Thanks for listening!

Contact Me douglas.lonie@youthmusic.org.uk Charity Website youthmusic.org.uk Online Community youthmusic.org.uk/network