e-Bug Pack Evaluation Senior Schools Warsaw, June 2008 e-Bug is - - PowerPoint PPT Presentation

e bug pack evaluation
SMART_READER_LITE
LIVE PREVIEW

e-Bug Pack Evaluation Senior Schools Warsaw, June 2008 e-Bug is - - PowerPoint PPT Presentation

e-Bug Pack Evaluation Senior Schools Warsaw, June 2008 e-Bug is funded by the European Commission DG-SANCO Evaluation Process The evaluation was carried out in 3 countries France Czech Republic United Kingdom Control and


slide-1
SLIDE 1

e-Bug Pack Evaluation

Senior Schools

Warsaw, June 2008

e-Bug is funded by the European Commission DG-SANCO

slide-2
SLIDE 2

Evaluation Process

  • The evaluation was carried out in 3 countries

– France – Czech Republic – United Kingdom

  • Control and Intervention Schools
  • Junior and Senior Schools
  • Minimum of 151 students in each group
slide-3
SLIDE 3

Evaluation Process

Quantitative Data

  • Baseline knowledge
  • Knowledge change
  • Knowledge retention

Qualitative Data

  • Teacher questionnaires
  • Teacher focus groups
  • Student questionnaires
slide-4
SLIDE 4

Quantitative data

Overview

Topics % Correct before % Correct after % Improvement score p value Micro organisms 50 63 17 (14, 21) <0.001 Spread of Infection 68 83 19 (15, 23) <0.001 Treatment and Prevention 29 51 27 (23, 31) <0.001

slide-5
SLIDE 5

Introduction to Microbes

Micro organisms: % Improvement (95% CI) p Value Fungi can be used to make antibiotics 14 (2, 25) 0.02 Microbes are the cause of all illnesses 12 (1, 23) 0.04 Microbes can cause food poisoning 11 (1, 22) 0.03

Quantitative Data

  • Significant increase in student knowledge (<0.001)

Improvement scores (baseline vs change) by statement and topic for senior schools

slide-6
SLIDE 6

Introduction to Microbes

Teacher Comments

  • Fact sheets

– Images did not photocopy well – Too much information and too advanced

  • Main Activity

– Quite childish although students seemed to like it

  • Suggestions

– More electron microscope images – Classroom demonstration to explain relative sizes – string around classroom, glitter, balloons, etc

  • Extension activity

– look at microbe types under microscope

7 10

slide-7
SLIDE 7

Introduction to Microbes

Student Comments

  • What were the main things they learned?

– There are 3 different types of microbes – Some can be useful and some harmful

  • Student Likes

– Practical activity – Interesting facts – Whiteboard presentations and images – Game

  • Student Dislikes

– Confusing – Too easy – Childish – Complicated names

  • How enjoyable did students find the activity?
  • 72% of students questioned rated the activity ≥3 on a scale of 1 – 5
  • Average rating of 3 in France
slide-8
SLIDE 8

Our suggestions

– Make more ID cards of microbe – Make game of the microbe names – Fact sheets

  • Highlight key words
  • Make outline diagrams in pack

and 3D on web

  • Condense to 1 student handout

– Make the ‘size’ presentation into a practical

slide-9
SLIDE 9

Good Microbes

Teacher Comments

  • The activity

– Fun and interesting – Met all the learning outcomes

  • Suggestions

– Make smaller quantities of yogurt – Remove the ‘add fruits etc to taste’, students cannot eat it – The sterile milk is NOT a proper control step, change to sterile yogurt and add a boiling step – Add the question – what is the purpose of a control?

7 10

slide-10
SLIDE 10

Good Microbes

Student Comments

  • What were the main things they learned
  • Microbes can be useful
  • There are good and bad microbes
  • Actual size of bacteria
  • Student Likes
  • Practical activity helped

understanding

  • Interesting and fun
  • Microscope work
  • Memorable
  • Student Dislikes
  • Teacher made the yogurt while

the students watched

  • Smell
  • No images
  • How enjoyable did students find the activity?
  • 90% of students questioned rated the activity ≥3 on a scale of 1 – 5
  • Average ranking of 4 in France
slide-11
SLIDE 11

Our Suggestions

– Suggest teacher sterilizes equipment and makes a batch of yogurt in advance – Include images of extension activity – Add an alternative to view mould in blue cheese – Highlight the benefits of good microbes – Include ‘what’s the purpose of a control?’ question

slide-12
SLIDE 12

Bad Microbes

Teacher Comments

  • Main Activity

– Liked the teacher sheets – Time-consuming

  • Suggestions

– Use the map as a starting point

  • Extension activity

– Too much reading, replace with research activity into MRSA or

  • C. difficile

5 10

slide-13
SLIDE 13

Bad Microbes

Student Comments

  • What were the main things they learned

– Geographic location and quantity of different diseases – How microbes can infect people – Diarrhoea can kill

  • Student Likes

– Researching the topics – Group work – Interesting and fun – Videos and images – Designing factsheets

  • Student Dislikes

– Too much copying from board – No practical – Homework – Not enough time

  • How enjoyable did students find the activity?
  • 67% of students questioned rated the activity ≥3 on a scale of 1 – 5
  • Average ranking of 4 in France
slide-14
SLIDE 14

Our Suggestions

– Make student questionnaires shorter – Suggest activity as a group work activity – Include more images – Use examples more relevant to teenagers i.e. holiday destinations, STIs – Replace extension activity with research into MRSA or C. difficile

slide-15
SLIDE 15

Transfer of Infection

Micro organisms: % Improvement (95% CI) P Value Fungi can be used to make antibiotics 14 (2, 25) 0.02 Microbes are the cause of all illnesses 12 (1, 23) 0.04 Microbes can cause food poisoning 11 (1, 22) 0.03

Quantitative Data

  • Significant increase in student knowledge (<0.001)

Improvement scores (baseline vs change) by statement and topic for senior schools

slide-16
SLIDE 16

Hand Hygiene

Teacher Comments

  • Main activity

– Students enjoyed the activity and the teachers enjoyed teaching this lesson – Didn’t work very well in the ‘all girls’ school as their hands were unbelievably clean to begin with (girls also unwilling to take part)

  • Suggestions

– Prompt the students to touch surfaces etc prior to starting the activity – Glitter glue worked better than the Glo gel – Stronger UV light works better or darken the room before showing the results

6 10

slide-17
SLIDE 17

Hand Hygiene

Student Comments

  • What were the main things they learned

– How to stop germs spreading – How and why to wash hands – Microbes are always there

  • Student Likes

– Visualise the microbes – Seeing how microbes grow on the agar – Interactive – Seeing how and why to wash hands properly

  • Student Dislikes

– Seeing how dirty our hands are – Too much class discussion

  • How enjoyable did students find the activity?
  • 78% of students questioned rated the activity ≥3 on a scale of 1 – 5
  • Average rank of 4 in France
slide-18
SLIDE 18

Our Suggestions

– Replace photos with coloured agar to make it easier to visualise – Simplify the questions – Take out graph paper and condense to 1 worksheet – Suggest activity begins with Glo gel and use photos of colonies for graphing work

slide-19
SLIDE 19

Respiratory Hygiene

Teacher Comments

  • Main lesson

– Popular activity with students – Chain of Infection sheets did not photocopy well – Presentation needs to be more interactive

  • Suggestions

– Extra prompt to make sure squeezy bottle works – Use of specific terms requested in the UK curriculum » Dependant and Independent variable

6 10

slide-20
SLIDE 20

Respiratory Hygiene

Student Comments

  • What were the main things they learned

– How infection can spread – How to prevent infection from spreading – Chain of Infection

  • Student Likes

– Fun practical activity – Visualise the spread of infection – Situation that was relevant to them as young people – Got to learn the causes AND prevention of infection

  • Student Dislikes

– Teacher did everything – Repetitive – Graphs were boring – Copying from board

  • How enjoyable did students find the activity?
  • 94% of students questioned rated the activity ≥3 on a scale of 1 - 5
slide-21
SLIDE 21

Our Suggestions

– Delete diagram on SW1 as teachers didn’t feel there was any need for it – Introduce a global activity aspect? – Take out graph paper from pack as this is generally supplied by schools

slide-22
SLIDE 22

Sexual Transmission

Teacher Comments

  • General comments

– Students enjoyed the activity and were genuinely interested – Area that is difficult to teach but very relevant

  • Main activity

– Prompt teachers to choose someone who won’t be picked on if they are the initial carrier – Add extra prompt to ensure students mix outside their own group

  • Extension Activity

– Cartoons very childish and almost spoilt the activity – Student discussions were interesting and informative – Dialogues can be changed on the web – not good!!!

7 10

slide-23
SLIDE 23

Sexual Transmission

Student Comments

  • What were the main things they learned

– How STIs can be transmitted – How to protect yourself – To get regular testing if sexually active

  • Student Likes

– Talked to as grown ups – Finally explained WHY its important to have safe sex – Showed HOW to be safe – Fun and memorable

  • Student Dislikes

– Slightly embarrassing – Stories were too basic – Practical was disturbing

  • How enjoyable did students find the activity?
  • 100% of students questioned rated the activity ≥3 on a scale of 1 – 5
  • Activity rank of 5 in France
slide-24
SLIDE 24

Our Suggestions

– Suggest activity be carried out in smaller groups of 15 students – Modify the online images so dialogues cannot be changed – Suggest teachers may wish to bring in other teacher or a doctor to carry out the test to make it more realistic – Demonstrate how to put on a condom?

slide-25
SLIDE 25

Treatment and Infection

Micro organisms: % Improvement (95% CI) p Value Vaccines help protect people against viral infections only 8 (-1, 18) 0.09

Quantitative Data

  • Significant increase in student knowledge (<0.001)

Improvement scores (baseline vs change) by statement and topic for senior schools

slide-26
SLIDE 26

Treatment of Infection

Teacher Comments

  • Activity

– Disappointed that there was no natural defence system diagrams or images – Too advanced, dry and dull – Some teachers thought it was interesting

  • Suggestions

– Request activity, possibly similar to the junior school pack activity

6 10

slide-27
SLIDE 27

Treatment of Infection

Student Comments

  • What were the main things they learned

– Overuse leads to resistance – Drugs become resistant – Antibiotics should only be used on bacteria!

  • Student Likes

– Story – Problem solving – How resistance works

  • Student Dislikes

– Too much writing – No practical activity – Boring – Difficult (but challenging)

  • How enjoyable did students find the activity?
  • 83% of students questioned rated the activity ≥3 on a scale of 1 – 5
  • Activity rank 3 from France
slide-28
SLIDE 28

Our Suggestions

– Use antibiotic discs to demonstrate resistance – Make the activity into an investigation or drama style activity

slide-29
SLIDE 29

Prevention of Infection

Teacher Comments

  • Start with travel vaccines to make it more relevant to the

students

  • Add Jenner story as an introduction and then data analysis
  • Include success rate facts
  • Picture of rare or eliminated diseases due to vaccines
  • Factsheet too static and too much information
  • More information on natural defences – request video clip of

white cells engulfing bacteria cells

  • More ICT – have students draw graphs on computers

6 10

slide-30
SLIDE 30

Prevention of Infection

Student Comments

  • What was the main thing they learned

– How a vaccine works

  • Student Likes

– Interesting – Story – Computer work

  • Student Dislikes

– No practical – Got boring – Seeing pox pictures – Complicated

  • How enjoyable did students find the activity?
  • 94% of students questioned rated the activity ≥3 on a scale of 1 – 5
  • Activity rank of 2 in France
slide-31
SLIDE 31

Our Suggestions

– Make shorter – Rethink entire activity

  • Ask students to research vaccines they

would need for holidays

  • How do they work, etc

– Add a section on the success of vaccines – Add a cartoon or series of images

  • n how vaccines work instead of

fact sheet

slide-32
SLIDE 32

How to improve the activities

  • Make the activities more interactive
  • Links to junior pack preferable for lower ability classes
  • Include more video clips and images
  • Suggest work be done in groups or pairs
  • Some activities too easy
  • More explanations – WHY do things happen!
  • Less worksheets and more ICT
  • Use songs, drama, etc to help us remember activities
  • Teachers should be more involved
  • Better ways of presenting practical