SIG FEEDBACKFRUITS VU NT&L / BETA OCTOBER 7TH, 2019 1 Intro: - - PDF document

10/7/19 1

1

SIG FEEDBACKFRUITS VU NT&L / BETA

OCTOBER 7TH, 2019

SIG FeedbackFruits

2

• 2008-2013: PhD & PD in Medicinal Chemistry
• 2014-Now: Teacher Pharmaceutical Sciences

– Focus on educational innovation – Initiator of FeedbackFruits @ BETA

• “Innovations in Human Health & Life Sciences”

– Prof.dr. Jacqueline van Muijlwijk

• Contact details

– 020 59 3918 – danny.scholten@vu.nl

Intro: Danny Scholten

10/7/19 2

SIG FeedbackFruits

3

• Active learning works*

– Focus on: student activity, (peer) feedback

• Plethora of tools to support active learning

– Many not directly available in canvas

• Barrier to incorporate proven innovations

– E.g. Staff workload

Why FeedbackFruits?

* Freeman S, et al., PNAS. 2014, 111, 8410 * Schneider, M., & Preckel, F., Psych. Bulletin. 2017,143(6), 565-600

SIG FeedbackFruits

4

• Integrated in canvas
• User-friendly & consistent interface
• Facilitates active learning

FeedbackFruits: a solution?

10/7/19 3

SIG FeedbackFruits

5

The Long and Winding Road

Presentation FbF BETA agrees to Fac. licence June 2018 IT testing ü Safety ü Functionality ü Canvas integration Data Processing Agreement DPIA (privacy) Technical assessment (IT) Start of Licence Feb 2019 First pilot June 2019 Multiple pilots Sep-dec 2019 Rollout over BETA faculty Feb-Mar 2020 Order of licence Dec 2018 Evaluations NT&L

SIG FeedbackFruits

6

Interactive documents

10/7/19 4

SIG FeedbackFruits

7

Interactive video

SIG FeedbackFruits

8

Overview for the teacher

10/7/19 5

SIG FeedbackFruits

9

• (Peer) Feedback including reflection

+ Critical thinking & self-reflection + Students can learn from each other’s work + Improve quality of final draft

• Feedback plugins

+ Simple interface + Process guidance & automation + Group & individual assignments

Feedback tools

SIG FeedbackFruits

10

• Project Modern Developments in

Pharmaceutical Sciences (6 EC)

– 2nd year, period 6 – Focus on academic skills in context – Assignments in groups of 3 students – Teachers: Danny Scholten & Anneke Vuuregge

• Group literature review on a drug
• Peer review is done for a few years now

– Group A gives feedback on B, B on C, etc. – Feedback quality can be improved – Organizing all logistics is quite labor-intensive – No good overview of the process us as teachers

First Pilot FeedbackFruits

10/7/19 6

SIG FeedbackFruits

11

• Major aims of improvement with FbF

– More overview of the peer review process – Less time spent on logistics – Higher-quality feedback reports

• Setup of pilot

– 44 students; groups of 3 – Group literature review on drug (unchanged) – Individual students review the draft – Each group receives 3 reviews

• Reflect on reviews and make a plan for improvement

– The final version is graded by us using same criteria

First Pilot FeedbackFruits

SIG FeedbackFruits

12

• Overall positive!

– Assignments and rubrics can be easily copied – Deadlines can be applied to each step (canvas agenda) – FbF distributes the reviews fairly to all students – Feedback process takes less time – Students can only submit review after meeting criteria – Feedback is directly linked to grading criteria – Students generally take it seriously – Students are generally satisfied with the system – All steps of the process can be monitored – Feedback quality seems to have improved

Results Pilot FeedbackFruits

10/7/19 7

SIG FeedbackFruits

13

• Downsides

– 2 major crashes during pilot (quickly & permanently fixed by FbF) – Canvas student view does not work (inherent to external tool) – Some small issues with feedback editor (fixed) – Did not spend less time yet… but expect to next time!

Results Pilot FeedbackFruits

SIG FeedbackFruits

14

• Assignment Feedback is a module similar to Peer

Feedback

– Uses the same structure, incl. rubrics and feedback editor/view – However, only teachers can review

Addendum

10/7/19 8

SIG FeedbackFruits

15

Want a demo for your own group/program? Contact: danny.scholten@vu.nl

FeedbackFruits in action: Demo