BUILDING A CROWDSOURCING PROGRAM at FDA
FROM MARKET RESEARCH TO A SYSTEMATIC PROGRAM
Mark Ascione and Kim Taylor Office of Strategic Programs (OSP) Center for Drug Evaluation and Research (CDER) Food & Drug Administration (FDA)
BUILDING A CROWDSOURCING PROGRAM at FDA FROM MARKET RESEARCH TO A - - PowerPoint PPT Presentation
BUILDING A CROWDSOURCING PROGRAM at FDA FROM MARKET RESEARCH TO A SYSTEMATIC PROGRAM Mark Ascione and Kim Taylor Office of Strategic Programs (OSP) Center for Drug Evaluation and Research (CDER) Food & Drug Administration (FDA) Heres
FROM MARKET RESEARCH TO A SYSTEMATIC PROGRAM
Mark Ascione and Kim Taylor Office of Strategic Programs (OSP) Center for Drug Evaluation and Research (CDER) Food & Drug Administration (FDA)
Leveraging standardized tools for consistent results and increased bandwidth Building excitement around and engagement in a crowdsourcing program Increasing value through program improvements
2 3 1
Developing tools to support increased demand
Leveraging early successes to establish best practices Using learning from all of you to increase value Introducing CDER Crowdsourcing
Q&A
Service’s “Effective Internal Communication Strategies Workshop”
community in designing program
weeks) sponsored by senior leaders
Background Execution Goals
leadership
E a r l y S u c c e s s
Example: Office Retreat Planning Challenge
discussion at upcoming all-
hour early dismissal
newsletter, recognition process and recurring All- Hands events
moderators
appropriate for crowdsourced conversation
idea generation
federal space Challenges Communications Incentives
C o n t i n u e d S u c c e s s
Example: Pharmacy Preceptor Challenge
enable more pharmacy preceptor students at CDER
time-off awards
timeliness, feasibility, popularity
preceptor program process
challenge: challenge objective, audience, questions, incentive, etc.
executive sponsor and moderator
touch-points customizable to challenge
communication of any implementation plans
Initiation Template Communication Plan Template Moderator Checklist
Value “Stages” implementation and enhanced community design Customer Connection Marketing segmentation and SharePoint integration Evaluation Focus groups, interviews and surveys
P E I S
Program Evaluation and Implementation Staff
evaluators (three of whom form Crowdsourcing team)
manages major internal evaluations related to key programs and initiatives
user segments, how to drive engagement, and how to enhance CDER crowdsourcing
can improve, and impact of implemented ideas
how to increase presence within CDER, and impact of implemented ideas
Crowd Moderators Sponsors
U s e r s e g m e n t s
in to a challenge but do not participate
who submit ideas, comment, or vote
more
Users who log in repeatedly and participate more than twice
Super crowdsourcer Participant Lurker
O p e n i d e a t i o n
and bureaucratic culture not ripe for open ideation
1000) and have staff dedicated to employee feedback
developing message board / suggestion box processes
brings power of IdeaScale right to users
IdeaScale SharePoint
S t a g e s
and comments from staff
Adjudicate ideas through voting (currently combined with ideate)
Review and elevate top ideas using ReviewScale (currently done offline)
for implementation, consideration, and parking lot
Ideate Staff Assessment Sponsor Assessment Action
“ A b o u t u s ”
story
challenges, # of ideas, etc.)
(overview and how- to) About us
Provides background on the program and includes infographics
Past challenges
Includes previous challenge questions, ideas, votes, and comments
How to participate
Describes how to submit an idea, vote, comment and participate confidentially
Host a challenge
Educates potential sponsors and moderators about how to host a challenge
Kimberly.Taylor@fda.hhs.gov
Mark.Ascione@fds.hhs.gov
Emily.Ewing@fda.hhs.gov
RESPOND
ENGAGE
Thank users for idea submissions (comments as warranted) Ask for elaboration of ideas or comments on submissions that are vague or about which you are curious Specify in a responding comment if an idea submission is already in practice
MERGE + DIVERGE
Merge ideas that are similar Diverge comments that contain new ideas into their own separate ideas Send relevant ideas to SMEs and ask them to engage on the crowdsourcing site
SEND
MONITOR
NOTIFY
Notify crowdsourcing team of any inappropriate or negative submissions
TRANSFER
Transfer off-topic or irrelevant ideas to the “additional input” category
Version 2.0 | 6/1/2018
C D E R C R O W D S O U R C I N G M O D E R A T O R S
CDER CROWDSOURCING CHALLENGE INITIATION TEMPLATE
SPONSOR MODERATOR(S) DATES AUDIENCE INCENTIVE
What senior leader sees the need for and will act as the face of this challenge? Who will monitor submissions to make sure they are appropriate and respond to idea submissions? When do you want to hold the challenge? Which office(s) are you targeting? Is there an incentive for this challenge (based on participation, idea quality, or some other factor)?
OBJECTIVES
What do you plan to get out of this challenge? How will the results be used?
Insert your response here Insert your response here Insert your response here Insert your response here Insert your response here This list should contain bullets of your overall goals for this challenge.
CDER CROWDSOURCING CHALLENGE INITIATION TEMPLATE
INTRO PARAGRAPH DRAFT QUESTIONS
What is this challenge about? Why is it important? Ask open-ended questions that require non-’yes’/’no’ answers
This paragraph will be posted on the home page of the crowdsourcing website and will be used to develop communications plan. Please keep your paragraph to 200 words or less. Limit yourself to 3-5 questions and provide titles for each question.
CDER CROWDSOURCING CHALLENGE INITIATION TEMPLATE
OPTIONAL FEATURES
Please highlight below the features you would like to utilize for your challenge.