What is an Impact Goal? • An impact goal is a long-term goal of the change an organizations wants to see happen due to their activities/programs. • Impact goals should help answer the question: “Why do you need impact data?” The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 34
Impact Goals Idea Bank: Impact Stories • Two years ago, Shelly and her husband applied for a home mortgage, but upon receiving their application and pulling their credit report we found out that their credit was too low. They got a credit builder loan and took a financial education class. Over the next 6 months they paid off their credit builder loan and reapplied for a home loan, which they were now qualified for. They are now happily living in their first home on their family’s land. The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 35
Impact Goals Idea Bank: Impact Stories, cont… • Wealth Creation • # of mortgages • $ of mortgages • # of credit builder loans • $ of credit builder loans • Increase knowledge of budgeting and saving • Financial Wellness • Increase in credit score • Change in home situation • Sustainability and Self-Sufficiency • Increase in knowledge of loan process The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 36
In fifteen years, what are three big picture changes you’ve made in your community (or in your target market)? • We’ve...increased wealth • We’ve...supported a thriving native-owned business economy • We’ve...empowered individuals to be self-sufficient The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 37
Write down your mission. What 3-4 changes/results do you promise in your mission? • Our mission is to remove the barriers that exists in Indian Country that prohibit the flow of capital and credit. We address the critical needs in native communities related to the growth of family assets and sustainable economic development. • Business growth and sustainability in Indian country • Less reliance on tribal and federal government • Personal asset creation • Decrease in use of predatory lending The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 38
List your programs and services. If they are successful, what happens for your clients? • Our Programs and Services • Matched Savings Account • Financial Literacy Training • Credit Builder Loans • Mortgages • Small & Micro Business Loans • Success Means: • Healthy households – financially, physically, mentally, spiritually • Economic self-sufficiency • Community connectedness • Individual empowerment The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 39
What stories, success, and/or outcomes did you promise your funders? • Increase in personal bankability • Confidence in financial abilities • Economic growth • Increase in business revenue • Increase in owner take-away • Increase in # of jobs • Positive changes in client’s financial capabilities • Increase in the number of youth who gain financial skills The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 40
Impact Goals Idea Bank The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 41
Bring it all Together: Impact Goals Worksheet • Wealth creation • Individual self-sufficiency • Sovereignty • Whole person wellness • Seventh generation transformation • See manual for more examples. The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 42
Peer Feedback & Report Out Share your impact goals and provide feedback at your table. Each CDFI reports out their impact goals to the group. The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 43
LUNCH The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 44
Module 5 – Organizing Your Efforts The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
The Native CDFI Impact Matrix How it was Made How to Use it • By Native CDFIs! • Five impact goals > outcomes > indicators > definitions > metrics/tools The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 46
The Native CDFI Impact Matrix, cont… The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 47
But first, the story. Discussion The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 48
Activity What do you currently track? What do you want to track? The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 49
The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 50
Revisit Your Impact Goals After engaging with the NCDFI Impact Matrix does anything need to change with your impact goals? The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 51
BREAK The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 52
Module 6 – Scenario and Best Practices #2 and #3 The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
Scenario The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 54
Table Activity Pictionary The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 55
Best Practice #2: Evaluation as Relationship Building • Build relationships with clients around evaluation • Do regular follow-up The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 56
Best Practice #3: Streamlining Existing Processes • Be aware of existing resources and systems – integrate and use them! • 100% commitment to new processes • Make evaluation a daily activity The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 57
SWOT ACTION WORK PLAN SWOT TOPIC WHAT ACTION STEP WHO BY WHEN Talk to data geek about her Module 7 – experience, what she needs to We have a data geek! Mary Nov. 1 STRENGTH succeed, and provide her with training and resources. Stage I Develop a short follow-up data • Nov. 30 – collection tool and corresponding Develop Tool We don’t collect follow-up data. SurveyMonkey survey. Raise money • Dec. 10 – Build in Alyssa WEAKNESS to provide a drawing for Survey Monkey • Jan. 5 – Send to participating. Send to loan clients in Loan Clients January via email and snail mail. Work Plan Reach out to the funder to request information about any grants or We know of a funder who is funding they provide for developing Andrea Nov. 18 OPPORTUNITY interested in evaluation. evaluation systems. Also request any resources they have about evaluation generally. Work on developing an office Procedures by procedure in which all staff Being able to make time for data Nov. 1 participate in a data entry (or other Michael, then all entry. THREAT data related activity) every Friday staff Implement by from 9-9:30am. Build on the Nov. 15 procedure over time. The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 59
Day Two Wednesday October 9, 2019 The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 60
Day 1 Recap Activity Review the Process The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
Module 8 – Defining Outcomes and Indicators for Goals The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
Outcomes and Indicators • Think about accountability. • Be sure to speak to industry standards while also highlighting unique approaches or services your organization offers. • Take the perspective of your clients. The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 63
IMPACT MATRIX WORKSHEET IMPACT GOAL 1: Sustainability and Self-Sufficiency Impact OUTCOMES INDICATORS METRICS TOOLS NOTES/ DEFINITIONS Collected at follow-up and compared to baseline. Use of predatory services. Predatory lending includes: predatory loans, money orders, check cashing, pawn Decrease in use of Have you used any these financial Core Program and shops, rent-to-own, and paycheck advances. Predatory predatory lending services in the past year? Follow-Up Form Matrix loans are defined as: Payday loans, car title loans, or loans with abusive terms are considered predatory Bankability loans. Increase in number of Do you have a checking account? Core Program and clients who have Collected at follow-up and compared to baseline. Do you have a savings account? Follow-Up Form checking/savings account(s) How confident are you in your Increase in knowledge of Loan Application Worksheet ability to apply for and receive a Collected at follow-up and compared to baseline. loan process and Follow-Up Form loan? Income worksheet Collected at follow-up and compared to baseline. asking for household Decrease client’s household Sources and amounts of income income monthly and Percentage of client’s total household income that in use of public benefits Less Reliance annually from all comes from public benefits (e.g. TANF, SNAP/EBT, on Tribe and sources GA, WIC, LIHEAP, etc.) Some examples include: Federal Government Increase in the number of Client service activity • Small business expansion loan after receiving one- Client service activity tracked borrowers who return for tracked through time. on-one technical assistance or a start-up loan. through time additional services • Movement from credit builder loan to a small business loan or homeownership loan What was your gross annual revenue in the last fiscal year? Increase in sustainability of Core Program and What was your net annual business Collected at follow-up and compared to baseline. borrower business(es) Follow-Up Form profit in the last fiscal year? What stage is your business in? Business Increase in the number of # of current jobs provided Growth Loan Application jobs provided by borrower # of projected and actual jobs Collected at follow-up and compared to baseline. and Follow-Up Form business(es) created Number of business loans, by type and total, deployed Increase in the number of Loan portfolio Loan Type by the NCDFI in a defined reporting period. Total business loans filtered by loan type deployed since NCDFI inception. The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 64
Peer Feedback The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 65
BREAK The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 66
Module 9 – Scenario and Best Practices #4 and #5 The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
Scenario The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 68
Individual Activity – Two Truths and a Lie CREATE A CULTURE OF EVALUATION Truth Lie MAKE AN INDIVIDUAL RESPONSIBLE WHILE Truth Lie ENSURING FULL STAFF BUY-IN ALIGN YOUR IMPACT MEASUREMENT TO Truth Lie YOUR FUNDERS’ REQUIREMENTS The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 69
Best Practice #4: Create a Culture of Evaluation • Educated leadership • Integrate data and impact reporting into regular, everyday activities. • Analyze and report data internally on a regular basis. The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 70
Best Practice #5: Make an Individual Responsible While Ensuring Full Staff Buy-In • All staff and board members to be supportive and involved • One expert who is accountable The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 71
Module 10 – Defining Metrics and Tools The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
Metrics • Metrics are most easily understood the data you choose to measure and track that assess your performance and ability to meet your indicators, outcomes, and impact goals. • Practically, metrics are the questions on data collection tools. The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 73
Outputs, Outcomes, Baseline, and Follow-up • This year, we closed 43 credit builder loans totaling $542,246, which is an increase of 15% from last year. Of our credit builder clients, 63% were women with children under eight, and 98% were Chippewa. Their credit builder loans allowed them to build their credit by an average of 16 points and, due to participating in classes, these participants increased their financial confidence and skills by 36% on average. The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 74
The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 75
Impact Matrix Worksheet The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 76
Peer Feedback The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 77
LUNCH REMEMBER TO HAND IN YOUR IMPACT MATRIX WORKSHEET! The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 78
Summary of Feedback From Lunch Review • FILL OUT DURING LUNCH WITH MAIN POINTS OF FEEDBACK FOR EVERYONE TO HEAR The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 79
Process Feedback and Adjust The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 80
Recommended Tools The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 81
Impact Matrix Worksheet The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 82
Discussion The importance of follow-up The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 83
Follow-up Best Practices • Tie follow-ups to monetary rewards/refunds • Keep follow-ups short and simple to complete • Make follow-ups mandatory • Engage clients in evaluation • Make follow-ups interactive and creative • Share impacts • Offer strategic incentives such as gift cards, trainings, money and/or physical gifts The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 84
Module 11 – Scenario and Best Practices #6 and #7 The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
Scenario The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 86
Group Activity Parent and Children The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 87
Best Practice #6: Meet Clients Where They Are At • Utilizing a variety of ways to collect and receive data will result in more complete data and satisfied clients. • Staff members should be available to help clients fill out forms. The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 88
Best Practice #7: Build Client Enthusiasm and Set Expectations • Client involvement • Transparency • Long-term The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 89
BREAK The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 90
ACTION WORK PLAN WHICH PEER TIMELINE WHAT BEST CAN I REACH TASK WEEK MONTH QUARTER YEAR 6 MONTHS PRACTICE(S) OUT TO FOR BY OCTOBER 18, BY NOVEMBER 18, BY JANUARY 18, BY OCTOBER 18, BY APRIL 18, 2020 HELP/ ADVICE? 2019 2019 2020 2020 What: What: What: What: What: ☒ Identify what you need and why ☒ The role of relationships Independently Refine impact Work on getting a Revisit impact Revisit impact in evaluation brainstorm impact matrix after theory of change matrix with what matrix and make ☐ Streamline existing matrix plan looking at all of and logic model we’ve learned any needed processes ☒ Create a culture of FACC their funder developed from our theory updates IMPACT evaluation and learning Share what you reports of change and MATRIX ☐ Make an individual did with the rest logic model responsible while ensuring full staff buy-in of the staff TLF W H Y DO Y OU ☐ Meet clients where they are at NE E D IMPA CT ☐ Build client enthusiasm DA T A ? and set expectations CPCDC Who: Who: Who: Who: Who: ☐ Document your process All staff All staff Executive Executive Executive ☐ Use your data Board Director Director Director ☒ Stay flexible and responsive Board Board Module 12 – Phase II Work Plan What: What: What: What: What: ☒ Identify what you need and why ☐ The role of relationships Gather all tools Perform data Draft new tools Finalize tools Fully implement in evaluation currently used harvest and/or refine streamlined data ☒ Streamline existing processes existing tools Train on use of collection ☒ Create a culture of Gather all reports Perform gap new tools process into NACDC evaluation and learning currently needed analysis new system ☒ Make an individual TOOLS Identify which responsible while ensuring full staff buy-in staff is assigned to FBCF H OW W ILL Y OU ☒ Meet clients where they collection and data are at COLLE CT DA T A ? entry of each form ☒ Build client enthusiasm and set expectations Who: Who: Who: Who: Who: CTLF ☒ Document your process Office Office Office All staff All staff ☐ Use your data ☒ Stay flexible and Administrator Administrator Administrator responsive and/or Consultant Executive Director Consultant The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 92
Day Three Thursday October 10, 2019 The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 93
Day 2 and 3 Recap Activity Jeopardy The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
Module 13 – Collecting Data, Reporting Data, and Effective Communication to Stakeholders The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking
Who is the report for? How to communicate effectively Data Collection and What software is needed? Reporting Considerations What types of analysis are needed? What data collection methods can you use? The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 96
Data Collection Methods • Participant Observation • Interview • Survey • Focus Group • Secondary Research The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 97
Data Analysis Techniques • Qualitative/Narrative • Descriptive Analysis Data • Measures of Frequency • Stories, Quotes, • Percentages, Averages, Counts, Sums Categorical (Location, • Measures of Central Gender, Education, Tendency Employment, etc.) • Mean/Average, Median, • Quantitative Data Mode • Numbers, Amounts, • Comparative Analysis Currency • Change over time • Across demographics The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 98
Software and Database The Process: • Training staff/clients • Data harvest and • Building standard inventory • Gap analysis queries and reports • Training staff in • Reports assessment reporting • Building • Reverse engineering forms/activities in forms database system • Continually review and • Importing/entering update existing data The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 99
Types of Software • Microsoft Office/Google • Review information on Drive products page 46 – 50 of the manual • Customer relationship management software • Loan origination/processing software The CDFI Fund’s Capacity Building Initiative // BNCSI II // Best Practices in Impact Tracking 100
Recommend
More recommend
