NFJP Performance and Reporting Webinar April 30 2019
NFJP Performance and Reporting Webinar April 30, 2019
Welcome and Introductions Steven Rietzke – Division Chief Office of Workforce Investment, Division of National Programs, Tools and Technical Assistance Dr. Andrew Wiegand – President Social Policy Research Associates Marcia Hampton – Workforce Analyst National Farmworker Jobs Program Aaron Mitchell – Workforce Analyst National Farmworker Jobs Program
Webinar Overview • This webinar will cover the following: • Review of annual performance data from Program Year (PY) 2017 and how this data is the baseline forming 2019 performance targets • Training and Employment Guidance Letter (TEGL) 14 -18, released on March 25, 2019 • New performance reporting technical assistance tools and a grants management resource tool
How is This Webinar Tied to the Upcoming Allotment Process? • Anticipate the allotment TEGL being released within the next couple of weeks • Grant submission instructions will require the same documents as in previous years: 424, 424 -A, budget narrative, and program plan • Submit documents into grants. gov and email a complete electronic set to your FPO • Prior to completing/submitting your plans, you will receive an email from the NFJP Program Office specifying the new PY 19 targets • If your organization accepts the new proposed targets based on the regression model, incorporate them into your PY 19 Program Plan • If your organization does not accept them, set up a negotiation with your FPO immediately • Once the targets are negotiated, enter them into the PY 19 Program Plan
Process Reminders • Timing of PY 19 Funds: • We will process grant awards as close to the beginning of July as possible, but generally do not expect PY 2019 funds to be available to grantees until approximately mid-July. Please flag concerns to your FPO and NFJP@dol. gov. • PY 2018 closeout activities: • As in other years, grant closeout activities must be completed for PY 2018 • Two financial reports are required for the September quarter if funds are carried over from PY 18. Performance reporting in the July-September quarter is only reflected for PY 19 • PY 18 results will be incorporated into an annual report once the data is available
Review of PY 17 Annual Data 2 nd Qtr Employment Rate 2 nd Qtr Earnings 4 th Qtr Employment Rate Credential Attainment Measurable Skills Gains NFJP PY 17 Goals 69. 9% $5, 180 66. 0% 53. 2% N/A NFJP 4 th Qtr PY 17 78. 0% $5, 459 69. 5% 70. 5% 26. 1% NFJP 1 st Qtr PY 18 70. 4% $5, 200 68. 4% 73. 2% 40. 4% NFJP 2 nd Qtr PY 18 78. 5% $5, 280 69. 9% 71. 0% 54. 9% WIOA Adult PY 17 70. 7% $5, 493 63. 2% 56. 5% 35. 5% WIOA DW PY 17 71. 0% $6, 965 62. 7% 61. 7% 28. 6%
Review of PY 17 Annual Data • Performance is generally strong • Overall numbers remain low • Fewer than 10, 000 participants • Fewer than 5, 000 exiters • Some grantees’ data not available through WIPS – likely because grantees did not certify their data • We will be producing a PY 17 databook within the next several weeks • National summary • Individual state/grantee summaries
Regression Adjustment Model • Since moving to WIOA, all grantees have been held to the same performance standards. • But the types of participants served vary from grantee to grantee. • • • Educational background Offender status Prior work history English proficiency, etc. Economic Factors 8
How was the model developed? • Used a technique called regression analysis to determine which of 27 variables might significantly affect employment, earnings, credential and MSG outcomes. • Regression analyses are used to determine if there are relationships between different variables, for example: • Local poverty rate and median earnings? • Limited English proficiency and entered employment? • Transportation challenges and employment retention? 9
Explanation of Regression Model • Used data from PY 17 • Subsequent years will use data over multiple program years, which will strengthen the stability of the model • Model is similar in concept to those used for other WIOA programs, but is unique to the NFJP
Regression Analysis Results • Multiple variables were shown to significantly affect outcomes. • We then use the values calculated from the regression (parameters) for each factor to “adjust” grantees’ performance targets. • Adjustment = (Value for Variable in Regression Model) X (Grantee’s deviation from the national average on the Variable) 11
Example Grantee A Example: Grantee A’s Average (%) National Grantee Average (%) Difference Between National and Grantee Averages (%) Limited English Proficiency 43. 1 38. 6 4. 5% Lack of Transportation 13. 6 17. 8 -4. 2% County Unemployment Rate 7. 2 5. 9 1. 3% Significant Variables 1. We first subtract the national average from the grantee’s avg. 2. Then all differences (+ and -) are plugged into each measure’s formula to make adjustments to grantee targets. 12
Regression Analysis – Next Steps • National office is determining whether to implement a “cap” on changes from existing measures (i. e. , no grantee’s goals could be adjusted upwards or downwards by more than, e. g. , 5%, or 10%) • Adjusted goals will be shared with grantees • Opportunity for negotiation • Goals to be put in place for PY 2019 13
Where are We Now? • Since WIOA requires logical comparisons across ETA programs, ETA staff needed to work together to codify the definitions and agree on who was being counted in the calculations. • NFJP PY 17’s annual data will be the primary factor in establishing baseline goals for PY 19 • Formal policy guidance was issued for the six core programs through TEGL 10 -16. Once it was released, work began on guidance for the remaining programs.
Where are We Now? (continued) • DOL – Only guidance, Aligning Performance Accountability Reporting, Definitions, and Policies Across Workforce Employment and Training Programs Administered by the U. S. Department of Labor, was released on March 25, 2019 for 15 programs. As the title states, the intent of this guidance is to measure ETA programs uniformly. • With the release of official guidance, National Office staff can move forward with developing data validation instructions and grantees can finalize any changes they need to make to their automated systems.
Key Points from Attachment 7: National Farmworker Jobs Program • NFJP uses the same WIOA primary performance indicators as the core programs and applies these indicators as described in Appendix 1 of the guidance. • NFJP also uses the same WIOA youth primary performance indicators as the core programs and applies these indicators as described in Appendix 1 of the guidance.
Key Differences Highlighted in Attachment 7 • NFJP has its own definitions for reportable individual or participant, versus other WIOA programs. • Housing grantees do not report into WIPS and do not have the same performance indicators as career services and training grantees. Housing measures are described under the unique features of NFJP. • NFJP uses an expanded definition of “family” when describing eligible dependents.
Housing Performance • Although Housing grantee data is not currently reported into WIPS, the data is collected through the Quarterly Narrative Report. This information is included in the overall performance for NFJP. For reports to Congress and USDOL executive leadership, housing data is included as part of our outcomes. • Housing grantees will be asked to provide input for reporting through WIPS in the near future.
Appendix III – Table C Participation Level Services Chart NFJP Career Services & Training Grants Benefit or Service Type (WIOA, Section 167) Does this benefit/service trigger inclusion in participation? Category of Benefit/Service (i. e. Basic, Individualized, Training) Applicable PIRL Data Element Number(s) Eligibility Determination See 20 CFR 685. 110 at WIOA Final Rule. No Basic 1007 Outreach, Intake, Orientation No Basic 1007 No Basic 1000 and 1002 Yes Basic 1004 and 1116 Initial Assessment of skill level & other service needs Job Search Assistance (Self-directed) Job Search Assistance (Staff assisted) Placement Assistance (includes “Referred to Employment”) (Staff assisted career guidance)
Benefit or Service Type (WIOA, Section 167) Out-of-area job search assistance and relocation assistance Youth Services See 20 CFR 685. 370 at WIOA Final Rule. Related Assistance (staff assisted) Services Does this Category of benefit/servic Benefit/Service (i. e. e trigger Basic, inclusion in Individualized, participation? Training) Applicable PIRL Data Element Number(s) Yes Individualized 1004 AND (1200 AND 1201) Yes Individualized 1004 AND (1401 AND/OR 1406) Yes Individualized 1004 AND 2215 Training Services (includes onthe-job training and occupational skills training) See 20 CFR 685. 350 at WIOA Final Rule. Yes Training 1300 AND Training #1 (1302, 1303, 1306, 1307, and 1308); Training #2 (1309, 1310, 1311, 1312, and 1313); Training #3 (1314, 1315, 1316, 1317 and 1318); AND (1319, 1320, OR 1332) Basic Skills Training (includes English language acquisition and integrated education and training programs (non OJT) Yes Training 2221
New Technical Assistance Tools Posted on Workforce. GPS Grantee Resource Guide https: //farmworker. workforcegps. org/resources/2019/04/26/20/19/NFJP-Grants-Management-Resources Performance and Reporting Scenarios https: //farmworker. workforcegps. org/resources/2019/02/27/21/45/Performance-Reporting-Scenarios-for-Career-Service-and-Training-Grants Navigating Adult WIOA Performance Measures https: //farmworker. workforcegps. org/resources/2019/02/27/21/45/Performance-Reporting-Scenarios-for-Career-Service-and-Training-Grants Eligibility and best practice tools are posted at: https: //farmworker. workforcegps. org/ in the Agricultural Connection Community. Under ETA Grants, click National Farmworker Jobs Program. Where you see the red “Resources” tab, click on “New. ” Performance and reporting tools are posted in the same area. Click on the Performance tab under “New”.
Recently asked question • Why doesn’t the data on the QPR match what we think the data should look like? • Make sure you are not putting an exit date in the system for reportable individuals. • Make sure you have blanks in all of the relevant elements for reportable individuals.
THANK YOU FOR PARTICIPATING!
- Slides: 23