November 2019 Peer Learning Group November 2019 Workforce

November 2019 Peer Learning Group November 2019

Workforce Analyst U. S. Department of Labor, Employment and Training Administration 2

Workforce Analyst U. S. Department of Labor, Employment and Training Administration 3

Workforce Analyst U. S. Department of Labor, Employment and Training Administration 4

UNDERSTAN D THE QUARTERLY REPORT ANALYSIS PROPOSED PILOT LEARN SPECIFICS THROUGH EXAMPLE(S) CLARIFY NEXT STEPS INFORM FURTHER DEVELOPMENT THROUGH FEEDBACK AND DISCUSSION 5

6

¡WIOA section 116(d)(5): data validation guidelines ¡TEGL 7 -18: Joint data validation framework ¡DOL-only data validation will expand joint guidance 7

An extension of our data-driven technical assistance. An ETA-generated review of grantee quarterly data. Enhance programmatic decision making, inform monitoring, and target technical assistance. Ensure data consistency and accurate reporting. 8

¡Addresses statutory and policy requirements for data validation ¡Responds to technical assistance requests 9

WIPS Standard Data Validation Quarterly Report Analysis • Report validation—WIPS calculates state performance reports to ensure standardized application of formula calculations • Valid value edit checks that ensure data are submitted according to the PIRL • Logical validations enforce consistency across PIRL elements • Parameters: State data validation requirements • Set monitoring and technical assistance expectations • Addresses data expectations where logical validations cannot be applied • Presents data graphically 10

REDUCE ERRORS Highlights areas of concern for additional investigation through monitoring, or technical assistance activities. SUPPORT SUCCESS 11

Data is illustrative only. Thresholds are illustrative only. 12

¡Data elements } Selected elements across programs related to eligibility, performance outcomes, and other program requirements } Subject to revision based on feedback and assessment ¡Thresholds } Reference points to serve as a technical assistance guide to demonstrate where data is in relation to the average being reported by all states } Initial thresholds will be based on assessment of national trends and will be revised as necessary 13

Quarterly Report Submission Implement TA & Improve Data ETA Issues QRA Results State Feedback 14

1. SQL 2. R 3. Python 4. Julia 5. Scala 6. Java 7. C/C#/C++ 8. STATA 9. SPSS 10. SAS 11. Matlab/Octave 12. Tableau 13. Other Choose the answers that best reflect your organization 15

1. SQL 2. R 3. Python 4. Julia 5. Scala 6. Java 7. C/C#/C++ 8. STATA 9. SPSS 10. SAS 11. Matlab/Octave 12. Tableau 13. Other Choose the answers that best reflect your organization 16

Initial impressions § Application § Elements § Communication and dissemination Next Steps § Collect feedback and make revisions § Provide training on the product 17

¡Tell us what you think! Requesting feedback by December 3, 2019. Scott Wheeler Consultant Maher & Maher swheeler@mahernet. com 18