Quality Reporting Connect Rob Reynolds Yan Heras 7222021

Quality Reporting Connect! Rob Reynolds Yan Heras 7/22/2021 © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office.

Agenda • What is being tested • How to test • How to record results • Next steps • Testing 2

WHAT IS BEING TESTED © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office. 3

Measure Testing Focus • $care-gaps parameters http: //build. fhir. org/ig/HL 7/davinci-deqm/Operation. Definition-caregaps. html#caregaps • End to End Scenario http: //build. fhir. org/ig/HL 7/davinci-deqm/gaps-examples. html#gapsin-care-report • Single Measure • EXM 130 7. 3. 000 Colorectal Cancer Screening 4

DEQM/GIC Sandbox https: //gic-sandbox. alphora. com/cqf-ruler-r 4/ © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office. 5

Known Validation Issues • • ERROR: Unknown Code http: //terminology. hl 7. org/Code. System/v 3 Act. Code#CAREGAP in http: //terminology. hl 7. org/Code. System/v 3 -Act. Code for 'http: //terminology. hl 7. org/Code. System/v 3 -Act. Code#CAREGAP'. Location: Parameters. parameter[0]. resource. entry[6]. resource. coding[0] (line 407, col 26). • The CAREGAP code is in the process of being deployed ERROR: SHALL have a contained resource if a local reference is provided ( (url: d 507170 e-96 fe-4 b 6 f-a 299 -5 c 40 fa 9 ad 482; ids: )) [reference. starts. With('#'). not() or (reference. substring(1). trace('url') in %root. Resource. contained. id. trace('ids'))]. Location: Parameters. parameter[0]. resource. entry[2]. resource. evaluated. Resource[0] (line 242, col 35). • Touchstone team is in the process of fixing the Validator 6

Known RI Issues • care-gap operation should return one bundle per Patient NOT one bundle per measure • care-gaps operation return when status parameter is “not -in-ip“ • Organization and Practitioner implementation pending 7

HOW TO TEST © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office. 8

Touchstone Test Scripts https: //touchstone. aegis. net/touchstone/testdefinitions? selected. Test. Grp=/FHIRSandbox/Da. Vinci/FHIR 4 -0 -1 -DEQM-GIC/Care-Gaps-3 -0 -0/04 Parameters&active. Only=false&content. Entry=TEST_SCRIPTS © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office. 9

Select Test 5 4 2 3 1 10

Execute 5 2 3 4 1 11

Test Execution screen • Wait for Status to change from “Running” • Click Test Script Execution link 1 2 12

Test Script Execution screen • Click Test Name to expand results • Determine pass/fail 1 13

Back to select test • Click Test Definitions 1 14

HOW TO RECORD RESULTS © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office. 15

Connectathon Manager • Will not be using Con. Man this Connectathon. • Quality Measure track is testing out a new feature that we will work to adopt next Connectathon • Test Plan Template in Confluence https: //confluence. hl 7. org/display/DVP/%24 caregaps+Test+Plan+Template • Copy $care-gaps Test Plan Template to test your server 16

Confluence Test Plan https: //confluence. hl 7. org/display/DVP/Da+Vinci+Reference+Implementation 17

NEXT STEPS © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office. 18

WIP • More tests • Gaps in Parameter tests (multiple measures) • More Category of tests • Test Result • Test different Measure Types • Test different Use Cases • Add better expected results • Add checking for errors • Add setup/teardown (enable some of the above) 19

TESTING © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office. 20

Demo RI Testing • Measure. Id-None-GIC – Pass • Period-Start-Out-Prior-GIC – Pass (with known validation issues) • Period-Start-Out-Post-GIC – Pass (expected error) • Status-In-Open-Closed-GIC – Fail © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office. 21

Other Servers? © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office. 22

QUESTIONS © 2019 Health Level Seven ® International. Licensed under Creative Commons Attribution 4. 0 International HL 7, Health Level Seven, FHIR and the FHIR flame logo are registered trademarks of Health Level Seven International. Reg. U. S. TM Office. 23