IHE Pre-Connectathon PIX and PDQ Test Tool Tutorial

IHE Pre-Connectathon PIX and PDQ Test Tool Tutorial and Guide (2011 Cycle) Robert Snelick National Institute of Standards and Technology Version 1. 4 November 3 rd 2010 Contact: rsnelick@nist. gov

Table of Contents • • • Overview Test Case Walkthrough Registration and Login Tool Demonstration Configuration, Preparing to Run Tests, and Troubleshooting Validating the v 3 SOAP Message Wrapper Validation Overview (HL 7 v 2) Validation Overview (HL 7 v 3) Summary 2

Overview of the NIST PIX/PDQ Pre. Connectathon Test Tool

NIST PIX/PDQ Test Tool: Process Overview • The Test Tool cam be used to fulfill 2011 V 2 and V 3 PIX/PDQ Pre. Connectathon testing requirements • Supports Pre-Connectathon testing for: Profile/HL 7 Version Actors IHE PIX HL 7 v 2 Source, Manager, Consumer IHE PDQ HL 7 v 2 Supplier, Consumer IHE PIX HL 7 v 3 Source, Manager, Consumer IHE PDQ HL 7 v 3 Supplier, Consumer • Covers the PIX/PDQ Integration Profile – – • • Version 7. 0 August 10, 2010 http: //www. ihe. net/Technical_Framework/index. cfm#IT V 2: ITI-8, ITI-9, ITI-21, ITI-22 V 3: ITI-44, ITI-45, ITI-47 Results are stored in the NIST PIX/PDQ tool The IHE project manager will review the results 4

NIST PIX/PDQ Test Tool: Access • Web-based application (no downloads or installations needed) – Site: http: //pixpdqtests. nist. gov: 8080/ • Tool may be used in Anonymous Mode or Registered Mode – Anonymous Mode (“Guest” Users) • Does not require user registration and may be used to conduct ad-hoc system testing – Registered Mode • Required for completing the Pre-Connectathon and participating in the Connectathon • Required to save pre-connectathon test results • Test reports are made available to the IHE project manager • User’s Guide is available on the site under “Documentation” 5

NIST PIX/PDQ Test Tool: Support • IHE PIX/PDQ Google Group – – http: //groups. google. com/group/ihe_pix_pdq_testing Preferred method of communication for discussing common issues Go to the site and request membership Administrative (only) issues can be sent directly to rsnelick@nist. gov • Issues Tracker – http: //code. google. com/p/pixpdqtool/issues/list – Google utility to report issues, bugs, and enhancement suggestions 6

Testing Environments • Instance Testing – Conformance (e. g. , against HL 7 2. x or CDA) • Test object conforms to specification on which it is based • IHE Model: ~Virtual and Pre-Connectathon • NIST IHE PCD v 2 Message Validation Test Tool • Isolated System Testing – Includes Instance Testing Activities – Protocol Conformance – Functional Behavior Conformance • Features and operational behavior correspond to specifications • IHE Model: ~Virtual and Pre-Connectathon • NIST IHE PIX/PDQ v 2/v 3 Test Tool • Peer-to-Peer System Testing – Includes Isolated System Testing Activities – Interoperability Testing • Testing complete application environment • May include interacting with Database, using Network Communications, or interacting with other hardware, applications, or systems if appropriate • IHE Model: ~Connectathon 7

NIST PIX/PDQ Test Tool: Operational Process INTERACTION/REPORTS MANUAL OR AUTOMATED SUT END-USER (VENDOR) Web Application Interface MESSAGES (TEST OBJECTS) STIMULUS OR RESPONSE (MESSAGES) NIST PIX/PDQ HL 7 v 2/v 3 TEST TOOL (via the communication protocol) SYSTEM UNDER TEST (SUT) SPECIFICATIONS (test material that defines test assertions) 8

NIST PIX/PDQ Test Tool: PIX Test Coverage PIX HL 7 v 3 PIX HL 7 v 2 Actor Source Consumer Manager Test Cases ITI-8 -Source-A 01 ITI-8 -Source-A 04 ITI-8 -Source-A 05 ITI-8 -Source-A 08 ITI-8 -Source-A 40 ITI-9 -Consumer ITI-8 -Feed-Check-PID-3. 4 -A 01 ITI-8 -Feed-Check-PID-3. 4 -A 04 ITI-8 -Feed-Check-PID-3. 4 -A 05 ITI-8 -Feed-Unknown-Domain-A 01 ITI-8 -Feed-Unknown-Domain-A 04 ITI-8 -Feed-Unknown-Domain-A 05 ITI-8 -Feed-Valid-Domain-A 01 ITI-8 -Feed-Valid-Domain-A 04 ITI-8 -Feed-Valid-Domain-A 05 ITI-8 -Merge-Patient ITI-8 -Update-Check-PID-3. 4 ITI-8 -Update-Unknown-Domain ITI-8 -Update-Valid-Domain-Patient-Exist ITI-8 -Update-and-Link ITI-9 -Query-Case 1 -Data-Found ITI-9 -Query-Case 2 -Data-Not-Found ITI-9 -Query-Case 3 ITI-9 -Query-Case 4 ITI-9 -Query-Case 5 ITI-9 -Query-Case 6 Actor Source Consumer Manager Test Cases ITI-44 -Source-Feed ITI-44 -Source-Update ITI-44 -Source-Merge ITI-45 -Consumer ITI-44 -Feed-Unknown-Domain ITI-44 -Feed-Valid-Domain ITI-44 -Merge-Patient ITI-44 -Update-Unknown-Domain ITI-44 -Update-Valid-Domain-Patient-Exist ITI-44 -Update-and-Link ITI-45 -Query-Case 1 -Data-Found ITI-45 -Query-Case 2 -Data-Not-Found ITI-45 -Query-Case 3 ITI-45 -Query-Case 4 ITI-45 -Query-Case 5 ITI-45 -Query-Case 6 9

NIST PIX/PDQ Test Tool: PDQ Test Coverage PDQ HL 7 v 3 PDQ HL 7 v 2 Actor Test Cases Consumer ITI-21 -Consumer-Query-Continuation-Protocol ITI-21 -Consumer-Query-Patient-Address ITI-21 -Consumer-Query-Patient-Name-Administrative. Sex ITI-21 -Consumer-Query-Patient-Name-DOB ITI-21 -Consumer-Query-Patient. Id Consumer ITI-47 -Consumer-Query-Continuation-Protocol ITI-47 -Consumer-Query-Patient-Address ITI-47 -Consumer-Query-Patient-Name-Administrative. Sex ITI-47 -Consumer-Query-Patient-Name-DOB ITI-47 -Consumer-Query-Patient. Id Supplier ITI-21 -Query-Case 1 -Data-Found-Exact-Match-Single. Domain ITI-21 -Query-Case 1 -Data-Found-Single-Domain ITI-21 -Query-Case 2 -Data-Found-Exact-Match-Single. Domain ITI-21 -Query-Case 2 -Data-Found-Single-Domain ITI-21 -Query-Case 3 ITI-21 -Query-Continuation-Protocol Supplier ITI-47 -Query-Case 1 -Data-Found-Exact-Match-Single. Domain ITI-47 -Query-Case 1 -Data-Found-Single-Domain ITI-47 -Query-Case 2 -Data-Found-Exact-Match-Single. Domain ITI-47 -Query-Case 2 -Data-Found-Single-Domain ITI-47 -Query-Case 3 ITI-47 -Query-Continuation-Protocol 10

Test Case Walkthrough PIX Manager Test Case: ITI-9 -Query-Case 1 -Data-Found

Test Case ITI-9 -Query-Case 1 -Data-Found – HL 7 Version 2 IHE ITI Technical Framework Volume 2 a (ITI TF-2 a) 3. 9 PIX Query Case 1: The Patient Identifier Cross-reference Manager Actor recognizes the specified Patient Identification Domain and Patient ID sent by the Patient Identifier Cross-reference Consumer in QPD-3, and corresponding identifiers exist for the specified patient in at least one of the domains requested in QPD-4 (one identifier per domain). (See Case 6 below for the required behavior if there are multiple identifiers recognized within a given Identifier Domain by the Patient Identifier Crossreference Manager Actor. ) AA (application accept) is returned in MSA-1. OK (data found, no errors) is returned in QAK-2. A single PID segment is returned in which one repetition of PID -3 Patient Identifier List is populated for each of the domains, if any, that the Patient Identifier Cross-reference Manager Actor did recognize in which a single identifier exists for the requested patient, not including the queried-for patient identifier that is returned in QPD-3. 12

Test Case ITI-9 -Query-Case 1 -Data-Found: Description References Test case ITI-9 -Query-Case 1 -Data-Found covers the PIX Query Case One patient (ALPHA) is registered in three different domains. Three registration messages are sent to a Cross Reference Manager. A PIX Query is sent to resolve a reference to ALPHA in a specific domain (NIST 2010 -2). Patient ALPHA should be found. Another PIX Query is sent to resolve a reference to ALPHA in two different domains (NIST 2010 -2 and NIST 2010 -3). Patient ALPHA should be found in those two domains. Another PIX Query is sent to resolve a reference to ALPHA in all domains. Patient ALPHA should be found in two domains (NIST 2010 -2 and NIST 2010 -3). IHE ITI TF-2 a: Transactions Part A (Revision 6. 0, August 10, 2009) § Actors 3. 9. 4. 2. 2. 6 Patient Identifier Cross-reference Manager Actor Query Response Behavior Patient Identity Source (Test Agent) Patient Identity Consumer (Test Agent) Patient Identity Cross-Reference Manager (Vendor System Under Test) 13

Test Case ITI-9 -Query-Case 1 -Data-Found: Test Steps STEPS DESCRIPTION SOURCE DESTINATION • PIX Manager • Reference The NIST PIX Source sends a registration message (ADT^A 04) to register patient ALAN ALPHA in domain NIST 2010&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO. Patient ID is PIX 10501. The PIX Manager shall register the patient and send a correct ACK message back. • PIX Source • Reference Message 2 The NIST PIX Source sends a registration message (ADT^A 04) to register patient ALAN ALPHA in domain NIST 2010 -2&2. 16. 840. 1. 113883. 3. 72. 5. 9. 2&ISO. Patient ID is XYZ 10501. The PIX Manager shall register the patient and send a correct ACK message back. • PIX Source • Reference Message • PIX Manager • Reference Example • Message 3 The NIST PIX Source sends a registration message (ADT^A 04) to register patient ALAN ALPHA in domain NIST 2010 -3&2. 16. 840. 1. 113883. 3. 72. 5. 9. 3&ISO. Patient ID is ABC 10501. The PIX Manager shall register the patient and send a correct ACK message back. • PIX Source • Reference Message • PIX Manager • Reference Example • Message 4 The NIST PIX Consumer sends a query message (QBP^Q 23) to ask for ALAN ALPHA''s ID in domain NIST 2010 -2&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO using his id PIX 10501 in domain NIST 2010&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO. The PIX Manager shall answer correctly to the query with ALAN ALPHA''s ID XYZ 10501 in domain NIST 20102&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO. • PIX Consumer • Reference Message • PIX Manager • Reference Example • Message 5 The NIST PIX Consumer sends a query message (QBP^Q 23) to ask for ALAN ALPHA''s ID in domain NIST 2010 -2&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO and NIST 20103&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO using his id PIX 10501 in domain NIST 2010&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO. The PIX Manager shall answer correctly to the query with ALAN ALPHA''s ID XYZ 10501 and ABC 10501 in domain NIST 20102&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO and NIST 20103&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO. • PIX Consumer • Reference Message • PIX Manager • Reference Example • Message 6 The NIST PIX Consumer sends a query message (QBP^Q 23) to ask for ALAN ALPHA''s ID in all domains using his id PIX 10501 in domain NIST 2010&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO. Your PIX Manager shall answer correctly to the query with ALAN ALPHA''s ID XYZ 10501 and ABC 10501 in domain NIST 20102&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO and NIST 20103&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO. • PIX Consumer • Reference Message • PIX Manager • Reference Example • Message 14

Test Case ITI-9 -Query-Case 1 -Data-Found PIX/PDQ Test Tool Web Application Interface End User (Vendor) NIST PIX Source Test Agent 1 ADTA 04 – Register patient “ALAN ALPHA” (ID = PIX 10501) in domain “NIST 2010” 1 a ACKA 04 – Send acknowledgement 2 ADTA 04 – Register patient “ALAN ALPHA” (ID = XYZ 10501) in domain “NIST 2010 -2” 2 a ACKA 04 – Send acknowledgement 3 ADTA 04 – Register patient “ALAN ALPHA” (ID = ABC 10501) in domain “NIST 2010 -3” 3 a ACKA 04 – Send acknowledgement QBPQ 23 – Send query message for patient 4 “ALAN ALPHA” in domain “NIST 2010 -2” using the patient ID in domain “NIST 2010” 4 a NIST PIX Consumer Test Agent RSPK 23– Send response that the identifier “XYZ 10501” for patient “ALPHA” was found in domain “NIST 2010 -2” System Under Test Vendor PIX Manager Application QBPQ 23 – Send query message for patient 5 “ALAN ALPHA” in domain “NIST 2010 -2” and “NIST 2010 -3” using the patient ID in domain “NIST 2010” RSPK 23 – Send response that the identifiers 5 a “XYZ 10501” and “ABC 10501” for patient “ALPHA” were found in domains “NIST 2010 -2” and “NIST 2010 -3” QBPQ 23 – Send query message for patient 6 “ALAN ALPHA” in all domains using the patient ID in domain “NIST 2010” RSPK 23 – Send response that the identifiers 6 a “XYZ 10501” and “ABC 10501” for patient “ALPHA” were found in domains “NIST 2010 -2” and “NIST 2010 -3” 15

Registration and Login

Steps for Completing Test Cases 1. Register/log-in 2. Select HL 7 Version (v 2 or v 3) and Actor 3. Select Test Case • • Client Type (PIX Source and PIX Consumer, PDQ Consumer) Server Type (PIX Manager, PDQ Supplier) 4. Set Configuration Information 5. Run Test 6. View/Save/Submit Reports 17

Registration/Log-in • To register, click-on Register in the upper-right corner of the tool’s home page – – – – Name Organization Name Email Address Login Information Application Name (MSH 3. 1) Facility Name (MSH 4. 1) IP Address(es) and Port Number(s) • NIST Administrator will confirm log-in credentials • Log-in is required to save test results, submit results to the IHE project manager, and gain credit for test completion NIST PIX/PDQ Test Tool *Push/Pull to Gazelle IHE Project Manager can view database of results IHE Gazelle * not yet implemented 18

Registration/Log-in Fill out the User Information section completely. Users unable to be verified by the NIST administrators will have accounts deleted. Document v 2 and/or v 3 actor information as appropriate for your case studies. Fields exist for multiple IP Addresses and Port Numbers if needed, based on your system configuration. 19

Viewing Account Information To view information about the currently logged in user, go to the User Account page. The Actor Information section will display the server configuration fields documented during registration. The Responder Information section will display as a reference the unique client configuration information, which the test tool dynamically generates. 20

Tool Demonstration PIX Manager Test Case: ITI-9 -Query-Case 1 -Data-Found

Overview and Home Page After registration, users can log-in using the ‘Log-in’ tab to submit test results to the IHE Project Manager Click to register Click to run test cases Go to the PIX/PDQ Test Tool User Guide for step-by-step instructions Discuss PIX/PDQ Profile and Tests on the Google Discussion Group 22

Select Test Case – Client (PIX Consumer, PIX Source, PDQ Consumer) Select an ‘HL 7 Version’ and ‘Actor’ to view a list of available test cases Select a test case by selecting the corresponding radio button Select the ‘Display Configuration Information’ button to view the test configuration details. The ‘Start Test’ button will become enabled once the configuration information dialog has been closed 23

Configure – v 2 User Client (for Registered Users) View the ‘Application Name’, ‘Facility Name’, ‘IP Address’, ‘Port Number(s)’ needed to configure your client application to send messages. Please note that each NIST PIX Manager instance is unique for each user. Important! The name of the NIST PIX server for a registered user is created based on your user account (login) name. The NIST server name (receiving application name ) is “NIST_PIX_PDQ_Manager_” + “Login Name”. Therefore, if your login name is Vendor then you send messages to NIST_PIX_PDQ_Manager_VENDOR. If your system is not configured accordingly you will receive an acknowledge error message over the network and nothing will appear in the console. 24

Configure – v 2 User Client (for Guest Users) View the ‘Application Name’, ‘Facility Name’, ‘IP Address’, ‘Port Number(s)’ needed to configure your client application to send messages. Please note that each NIST PIX Manager instance is unique for that run, if not logged in as a registered user. Important! The name of the NIST PIX server is temporary and will changed for every test that is run. You must review the configuration information each time and change the receiving application name accordingly. Using an old name will result in failure; you will receive an acknowledge error message over the network and nothing will appear in the console. 25

Configure – v 3 User Client Registered User As with v 2 client configuration, the application name will be the same for all tests performed when logged in as this user. Guest users, however, will receive a new application name each time a test is run. Guest User Unlike v 2, which generates an application name based on the registered user’s login, v 3 client configuration will generate an application name with a unique ID appended to the end (in this example, 56). 26

Select Test Case – Server (PIX Manager, PDQ Supplier) Select an ‘HL 7 Version’ and ‘Actor’ to view a list of available test cases Select a test case by selecting the corresponding radio button to view a description, references, and list of transactions Select the ‘Configure’ button to enter the test configuration details – the ‘Start Test’ button will become enabled once the configuration information has been entered 27

Configure – v 2 Test Cases - User Server (Single IP/Port) Enter the ‘Application Name’ and ‘Facility Name’ for the System Under Test – these fields are associated with MSH. 3. 1 and MSH. 4. 1 in the HL 7 v 2 message and match exactly. Single IP/Port Select the “With user interaction” execution type to stop the test after each transaction and manually tell the tool to begin the next step. Choosing “Without user interaction” will run all of the transactions within the test case without pausing. Example PIX Manager V 2 Application Name: V 2 Facility Name: IP Address: Port: Select ‘Single IP/Port’ or ‘Multi IP/Port’ and enter the information accordingly – ‘Multi IP/Port’ may be used to handle ADT and PDQ messages separately. Use this PIX Manager from Open Health Tools (OHT) to try the tool if you don’t have an application to test PAT_IDENTITY_X_REF_MGR_MISYS 198. 160. 211. 53 3600 (PDQ Port: 3601) 28

Configure – v 2 Test Cases - User Server (Multi IP/Port) Multi IP/Port Select ‘Multi IP/Port’ and enter the information accordingly 29

Configure – v 3 Test Cases - User Server Single IP/Port Multi IP/Port Note: the configuration information in this example is fictitious. 30

Run Test cases are executed one transaction at a time and real-time results can be tracked in the ‘Console Log’ Individual validation reports can be viewed by selecting the ‘Magnifying Glass’ icon at the end of each transaction Results, Messages Sent/Received, and Detailed Results (XML/HTML) can be viewed in between each transaction Select ‘Next Step’ at the conclusion of each transaction to initiate the next one 31

View/Save/Submit Report Select the ‘Submit Results and Finish’ button to submit test results to the IHE Project Manager for review A summary-level report will also be available – reports may be printed or saved to the user’s local file system 32

Validation and Summary Reports Individual validation reports are available at the end of each transaction and again at the conclusion of a test case A summary-level report that compiles individual validations reports will also be available – reports may be printed or saved to the user’s local file system It is always a good idea to download your results to your local system for backup! 33

View Past Results Registered users can view their test history on the ‘Reports’ tab – this tab provides access to saved transaction and summary-level reports Users may select the ‘Actor Tested’ and ‘HL 7 Version’ to view their list of previously run test cases. Users may then select the corresponding radio button to view the results for a particular test case Users can download and save the ‘Result Summary’ in both HTML and PDF formats 34

Configuration, Preparing to Run Tests, and Troubleshooting

Configuration Information • v 2 Applications sending ER 7 – IP Address: 129. 6. 24. 143 – Port Number: 9080 • v 2 Applications sending XML – IP Address: 129. 6. 24. 143 – Port Number: 9070 • v 3 Applications – IP Address: 129. 6. 24. 143 – Port Number: 9090 • v 3 SOAP end point – http: // 129. 6. 24. 143: 9090 36

Example v 2 PIX Source Vendor Configuration Information • Configuration Information for sending v 2 messages For Registered User: Application Name: NIST_PIX_PDQ_Manager_Bob. Vendor* For Guest User: Application Name: NIST_PIX_PDQ_Manager_78 (varies each time) Same for Registered and Guest User: Facility Name: NIST IP Address: 129. 6. 24. 143 Port Number: 9080 (ER 7 Messages) Port Number: 9070 (XML Messages) * The application name is derived from the log-in name. Registered users can view this under the “User Account” tab. It will remain the same for every client test. 37

Example v 3 PIX Source Vendor Configuration Information • Configuration Information for sending v 3 messages For Registered User: Application Name: 2. 16. 840. 1. 113883. 3. 72. 6. 5_13* For Guest User: Application Name: 2. 16. 840. 1. 113883. 3. 72. 6. 5. 92 (varies for each test case run) Same for Registered and Guest User: Facility Name: 2. 16. 840. 1. 113883. 3. 72. 6. 1 (Optional) IP Address: 129. 6. 24. 143 Port Number: 9090 (v 3 Messages) * The application name is derived from the log-in name. Registered users are assigned a number and this can be viewed this under the “User Account” tab. It will remain the same for every client test. 38

PIX/PDQ Server Application Name Allocation (for Registered Users) • For each user the name of the PIX Manager or PDQ Supplier is uniquely assigned – Is based on the user login name – This ensures that each vendor test is isolated • In order to interact with the NIST PIX Manager or the NIST PDQ Supplier Test Agent you will need to use the information provided in “Configuration Information” dialog – For example (V 2): • Application Name: NIST_PIX_PDQ_Manager_Bob. Vendor • Facility Name: NIST – For example (V 3): • Application Name: 2. 16. 840. 1. 113883. 3. 72. 6. 5. 17 • Facility Name: 2. 16. 840. 1. 113883. 3. 72. 6. 1 (Optional) • If you send to an application name that doesn’t exists you will get the following response from our system: – Nothing from the user console (it’s still listening for messages) – An acknowledge message with error is sent back to you over the network 39

Dynamic PIX/PDQ Server Application Name Allocation (for Guest Users) • For each test case instance the name of the PIX Manager or PDQ Supplier is created dynamically – The life of this test agent exists only for the duration of the test – This ensures that each vendor test is isolated • In order to interact with the NIST PIX Manager or the NIST PDQ Supplier Test Agent you will need to use the information provided in “Configuration Information” dialog – For example (V 2): • Application Name: NIST_PIX_PDQ_Manager_150 • Facility Name: NIST – For example (V 3): • Application Name: 2. 16. 840. 1. 113883. 3. 72. 6. 5. 98 • Facility Name: 2. 16. 840. 1. 113883. 3. 72. 6. 1 (Optional) • If you send to an application name that no longer exists you will get the following response from our system: – Nothing from the user console (it’s still listening for messages) – An acknowledge message with error is sent back to you over the network 40

Test Case Preparation • Before testing a PIX/PDQ server, users need to: 1. Clean your database of patients used in the test cases to avoid mixing tests with residual data. This is particularly important for test cases such as Merge since the merge patient will already exist if the test had been run previously. 2. Configure the PIX/PDQ Server to handle the following patient identifier assigning authority domains: NIST 2010&2. 16. 840. 1. 113883. 3. 72. 5. 9. 1&ISO NIST 2010 -2&2. 16. 840. 1. 113883. 3. 72. 5. 9. 2&ISO NIST 2010 -3&2. 16. 840. 1. 113883. 3. 72. 5. 9. 3&ISO IHE 2010&1. 3. 6. 1. 4. 1. 21367. 2010. 1. 1&ISO 41

Troubleshooting • Site is unavailable – Typically means we are redeploying the application to make updates and the tool – We will announce redeployments – The downtime will be in the neighborhood of 10 -15 minutes – Please refresh the browser following the redeployment – Server is controlled by central computing facility and may be unavailable • Site appears to be down – Restart in a new browser window • Site has timed out – This will happen if the tool is open in an inactive browser window – To correct, refresh the browser 42

Troubleshooting (continued) • No response from console log – You may have sent to a destination that we could not process (i. e. , an incorrect receiving name) – We will send back an acknowledge/error over the network – On the console log nothing will happen – You need to check the destination on your end – If you determined that this was the problem you can resend a properly addressed message; we’ll still be listening up to the session timeout • Completed report is missing – When we discover an error in the test case (i. e. , the test case is wrong) we fix it – Tests that passed using an incorrect test are no longer valid – This should not occur often 43

Validating the v 3 SOAP Message Wrapper Prior to using the PIX/PDQ Tool

Introduction • The NIST PIX/PDQ test tool is primarily concerned with the PIX/PDQ payload. • However, since the tool is interactive, messages are exchanged using transport layer protocols - namely SOAP for HL 7 V 3. • Testing this layer is not in the scope NIST PIX/PDQ test tool, but a malformed message will prevent delivery to the tool. • Therefore, users need to ensure that messages are well-formed and adhere to transport layer requirements • Users need to test V 3 messages at this layer before beginning testing with the interactive PIX/PDQ test tool or if you don’t get a response from the PIX/PDQ test system • The following slides provide some helpful hints and a link to additional tooling for debugging your V 3 SOAP messages • Please note that these tools are not part of the PIX/PDQ tool, and the PIX/PDQ team does not support the tools 45

Debugging PIX/PDQ v 3 Messages • Malformed SOAP envelopes may cause the PIX/PDQ tool to not respond • This is due mostly to malformed XML • Use the NIST XDS Toolkit to validate SOAP messages – http: //ihexds. nist. gov/xdstools 2/ – The tool provides testing for the various layers of the v 3 message • HTTP Header • SOAP Wrapper – The tool does not provide validation of the SOAP body (or payload). • In this case the PIX/PDQ payload • The PIX/PDQ tool validates the payload in the context of the test case 46

Using the XDS Toolkit • The toolkit requires sending the entire HTTP message in plain text format • If this is not easily obtained from your server, consider using TCPMon to act as a proxy: – https: //tcpmon. dev. java. net/ 47

XDS Tool Kit http: //ihexds. nist. gov/xdstools 2/ Click here to reach the Message Validator 48

XDS Tool Kit Step 1: Leave this option as “Guess based on content” 3) Once the file has been selected click here to have the tool validate the SOAP message. Step 2: Use this button to locate the text file on your local system which contains the server’s HTTP SOAP message. 49

XDS Validation Results This section reports on the correctness of the HTTP header. This section reports XML violations 50

XDS Validation Results (continued) This section will report SOAP violations Note: As the XDS Toolkit was not built to validate the PIX/PDQ message payload this error message is expected. If this is the only error you get, then you are ready to move onto the PIX/PDQ tool! 51

Example Malformed Messages • The following example messages will not be processable by the PIX/PDQ tool • The XDS Tool Kit can be used to help debug implementation challenges 52

Example v 3 Message with Malformed HTTP Header POST / HTTP/1. 1 Host: Content-Length: 3556 Missing Content-Type header http: //www. fakelistener. com/myapp http: //pixpdq 2010 tests. nist. gov: 8080/ http: //pixpdq 2010 tests. nist. gov: 8080/ . . . 53

Example Message Validation Results Malformed HTTP Headers cause the tool to be unable to determine content type and thus messages cannot be parsed 54

Example V 3 Message with Malformed XML Content POST / HTTP/1. 1 Content-Type: application/soap+xml Host: Content-Length: 3556 http: //www. fakelistener. com/myapp http: //pixpdq 2010 tests. nist. gov: 8080/ http: //pixpdq 2010 tests. nist. gov: 8080/ Missing closing wsa: Header tag . . 55

Example Message Validation Results Malformed XML causes the parser to halt 56

Example v 3 Message with Malformed SOAP Structure POST / HTTP/1. 1 Content-Type: application/soap+xml Host: Content-Length: 3556 http: //www. fakelistener. com/myapp http: //pixpdq 2010 tests. nist. gov: 8080/ http: //pixpdq 2010 tests. nist. gov: 8080/ Misspelled env: Body element . . 57

Example Message Validation Results 58

Example Message Validation Results (continued) Misspelled env: Body element makes it impossible to extract message payloads 59

Example Message with Malformed SOAP Header • The following shows an example of attempting to validate a message with a malformed SOAP Header. • Messages like this category will be accepted by our the PIX/PDQ tool, but errors reported by the XDS Toolkit should be fixed to bring implementations in line with the specification. 60

Example v 3 Message with Malformed SOAP Header POST / HTTP/1. 1 Content-Type: application/soap+xml Host: Content-Length: 3556 wsa: From elements are optional but must have a nested wsa: Address element that contains the sender uri http: //www. fakelistener. com/myapp http: //pixpdq 2010 tests. nist. gov: 8080/ http: //pixpdq 2010 tests. nist. gov: 8080/ At least one element must wsa: Action is contain the attribute absent env: must. Understand=“ 1” . . . 61

Example Message Validation Results 62

Example Message Validation Results (continued) Caused by missing wsa: Action element Caused by missing env: must. Understand attribute Caused by missing wsa: Address element 63

Examining Your Validation Results • (1) Errors reported in the sections “HTTP Parser, ” and “Validate Simple SOAP” must be fixed before using the PIX/PDQ tool – If not, the PIX/PDQ tool will not respond • (2) Errors in the “SOAP Wrapper” – (a) Errors pertaining to the Envelope and Body of the message must be fixed before using the PIX/PDQ tool (PIX/PDQ won’t respond) – (b) Errors pertaining to Header, WS-Addressing and WS-Action should not affect processing of the message by the PIX/PDQ tool but they should be fixed – (c) All well-formed messages will show the following error: “Cannot validate SOAP Body - WS-Addressing Action header **** is not understood. ” This error is to be expected; the XDS Tool Kit is not designed to evaluate the PIX/PDQ payload 64

Summary • Before using the PIX/PDQ make sure you have valid SOAP messages • Use the XDS Tool Kit to find out • Examine your test report, if you get errors: • 1 or 2 a You need to fix • 2 b You should fix • 2 c You are OK, proceed to the PIX/PDQ Tool See previous slide for explanation of 1, 2 a, 2 b, 2 c 65

Validation HL 7 v 2 Messages and IHE Actor Functional Behavior

HL 7 v 2 Transaction Validation Process • HL 7 v 2 Syntax Validation – Ensure the message structure is valid with respect to the HL 7 v 2 message definition and the HL 7 v 2 conformance profile – Ensure that the conformance requirements such as usage, cardinality, data type usage, etc. are valid with respect to the standard and the HL 7 v 2 conformance profile that constrains the message, in accordance with the IHE technical framework for a given transaction • Value Set Semantic Validation – Ensure that elements that refer to a table are valid with respect to the value set it references. The value set is given by the HL 7 v 2 standard or as constrained by the IHE technical framework. An example includes confirming that the administrative sex element (PID. 8) of the PID segment contains a value that is given in the HL 7 v 2 Administrative Sex table (HL 70001). – Identify conformance violations of constraints implied by the IHE Integration Profile. These constraints are captured in a validation context file. An example of such a test includes an element that is fixed in the IHE integration profile (e. g. , RCP. 1 = I). • HL 7 v 2 MLLP Validation – Ensure the message is valid with respect to the HL 7 v 2 MLLP specification for wrapping and unwrapping HL 7 v 2 messages. This is an implied test. • Test Case Specific Validation – Verify element content against a validation context file that captures test values as defined in the Pre-Connectathon test cases. 67

Test Case Specific Validation Checks STEPS Validation Criteria ASSERTIONS 1 • Assert an “AA” acknowledge message for registration of patient “ALPHA” in domain “NIST 2010”; Patient ID is “PIX 10501” 2 • Assert an “AA” acknowledgement message for registration of patient “ALPHA” in domain “NIST 2010 -2”; Patient ID is “XYZ 10501” 3 • Assert an “AA” acknowledgement message for the registration of patient “SIMPSON” in domain “NIST 2010 -3”; Patient ID is “ABC 10501” 4 • PIX Query Case 1: Assert response message with MSA. 1 = “AA” • PIX Query Case 1: Assert response message with PID. 3. 1 = “XYZ 10501” • PIX Query Case 1: Assert response message with QAK. 2 = “OK” • more… 5 • PIX Query Case 1: Assert response message with MSA. 1 = "AA“ • PIX Query Case 1: Assert response message with PID. 3[1]. 1 = "XYZ 10501" and PID. 3[2]. 2 = "ABC 10501“ • PIX Query Case 1: Assert response message with QAK. 2 = "OK“ • more. . . 6 • PIX Query Case 1: Assert response message with MSA. 1 = "AA“ • PIX Query Case 1: Assert response message with PID. 3[1]. 1 = "XYZ 10501" and PID. 3[2]. 2 = "ABC 10501“ • PIX Query Case 1: Assert response message with QAK. 2 = "OK“ • more. . . 68

Validation Operational Process: Origin of Test Assertions HL 7 v 2 Standard Message Definition IHE TF Message Transaction Constraints Conformance Profile (XML) HL 7 v 2 Standard Value Sets IHE TF Message Transaction Value Set Constraints Table Library (XML) IHE TF Message Transaction Test Assertions Test Case Specific Test Assertions** Validation Context File (XML) Validation Engine Assertions ** Dynamic Data (Future Work) 69

HL 7 V 2 Conformance Profile Example (ADT A 04 Message) - - - 11. 6. 1 - 11. 2. 2 - 11. 2. 3 - 11. 2. 4 - 11. 6. 6 70

" src="https://present5.com/presentation/6f9099acf32ab86c19093a77ab36071c/image-71.jpg" alt="HL 7 V 2 Table Library Example " /> HL 7 V 2 Table Library Example 71

HL 7 v 2 Validation Context Example - - - - XYZ 10501 - - - - XREF 2005 72

HL 7 v 2 Message Validation Report 73

Testing Validation Types • Validation against ‘failure types’: – VERSION*: The version in the message and in the profile should match. – MESSAGE_STRUCTURE_ID*: The message type (MSH. 9 element) in the profile and in the message should match. – MESSAGE_STRUCTURE: The message should have a valid message structure (correct usage, correct cardinality, and correct element name). – USAGE: R elements should be present; X elements should not be present in the message. – CARDINALITY: Elements should be present at least the minimum times and at most the maximum times specified in the profile. It should also take into account the usage of the element (X element with a minimum of 4 should not be present in the message). – LENGTH: The value of the element should have a length equal or less than the value specified in the profile. – DATATYPE: For the datatype NM, DTM, SI and TM, the value of the element should match the regular expression defined in the standard. – DATA: The value of the element should match a constant specified in the profile, a value set specified in a table, a value or a regular expression specified in the message validation context. – MESSAGE_VALIDATION_CONTEXT*: This is a user input error when the location specified in the message validation context can't be found in the message. – TABLE_NOT_FOUND*: This is a user input when a table can't be found in the table files (Table. Profile. Document). – AMBIGUOUS_PROFILE*: The profile should not be ambiguous. 74

Conceptual View of HL 7 v 2 PIX Manager Test Vendor PIX Manager Application Test Cases Reports Test Flow Engine MLLP (v 2) NIST PIX Consumer Test Agent HL 7 v 3 Other NIST Test Agents Validation Web Application End-User (Vendor) HL 7 v 2 NIST PIX Source Test Agent Test Executor Real. Time Log Screen Communication PIX/PDQ Test Tool NIST Server 75

Step 1 and 1 a - Profiles - Test Scenarios - Test Cases - Value Sets - Generation and Validation Context Files Last Name First Name PIX 10501 ALPHA ALAN ABC 10501 Test Repository Patient ID XYZ 10501 ADTA 04 Profile (XML) ALPHA ALAN TC 10501 -1 Generation Context (XML) NIST PIX Source Test Agent Value Set (XML) TC 10501 -1 Validation Context (XML) ACK Profile (XML) 1 ADTA 04 – Register patient “ALAN ALPHA” (ID = PIX 10501) in domain “NIST 2010” 1 a ACKA 04 – Send acknowledgement Vendor PIX Manager Application Validation Criteria Check against ADTA 04 Profile Check against Value Set Check against TC 10501 -1 Validation Context Assert an “AA” acknowledge message for registration of patient “ALPHA” in domain “NIST 2010”; Patient ID is “PIX 10501” 76

Step 2 and 2 a - Profiles - Test Scenarios - Test Cases - Value Sets - Generation and Validation Context Files Last Name First Name PIX 10501 ALPHA ALAN ABC 10501 Test Repository Patient ID XYZ 10501 ADTA 04 Profile (XML) ALPHA ALAN TC 10501 -1 Generation Context (XML) 2 NIST PIX Source Test Agent Value Set (XML) TC 10501 -1 Validation Context (XML) ACK Profile (XML) ADTA 04 – Register patient “ALAN ALPHA” (ID = XYZ 10501) in domain “NIST 2010 -2” 2 a ACKA 04 – Send acknowledgement Vendor PIX Manager Application Validation Criteria Check against ADTA 04 Profile Check against Value Set Check against TC 10501 -1 Validation Context Assert an “AA” acknowledgement message for the registration of patient “ALPHA” in domain “NIST 2010 -2”; Patient ID is “XYZ 10501” 77

Step 3 and 3 a - Profiles - Test Scenarios - Test Cases - Value Sets - Generation and Validation Context Files Last Name First Name PIX 10501 ALPHA ALAN ABC 10501 Test Repository Patient ID XYZ 10501 ADTA 04 Profile (XML) ALPHA ALAN TC 10501 -1 Generation Context (XML) 3 NIST PIX Source Test Agent Value Set (XML) TC 10501 -1 Validation Context (XML) ACK Profile (XML) ADTA 04 – Register patient “ALAN ALPHA” (ID = ABC 10501) in domain “NIST 2010 -3” 3 a ACKA 04 – Send acknowledgement Vendor PIX Manager Application Validation Criteria Check against ADTA 04 Profile Check against Value Set Check against TC 10501 -1 Validation Context Assert an “AA” acknowledgement message for registration of patient “ALPHA” in domain “NIST 2010 -3”; Patient ID is “ABC 10501” 78

Step 4 and 4 a - Profiles - Test Scenarios - Test Cases - Value Sets - Generation and Validation Context Files Last Name First Name PIX 10501 ALPHA ALAN ABC 10501 Test Repository Patient ID XYZ 10501 QBPQ 23 Profile (XML) ALPHA ALAN TC 10501 Generation Context (XML) NIST PIX Consumer Test Agent Value Set (XML) TC 10501 Validation Context (XML) RSPK 23 Profile (XML) 4 QBPQ 23 – Send query message for patient “ALAN ALPHA” in domain “NIST 2010 -2” using the patient ID in domain “NIST 2010” 4 a RSPK 23– Send response indicating that the identifier (“XYZ 10501”) for patient “ALPHA” was found in domain “NIST 2010 -2” Vendor PIX Manager Application Validation Criteria PIX Query Case 1: Assert response message with MSA. 1 = “AA” PIX Query Case 1: Assert response message with PID. 3. 1 = “XYZ 10501” PIX Query Case 1: Assert response message with QAK. 2 = “OK” And more… 79

Step 5 and 5 a - Profiles - Test Scenarios - Test Cases - Value Sets - Generation and Validation Context Files Last Name First Name PIX 10501 ALPHA ALAN ABC 10501 Test Repository Patient ID XYZ 10501 QBPQ 23 Profile (XML) ALPHA ALAN TC 10501 Generation Context (XML) NIST PIX Consumer Test Agent Value Set (XML) TC 10501 Validation Context (XML) RSPK 23 Profile (XML) 5 QBPQ 23 – Send query message for patient “ALAN ALPHA” in domain “NIST 2010 -2” and “NIST 2010 -3” using the patient ID in domain “NIST 2010” 5 a RSPK 23 – Send response that the identifiers “XYZ 10501” and “ABC 10501” for patient “ALPHA” were found in domains “NIST 20102” and “NIST 2010 -3” Vendor PIX Manager Application Validation Criteria PIX Query Case 1: Assert response message with MSA. 1 = "AA“ PIX Query Case 1: Assert response message with PID. 3[1]. 1 = "XYZ 10501" and PID. 3[2]. 2 = "ABC 10501“ PIX Query Case 1: Assert response message with QAK. 2 = "OK“ And more. . . 80

Step 6 and 6 a - Profiles - Test Scenarios - Test Cases - Value Sets - Generation and Validation Context Files Last Name First Name PIX 10501 ALPHA ALAN ABC 10501 Test Repository Patient ID XYZ 10501 QBPQ 23 Profile (XML) ALPHA ALAN TC 10501 Generation Context (XML) NIST PIX Consumer Test Agent Value Set (XML) TC 10501 Validation Context (XML) RSPK 23 Profile (XML) 6 QBPQ 23 – Send query message for patient “ALAN ALPHA” in all domains using the patient ID in domain “NIST 2010” 6 a RSPK 23 – Send response that the identifiers “XYZ 10501” and “ABC 10501” for patient “ALPHA” were found in domains “NIST 20102” and “NIST 2010 -3” Vendor PIX Manager Application Validation Criteria PIX Query Case 1: Assert response message with MSA. 1 = "AA“ PIX Query Case 1: Assert response message with PID. 3[1]. 1 = "XYZ 10501" and PID. 3[2]. 2 = "ABC 10501“ PIX Query Case 1: Assert response message with QAK. 2 = "OK“ And more. . . 81

Validation HL 7 v 3 Messages and IHE Actor Functional Behavior

HL 7 v 3 Validation Overview • HL 7 v 3 Syntax Validation – Ensure the message structure is valid with respect to the HL 7 V 3 conformance schemas. The schemas used for testing are the IHE schemas and can be downloaded at: ftp: //ftp. ihe. net/TF_Implementation_Material/ITI/packages/PIXV 3. Support. Materials. v 3. zip ftp: //ftp. ihe. net/TF_Implementation_Material/ITI/packages/PDQV 3. Support. Materials. v 2. zip – Ensure that the conformance requirements are valid with respect to the standard and the IHE technical framework for a given transaction. These additional requirements are tested using the NIST created schematron rules available at • Value Set Semantic Validation – Value set semantic testing is also handled with the schemas and schematron validation described above. • Test Case Specific Validation – Verify element content against a validation context file that captures test values as defined in the Pre-Connectathon test cases. – The methodology is the same as v 2. • Transport Layer (SOAP) – Not part of PIX/PDQ Tool; use XDS toolkit to validate this aspect 83

Summary

Support Before sending questions please read all documentation. Our resources are limited. We will focus on questions related to our testing tool and bugs. We can’t spend time debugging your code. Report Bugs, Issues, and Suggestions for Improvement to: http: //code. google. com/p/pixpdqtool/issues/list IHE PIX/PDQ Google Group (To discuss PIX/PDQ and testing issues): http: //groups. google. com/group/ihe_pix_pdq_testing V 3 SOAP Message Validation. This is an external tool and we do not provide support for this tool. The link is provided to help you debug your V 3 message wrapper. For administrative questions and comments only contact Rob Snelick: rsnelick@nist. gov 85