|
Introduction
ILL Interoperability
Interoperability Test
Reporting
Interoperability Test
Role of the Testing Other Testing
ILL Protocol Interoperability
For More Information, contact the ILL Application Standards Maintenance Agency, Library and Archives Canada Last Update: 2002/01/15
|
Interlibrary Loan Application Standards Maintenance Agency
ILL PROTOCOL IMPLEMENTATION INTEROPERABILITY TESTINGPrepared by the National Library of Canada for the ILL Protocol Implementation Programme Interoperability Testing, July 1992 INTRODUCTIONThe objective of Interoperability Testing is to verify that implementations of the ISO Interlibrary Loan (ILL) Protocol Standard (ISO 10160/10161) can interoperate, that is, communicate and provide the services stipulated by the Standard. This document describes a methodology to be used for ILL Interoperability Testing and the participating partners. Interoperability testing is limited to normal operation and verifies that each implementation can invoke the services that it supports. Test cases focusing on the use of optional APDUs have also been defined. The procedure described here was developed by the National Library of Canada (NLC) for the testing of Canadian ILL protocol implementations in 1992. During this testing, NLC played a coordinating and technical supporting role. The Canadian interoperability test suite was designed with the assumption that each implementation had undergone conformance testing and that the implementation conformed to the ISO ILL Standard and the ILL Interim Canadian Standardized Profile. It could be adapted for use by IPIG implementors. ILL INTEROPERABILITY TEST STEPSThe process for ILL interoperability testing consists of the following steps: Test SetupTest CampaignTo minimize the need for coordination of the partners during the test campaign, the details for test case execution should be provided within the test plan. Results AnalysisTesting Coordinator:The objective of the report is to provide statistics on the interoperability testing and list problems which occurred. COMPOSITION OF TEST PARTIESA test party consists of a number of implementors that have successfully completed conformance testing. The composition of test parties is based on two objectives: To meet the above objectives, a test party should be composed of at least three participants. Thus each implementation will have a sufficient number of partners for testing the FORWARD service. For testing other services, each implementation plays the role of the requester for one partner, and the role of the responder for the other. This ensures that the implementations are tested with at least two others.
The tables above illustrate the roles the participants will play with each other. A test plan will be defined for each participant. The above tables can be used in determining the partners during test case selection. It may be necessary to modify the partner if a service is not supported by the partner. TEST CASE SELECTIONThe Implementation Under Test (IUT) and its testing partners should select test cases based on the ILL services that their ILL protocol implementations support. They can use the test plan proforma, ILL INTEROPERABILITY TEST PLAN, which provides the required tables for making this selection. A test plan for each participant is completed for each participant. It should: The Test Plan, when completed, should identify all test cases to be run by the implementation and the partner associated with each test case. The content of each test is specified in the Interlibrary Loan (ILL) Interoperability Test Suite. Each table in the test plan contains the following information: Common Services:identifies the ILL services required by all test cases in a specific test group.SERVICES SUPPORTEDidentifies the services required by the test cases listed in the IUT CASE and PARTNER CASE columns.IUT CASE:indicates the test case which the implementation operator executes.PARTNER CASE:indicates the test case which the corresponding partner executes.PARTNER SYMBOL:institution symbol used by the testing partner during the exchange of test cases. Identifies the testing partner.DATE COMPLETED:information supplied by the IUT operator to indicate the date that the case is completed. Use the annotation "NOT RUN" if either the IUT or its partner does not support a service required by the test case.See the sample ILL INTEROPERABILITY TEST PLAN TABLE 4. This table lists the requester test cases which test the ILL services required in transactions of returnable items.
INTEROPERABILITY TEST CAMPAIGNBefore testing begins, participants must contact their partners. The contact person, telephone number, library symbol, etc. can be found in the test plan. During the test campaign, an IUT operator will initiate the transactions for the cases where it plays the role of the requester. The cases to be executed are identified in the test plan and specified in the ILL Interoperability Test Suite. A case specification identifies all events which occur in a test case (see the example below). Consult the document "ILL Interoperability Test Suite" for a description of the notation used in specifying test cases.
Thirty-four test cases have been defined for each role. Thus and implementation will run a maximum of 68 test cases during a test campaign. Before executing a test case, the operator should consult the Purpose section of the Dynamic Behaviour Table. It provides specific instructions for executing the case. In the example of Test Case Dynamic Behaviour, CASE154, the requester is encouraged to provide data for all parameters in the RENreq service and the responder, data for all parameters in the REAreq service.In addition to these specific instructions, the IUT operator should perform the following: For example, the responder invokes the SHIreq (no SHI APDU is sent) followed by the STRreq. The requester would only receive the STR APDU and get an STRind. Testing partners should discuss how test cases are to be executed. For better efficiency, concurrently execute the test cases belonging to the same test group. If using store and forward communications, the length of time it takes to execute the cases one at a time is not practical. The groups should be processed in the following order:
This order reflects the increasing complexity of the ILL transactions defined in the test cases. It is also possible to execute all cases at once. As well, concatenate a group of APDUs into one ILL message. For example, when executing the BASIC group, the requester initiates three transaction, one for each of the cases CASE100, CASE101, and CASE102 and combines them into one message. Each testing partner should start initiating the transactions for the requester group as indicated above. This means that implementations will be processing transactions as a responder and a requester simultaneously, reflecting the normal operations of a library. REPORTING INTEROPERABILITY TEST RESULTSUse the Interoperability Test Results form to report test results. Compete a form for each transaction of the test campaign. Attach system logs to the test result form. The logs can consist of printouts of received and transmitted APDUs, screen dumps illustrating the data from a request or indication service, and/or communication logs listing the events and actions occurring within the system during transaction processing. Elements of the Test Results form are: CASE NAME:Case name associated with the transaction.PARTNER SYMBOL:Partner's institution-symbol, to provide a means of identifying the partner in the transaction.TRANSACTION ID:Transaction's identifier, to provide a means of associating the Test Result form to the ILL transaction in the system under test.DATE STARTED:Date the transaction started.DATE COMPLETED:Date the transaction was completed.EVENTS:Test events which occurred for the transaction. For each event specified in the TTCN test case, there will be a corresponding recorded test event.The recorded events will differ with the test case specification when an optional APDU is not transmitted. In this situation, the initiator of the request service invokes the STRreq service and the partner receives only the STR APDU (an STRind) and not the specified indication service. The second situation is illustrated by the recorded events "received STR", "STRind (cHECKED-IN)". Here, the IUT received an STR APDU indicating that the partner invoked the CHKreq service without sending the optional APDU CHK. The IUT operator in this case records that the STR was received and got an STRind. The (cHECKED-IN) is the most-recent-service parameter value from Status-or-Error-Report indication. In this example, the test case specification events "L?CHK" and "<IUT?CHKind>" are replaced by the recorded events "received STR" and "STRind (cHECKED-IN)". PROBLEMS:Description of problems encountered during the course of transaction.RESOLUTION:Actions taken to resolve the problems recorded in the "PROBLEMS" section.INTEROPERABILITY TEST RESULTSCASE: __CASE154_______ PARTNER SYMBOL: __SYMB2______ EVENTS: PROBLEMS: __No problems encountered._____________________ RESOLUTION: _____________________________________________ INTEROPERABILITY TEST RESULTS ANALYSISThe test results provided by the implementations will be analyzed for completion of test cases and reviewed for any problems and resolutions. A summary test report, "System Interoperability Test Report", will be prepared for each participant. This report will provide statistics on tests run during interoperability testing and comments on problems that occurred during testing. ROLE OF THE TESTING COORDINATORTasks of the ILL Implementation Interoperability Testing Coordinator include:Test Setup:Test Campaign:Provision of technical support in resolving problems which may occur during the test campaign.Results Analysis: |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Interlibrary Loan Application Standards Maintenance Agency |
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||