Industrial automation systems and integration - Product data representation and exchange Conformance testing methodology and framework: General concepts
Standards Australia
<toc>
<bookmarktable>
<bookmark index='0'>
<pageno>1</pageno>
<text>AS 10303.31-1998 INDUSTRIAL AUTOMATION SYSTEMS AND INTEGRATION - PRODUCT DATA REPRESENTATION AND EXCHANGE - CONFORMANCE TESTING</text>
<bookmark index='1'>
<pageno>4</pageno>
<text>PREFACE</text>
</bookmark>
<bookmark index='2'>
<pageno>6</pageno>
<text>CONTENTS</text>
</bookmark>
<bookmark index='3'>
<pageno>9</pageno>
<text>1 Scope</text>
<bookmark index='4'>
<pageno>9</pageno>
<text>1.1 Applicability of this series of parts</text>
</bookmark>
<bookmark index='5'>
<pageno>9</pageno>
<text>1.2 Applicability of this part of ISO 10303</text>
</bookmark>
<bookmark index='6'>
<pageno>9</pageno>
<text>1.3 Coverage of this series of parts</text>
</bookmark>
<bookmark index='7'>
<pageno>11</pageno>
<text>1.4 Coverage of this part of ISO 10303</text>
</bookmark>
</bookmark>
<bookmark index='8'>
<pageno>11</pageno>
<text>2 Normative references</text>
</bookmark>
<bookmark index='9'>
<pageno>12</pageno>
<text>3 Definitions</text>
<bookmark index='10'>
<pageno>12</pageno>
<text>3.1 Terms defined in ISO 10303-1</text>
</bookmark>
<bookmark index='11'>
<pageno>12</pageno>
<text>3.2 Other definitions</text>
<bookmark index='12'>
<pageno>12</pageno>
<text>3.2.1 abstract test case (ATC):</text>
</bookmark>
<bookmark index='13'>
<pageno>12</pageno>
<text>3.2.2 abstract test group:</text>
</bookmark>
<bookmark index='14'>
<pageno>12</pageno>
<text>3.2.4 (laboratory) accreditation:</text>
</bookmark>
<bookmark index='15'>
<pageno>13</pageno>
<text>3.2.5 accreditation body:</text>
</bookmark>
<bookmark index='16'>
<pageno>13</pageno>
<text>3.2.6 assessor:</text>
</bookmark>
<bookmark index='17'>
<pageno>13</pageno>
<text>3.2.7 attestation of conformity:</text>
</bookmark>
<bookmark index='18'>
<pageno>13</pageno>
<text>3.2.8 basic tests:</text>
</bookmark>
<bookmark index='19'>
<pageno>13</pageno>
<text>3.2.9 capabilities of an IUT:</text>
</bookmark>
<bookmark index='20'>
<pageno>13</pageno>
<text>3.2.10 capability tests:</text>
</bookmark>
<bookmark index='21'>
<pageno>13</pageno>
<text>3.2.11 certificate of conformance:</text>
</bookmark>
<bookmark index='22'>
<pageno>13</pageno>
<text>3.2.12 certificate of conformity; certificate of conformance:</text>
</bookmark>
<bookmark index='23'>
<pageno>13</pageno>
<text>3.2.13 certification body:</text>
</bookmark>
<bookmark index='24'>
<pageno>13</pageno>
<text>3.2.14 certification mark:</text>
</bookmark>
<bookmark index='25'>
<pageno>13</pageno>
<text>3.2.15 certification of conformity:</text>
</bookmark>
<bookmark index='26'>
<pageno>14</pageno>
<text>3.2.16 certification system:</text>
</bookmark>
<bookmark index='27'>
<pageno>14</pageno>
<text>3.2.17 client (of a testing laboratory):</text>
</bookmark>
<bookmark index='28'>
<pageno>14</pageno>
<text>3.2.18 comparability (of results):</text>
</bookmark>
<bookmark index='29'>
<pageno>14</pageno>
<text>3.2.19 conformance:</text>
</bookmark>
<bookmark index='30'>
<pageno>14</pageno>
<text>3.2.20 conformance assessment process:</text>
</bookmark>
<bookmark index='31'>
<pageno>14</pageno>
<text>3.2.21 conformance log:</text>
</bookmark>
<bookmark index='32'>
<pageno>14</pageno>
<text>3.2.22 conformance testing:</text>
</bookmark>
<bookmark index='33'>
<pageno>14</pageno>
<text>3.2.23 (conformance) test report:</text>
</bookmark>
<bookmark index='34'>
<pageno>14</pageno>
<text>3.2.24 conforming implementation:</text>
</bookmark>
<bookmark index='35'>
<pageno>14</pageno>
<text>3.2.25 conformity; conformance:</text>
</bookmark>
<bookmark index='36'>
<pageno>14</pageno>
<text>3.2.26 control board:</text>
</bookmark>
<bookmark index='37'>
<pageno>14</pageno>
<text>3.2.27 declaration of conformance:</text>
</bookmark>
<bookmark index='38'>
<pageno>14</pageno>
<text>3.2.28 declaration of conformity; (manufacturer’s) declaration of conformance:</text>
</bookmark>
<bookmark index='39'>
<pageno>15</pageno>
<text>3.2.29 executable test case:</text>
</bookmark>
<bookmark index='40'>
<pageno>15</pageno>
<text>3.2.30 executable test suite:</text>
</bookmark>
<bookmark index='41'>
<pageno>15</pageno>
<text>3.2.31 fail (verdict):</text>
</bookmark>
<bookmark index='42'>
<pageno>15</pageno>
<text>3.2.32 falsification testing:</text>
</bookmark>
<bookmark index='43'>
<pageno>15</pageno>
<text>3.2.33 Implementation Under Test (IUT):</text>
</bookmark>
<bookmark index='44'>
<pageno>15</pageno>
<text>3.2.34 inconclusive (verdict):</text>
</bookmark>
<bookmark index='45'>
<pageno>15</pageno>
<text>3.2.35 in-house testing:</text>
</bookmark>
<bookmark index='46'>
<pageno>15</pageno>
<text>3.2.36 manufacturer’s declaration of conformance:</text>
</bookmark>
<bookmark index='47'>
<pageno>15</pageno>
<text>3.2.37 non-conformance:</text>
</bookmark>
<bookmark index='48'>
<pageno>15</pageno>
<text>3.2.38 non-conformity; non-conformance:</text>
</bookmark>
<bookmark index='49'>
<pageno>15</pageno>
<text>3.2.39 pass (verdict):</text>
</bookmark>
<bookmark index='50'>
<pageno>16</pageno>
<text>3.2.40 PIXIT proforma:</text>
</bookmark>
<bookmark index='51'>
<pageno>16</pageno>
<text>3.2.41 postprocessor:</text>
</bookmark>
<bookmark index='52'>
<pageno>16</pageno>
<text>3.2.42 preprocessor:</text>
</bookmark>
<bookmark index='53'>
<pageno>16</pageno>
<text>3.2.43 proficiency testing:</text>
</bookmark>
<bookmark index='54'>
<pageno>16</pageno>
<text>3.2.44 Protocol Implementation eXtra Information for Testing (PIXIT):</text>
</bookmark>
<bookmark index='55'>
<pageno>16</pageno>
<text>3.2.45 repeatability (of results):</text>
</bookmark>
<bookmark index='56'>
<pageno>16</pageno>
<text>3.2.46 resolution tests:</text>
</bookmark>
<bookmark index='57'>
<pageno>16</pageno>
<text>3.2.47 selected abstract test suite:</text>
</bookmark>
<bookmark index='58'>
<pageno>16</pageno>
<text>3.2.48 selected executable test suite:</text>
</bookmark>
<bookmark index='59'>
<pageno>16</pageno>
<text>3.2.49 System Under Test (SUT):</text>
</bookmark>
<bookmark index='60'>
<pageno>16</pageno>
<text>3.2.50 test campaign:</text>
</bookmark>
<bookmark index='61'>
<pageno>16</pageno>
<text>3.2.51 test case:</text>
</bookmark>
<bookmark index='62'>
<pageno>16</pageno>
<text>3.2.52 test case error:</text>
</bookmark>
<bookmark index='63'>
<pageno>17</pageno>
<text>3.2.53 test purpose:</text>
</bookmark>
<bookmark index='64'>
<pageno>17</pageno>
<text>3.2.54 test realiser:</text>
</bookmark>
<bookmark index='65'>
<pageno>17</pageno>
<text>3.2.55 test report:</text>
</bookmark>
<bookmark index='66'>
<pageno>17</pageno>
<text>3.2.56 test verdict:</text>
</bookmark>
<bookmark index='67'>
<pageno>17</pageno>
<text>3.2.57 testing laboratory:</text>
</bookmark>
<bookmark index='68'>
<pageno>17</pageno>
<text>3.2.58 (test) verdict:</text>
</bookmark>
<bookmark index='69'>
<pageno>17</pageno>
<text>3.2.59 verdict criteria:</text>
</bookmark>
<bookmark index='70'>
<pageno>17</pageno>
<text>3.2.60 verification testing:</text>
</bookmark>
</bookmark>
</bookmark>
<bookmark index='71'>
<pageno>17</pageno>
<text>4 Abbreviations</text>
</bookmark>
<bookmark index='72'>
<pageno>18</pageno>
<text>5 Conformance</text>
<bookmark index='73'>
<pageno>18</pageno>
<text>5.1 The meaning of conformance in ISO 10303</text>
</bookmark>
<bookmark index='74'>
<pageno>18</pageno>
<text>5.2 Conformance requirements</text>
</bookmark>
<bookmark index='75'>
<pageno>18</pageno>
<text>5.3 Protocol Implementation Conformance Statement</text>
</bookmark>
<bookmark index='76'>
<pageno>19</pageno>
<text>5.4 A conforming system</text>
</bookmark>
</bookmark>
<bookmark index='77'>
<pageno>19</pageno>
<text>6 Conformance testing</text>
<bookmark index='78'>
<pageno>19</pageno>
<text>6.1 Introduction</text>
</bookmark>
<bookmark index='79'>
<pageno>19</pageno>
<text>6.2 Types of conformance tests</text>
<bookmark index='80'>
<pageno>20</pageno>
<text>6.2.1 Basic tests</text>
</bookmark>
<bookmark index='81'>
<pageno>20</pageno>
<text>6.2.2 Capability tests</text>
</bookmark>
</bookmark>
<bookmark index='82'>
<pageno>21</pageno>
<text>6.3 Protocol Implementation eXtra Information for Testing</text>
</bookmark>
<bookmark index='83'>
<pageno>21</pageno>
<text>6.4 Conformance assessment process overview</text>
</bookmark>
<bookmark index='84'>
<pageno>22</pageno>
<text>6.5 Preparation for testing</text>
</bookmark>
<bookmark index='85'>
<pageno>24</pageno>
<text>6.6 Test campaign</text>
</bookmark>
<bookmark index='86'>
<pageno>24</pageno>
<text>6.7 Analysis of results</text>
</bookmark>
<bookmark index='87'>
<pageno>24</pageno>
<text>6.8 Conformance test report production</text>
</bookmark>
<bookmark index='88'>
<pageno>25</pageno>
<text>6.9 Intrinsic properties of the conformance assessment process</text>
<bookmark index='89'>
<pageno>25</pageno>
<text>6.9.1 Repeatability of results</text>
</bookmark>
<bookmark index='90'>
<pageno>25</pageno>
<text>6.9.2 Comparability of results</text>
</bookmark>
<bookmark index='91'>
<pageno>25</pageno>
<text>6.9.3 Auditability of results</text>
</bookmark>
</bookmark>
</bookmark>
<bookmark index='92'>
<pageno>26</pageno>
<text>7 Abstract test methods</text>
</bookmark>
<bookmark index='93'>
<pageno>26</pageno>
<text>8 Abstract and executable test suites</text>
<bookmark index='94'>
<pageno>26</pageno>
<text>8.1 Structure</text>
</bookmark>
<bookmark index='95'>
<pageno>26</pageno>
<text>8.2 Test purposes</text>
</bookmark>
<bookmark index='96'>
<pageno>26</pageno>
<text>8.3 Abstract test cases</text>
</bookmark>
<bookmark index='97'>
<pageno>28</pageno>
<text>8.4 Executable test cases</text>
</bookmark>
<bookmark index='98'>
<pageno>28</pageno>
<text>8.5 Relationship between abstract and executable test cases</text>
</bookmark>
</bookmark>
<bookmark index='99'>
<pageno>29</pageno>
<text>Annex A - Information object registration</text>
</bookmark>
<bookmark index='100'>
<pageno>30</pageno>
<text>Annex B - Optional conformance requirements</text>
</bookmark>
<bookmark index='101'>
<pageno>31</pageno>
<text>Annex C - Resolution tests</text>
</bookmark>
<bookmark index='102'>
<pageno>32</pageno>
<text>Annex D - Supporting organisations</text>
<bookmark index='103'>
<pageno>32</pageno>
<text>D.1 Introduction</text>
</bookmark>
<bookmark index='104'>
<pageno>33</pageno>
<text>D.2 Responsible authorities</text>
</bookmark>
<bookmark index='105'>
<pageno>38</pageno>
<text>D.3 Administration and certification</text>
</bookmark>
<bookmark index='106'>
<pageno>42</pageno>
<text>D.4 The process of certification</text>
</bookmark>
</bookmark>
<bookmark index='107'>
<pageno>46</pageno>
<text>Annex E - Bibliography</text>
</bookmark>
<bookmark index='108'>
<pageno>47</pageno>
<text>Index</text>
</bookmark>
</bookmark>
</bookmarktable>
</toc>
Specifies general methodology and framework for testing the conformance of an implementation of AS 10303. It is identical with and has been reproduced from ISO 10303-31:1994.
Technical Committee IT-006 has reviewed the content of this publication and in accordance
with Standards Australia procedures for reconfirmation, it has been determined that the
publication is still valid and does not require change.
Certain documents referenced in the publication may have been amended since the original
date of publication. Users are advised to ensure that they are using the latest versions of
such documents as appropriate, unless advised otherwise in this Reconfirmation Notice.
Approved for reconfirmation in accordance with Standards Australia procedures for
reconfirmation on 20 August 2013.
The following are represented on Technical Committee IT-006:
Australia Safety Critical Systems Association
Australian Computer Society
Australian Industry Group
Australian Petroleum Production and Exploration Association
Consult Australia
Engineers Australia
Institute of Chemical Engineers Australia
Institute of Instrumentation, Control & Automation Australia
Process Control Society
The University of Queensland
Workplace Health and Safety Queensland
This part of ISO 10303, which introduces the series of parts devoted to conformance testing, specifies a general methodology and framework for testing the conformance of an implementation of ISO 10303. During conformance testing, such an implementation is termed an IUT (implementation under test).
NOTE - Figure 1 is a pictorial representation of the relation between the various standards and some of the concepts of conformance testing. The roles of other parts of ISO 10303 are documented in ISO 10303-1.
| Document Type | Standard |
| Status | Current |
| Publisher | Standards Australia |
| ProductNote | Reconfirmation Notice 09/09/2013 |
| Committee | IT-006 |
| Supersedes |
|
