eDelivery Conformance Testing Service 2023.06-p2

This page collects the resources for eDelivery Conformance Testing Service version 2023.06-p2, released in February 2025.

Description

We are happy to announce the release of eDelivery Conformance Testing Service version 2023.06-p2. It includes a number of new features, improvements and bug fixes:

• ENTSOG Test Suite label and ID changes.

• Test Suite labels now include the Version.

• Replacing Test Case Label Prefixes

• Merging the Default and ENTSOG Systems

• Specification groups and Specifications hierarchy restructuring.

• Specification groups and Specifications new labels and descriptions.

• Conformance Overview Certificate templates for Specification Groups and Specifications

• Upgraded the Interoperability Test Bed platform from version 1.24.4. to 1.25.1

Test Cases

Solutions that were conformant according to the previous version of the conformance testing platform (2023.06) can easily become conformant according to this newer version. To do so, they must:

• check the releases notes of eDelivery Conformance Testing Service version 2023.06-p1
• pass all new tests that are not marked as "optional"
• pass all updated tests that are marked as "to be repeated"

New tests marked as "optional" and updated tests marked as "no need to repeat" do not have to be passed (again).

(eDel AS4 1.15) Basic Connectivity Tests v1.1.1

Updated Tests - No need to repeat

• • (eDel AS4 1.15) Basic One Way Retry C2

(eDel AS4 1.15) AS4 Common Profile Tests v1.1.1

New Tests

• • (eDel AS4 1.15) CP_TA47_C3 (Optional)
  • (eDel AS4 1.15) CP_TA48_C2 (Optional)
  • (eDel AS4 1.15) CP_TA49_C3 (Optional)
  • (eDel AS4 1.15) CP_TA50_C3 (Optional)
  • (eDel AS4 1.15) CP_TA51_C3 (Optional)

Updated Tests - To be repeated

• • (eDel AS4 1.15) CP_TA08_C3

  • (eDel AS4 1.15) CP_TA26_C3

  • (eDel AS4 1.15) CP_TA29_C3

  • (eDel AS4 1.15) CP_TA30_C3

  • (eDel AS4 1.15) CP_TA31_C3

  • (eDel AS4 1.15) CP_TA37_C3

Updated Tests - No need to repeat

• • (eDel AS4 1.15) CP_TA09_C2
  • (eDel AS4 1.15) CP_TA10_C2
  • (eDel AS4 1.15) CP_TA15_C2

(ENTSOG AS4 3.5) ENTSOG Tests - v1.0.1

New Tests

• • (ENTSOG AS4 3.5) ENTSOG_TA01_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA01_WITH_MPC_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA01_WITHOUT_MPC_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA02_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA02_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA03_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA03_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA04_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA04_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA05_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA05_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA06_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA06_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA07_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA07_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA08_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA08_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA09_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA09_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA10_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA10_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA11_C2

  • (ENTSOG AS4 3.5) ENTSOG_TA11_C3

  • (ENTSOG AS4 3.5) ENTSOG_TA12_C3

Impact on SUT Controller

A SUT Controller that was used with the previous version of the Conformance Testing Service (2023.06) must be updated in order to be used with this new version.

Interoperability Test Bed Platform version v1.25.1

We are happy to announce that we upgraded the Service platform from v1.24.4 to v1.25.1. Please find below the summary of the most important changes:

• Support test case groups in which only one of the included test cases needs to pass for a successful conformance result
• Improve the responsive behaviour of the conformance statement detail page
• When a test suite fails validation due to an invalid expression include the cause in the reported message

Detailed release notes for intervening ITB releases:

• Release Notes for the Interoperability Test Bed v1.25.0
• Release Notes for the Interoperability Test Bed v1.25.1

Technical Documentation

Release notes

Please find below the list of new features, improvements, and Fixed bugs.

New Features:

• New setup for the Specification Groups and Specifications and support for Conformance Statement Certificate/Conformance Overview Certificate templates. Adding Test Version as suffix to the Test Suite Description.

  • Change in the Code parsing the test Suite's property files led to an increase of minor version.

Improvements:

• Support for ENTSOG running in the same System as the other test suites.

Fixed Bugs:

• Change ID/Labels in ENTSOG and Prefixes in other Test Suites; Test Suites should mention it's version in the suffix of it's Test Suite Name.

  • ENTSOG Test Suites/Cases Names and IDs should reflect that it's a separate profile. 

  • AS4 Test Suites/Cases have new prefix: (AS4 1.15) changed to (eDel AS4 1.15)

  • ENTSOG Test Cases have new prefix:  (3.5 ENTSOG-AS4) changed to (ENTSOG AS4 3.5)

  • Test Suites now mention it's version in the Test Suite Name.

Known bugs and limitations

• Testbed logs in Retry test cases need to be corrected.

• In test case reports of test cases using Test Action Behaviours, a better description for the Test Behaviours should be found. 

• Some log messages showing mismatching messageId between MDC and the log message itself. 

• ENTSOG Test Suite not supported for SUT Controller 5.1.7-1.0 code. 

• TA05 currently only supports Service A05; TA10 C3 Should be removed; TA11 should have coverage enhanced.

For more information, please contact us via our portal or by e-mail: EC-EDELIVERY-SUPPORT@ec.europa.eu