Commit 309176d8 authored by Giacomo Bernini's avatar Giacomo Bernini
Browse files

Merge branch '4.3.1-dev-SOL002-VNFPerformanceManagement' into '4.3.1-dev' 

SOL002 VNF Performance Management - Implementation of deltas between v4.3.1 and v3.6.1

See merge request nfv/api-tests!262
parents 6630213a 948e27d8

SOL002/VNFPerformanceManagement-API/ApiVersion.robot

+10 −10
Original line number Original line Diff line number Diff line
@@ -11,7 +11,7 @@ POST API Version - Method not implemented 
    ...    Test title: POST API version - Method not implemented

    ...    Test title: POST API version - Method not implemented

    ...    Test objective: The objective is to test that POST method is not implemented

    ...    Test objective: The objective is to test that POST method is not implemented

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 9.3.3.3.1 - ETSI GS NFV-SOL 013 [5] v3.5.1

    ...    Reference: Clause 9.3.3.3.1 - ETSI GS NFV-SOL 013 [5] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none    

    ...    Post-Conditions: none
@@ -23,7 +23,7 @@ GET API Version 
    ...    Test title: GET API Version

    ...    Test title: GET API Version

    ...    Test objective: The objective is to test that GET method successfully return ApiVersionInformation

    ...    Test objective: The objective is to test that GET method successfully return ApiVersionInformation

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 9.3.3.3.2 - ETSI GS NFV-SOL 013 [5] v3.5.1

    ...    Reference: Clause 9.3.3.3.2 - ETSI GS NFV-SOL 013 [5] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none 

    ...    Post-Conditions: none
@@ -36,7 +36,7 @@ PUT API Version - Method not implemented 
    ...    Test title: PUT API Version - Method not implemented

    ...    Test title: PUT API Version - Method not implemented

    ...    Test objective: The objective is to test that PUT method is not implemented

    ...    Test objective: The objective is to test that PUT method is not implemented

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 9.3.3.3.3 - ETSI GS NFV-SOL 013 [5] v3.5.1

    ...    Reference: Clause 9.3.3.3.3 - ETSI GS NFV-SOL 013 [5] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none 

    ...    Post-Conditions: none
@@ -48,7 +48,7 @@ PATCH API Version - Method not implemented 
    ...    Test title: PATCH API Version - Method not implemented

    ...    Test title: PATCH API Version - Method not implemented

    ...    Test objective: The objective is to test that PATCH method is not implemented

    ...    Test objective: The objective is to test that PATCH method is not implemented

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 9.3.3.3.4 - ETSI GS NFV-SOL 013 [5] v3.5.1

    ...    Reference: Clause 9.3.3.3.4 - ETSI GS NFV-SOL 013 [5] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none 

    ...    Post-Conditions: none
@@ -60,7 +60,7 @@ DELETE API Version - Method not implemented 
    ...    Test title: DELETE API Version - Method not implemented

    ...    Test title: DELETE API Version - Method not implemented

    ...    Test objective: The objective is to test that DELETE method is not implemented

    ...    Test objective: The objective is to test that DELETE method is not implemented

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 9.3.3.3.5 - ETSI GS NFV-SOL 013 [5] v3.5.1

    ...    Reference: Clause 9.3.3.3.5 - ETSI GS NFV-SOL 013 [5] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none 

    ...    Post-Conditions: none
@@ -72,7 +72,7 @@ POST API Version with apiMajorVerion - Method not implemented 
    ...    Test title: POST API version with apiMajorVerion - Method not implemented

    ...    Test title: POST API version with apiMajorVerion - Method not implemented

    ...    Test objective: The objective is to test that POST method is not implemented

    ...    Test objective: The objective is to test that POST method is not implemented

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 9.3.3.3.1 - ETSI GS NFV-SOL 013 [5] v3.5.1

    ...    Reference: Clause 9.3.3.3.1 - ETSI GS NFV-SOL 013 [5] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none    

    ...    Post-Conditions: none
@@ -84,7 +84,7 @@ GET API Version with apiMajorVerion 
    ...    Test title: GET API Version with apiMajorVerion

    ...    Test title: GET API Version with apiMajorVerion

    ...    Test objective: The objective is to test that GET method successfully return ApiVersionInformation

    ...    Test objective: The objective is to test that GET method successfully return ApiVersionInformation

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 9.3.3.3.2 - ETSI GS NFV-SOL 013 [5] v3.5.1

    ...    Reference: Clause 9.3.3.3.2 - ETSI GS NFV-SOL 013 [5] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none 

    ...    Post-Conditions: none
@@ -97,7 +97,7 @@ PUT API Version with apiMajorVerion - Method not implemented 
    ...    Test title: PUT API Version with apiMajorVerion - Method not implemented

    ...    Test title: PUT API Version with apiMajorVerion - Method not implemented

    ...    Test objective: The objective is to test that PUT method is not implemented

    ...    Test objective: The objective is to test that PUT method is not implemented

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 9.3.3.3.3 - ETSI GS NFV-SOL 013 [5] v3.5.1

    ...    Reference: Clause 9.3.3.3.3 - ETSI GS NFV-SOL 013 [5] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none 

    ...    Post-Conditions: none
@@ -109,7 +109,7 @@ PATCH API Version with apiMajorVerion - Method not implemented 
    ...    Test title: PATCH API Version with apiMajorVerion - Method not implemented

    ...    Test title: PATCH API Version with apiMajorVerion - Method not implemented

    ...    Test objective: The objective is to test that PATCH method is not implemented

    ...    Test objective: The objective is to test that PATCH method is not implemented

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 9.3.3.3.4 - ETSI GS NFV-SOL 013 [5] v3.5.1

    ...    Reference: Clause 9.3.3.3.4 - ETSI GS NFV-SOL 013 [5] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none 

    ...    Post-Conditions: none
@@ -121,7 +121,7 @@ DELETE API Version with apiMajorVerion - Method not implemented 
    ...    Test title: DELETE API Version with apiMajorVerion - Method not implemented

    ...    Test title: DELETE API Version with apiMajorVerion - Method not implemented

    ...    Test objective: The objective is to test that DELETE method is not implemented

    ...    Test objective: The objective is to test that DELETE method is not implemented

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 9.3.3.3.5 - ETSI GS NFV-SOL 013 [5] v3.5.1

    ...    Reference: Clause 9.3.3.3.5 - ETSI GS NFV-SOL 013 [5] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none 

    ...    Post-Conditions: none

SOL002/VNFPerformanceManagement-API/IndividualPmJob.robot

+18 −9
Original line number Original line Diff line number Diff line
@@ -13,12 +13,13 @@ GET individual VNF Performance Job 
    ...    Test title: Get individual VNF Performance Job

    ...    Test title: Get individual VNF Performance Job

    ...    Test objective: The objective is to test the retrieval of an individual VNF performance monitoring job and perform a JSON schema and content validation of the collected job data structure

    ...    Test objective: The objective is to test the retrieval of an individual VNF performance monitoring job and perform a JSON schema and content validation of the collected job data structure

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Reference: Clause 6.4.3.3.2 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.3.3.2 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none

    GET individual VNF Performance Job

    GET individual VNF Performance Job

    Check HTTP Response Status Code Is    200

    Check HTTP Response Status Code Is    200

    Check HTTP Response Header Contains ETag and Last-Modified

    Check HTTP Response Body Json Schema Is   PmJob

    Check HTTP Response Body Json Schema Is   PmJob

    Check HTTP Response Body Pm Job Identifier matches the requested Pm Job

    Check HTTP Response Body Pm Job Identifier matches the requested Pm Job
@@ -27,7 +28,7 @@ GET individual VNF Performance Job with invalid resource identifier 
    ...    Test title: Get individual VNF Performance Job with invalid resource identifier

    ...    Test title: Get individual VNF Performance Job with invalid resource identifier

    ...    Test objective: The objective is to test that the retrieval of an individual VNF performance monitoring job fails when using an invalid resource identifier, and perform the JSON schema validation of the failed operation HTTP response

    ...    Test objective: The objective is to test that the retrieval of an individual VNF performance monitoring job fails when using an invalid resource identifier, and perform the JSON schema validation of the failed operation HTTP response

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Reference: Clause 6.4.3.3.2 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.3.3.2 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -40,7 +41,7 @@ DELETE Individual VNF Performance Job 
    ...    Test title: Delete Individual VNF Performance Job

    ...    Test title: Delete Individual VNF Performance Job

    ...    Test objective: The objective is to test the deletion of an individual VNF performance monitoring job

    ...    Test objective: The objective is to test the deletion of an individual VNF performance monitoring job

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Reference: Clause 6.4.3.3.5 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.3.3.5 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: The VNF Performance Job is no more available in the VNFM    

    ...    Post-Conditions: The VNF Performance Job is no more available in the VNFM
@@ -53,7 +54,7 @@ DELETE Individual VNF Performance Job with invalid resource identifier 
    ...    Test title: Delete individual VNF Performance Job with invalid resource identifier

    ...    Test title: Delete individual VNF Performance Job with invalid resource identifier

    ...    Test objective: The objective is to test that the deletion of an individual VNF performance monitoring job fails when using an invalid resource identifier, and perform the JSON schema validation of the failed operation HTTP response

    ...    Test objective: The objective is to test that the deletion of an individual VNF performance monitoring job fails when using an invalid resource identifier, and perform the JSON schema validation of the failed operation HTTP response

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Reference: Clause 6.4.3.3.5 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.3.3.5 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -66,7 +67,7 @@ POST Individual VNF Performance Job - Method not implemented 
    ...    Test title: POST Individual VNF Performance Job - method not implemented

    ...    Test title: POST Individual VNF Performance Job - method not implemented

    ...    Test objective: The objective is to test that POST method is not allowed to create a new VNF Performance Monitoring Job

    ...    Test objective: The objective is to test that POST method is not allowed to create a new VNF Performance Monitoring Job

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 6.4.3.3.1 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.3.3.1 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -78,7 +79,7 @@ PUT Individual VNF Performance Job - Method not implemented 
    ...    Test title: PUT Individual VNF Performance Job - method not implemented

    ...    Test title: PUT Individual VNF Performance Job - method not implemented

    ...    Test objective: The objective is to test that PUT method is not allowed to update an existing VNF Performance Monitoring Job

    ...    Test objective: The objective is to test that PUT method is not allowed to update an existing VNF Performance Monitoring Job

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 6.4.3.3.3 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.3.3.3 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -90,12 +91,13 @@ PATCH Individual VNF Performance Job 
    ...    Test title: PATCH Individual VNF Performance Job

    ...    Test title: PATCH Individual VNF Performance Job

    ...    Test objective: The objective is to test that PATCH method allows to modify an exsisting individual PM job resource.

    ...    Test objective: The objective is to test that PATCH method allows to modify an exsisting individual PM job resource.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Reference: Clause 6.4.3.3.4 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.3.3.4 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none

    Send Patch request for individual VNF Performance Job

    Send Patch request for individual VNF Performance Job

    Check HTTP Response Status Code Is    200

    Check HTTP Response Status Code Is    200

    Check HTTP Response Header Contains ETag and Last-Modified

    Check HTTP Response Body Json Schema Is    PMJobModifications

    Check HTTP Response Body Json Schema Is    PMJobModifications

    

    

PATCH Individual VNF Performance Job - Precondition failed

PATCH Individual VNF Performance Job - Precondition failed
@@ -103,7 +105,7 @@ PATCH Individual VNF Performance Job - Precondition failed 
    ...    Test title: PATCH Individual VNF Performance Job - Precondition failed

    ...    Test title: PATCH Individual VNF Performance Job - Precondition failed

    ...    Test objective: The objective is to attempt to Modify an individual alarm resource, where the precondition was not met

    ...    Test objective: The objective is to attempt to Modify an individual alarm resource, where the precondition was not met

    ...    Pre-conditions:  A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Pre-conditions:  A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Reference: Clause 6.4.3.3.4 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.3.3.4 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions:  The VNF Performance Job is not modified by the operation

    ...    Post-Conditions:  The VNF Performance Job is not modified by the operation
@@ -117,7 +119,7 @@ PATCH Individual VNF Performance Job - UNPROCESSIBLE ENTITY 
    ...    Test title: PATCH Individual VNF Performance Job - UNPROCESSIBLE ENTITY

    ...    Test title: PATCH Individual VNF Performance Job - UNPROCESSIBLE ENTITY

    ...    Test objective: The objective is to test that PATCH method cannot modify an exsisting individual PM job resource when the callback URI provided in the Request body is unreachable by the VNFM.

    ...    Test objective: The objective is to test that PATCH method cannot modify an exsisting individual PM job resource when the callback URI provided in the Request body is unreachable by the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Reference: Clause 6.4.3.3.4 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.3.3.4 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: The VNFM cannot reach the Notification endpoint.

    ...    Applicability: The VNFM cannot reach the Notification endpoint.

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -235,3 +237,10 @@ Check HTTP Response Body Json Schema Is 
    Validate Json    ${schema}    ${response['body']}

    Validate Json    ${schema}    ${response['body']}

    Log    Json Schema Validation OK

    Log    Json Schema Validation OK





Check HTTP Response Header Contains ETag and Last-Modified

    Pass Execution If    ${HEADER_TEST_SUPPORTED} == 0    Headers testing not supported. Skipping the Test.

    Log    ${response['headers']}

    Should Contain    ${response['headers']}    Etag

    Should Contain    ${response['headers']}    Last-Modified

    Log    Etag and Last-Modified Headers are present

SOL002/VNFPerformanceManagement-API/IndividualReport.robot

+6 −6
Original line number Original line Diff line number Diff line
@@ -10,7 +10,7 @@ Get Individual Performance Report 
    ...    Test title: Get Individual Performance Report

    ...    Test title: Get Individual Performance Report

    ...    Test objective: The objective is to test the retrieval of an individual VNF performance report associated to a monitoring job and perform a JSON schema validation of the collected report data structure

    ...    Test objective: The objective is to test the retrieval of an individual VNF performance report associated to a monitoring job and perform a JSON schema validation of the collected report data structure

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance reports are set for a monitoring job in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance reports are set for a monitoring job in the VNFM.

    ...    Reference: Clause 6.4.4.3.2 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.4.3.2 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -23,7 +23,7 @@ Get Individual Performance Report with invalid resource endpoint 
    ...    Test title: Get Individual Performance Report with invalid resource endpoint

    ...    Test title: Get Individual Performance Report with invalid resource endpoint

    ...    Test objective:  The objective is to test that the retrieval of an individual VNF performance report associated to a monitoring job fails when using an invalid resource endpoint 

    ...    Test objective:  The objective is to test that the retrieval of an individual VNF performance report associated to a monitoring job fails when using an invalid resource endpoint 

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance reports are set for a monitoring job in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance reports are set for a monitoring job in the VNFM.

    ...    Reference: Clause 6.4.4.3.2 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.4.3.2 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -36,7 +36,7 @@ POST Individual Performance Report - Method not implemented 
    ...    Test title: POST Individual Performance Report - Method not implemented

    ...    Test title: POST Individual Performance Report - Method not implemented

    ...    Test objective: The objective is to test that POST method is not allowed to create a new VNF performance report within a monitoring job

    ...    Test objective: The objective is to test that POST method is not allowed to create a new VNF performance report within a monitoring job

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 6.4.4.3.1 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.4.3.1 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -48,7 +48,7 @@ PUT Individual Performance Report - Method not implemented 
    ...    Test title: PUT Individual Performance Report - Method not implemented

    ...    Test title: PUT Individual Performance Report - Method not implemented

    ...    Test objective: The objective is to test that PUT method is not allowed to update an existing VNF performance report within a monitoring job

    ...    Test objective: The objective is to test that PUT method is not allowed to update an existing VNF performance report within a monitoring job

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 6.4.4.3.3 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.4.3.3 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -60,7 +60,7 @@ PATCH Individual Performance Report - Method not implemented 
    ...    Test title: PATCH Individual Performance Report - Method not implemented

    ...    Test title: PATCH Individual Performance Report - Method not implemented

    ...    Test objective: The objective is to test that PATCH method is not allowed to modify an existing VNF performance report within a monitoring job

    ...    Test objective: The objective is to test that PATCH method is not allowed to modify an existing VNF performance report within a monitoring job

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 6.4.4.3.4 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.4.3.4 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -72,7 +72,7 @@ DELETE Individual Performance Report - Method not implemented 
    ...    Test title: DELETE Individual Performance Report - Method not implemented

    ...    Test title: DELETE Individual Performance Report - Method not implemented

    ...    Test objective: The objective is to test that DELETE method is not allowed to delete an existing VNF performance report within a monitoring job

    ...    Test objective: The objective is to test that DELETE method is not allowed to delete an existing VNF performance report within a monitoring job

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 6.4.4.3.5 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.4.3.5 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none

SOL002/VNFPerformanceManagement-API/IndividualThreshold.robot

+17 −10
Original line number Original line Diff line number Diff line
@@ -12,12 +12,13 @@ GET Individual Threshold 
    ...    Test title: GET Individual Threshold

    ...    Test title: GET Individual Threshold

    ...    Test objective: The objective is to test the retrieval of an individual VNF performance threshold and perform a JSON schema and content validation of the collected threshold data structure

    ...    Test objective: The objective is to test the retrieval of an individual VNF performance threshold and perform a JSON schema and content validation of the collected threshold data structure

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance thresholds are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance thresholds are set in the VNFM.

    ...    Reference: Clause 6.4.6.3.2 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.6.3.2 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none

    GET individual VNF Performance Threshold

    GET individual VNF Performance Threshold

    Check HTTP Response Status Code Is    200

    Check HTTP Response Status Code Is    200

    Check HTTP Response Header Contains ETag and Last-Modified

    Check HTTP Response Body Json Schema Is   Threshold

    Check HTTP Response Body Json Schema Is   Threshold

    Check HTTP Response Body Threshold Identifier matches the requested Threshold

    Check HTTP Response Body Threshold Identifier matches the requested Threshold
@@ -26,7 +27,7 @@ GET Individual Threshold with invalid resource identifier 
    ...    Test title: GET Individual Threshold with invalid resource identifier

    ...    Test title: GET Individual Threshold with invalid resource identifier

    ...    Test objective: The objective is to test that the retrieval of an individual VNF performance threshold fails when using an invalid resource identifier

    ...    Test objective: The objective is to test that the retrieval of an individual VNF performance threshold fails when using an invalid resource identifier

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Reference: Clause 6.4.6.3.2 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.6.3.2 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -39,7 +40,7 @@ DELETE Individual Threshold 
    ...    Test title: DELETE Individual Threshold

    ...    Test title: DELETE Individual Threshold

    ...    Test objective: The objective is to test the deletion of an individual VNF performance threshold

    ...    Test objective: The objective is to test the deletion of an individual VNF performance threshold

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance thresholds are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance thresholds are set in the VNFM.

    ...    Reference: Clause 6.4.6.3.5 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.6.3.5 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: The VNF Performance Threshold is not available anymore in the VNFM    

    ...    Post-Conditions: The VNF Performance Threshold is not available anymore in the VNFM
@@ -52,7 +53,7 @@ DELETE Individual Threshold with invalid resource identifier 
    ...    Test title: DELETE Individual Threshold with invalid resource identifier

    ...    Test title: DELETE Individual Threshold with invalid resource identifier

    ...    Test objective: The objective is to test the deletion of an individual VNF performance threshold

    ...    Test objective: The objective is to test the deletion of an individual VNF performance threshold

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance thresholds are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance thresholds are set in the VNFM.

    ...    Reference: Clause 6.4.6.3.5 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.6.3.5 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none   

    ...    Post-Conditions: none
@@ -65,7 +66,7 @@ POST Individual Threshold - Method not implemented 
    ...    Test title: POST Individual Threshold - Method not implemented

    ...    Test title: POST Individual Threshold - Method not implemented

    ...    Test objective: The objective is to test that POST method is not allowed to create a new VNF Performance Threshold

    ...    Test objective: The objective is to test that POST method is not allowed to create a new VNF Performance Threshold

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 6.4.6.3.1 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.6.3.1 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: The VNF Performance Threshold is not created on the VNFM

    ...    Post-Conditions: The VNF Performance Threshold is not created on the VNFM
@@ -77,7 +78,7 @@ PUT Individual Threshold - Method not implemented 
    ...    Test title: PUT Individual Threshold - Method not implemented

    ...    Test title: PUT Individual Threshold - Method not implemented

    ...    Test objective: The objective is to test that PUT method is not allowed to update an existing VNF Performance threshold

    ...    Test objective: The objective is to test that PUT method is not allowed to update an existing VNF Performance threshold

    ...    Pre-conditions: none

    ...    Pre-conditions: none

    ...    Reference: Clause 6.4.6.3.3 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.6.3.3 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none

    ...    Post-Conditions: none
@@ -89,12 +90,13 @@ PATCH Individual Threshold 
    ...    Test title: PATCH Individual Threshold 

    ...    Test title: PATCH Individual Threshold 

    ...    Test objective: The objective is to test that PATCH method allows to modify an Individual threshold resource.

    ...    Test objective: The objective is to test that PATCH method allows to modify an Individual threshold resource.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance thresholds are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance thresholds are set in the VNFM.

    ...    Reference: Clause 6.4.6.3.4 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.6.3.4 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: The VNF Performance Threshold is not modified by the operation

    ...    Post-Conditions: The VNF Performance Threshold is not modified by the operation

    Send Patch request for individual VNF Performance Threshold

    Send Patch request for individual VNF Performance Threshold

    Check HTTP Response Status Code Is    200

    Check HTTP Response Status Code Is    200

    Check HTTP Response Header Contains ETag and Last-Modified

    Check HTTP Response Body Json Schema Is    ThresholdModifications

    Check HTTP Response Body Json Schema Is    ThresholdModifications

       

       

PATCH Individual Threshold - Precondition failed

PATCH Individual Threshold - Precondition failed
@@ -102,7 +104,7 @@ PATCH Individual Threshold - Precondition failed 
    ...    Test title: PATCH Individual Threshold - Preconition failed

    ...    Test title: PATCH Individual Threshold - Preconition failed

    ...    Test objective: The objective is to attempt to modify an individual threshold resource, where the precondition was not met.

    ...    Test objective: The objective is to attempt to modify an individual threshold resource, where the precondition was not met.

    ...    Pre-conditions:  A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Pre-conditions:  A VNF instance is instantiated. One or more VNF performance jobs are set in the VNFM.

    ...    Reference: Clause 6.4.6.3.4 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.6.3.4 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions:  The VNF Performance Job is not modified by the operation

    ...    Post-Conditions:  The VNF Performance Job is not modified by the operation
@@ -116,7 +118,7 @@ PATCH Individual Threshold - Unprocessible Entity 
    ...    Test title: PATCH Individual Threshold - Unprocessible Entity 

    ...    Test title: PATCH Individual Threshold - Unprocessible Entity 

    ...    Test objective: The objective is to test that PATCH method cannot modify an exsisting individual PM job resource when the callback URI provided in the Request body is unreachable by the VNFM.

    ...    Test objective: The objective is to test that PATCH method cannot modify an exsisting individual PM job resource when the callback URI provided in the Request body is unreachable by the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance thresholds are set in the VNFM.

    ...    Pre-conditions: A VNF instance is instantiated. One or more VNF performance thresholds are set in the VNFM.

    ...    Reference: Clause 6.4.6.3.4 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.6.3.4 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_VNFM

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: The VNFM cannot reach the Notification endpoint.

    ...    Applicability: The VNFM cannot reach the Notification endpoint.

    ...    Post-Conditions: The VNF Performance Threshold is not modified by the operation

    ...    Post-Conditions: The VNF Performance Threshold is not modified by the operation
@@ -234,4 +236,9 @@ Check HTTP Response Body Json Schema Is 
    Validate Json    ${schema}    ${response['body']}

    Validate Json    ${schema}    ${response['body']}

    Log    Json Schema Validation OK

    Log    Json Schema Validation OK





Check HTTP Response Header Contains ETag and Last-Modified

    Pass Execution If    ${HEADER_TEST_SUPPORTED} == 0    Headers testing not supported. Skipping the Test.

    Log    ${response['headers']}

    Should Contain    ${response['headers']}    Etag

    Should Contain    ${response['headers']}    Last-Modified

    Log    Etag and Last-Modified Headers are present

SOL002/VNFPerformanceManagement-API/NotificationEndpoint.robot

+2 −2
Original line number Original line Diff line number Diff line
@@ -13,7 +13,7 @@ VNF Performance Information Availability Notification 
    ...    Test title: VNF Performance Information Availability Notification

    ...    Test title: VNF Performance Information Availability Notification

    ...    Test objective: The objective is to test that VNF Performance Information Availability Notification is delivered with success to the notification consumer

    ...    Test objective: The objective is to test that VNF Performance Information Availability Notification is delivered with success to the notification consumer

    ...    Pre-conditions: A VNF performance job is created, and a subscription for information availability notifications is available in the VNFM.

    ...    Pre-conditions: A VNF performance job is created, and a subscription for information availability notifications is available in the VNFM.

    ...    Reference: Clause 6.4.9.3.1 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.9.3.1 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_Notif_Endpoint

    ...    Config ID: Config_prod_Notif_Endpoint

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none 

    ...    Post-Conditions: none
@@ -25,7 +25,7 @@ VNF Threshold Crossed Notification 
    ...    Test title: VNF Threshold Crossed Notification

    ...    Test title: VNF Threshold Crossed Notification

    ...    Test objective: The objective is to test that VNF Threshold Crossed Notification is delivered with success to the notification consumer

    ...    Test objective: The objective is to test that VNF Threshold Crossed Notification is delivered with success to the notification consumer

    ...    Pre-conditions: A VNF performance job is created, and a subscription for Threshold Crossed Notification is available in the VNFM.

    ...    Pre-conditions: A VNF performance job is created, and a subscription for Threshold Crossed Notification is available in the VNFM.

    ...    Reference: Clause 6.4.9.3.1 - ETSI GS NFV-SOL 002 [2] v3.6.1

    ...    Reference: Clause 6.4.9.3.1 - ETSI GS NFV-SOL 002 [2] v4.3.1

    ...    Config ID: Config_prod_Notif_Endpoint

    ...    Config ID: Config_prod_Notif_Endpoint

    ...    Applicability: none

    ...    Applicability: none

    ...    Post-Conditions: none 

    ...    Post-Conditions: none