Skip to content
Snippets Groups Projects
Commit 30ca2392 authored by Sana Zulfiqar's avatar Sana Zulfiqar Committed by Giacomo Bernini
Browse files

Added tests for thresholds & updated versions

parent f834ebff
No related branches found
No related tags found
2 merge requests!199Merge "3.3.1 dev" into "release 3" master,!167SOL005 NS Performance Management - Implementation of deltas between v3.3.1 and v2.7.1
Hide whitespace changes
Inline Side-by-side
Showing
with 81 additions and 31 deletions
SOL005/NSPerformanceManagement-API/IndividualReport.robot
+ 6
− 6
View file @ 30ca2392
......@@ -11,7 +11,7 @@ Get Individual Performance Report
... Test title: Get Individual Performance Report
... Test objective: The objective is to test the retrieval of an individual NS performance report associated to a monitoring job and perform a JSON schema validation of the collected report data structure
... Pre-conditions: A NS instance is instantiated. One or more NS performance reports are set for a monitoring job in the NFVO.
... Reference: Clause 7.4.4.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.4.3.2 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -24,7 +24,7 @@ Get Individual Performance Report with invalid resource endpoint
... Test title: Get Individual Performance Report with invalid resource endpoint
... Test objective: The objective is to test that the retrieval of an individual NS performance report associated to a monitoring job fails when using an invalid resource endpoint
... Pre-conditions: A NS instance is instantiated. One or more NS performance reports are set for a monitoring job in the NFVO.
... Reference: Clause 7.4.4.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.4.3.2 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -37,7 +37,7 @@ POST Individual Performance Report - Method not implemented
... Test title: POST Individual Performance Report - Method not implemented
... Test objective: The objective is to test that POST method is not allowed to create a new NS performance report within a monitoring job
... Pre-conditions: none
... Reference: Clause 7.4.4.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.4.3.1 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -49,7 +49,7 @@ PUT Individual Performance Report - Method not implemented
... Test title: PUT Individual Performance Report - Method not implemented
... Test objective: The objective is to test that PUT method is not allowed to update an existing NS performance report within a monitoring job
... Pre-conditions: none
... Reference: Clause 7.4.4.3.3 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.4.3.3 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -61,7 +61,7 @@ PATCH Individual Performance Report - Method not implemented
... Test title: PATCH Individual Performance Report - Method not implemented
... Test objective: The objective is to test that PATCH method is not allowed to modify an existing NS performance report within a monitoring job
... Pre-conditions: none
... Reference: Clause 7.4.4.3.4 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.4.3.4 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -73,7 +73,7 @@ DELETE Individual Performance Report - Method not implemented
... Test title: DELETE Individual Performance Report - Method not implemented
... Test objective: The objective is to test that DELETE method is not allowed to delete an existing NS performance report within a monitoring job
... Pre-conditions: none
... Reference: Clause 7.4.4.3.5 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.4.3.5 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......
SOL005/NSPerformanceManagement-API/IndividualThreshold.robot
+ 22
− 8
View file @ 30ca2392
......@@ -13,7 +13,7 @@ GET Individual Threshold
... Test title: GET Individual Threshold
... Test objective: The objective is to test the retrieval of an individual NS performance threshold and perform a JSON schema and content validation of the collected threshold data structure
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.6.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.6.3.2 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -27,7 +27,7 @@ GET Individual Threshold with invalid resource identifier
... Test title: GET Individual Threshold with invalid resource identifier
... Test objective: The objective is to test that the retrieval of an individual NS performance threshold fails when using an invalid resource identifier
... Pre-conditions: A NS instance is instantiated. One or more NS performance jobs are set in the NFVO.
... Reference: Clause 7.4.6.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.6.3.2 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -40,7 +40,7 @@ DELETE Individual Threshold with invalid resource identifier
... Test title: DELETE Individual Threshold with invalid resource identifier
... Test objective: The objective is to test the deletion of an individual NS performance threshold
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.6.3.5 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.6.3.5 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -52,7 +52,7 @@ POST Individual Threshold - Method not implemented
... Test title: POST Individual Threshold - Method not implemented
... Test objective: The objective is to test that POST method is not allowed to create a new NS performance Threshold
... Pre-conditions: A NS instance is instantiated
... Reference: Clause 7.4.6.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.6.3.1 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -64,7 +64,7 @@ PUT Individual Threshold - Method not implemented
... Test title: PUT Individual Threshold - Method not implemented
... Test objective: The objective is to test that PUT method is not allowed to update an existing NS performance threshold
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.6.3.3 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.6.3.3 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -76,7 +76,7 @@ PATCH Individual Threshold
... Test title: PATCH Individual Threshold
... Test objective: The objective is to test that PATCH method modify an existing NS performance threshold
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.6.3.4 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.6.3.4 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: The NS performance Threshold is modified by the operation
......@@ -90,7 +90,7 @@ DELETE Individual Threshold
... Test title: DELETE Individual Threshold
... Test objective: The objective is to test the deletion of an individual NS performance threshold
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.6.3.5 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.6.3.5 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: The NS performance Threshold is not available anymore in the NFVO
......@@ -103,11 +103,25 @@ PATCH Individual Threshold - Precondition failed
... Test title: PATCH Individual Threshold - Precondition failed
... Test objective: The objective is to attempt to Modify an individual NS Performance threshold fails, where the precondition was not met
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.6.3.4 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.6.3.4 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: The NS performance Threshold is not modified by the operation
Send Patch request for individual NS performance Threshold
Check HTTP Response Status Code Is 412
Check HTTP Response Body Json Schema Is ProblemDetails
Check Postcondition NS performance Threshold is Unmodified (Implicit)
PATCH Individual Threshold - Unprocessable Entity
[Documentation] Test ID: 5.3.4.2.9
... Test title: PATCH Individual NS Performance Job - Unprocessable Entity
... Test objective: The objective is to test that PATCH method cannot modify an exsisting individual PM job resource when a request contains syntactically correct data but the data cannot be processed.
... Pre-conditions: A NS instance is instantiated. One or more NS performance jobs are set in the NFVO.
... Reference: Clause 7.4.6.3.4 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: The NS performance Threshold is not modified by the operation
Send Patch request for Individual Threshold with unprocessable entity
Check HTTP Response Status Code Is 422
Check HTTP Response Body Json Schema Is ProblemDetails
Check Postcondition NS performance Threshold is Unmodified (Implicit)
\ No newline at end of file
SOL005/NSPerformanceManagement-API/NSPerformanceManagementKeywords.robot
+ 22
− 1
View file @ 30ca2392
......@@ -376,7 +376,7 @@ GET NS performance Thresholds with invalid resource endpoint
Set Suite Variable ${response} ${output}
Send Post Request Create new Performance Threshold
Log Creating a new THreshold
Log Creating a new Threshold
Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"${AUTHORIZATION_HEADER}":"${AUTHORIZATION_TOKEN}"}
Set Headers {"Accept": "${ACCEPT_JSON}"}
Set Headers {"Content-Type": "${CONTENT_TYPE_JSON}"}
......@@ -385,6 +385,17 @@ Send Post Request Create new Performance Threshold
POST ${apiRoot}/${apiName}/${apiMajorVersion}/thresholds ${body}
${output}= Output response
Set Suite Variable ${response} ${output}
Send POST request for Performance threshold with unprocessable entity
Log Creating a new Threshold
Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"${AUTHORIZATION_HEADER}":"${AUTHORIZATION_TOKEN}"}
Set Headers {"Accept": "${ACCEPT_JSON}"}
Set Headers {"Content-Type": "${CONTENT_TYPE_JSON}"}
${template}= Get File jsons/CreateThresholdRequest.json
${body}= Format String ${template} callback_uri=${unreachable_callback_uri}:${callback_port}
POST ${apiRoot}/${apiName}/${apiMajorVersion}/thresholds ${body}
${output}= Output response
Set Suite Variable ${response} ${output}
Send PUT Request for all Performance Thresholds
Log PUT THresholds
......@@ -484,6 +495,16 @@ Send Patch request for individual NS performance Threshold
PATCH ${apiRoot}/${apiName}/${apiMajorVersion}/thresholds/${thresholdId} ${body}
${output}= Output response
Set Suite Variable ${response} ${output}
Send Patch request for Individual Threshold with unprocessable entity
Set Headers {"Accept":"${ACCEPT_JSON}"}
Set Headers {"Content-Type": "${CONTENT_TYPE_PATCH}"}
Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"${AUTHORIZATION_HEADER}":"${AUTHORIZATION_TOKEN}"}
${template}= Get File jsons/ThresholdModifications.json
${body}= Format String ${template} callback_uri=${unreachable_callback_uri}:${callback_port}
PATCH ${apiRoot}/${apiName}/${apiMajorVersion}/thresholds/${thresholdId} ${body}
${output}= Output response
Set Suite Variable ${response} ${output}
Check Postcondition NS performance Threshold is Unmodified (Implicit)
Log Check postconidtion threshold not modified
......
SOL005/NSPerformanceManagement-API/NotificationConsumer.robot
+ 2
− 2
View file @ 30ca2392
......@@ -13,7 +13,7 @@ NS Performance Information Availability Notification
... Test title: NS Performance Information Availability Notification
... Test objective: The objective is to test that NS Performance Information Availability Notification is delivered with success to the notification consumer
... Pre-conditions: A NS performance job is created, and information availability notifications is available in the NFVO.
... Reference: Clause 7.4.9.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.9.3.1 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_Notif_Endpoint
... Applicability: none
... Post-Conditions: none
......@@ -25,7 +25,7 @@ NS Threshold Crossed Notification
... Test title: NS Threshold Crossed Notification
... Test objective: The objective is to test that NS Threshold Crossed Notification is delivered with success to the notification consumer
... Pre-conditions: A NS performance job is created, and threshold crossed notifications is available in the NFVO.
... Reference: Clause 7.4.9.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.9.3.1 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_Notif_Endpoint
... Applicability: none
... Post-Conditions: none
......
SOL005/NSPerformanceManagement-API/Notifications.robot
+ 2
− 2
View file @ 30ca2392
......@@ -16,7 +16,7 @@ NS Performance Information Availability Notification
... Test title: NS Performance Information Availability Notification
... Test objective: The objective is to test the dispatch of NS Performance Information Availability Notification when new NS performance information is available in the NFVO, and perform a JSON schema and content validation of the delivered notification. The action that triggers the notification under test is an explicit test step, but it is not performed by the test system.
... Pre-conditions: A NS performance job is created, and a subscription for information availability notifications is available in the NFVO.
... Reference: Clause 7.4.9.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.9.3.1 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -29,7 +29,7 @@ NS Threshold Crossed Notification
... Test title: NS Threshold Crossed Notification
... Test objective: The objective is to test the dispatch of NS Threshold Crossed Notification when a previously set NS performance metric threshold is crossed, and perform a JSON schema and content validation of the delivered notification. The action that triggers the notification under test is an explicit test step, but it is not performed by the test system.
... Pre-conditions: A NS performance job is created, and a threshold subscription is available in the NFVO.
... Reference: Clause 7.4.9.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.9.3.1 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......
SOL005/NSPerformanceManagement-API/Thresholds.robot
+ 25
− 11
View file @ 30ca2392
......@@ -13,7 +13,7 @@ GET All Performance Thresholds
... Test title: GET All Performance Thresholds
... Test objective: The objective is to test the retrieval of all the available NS performance thresholds and perform a JSON schema validation of the collected thresholds data structure
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -26,7 +26,7 @@ GET Performance Thresholds with attribute-based filter
... Test title: GET Performance Thresholds with attribute-based filter
... Test objective: The objective is to test the retrieval of all the available NS performance thresholds when using attribute-based filters, perform a JSON schema validation of the collected thresholds data structure, and verify that the retrieved information matches the issued attribute-based filter
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -40,7 +40,7 @@ GET Performance Thresholds with invalid attribute-based filter
... Test title: GET Performance Thresholds with invalid attribute-based filter
... Test objective: The objective is to test that the retrieval of NS performance thresholds fails when using invalid attribute-based filter, and perform the JSON schema validation of the failed operation HTTP response
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -53,7 +53,7 @@ GET Performance Thresholds with invalid resource endpoint
... Test title: GET Performance Thresholds with invalid resource endpoint
... Test objective: The objective is to test that the retrieval of NS performance thresholds fails when using invalid resource endpoint, and perform the JSON schema validation of the failed operation HTTP response
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -66,7 +66,7 @@ Create new Performance Threshold
... Test title: Create new Performance Threshold
... Test objective: The objective is to test the creation of a new NS performance threshold and perform the JSON schema validation of the returned threshold data structure
... Pre-conditions: A NS instance is instantiated.
... Reference: Clause 7.4.5.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.5.3.1 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: The NS performance Threshold is successfully created on the NFVO
......@@ -81,7 +81,7 @@ PUT Performance Thresholds - Method not implemented
... Test title: PUT Performance Thresholds - Method not implemented
... Test objective: The objective is to test that PUT method is not allowed to modify NS performance Thresholds
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.5.3.3 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.5.3.3 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -93,7 +93,7 @@ PATCH Performance Thresholds - Method not implemented
... Test title: PATCH Performance Thresholds - Method not implemented
... Test objective: The objective is to test that PATCH method is not allowed to modify NS performance Thresholds
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.5.3.4 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.5.3.4 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -105,7 +105,7 @@ DELETE Performance Thresholds - Method not implemented
... Test title: DELETE Performance Thresholds - Method not implemented
... Test objective: The objective is to test that DELETE method is not allowed to update NS performance Thresholds
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.5.3.5 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.5.3.5 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -117,7 +117,7 @@ GET All Performance Thresholds as Paged Response
... Test title: GET All Performance Thresholds as Paged Response
... Test objective: The objective is to test the retrieval of all the available NS performance thresholds as paged response.
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
......@@ -130,10 +130,24 @@ GET Performance Thresholds - Bad Request Response too Big
... Test title: GET Performance Thresholds - Bad Request Response too Big
... Test objective: The objective is to test that the retrieval of NS performance thresholds fails because reponse is too big, and perform the JSON schema validation of the failed operation HTTP response
... Pre-conditions: A NS instance is instantiated. One or more NS performance thresholds are set in the NFVO.
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
... Reference: Clause 7.4.5.3.2 - ETSI GS NFV-SOL 005 [3] v3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
GET all Performance Thresholds
Check HTTP Response Status Code Is 400
Check HTTP Response Body Json Schema Is ProblemDetails
\ No newline at end of file
Check HTTP Response Body Json Schema Is ProblemDetails
POST new Performance Threshold - Unprocessable Entity
[Documentation] Test ID: 5.3.4.4.11
... Test title: POST new Performance Threshold - Unprocessable Entity
... Test objective: The objective is to test the creation of a new NS performance threshold fails when a request contains syntactically correct data but the data cannot be processed.
... Pre-conditions: A NS instance is instantiated.
... Reference: clause 7.4.5.3.1 - ETSI GS NFV-SOL 005 [3] V3.3.1
... Config ID: Config_prod_NFVO
... Applicability: none
... Post-Conditions: none
Send POST request for Performance threshold with unprocessable entity
Check HTTP Response Status Code Is 422
Check HTTP Response Body Json Schema Is ProblemDetails
\ No newline at end of file
SOL005/NSPerformanceManagement-API/jsons/CreateThresholdRequest.json
+ 2
− 1
View file @ 30ca2392
......@@ -7,5 +7,6 @@
"thresholdValue": {thresholdValue},
"hysteresis": {hysteresis}
}}
}}
}},
"callbackUri": "{callback_uri}"
}}
\ No newline at end of file
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment