Merge branch 'SOL009-NFVManoPerformanceManagement' into '4.5.1-dev' (18e41e60) · Commits · NFV - Network Functions Virtualisation / api-tests

SOL009/NFVMANOPerformanceManagement-API/IndividualPmJob.robot

+34 −9

Original line number	Diff line number	Diff line
		@@ -7,7 +7,7 @@ POST Individual NFV-MANO Performance Job - Method not implemented
		... Test title: POST Individual NFV-MANO Performance Job - method not implemented
		... Test objective: The objective is to test that POST method is not allowed to create a new NFV-MANO Performance Monitoring Job
		... Pre-conditions: none
		... Reference: clause 6.5.4.3.1 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.4.3.1 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -19,7 +19,7 @@ GET individual NFV-MANO Performance Job
		... Test title: Get individual NFV-MANO Performance Job
		... Test objective: The objective is to test the retrieval of an individual performance monitoring job and perform a JSON schema validation of the collected job data structure
		... Pre-conditions: A NFV-MANO instance is instantiated.
		... Reference: clause 6.5.4.3.2 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.4.3.2 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -33,7 +33,7 @@ GET individual NFV-MANO Performance Job with invalid resource identifier
		... Test title: Get individual NFV-MANO Performance Job with invalid resource identifier
		... Test objective: The objective is to test that the retrieval of an individual performance monitoring job fails when using an invalid resource identifier, and perform the JSON schema validation of the failed operation HTTP response
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance jobs are set in the NFV-MANO.
		... Reference: clause 6.5.4.3.2 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.4.3.2 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -46,7 +46,7 @@ PUT Individual NFV-MANO Performance Job - Method not implemented
		... Test title: PUT Individual NFV-MANO Performance Job - method not implemented
		... Test objective: The objective is to test that PUT method is not allowed to update an existing NFV-MANO Performance Monitoring Job
		... Pre-conditions: none
		... Reference: clause 6.5.4.3.4 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.4.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -58,7 +58,7 @@ PATCH Individual NFV-MANO Performance Job
		... Test title: PATCH Individual NFV-MANO Performance Job
		... Test objective: The objective is to test that PATCH method modify an existing individual NFV-MANO Performance Monitoring Job
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance jobs are set in the NFV-MANO.
		... Reference: clause 6.5.4.3.4 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.4.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: PM Job resource is modified.
		@@ -71,7 +71,7 @@ DELETE Individual NFV-MANO Performance Job
		... Test title: Delete Individual NFV-MANO Performance Job
		... Test objective: The objective is to test the deletion of an individual performance monitoring job
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance jobs are set in the NFV-MANO.
		... Reference: clause 6.5.4.3.5 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.4.3.5 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: The NFV-MANO Performance Job is no more available.
		@@ -84,7 +84,7 @@ DELETE Individual NFV-MANO Performance Job with invalid resource identifier
		... Test title: Delete individual NFV-MANO Performance Job with invalid resource identifier
		... Test objective: The objective is to test that the deletion of an individual NFV-MANO performance monitoring job fails when using an invalid resource identifier
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance jobs are set in the NFV-MANO.
		... Reference: clause 6.5.4.3.5 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.4.3.5 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -96,7 +96,7 @@ PATCH Individual NFV-MANO Performance Job - Precondition failed
		... Test title: PATCH Individual NFV-MANO Performance Job - Precondition failed
		... Test objective: The objective is to test that the PATCH method cannot modify an individual NFV-MANO Performance job where the precondition was not met.
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance jobs are set in the NFV-MANO.
		... Reference: clause 6.5.4.3.4 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.4.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: PM Job resource is not modified.
		@@ -109,10 +109,35 @@ PATCH Individual NFV-MANO Performance Job - Unprocessable content
		... Test title: PATCH Individual NFV-MANO Performance Job - Unprocessable content
		... Test objective: The objective is to test that PATCH method cannot modify an exsisting individual PM job resource when a request contains syntactically correct data but the data cannot be processed.
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance jobs are set in the NFV-MANO.
		... Reference: clause 6.5.4.3.4 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.4.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: PM Job resource is not modified.
		Send Patch request for individual NFV_MANO Performance Job with unprocessable content
		Check HTTP Response Status Code Is 422
		Check HTTP Response Body Json Schema Is ProblemDetails

		PATCH Individual NFV-MANO Performance Job with permitted authorization scope
		[Documentation] Test ID: 8.3.2.2.10
		... Test title: PATCH Individual NFV-MANO Performance Job with permitted authorization scope
		... Test objective: The objective is to test that PATCH method with permitted authorization scope modify an existing individual NFV-MANO Performance Monitoring Job
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance jobs are set in the NFV-MANO.
		... Reference: clause 6.5.4.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: PM Job resource is modified.
		Send Patch request for individual NFV-MANO Performance Job with permitted authorization scope
		Check HTTP Response Status Code Is 200
		Check HTTP Response Body Json Schema Is PmJobModifications

		PATCH Individual NFV-MANO Performance Job with not permitted authorization scope
		[Documentation] Test ID: 8.3.2.2.11
		... Test title: PATCH Individual NFV-MANO Performance Job with not permitted authorization scope
		... Test objective: The objective is to test that PATCH method with not permitted authorization scope fails
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance jobs are set in the NFV-MANO.
		... Reference: clause 6.5.4.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: PM Job resource is modified.
		Send Patch request for individual NFV-MANO Performance Job with not permitted authorization scope
		Check HTTP Response Status Code Is 401

SOL009/NFVMANOPerformanceManagement-API/IndividualReport.robot

+31 −6

Original line number	Diff line number	Diff line
		@@ -7,7 +7,7 @@ POST Individual Performance Report - Method not implemented
		... Test title: POST Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that POST method is not allowed to create a new NFV-MANO performance report within a monitoring job.
		... Pre-conditions: none
		... Reference: clause 6.5.5.3.1 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.5.3.1 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -19,7 +19,7 @@ Get Individual Performance Report
		... Test title: Get Individual Performance Report
		... Test objective: The objective is to test the retrieval of an individual performance report associated to a monitoring job and perform a JSON schema validation of the collected report data structure
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance reports are set for a monitoring job.
		... Reference: clause 6.5.5.3.2 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.5.3.2 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -32,7 +32,7 @@ Get Individual Performance Report with invalid resource endpoint
		... Test title: Get Individual Performance Report with invalid resource endpoint
		... Test objective: The objective is to test that the retrieval of an individual NFV-MANO performance report associated to a monitoring job fails when using an invalid resource endpoint.
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance reports are set for a monitoring job.
		... Reference: clause 6.5.5.3.2 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.5.3.2 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -44,7 +44,7 @@ PUT Individual Performance Report - Method not implemented
		... Test title: PUT Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that PUT method is not allowed to update an existing NFV-MANO performance report within a monitoring job.
		... Pre-conditions: none
		... Reference: clause 6.5.5.3.3 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.5.3.3 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -56,7 +56,7 @@ PATCH Individual Performance Report - Method not implemented
		... Test title: PATCH Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that PATCH method is not allowed to modify an existing NFV-MANO performance report within a monitoring job.
		... Pre-conditions: none
		... Reference: clause 6.5.5.3.4 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.5.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -68,10 +68,35 @@ DELETE Individual Performance Report - Method not implemented
		... Test title: DELETE Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that DELETE method is not allowed to delete an existing NFV-MANO performance report within a monitoring job
		... Pre-conditions: none
		... Reference: clause 6.5.5.3.5 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.5.3.5 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANOM
		... Applicability: none
		... Post-Conditions: none
		Send Delete request for Individual Performance Report
		Check HTTP Response Status Code Is 405

		Get Individual Performance Report with permitted authorization scope
		[Documentation] Test ID: 8.3.2.3.7
		... Test title: Get Individual Performance Report with permitted authorization scope
		... Test objective: The objective is to test the retrieval of an individual performance report associated to a monitoring job with permitted authorization scope
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance reports are set for a monitoring job.
		... Reference: clause 6.5.5.3.2 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		Get Individual Performance Report with permitted authorization scope
		Check HTTP Response Status Code Is 200
		Check HTTP Response Body Json Schema Is PerformanceReport

		Get Individual Performance Report with not permitted authorization scope
		[Documentation] Test ID: 8.3.2.3.8
		... Test title: Get Individual Performance Report with not permitted authorization scope
		... Test objective: The objective is to test the retrieval of an individual performance report associated to a monitoring job fails with not permitted authorization scope
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more NFV-MANO performance reports are set for a monitoring job.
		... Reference: clause 6.5.5.3.2 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		Get Individual Performance Report with not permitted authorization scope
		Check HTTP Response Status Code Is 401

SOL009/NFVMANOPerformanceManagement-API/IndividualThreshold.robot

+34 −9

Original line number	Diff line number	Diff line
		@@ -7,7 +7,7 @@ POST Individual Threshold - Method not implemented
		... Test title: POST Individual Threshold - Method not implemented
		... Test objective: The objective is to test that POST method is not allowed to create a new Performance Threshold
		... Pre-conditions: none
		... Reference: clause 6.5.7.3.1 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.7.3.1 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -19,7 +19,7 @@ GET Individual Threshold
		... Test title: GET Individual Threshold
		... Test objective: The objective is to test the retrieval of an individual NFV-MANO performance threshold and perform a JSON schema and content validation of the collected threshold data structure
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more performance thresholds are set.
		... Reference: clause 6.5.7.3.2 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.7.3.2 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -33,7 +33,7 @@ GET Individual Threshold with invalid resource identifier
		... Test title: GET Individual Threshold with invalid resource identifier
		... Test objective: The objective is to test that the retrieval of an individual performance threshold fails when using an invalid resource identifier
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more performance jobs are set.
		... Reference: clause 6.5.7.3.2 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.7.3.2 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -45,7 +45,7 @@ PUT Individual Threshold - Method not implemented
		... Test title: PUT Individual Threshold - Method not implemented
		... Test objective: The objective is to test that PUT method is not allowed to update an existing Performance threshold
		... Pre-conditions: none
		... Reference: clause 6.5.7.3.3 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.7.3.3 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -57,7 +57,7 @@ PATCH Individual Threshold
		... Test title: PATCH Individual Threshold
		... Test objective: The objective is to test that PATCH method modify an existing NFV_MANO performance threshold.
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more performance thresholds are set.
		... Reference: clause 6.5.7.3.4 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.7.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: Threshold resource is modified.
		@@ -70,7 +70,7 @@ DELETE Individual Threshold
		... Test title: DELETE Individual Threshold
		... Test objective: The objective is to test the deletion of an individual performance threshold
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more performance thresholds are set.
		... Reference: clause 6.5.7.3.5 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.7.3.5 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: The Performance Threshold is not available anymore in the NFV-MANO
		@@ -83,7 +83,7 @@ DELETE Individual Threshold with invalid resource identifier
		... Test title: DELETE Individual Threshold with invalid resource identifier
		... Test objective: The objective is to test the deletion of an individual performance threshold
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more performance thresholds are set.
		... Reference: clause 6.5.7.3.5 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.7.3.5 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: none
		@@ -95,7 +95,7 @@ PATCH Individual Threshold - Precondition failed
		... Test title: PATCH Individual Threshold - Precondition failed
		... Test objective: The objective is to test that the PATCH method cannot modify an individual NFV-MANO threshold where the precondition was not met.
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more performance thresholds are set.
		... Reference: clause 6.5.7.3.4 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.7.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: Threshold resource is not modified.
		@@ -108,10 +108,35 @@ PATCH Individual Threshold - Unprocessable content
		... Test title: PATCH Individual Threshold - Unprocessable content
		... Test objective: The objective is to test that PATCH method cannot modify an exsisting individual threshold resource when a request contains syntactically correct data but the data cannot be processed.
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more performance thresholds are set.
		... Reference: clause 6.5.7.3.4 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.7.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: Threshold resource is not modified.
		Send Patch request for individual Performance Threshold with unprocessable content
		Check HTTP Response Status Code Is 422
		Check HTTP Response Body Json Schema Is ProblemDetails

		PATCH Individual Threshold with permitted authorization scope
		[Documentation] Test ID: 8.3.2.5.10
		... Test title: PATCH Individual Threshold with permitted authorization scope
		... Test objective: The objective is to test that PATCH method modify an existing NFV_MANO performance threshold with permitted authorization scope.
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more performance thresholds are set.
		... Reference: clause 6.5.7.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: Threshold resource is modified.
		Send Patch request for individual Performance Threshold with permitted authorization scope
		Check HTTP Response Status Code Is 200
		Check HTTP Response Body Json Schema Is ThresholdModifications

		PATCH Individual Threshold with not permitted authorization scope
		[Documentation] Test ID: 8.3.2.5.11
		... Test title: PATCH Individual Threshold with not permitted authorization scope
		... Test objective: The objective is to test that PATCH method fails with not permitted authorization scope.
		... Pre-conditions: A NFV-MANO instance is instantiated. One or more performance thresholds are set.
		... Reference: clause 6.5.7.3.4 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_NFV-MANO
		... Applicability: none
		... Post-Conditions: Threshold resource is modified.
		Send Patch request for individual Performance Threshold with not permitted authorization scope
		Check HTTP Response Status Code Is 401

SOL009/NFVMANOPerformanceManagement-API/NFVMANOPMKeywords.robot

+153 −1

File changed.

Preview size limit exceeded, changes collapsed.

SOL009/NFVMANOPerformanceManagement-API/NotificationEndpoint.robot

+2 −2

Original line number	Diff line number	Diff line
		@@ -8,7 +8,7 @@ Performance Information Available Notification
		... Test title: Performance Information Available Notification
		... Test objective: The objective is to test that Performance Available Notification is delivered with success to the notification consumer
		... Pre-conditions: A subscription for performance available notification is available in the NFV-MANO.
		... Reference: clause 6.5.10.3.1 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.10.3.1 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_Notif_Endpoint
		... Applicability: none
		... Post-Conditions: none
		@@ -21,7 +21,7 @@ Threshold Crossed Notification
		... Test title: Threshold Crossed Notification
		... Test objective: The objective is to test that Threshold Crossed Notification is delivered with success to the notification consumer
		... Pre-conditions: A subscription for threshold crosssed notification is available in the NFV-MANO.
		... Reference: clause 6.5.10.3.1 - ETSI GS NFV-SOL 009 [7] v4.4.1
		... Reference: clause 6.5.10.3.1 - ETSI GS NFV-SOL 009 [7] v4.5.1
		... Config ID: Config_prod_Notif_Endpoint
		... Applicability: none
		... Post-Conditions: none