Merge branch '2.7.1-dev-SOL005-NSPerformanceManagement-API' into '2.7.1-dev' (404d2e72) · Commits · NFV - Network Functions Virtualisation / api-tests

SOL005/NSPerformanceManagement-API/ApiVersion.robot

+212 −212

Original line number	Diff line number	Diff line
		@@ -9,11 +9,11 @@ Library JSONSchemaLibrary schemas/

		* Test Cases *
		POST API Version - Method not implemented
		[Documentation] Test ID: 5.3.4.9.1
		[Documentation] Test ID: 5.3.4.10.1
		... Test title: POST API version - Method not implemented
		... Test objective: The objective is to test that POST method is not implemented
		... Pre-conditions: none
		... Reference: Clause 9.3.3.3.1 - ETSI GS NFV-SOL 013 v2.6.1
		... Reference: Clause 9.3.3.3.1 - ETSI GS NFV-SOL 013 v2.7.1
		... Config ID: Config_prod_VNFM
		... Applicability: none
		... Post-Conditions: none
		@@ -25,7 +25,7 @@ GET API Version
		... Test title: GET API Version
		... Test objective: The objective is to test that GET method successfully return ApiVersionInformation
		... Pre-conditions: none
		... Reference: Clause 9.3.3.3.2 - ETSI GS NFV-SOL 013 v2.6.1
		... Reference: Clause 9.3.3.3.2 - ETSI GS NFV-SOL 013 v2.7.1
		... Config ID: Config_prod_VNFM
		... Applicability: none
		... Post-Conditions: none
		@@ -38,7 +38,7 @@ PUT API Version - Method not implemented
		... Test title: PUT API Version - Method not implemented
		... Test objective: The objective is to test that PUT method is not implemented
		... Pre-conditions: none
		... Reference: Clause 9.3.3.3.3 - ETSI GS NFV-SOL 013 v2.6.1
		... Reference: Clause 9.3.3.3.3 - ETSI GS NFV-SOL 013 v2.7.1
		... Config ID: Config_prod_VNFM
		... Applicability: none
		... Post-Conditions: none
		@@ -50,7 +50,7 @@ PATCH API Version - Method not implemented
		... Test title: PATCH API Version - Method not implemented
		... Test objective: The objective is to test that PATCH method is not implemented
		... Pre-conditions: none
		... Reference: Clause 9.3.3.3.4 - ETSI GS NFV-SOL 013 v2.6.1
		... Reference: Clause 9.3.3.3.4 - ETSI GS NFV-SOL 013 v2.7.1
		... Config ID: Config_prod_VNFM
		... Applicability: none
		... Post-Conditions: none
		@@ -62,7 +62,7 @@ DELETE API Version - Method not implemented
		... Test title: DELETE API Version - Method not implemented
		... Test objective: The objective is to test that DELETE method is not implemented
		... Pre-conditions: none
		... Reference: Clause 9.3.3.3.5 - ETSI GS NFV-SOL 013 v2.6.1
		... Reference: Clause 9.3.3.3.5 - ETSI GS NFV-SOL 013 v2.7.1
		... Config ID: Config_prod_VNFM
		... Applicability: none
		... Post-Conditions: none
		@@ -74,7 +74,7 @@ POST API Version with apiMajorVerion - Method not implemented
		... Test title: POST API version with apiMajorVerion - Method not implemented
		... Test objective: The objective is to test that POST method is not implemented
		... Pre-conditions: none
		... Reference: Clause 9.3.3.3.1 - ETSI GS NFV-SOL 013 v2.6.1
		... Reference: Clause 9.3.3.3.1 - ETSI GS NFV-SOL 013 v2.7.1
		... Config ID: Config_prod_VNFM
		... Applicability: none
		... Post-Conditions: none
		@@ -86,7 +86,7 @@ GET API Version with apiMajorVerion
		... Test title: GET API Version with apiMajorVerion
		... Test objective: The objective is to test that GET method successfully return ApiVersionInformation
		... Pre-conditions: none
		... Reference: Clause 9.3.3.3.2 - ETSI GS NFV-SOL 013 v2.6.1
		... Reference: Clause 9.3.3.3.2 - ETSI GS NFV-SOL 013 v2.7.1
		... Config ID: Config_prod_VNFM
		... Applicability: none
		... Post-Conditions: none
		@@ -99,7 +99,7 @@ PUT API Version with apiMajorVerion - Method not implemented
		... Test title: PUT API Version with apiMajorVerion - Method not implemented
		... Test objective: The objective is to test that PUT method is not implemented
		... Pre-conditions: none
		... Reference: Clause 9.3.3.3.3 - ETSI GS NFV-SOL 013 v2.6.1
		... Reference: Clause 9.3.3.3.3 - ETSI GS NFV-SOL 013 v2.7.1
		... Config ID: Config_prod_VNFM
		... Applicability: none
		... Post-Conditions: none
		@@ -111,7 +111,7 @@ PATCH API Version with apiMajorVerion - Method not implemented
		... Test title: PATCH API Version with apiMajorVerion - Method not implemented
		... Test objective: The objective is to test that PATCH method is not implemented
		... Pre-conditions: none
		... Reference: Clause 9.3.3.3.4 - ETSI GS NFV-SOL 013 v2.6.1
		... Reference: Clause 9.3.3.3.4 - ETSI GS NFV-SOL 013 v2.7.1
		... Config ID: Config_prod_VNFM
		... Applicability: none
		... Post-Conditions: none
		@@ -123,7 +123,7 @@ DELETE API Version with apiMajorVerion - Method not implemented
		... Test title: DELETE API Version with apiMajorVerion - Method not implemented
		... Test objective: The objective is to test that DELETE method is not implemented
		... Pre-conditions: none
		... Reference: Clause 9.3.3.3.5 - ETSI GS NFV-SOL 013 v2.6.1
		... Reference: Clause 9.3.3.3.5 - ETSI GS NFV-SOL 013 v2.7.1
		... Config ID: Config_prod_VNFM
		... Applicability: none
		... Post-Conditions: none
		@@ -134,70 +134,70 @@ DELETE API Version with apiMajorVerion - Method not implemented
		POST API Version
		Set Headers {"Accept":"${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization":"${AUTHORIZATION}"}
		Post ${apiRoot}/${apiName}/api_version
		Post ${apiRoot}/${apiName}/api_versions
		${outputResponse}= Output response
		Set Global Variable ${response} ${outputResponse}

		GET API Version
		Set Headers {"Accept":"${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization":"${AUTHORIZATION}"}
		Get ${apiRoot}/${apiName}/api_version
		Get ${apiRoot}/${apiName}/api_versions
		${outputResponse}= Output response
		Set Global Variable ${response} ${outputResponse}

		PUT API Version
		Set Headers {"Accept":"${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization":"${AUTHORIZATION}"}
		Put ${apiRoot}/${apiName}/api_version
		Put ${apiRoot}/${apiName}/api_versions
		${outputResponse}= Output response
		Set Global Variable ${response} ${outputResponse}

		PATCH API Version
		Set Headers {"Accept":"${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization":"${AUTHORIZATION}"}
		Patch ${apiRoot}/${apiName}/api_version
		Patch ${apiRoot}/${apiName}/api_versions
		${outputResponse}= Output response
		Set Global Variable ${response} ${outputResponse}

		DELETE API Version
		Set Headers {"Accept":"${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization":"${AUTHORIZATION}"}
		Delete ${apiRoot}/${apiName}/api_version
		Delete ${apiRoot}/${apiName}/api_versions
		${outputResponse}= Output response
		Set Global Variable ${response} ${outputResponse}

		POST API Version with apiMajorVersion
		Set Headers {"Accept":"${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization":"${AUTHORIZATION}"}
		Post ${apiRoot}/${apiName}/v1/api_version
		Post ${apiRoot}/${apiName}/${apiMajorVersion}/api_versions
		${outputResponse}= Output response
		Set Global Variable ${response} ${outputResponse}

		GET API Version with apiMajorVersion
		Set Headers {"Accept":"${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization":"${AUTHORIZATION}"}
		Get ${apiRoot}/${apiName}/v1/api_version
		Get ${apiRoot}/${apiName}/${apiMajorVersion}/api_versions
		${outputResponse}= Output response
		Set Global Variable ${response} ${outputResponse}

		PUT API Version with apiMajorVersion
		Set Headers {"Accept":"${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization":"${AUTHORIZATION}"}
		Put ${apiRoot}/${apiName}/v1/api_version
		Put ${apiRoot}/${apiName}/${apiMajorVersion}/api_versions
		${outputResponse}= Output response
		Set Global Variable ${response} ${outputResponse}

		PATCH API Version with apiMajorVersion
		Set Headers {"Accept":"${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization":"${AUTHORIZATION}"}
		Patch ${apiRoot}/${apiName}/v1/api_version
		Patch ${apiRoot}/${apiName}/${apiMajorVersion}/api_versions
		${outputResponse}= Output response
		Set Global Variable ${response} ${outputResponse}

		DELETE API Version with apiMajorVersion
		Set Headers {"Accept":"${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization":"${AUTHORIZATION}"}
		Delete ${apiRoot}/${apiName}/v1/api_version
		Delete ${apiRoot}/${apiName}/${apiMajorVersion}/api_versions
		${outputResponse}= Output response
		Set Global Variable ${response} ${outputResponse}

SOL005/NSPerformanceManagement-API/IndividualPmJob.robot

+29 −16

Original line number	Diff line number	Diff line
		@@ -2,7 +2,6 @@
		Library JSONSchemaLibrary schemas/
		Resource environment/variables.txt # Generic Parameters
		Library JSONLibrary
		Resource environment/IndividualPmJob.txt
		Resource NSPerformanceManagementKeywords.robot
		Library REST ${NFVO_SCHEMA}://${NFVO_HOST}:${NFVO_PORT} ssl_verify=false

		@@ -12,7 +11,7 @@ GET individual NS Performance Job
		... Test title: Get individual NS Performance Job
		... Test objective: The objective is to test the retrieval of an individual NS Performance monitoring job and perform a JSON schema and content validation of the collected job data structure
		... Pre-conditions: A NS instance is instantiated. One or more NS Performance jobs are set in the NFVO.
		... Reference: Clause 7.4.3.3.2 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Reference: Clause 7.4.3.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: none
		@@ -26,7 +25,7 @@ GET individual NS Performance Job with invalid resource identifier
		... Test title: Get individual NS Performance Job with invalid resource identifier
		... Test objective: The objective is to test that the retrieval of an individual NS Performance monitoring job fails when using an invalid resource identifier, and perform the JSON schema validation of the failed operation HTTP response
		... Pre-conditions: A NS instance is instantiated. One or more NS Performance jobs are set in the NFVO.
		... Reference: Clause 7.4.3.3.2 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Reference: Clause 7.4.3.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: none
		@@ -39,7 +38,7 @@ DELETE Individual NS Performance Job with invalid resource identifier
		... Test title: Delete individual NS Performance Job with invalid resource identifier
		... Test objective: The objective is to test that the deletion of an individual NS Performance monitoring job fails when using an invalid resource identifier
		... Pre-conditions: A NS instance is instantiated. One or more NS Performance jobs are set in the NFVO.
		... Reference: Clause 7.4.3.3.5 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Reference: Clause 7.4.3.3.5 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: none
		@@ -50,8 +49,8 @@ POST Individual NS Performance Job - Method not implemented
		[Documentation] Test ID: 5.3.4.2.4
		... Test title: POST Individual NS Performance Job - method not implemented
		... Test objective: The objective is to test that POST method is not allowed to create a new NS Performance Monitoring Job
		... Pre-conditions: A NS instance is instantiated
		... Reference: Clause 7.4.3.3.1 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Pre-conditions: none
		... Reference: Clause 7.4.3.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: none
		@@ -62,35 +61,49 @@ PUT Individual NS Performance Job - Method not implemented
		[Documentation] Test ID: 5.3.4.2.5
		... Test title: PUT Individual NS Performance Job - method not implemented
		... Test objective: The objective is to test that PUT method is not allowed to update an existing NS Performance Monitoring Job
		... Pre-conditions: A NS instance is instantiated. One or more NS Performance jobs are set in the NFVO.
		... Reference: Clause 7.4.3.3.3 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Pre-conditions: none
		... Reference: Clause 7.4.3.3.3 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: none
		Send Put request for individual NS Performance Job
		Check HTTP Response Status Code Is 405

		PATCH Individual NS Performance Job - Method not implemented
		PATCH Individual NS Performance Job
		[Documentation] Test ID: 5.3.4.2.6
		... Test title: PATCH Individual NS Performance Job - method not implemented
		... Test objective: The objective is to test that PATCH method is not allowed to modify an existing new NS Performance Monitoring Job
		... Test title: PATCH Individual NS Performance Job
		... Test objective: The objective is to test that PATCH method modify an existing new NS Performance Monitoring Job
		... Pre-conditions: A NS instance is instantiated. One or more NS performance jobs are set in the NFVO.
		... Reference: Clause 6.4.3.3.4 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Reference: Clause 6.4.3.3.4 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: none
		... Post-Conditions: Resource modified
		Send Patch request for individual NS Performance Job
		Check HTTP Response Status Code Is 405
		Check HTTP Response Status Code Is 200
		Check HTTP Response Body Json Schema Is PmJobModifications

		DELETE Individual NS Performance Job
		[Documentation] Test ID: 5.3.4.2.7
		... Test title: Delete Individual NS Performance Job
		... Test objective: The objective is to test the deletion of an individual NS Performance monitoring job
		... Pre-conditions: A NS instance is instantiated. One or more NS Performance jobs are set in the NFVO.
		... Reference: Clause 7.4.3.3.5 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Reference: Clause 7.4.3.3.5 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS Performance Job is no more available in the NFVO
		Send Delete request for individual NS Performance Job
		Check HTTP Response Status Code Is 204
		Check Postcondition NS Pm Job is Deleted

		PATCH Individual NS Performance Job - Precondition failed
		[Documentation] Test ID: 5.3.4.2.8
		... Test title: PATCH Individual NS Performance Job - Precondition failed
		... Test objective: The objective is to attempt to Modify an individual NS Performance job fails, where the precondition was not met
		... Pre-conditions: The related job already exsisit
		... Reference: Clause 7.4.3.3.4 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The resource is not modified
		Send Patch request for individual NS Performance Job
		Check HTTP Response Status Code Is 412
		Check HTTP Response Body Json Schema Is ProblemDetails
		No newline at end of file

SOL005/NSPerformanceManagement-API/IndividualReport.robot

+15 −19

Original line number	Diff line number	Diff line
		* Settings *
		Library JSONSchemaLibrary schemas/
		Resource environment/variables.txt # Generic Parameters
		Resource environment/reports.txt
		Resource NSPerformanceManagementKeywords.robot
		Library JSONLibrary
		Library REST ${NFVO_SCHEMA}://${NFVO_HOST}:${NFVO_PORT} ssl_verify=false
		@@ -12,7 +11,7 @@ Get Individual Performance Report
		... Test title: Get Individual Performance Report
		... Test objective: The objective is to test the retrieval of an individual NS performance report associated to a monitoring job and perform a JSON schema validation of the collected report data structure
		... Pre-conditions: A NS instance is instantiated. One or more NS performance reports are set for a monitoring job in the NFVO.
		... Reference: Clause 7.4.4.3.2 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Reference: Clause 7.4.4.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: none
		@@ -25,62 +24,59 @@ Get Individual Performance Report with invalid resource endpoint
		... Test title: Get Individual Performance Report with invalid resource endpoint
		... Test objective: The objective is to test that the retrieval of an individual NS performance report associated to a monitoring job fails when using an invalid resource endpoint
		... Pre-conditions: A NS instance is instantiated. One or more NS performance reports are set for a monitoring job in the NFVO.
		... Reference: Clause 7.4.4.3.2 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Reference: Clause 7.4.4.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: none
		Get Individual Performance Report with invalid resource endpoint
		Check HTTP Response Status Code Is 404
		Check HTTP Response Body Json Schema Is ProblemDetails

		POST Individual Performance Report - Method not implemented
		[Documentation] Test ID: 5.3.4.3.3
		... Test title: POST Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that POST method is not allowed to create a new NS performance report within a monitoring job
		... Pre-conditions: A NS instance is instantiated.
		... Reference: Clause 7.4.4.3.1 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Pre-conditions: none
		... Reference: Clause 7.4.4.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS performance report is not created on the NFVO
		... Post-Conditions: none
		Send Post request for Individual Performance Report
		Check HTTP Response Status Code Is 405
		Check Postcondition NS Individual Performance Report is not Created

		PUT Individual Performance Report - Method not implemented
		[Documentation] Test ID: 5.3.4.3.4
		... Test title: PUT Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that PUT method is not allowed to update an existing NS performance report within a monitoring job
		... Pre-conditions: A NS instance is instantiated. One or more NS performance reports are set for a monitoring job in the NFVO.
		... Reference: Clause 7.4.4.3.3 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Pre-conditions: none
		... Reference: Clause 7.4.4.3.3 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS performance report is not modified by the operation
		... Post-Conditions: none
		Send Put request for Individual Performance Report
		Check HTTP Response Status Code Is 405
		Check Postcondition NS Individual Performance Report is Unmodified (Implicit)

		PATCH Individual Performance Report - Method not implemented
		[Documentation] Test ID: 5.3.4.3.5
		... Test title: PATCH Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that PATCH method is not allowed to modify an existing NS performance report within a monitoring job
		... Pre-conditions: A NS instance is instantiated. One or more NS performance reports are set for a monitoring job in the NFVO.
		... Reference: Clause 7.4.4.3.4 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Pre-conditions: none
		... Reference: Clause 7.4.4.3.4 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS performance report is not modified by the operation
		... Post-Conditions: none
		Send Patch request for Individual Performance Report
		Check HTTP Response Status Code Is 405
		Check Postcondition NS Individual Performance Report is Unmodified (Implicit)

		DELETE Individual Performance Report - Method not implemented
		[Documentation] Test ID: 5.3.4.3.6
		... Test title: DELETE Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that DELETE method is not allowed to delete an existing NS performance report within a monitoring job
		... Pre-conditions: A NS instance is instantiated. One or more NS performance reports are set for a monitoring job in the NFVO.
		... Reference: Clause 7.4.4.3.5 - ETSI GS NFV-SOL 005 [3] v2.6.1
		... Pre-conditions: none
		... Reference: Clause 7.4.4.3.5 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS performance report is not deleted by the operation
		... Post-Conditions: none
		Send Delete request for Individual Performance Report
		Check HTTP Response Status Code Is 405
		Check Postcondition NS Individual Performance Report Exists

SOL005/NSPerformanceManagement-API/IndividualSubscription.robot

deleted100644 → 0

+0 −102

File deleted.

Preview size limit exceeded, changes collapsed.

SOL005/NSPerformanceManagement-API/IndividualThreshold.robot

+29 −17

File changed.

Preview size limit exceeded, changes collapsed.

Admin message