new testcase and bug fix added (2756d222) · Commits · Miguel Angel Reina Ortega / api-tests

SOL005/NSPerformanceManagement-API/IndividualPmJob.robot

+2 −2

Original line number	Diff line number	Diff line
		@@ -50,7 +50,7 @@ POST Individual NS Performance Job - Method not implemented
		[Documentation] Test ID: 5.3.4.2.4
		... Test title: POST Individual NS Performance Job - method not implemented
		... Test objective: The objective is to test that POST method is not allowed to create a new NS Performance Monitoring Job
		... Pre-conditions: A NS instance is instantiated
		... Pre-conditions: none
		... Reference: Clause 7.4.3.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		@@ -62,7 +62,7 @@ PUT Individual NS Performance Job - Method not implemented
		[Documentation] Test ID: 5.3.4.2.5
		... Test title: PUT Individual NS Performance Job - method not implemented
		... Test objective: The objective is to test that PUT method is not allowed to update an existing NS Performance Monitoring Job
		... Pre-conditions: A NS instance is instantiated. One or more NS Performance jobs are set in the NFVO.
		... Pre-conditions: none
		... Reference: Clause 7.4.3.3.3 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none

SOL005/NSPerformanceManagement-API/IndividualReport.robot

+9 −12

Original line number	Diff line number	Diff line
		@@ -31,56 +31,53 @@ Get Individual Performance Report with invalid resource endpoint
		... Post-Conditions: none
		Get Individual Performance Report with invalid resource endpoint
		Check HTTP Response Status Code Is 404
		Check HTTP Response Body Json Schema Is ProblemDetails

		POST Individual Performance Report - Method not implemented
		[Documentation] Test ID: 5.3.4.3.3
		... Test title: POST Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that POST method is not allowed to create a new NS performance report within a monitoring job
		... Pre-conditions: A NS instance is instantiated.
		... Pre-conditions: none
		... Reference: Clause 7.4.4.3.1 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS performance report is not created on the NFVO
		... Post-Conditions: none
		Send Post request for Individual Performance Report
		Check HTTP Response Status Code Is 405
		Check Postcondition NS Individual Performance Report is not Created

		PUT Individual Performance Report - Method not implemented
		[Documentation] Test ID: 5.3.4.3.4
		... Test title: PUT Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that PUT method is not allowed to update an existing NS performance report within a monitoring job
		... Pre-conditions: A NS instance is instantiated. One or more NS performance reports are set for a monitoring job in the NFVO.
		... Pre-conditions: none
		... Reference: Clause 7.4.4.3.3 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS performance report is not modified by the operation
		... Post-Conditions: none
		Send Put request for Individual Performance Report
		Check HTTP Response Status Code Is 405
		Check Postcondition NS Individual Performance Report is Unmodified (Implicit)

		PATCH Individual Performance Report - Method not implemented
		[Documentation] Test ID: 5.3.4.3.5
		... Test title: PATCH Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that PATCH method is not allowed to modify an existing NS performance report within a monitoring job
		... Pre-conditions: A NS instance is instantiated. One or more NS performance reports are set for a monitoring job in the NFVO.
		... Pre-conditions: none
		... Reference: Clause 7.4.4.3.4 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS performance report is not modified by the operation
		... Post-Conditions: none
		Send Patch request for Individual Performance Report
		Check HTTP Response Status Code Is 405
		Check Postcondition NS Individual Performance Report is Unmodified (Implicit)

		DELETE Individual Performance Report - Method not implemented
		[Documentation] Test ID: 5.3.4.3.6
		... Test title: DELETE Individual Performance Report - Method not implemented
		... Test objective: The objective is to test that DELETE method is not allowed to delete an existing NS performance report within a monitoring job
		... Pre-conditions: A NS instance is instantiated. One or more NS performance reports are set for a monitoring job in the NFVO.
		... Pre-conditions: none
		... Reference: Clause 7.4.4.3.5 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS performance report is not deleted by the operation
		... Post-Conditions: none
		Send Delete request for Individual Performance Report
		Check HTTP Response Status Code Is 405
		Check Postcondition NS Individual Performance Report Exists

SOL005/NSPerformanceManagement-API/NSPerformanceManagementKeywords.robot

+12 −30

Original line number	Diff line number	Diff line
		@@ -48,12 +48,21 @@ GET NS Performance Monitoring Jobs with exclude_default attribute selector
		${output}= Output response
		Set Suite Variable ${response} ${output}

		GET NS Performance Monitoring Jobs with include attribute selector
		GET NS Performance Monitoring Jobs with fields attribute selector
		Log Trying to get all NS Packages present in the NFVO, using filter params
		Pass Execution If ${FIELD_USAGE} == 0 Skipping test as NFVO is not supporting 'fields'
		Set Headers {"Accept": "${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization": "${AUTHORIZATION}"}
		GET ${apiRoot}/${apiName}/${apiMajorVersion}/pm_jobs?include=${fields}
		GET ${apiRoot}/${apiName}/${apiMajorVersion}/pm_jobs?fields=${fields}
		${output}= Output response
		Set Suite Variable ${response} ${output}

		GET NS Performance Monitoring Jobs with fields and exclude_default attribute selector
		Log Trying to get all NS Packages present in the NFVO, using filter params
		Pass Execution If ${FIELD_USAGE} == 0 Skipping test as NFVO is not supporting 'fields'
		Set Headers {"Accept": "${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization": "${AUTHORIZATION}"}
		GET ${apiRoot}/${apiName}/${apiMajorVersion}/pm_jobs?fields=${fields}&exclude_default
		${output}= Output response
		Set Suite Variable ${response} ${output}

		@@ -117,9 +126,6 @@ Send DELETE Request for all NS Performance Monitoring Jobs
		${output}= Output response
		Set Suite Variable ${response} ${output}

		Check Postcondition NS Performance Monitoring Jobs Exist
		Log Checking that Pm Job still exists
		GET all NS Performance Monitoring Jobs

		Check Postcondition PmJob Exists
		Log Checking that Pm Job exists
		@@ -140,7 +146,7 @@ Check HTTP Response Body PmJobs Matches the requested exclude selector
		Should Be Empty ${criteria}
		Log Reports element is empty as expected

		Check HTTP Response Body PmJobs Matches the requested include selector
		Check HTTP Response Body PmJobs Matches the requested selector
		Log Trying to validate criteria schema
		${criteria}= Get Value From Json ${response['body']} $..criteria
		Validate Json criteria.schema.json ${criteria}
		@@ -321,26 +327,6 @@ Send Delete request for Individual Performance Report
		${output}= Output response
		Set Suite Variable ${response} ${output}

		Check Postcondition NS Individual Performance Report Exists
		Log Checking that report still exists
		Get Individual Performance Report

		Check Postcondition NS Individual Performance Report is not Created
		Log Trying to get a new report
		Set Headers {"Accept": "${ACCEPT_JSON}"}
		Run Keyword If ${AUTH_USAGE} == 1 Set Headers {"Authorization": "${AUTHORIZATION}"}
		GET ${apiRoot}/${apiName}/${apiMajorVersion}/pm_jobs/${pmJobId}/reports/${newReportId}
		${output}= Output response
		Set Suite Variable ${response} ${output}
		Check HTTP Response Status Code Is 404

		Check Postcondition NS Individual Performance Report is Unmodified (Implicit)
		Log Check Postcondition VNF PM job is not modified
		Get Individual Performance Report
		Log Check Response matches original VNF report
		${report}= evaluate json.loads('''${response['body']}''') json
		Should Be Equal ${origResponse['body']['entries'][0]['objectInstanceId']} ${report['entries'][0]['objectInstanceId']}

		GET all Performance Thresholds
		Log Trying to get all thresholds present in the NFVO
		Set Headers {"Accept": "${ACCEPT_JSON}"}
		@@ -409,10 +395,6 @@ Send DELETE Request for all Performance Thresholds
		${output}= Output response
		Set Suite Variable ${response} ${output}

		Check Postcondition Thresholds Exist
		Log Checking that Thresholds still exists
		GET all Performance Thresholds

		Check Postcondition Threshold Exists
		Log Checking that Threshold exists
		Set Headers {"Accept": "${ACCEPT_JSON}"}

SOL005/NSPerformanceManagement-API/PMJobs.robot

+22 −8

Original line number	Diff line number	Diff line
		@@ -65,19 +65,19 @@ GET all NS Performance Monitoring Jobs with "exclude_default" attribute selector
		Check HTTP Response Body Json Schema Is PmJobs
		Check HTTP Response Body PmJobs Matches the requested exclude_default selector

		GET all NS Performance Monitoring Jobs with "include" attribute selector
		GET all NS Performance Monitoring Jobs with "fields" attribute selector
		[Documentation] Test ID: 5.3.4.1.5
		... Test title: GET all NS Performance Monitoring Jobs with "include" attribute selector
		... Test objective: The objective is to test the retrieval of all NS performance monitoring jobs "include" attribute selector, perform a JSON schema validation of the collected jobs data structure, and verify that the retrieved information matches the issued "include" selector
		... Test title: GET all NS Performance Monitoring Jobs with "fields" attribute selector
		... Test objective: The objective is to test the retrieval of all NS performance monitoring jobs "fields" attribute selector, perform a JSON schema validation of the collected jobs data structure, and verify that the retrieved information matches the issued "include" selector
		... Pre-conditions: A NS instance is instantiated. One or more NS performance jobs are set in the NFVO.
		... Reference: Clause 4.3.3.2.1, 7.4.2.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: The NFVO supports the use of "include" attribute selector
		... Post-Conditions: none
		GET NS Performance Monitoring Jobs with include attribute selector
		GET NS Performance Monitoring Jobs with fields attribute selector
		Check HTTP Response Status Code Is 200
		Check HTTP Response Body Json Schema Is PmJobs
		Check HTTP Response Body PmJobs Matches the requested include selector
		Check HTTP Response Body PmJobs Matches the requested selector

		GET all NS Performance Monitoring Jobs with "exclude" attribute selector
		[Documentation] Test ID: 5.3.4.1.6
		@@ -117,6 +117,7 @@ GET NS Performance Monitoring Jobs with invalid resource endpoint
		... Post-Conditions: none
		GET NS Performance Monitoring Jobs with invalid resource endpoint
		Check HTTP Response Status Code Is 404
		Check HTTP Response Body Json Schema Is ProblemDetails

		Create new NS Performance Monitoring Job
		[Documentation] Test ID: 5.3.4.1.9
		@@ -164,10 +165,9 @@ DELETE all NS Performance Monitoring Jobs - Method not implemented
		... Reference: Clause 7.4.2.3.5 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS Performance Monitoring Jobs are not deleted by the failed operation
		... Post-Conditions: none
		Send PATCH Request for all NS Performance Monitoring Jobs
		Check HTTP Response Status Code Is 405
		Check Postcondition NS Performance Monitoring Jobs Exist

		GET all NS Performance Monitoring Jobs as Paged Response
		[Documentation] Test ID: 5.3.4.1.13
		@@ -194,3 +194,17 @@ GET NS Performance Monitoring Jobs - Bad Request Response too Big
		GET all NS Performance Monitoring Jobs
		Check HTTP Response Status Code Is 400
		Check HTTP Response Body Json Schema Is ProblemDetails

		GET all NS Performance Monitoring Jobs with "fields" and "exclude_default" attribute selector
		[Documentation] Test ID: 5.3.4.1.15
		... Test title: GET all NS Performance Monitoring Jobs with "fields" and "exclude_default" attribute selector
		... Test objective: The objective is to test the retrieval of all NS performance monitoring jobs "fields" and "exclude_default" attribute selector, perform a JSON schema validation of the collected jobs data structure, and verify that the retrieved information matches the issued selector
		... Pre-conditions: A NS instance is instantiated. One or more NS performance jobs are set in the NFVO.
		... Reference: Clause 4.3.3.2.1, 7.4.2.3.2 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: The NFVO supports the use of "include" attribute selector
		... Post-Conditions: none
		GET NS Performance Monitoring Jobs with fields and exclude_default attribute selector
		Check HTTP Response Status Code Is 200
		Check HTTP Response Body Json Schema Is PmJobs
		Check HTTP Response Body PmJobs Matches the requested selector
		No newline at end of file

SOL005/NSPerformanceManagement-API/Thresholds.robot

+2 −2

Original line number	Diff line number	Diff line
		@@ -47,6 +47,7 @@ GET Performance Thresholds with invalid attribute-based filter
		... Post-Conditions: none
		GET Performance Thresholds with invalid attribute-based filter
		Check HTTP Response Status Code Is 404
		Check HTTP Response Body Json Schema Is ProblemDetails

		GET Performance Thresholds with invalid resource endpoint
		[Documentation] Test ID: 5.3.4.4.4
		@@ -108,10 +109,9 @@ DELETE Performance Thresholds - Method not implemented
		... Reference: Clause 7.4.5.3.5 - ETSI GS NFV-SOL 005 [3] v2.7.1
		... Config ID: Config_prod_NFVO
		... Applicability: none
		... Post-Conditions: The NS performance thresholds are not deleted by the failed operation
		... Post-Conditions: none
		Send DELETE Request for all Performance Thresholds
		Check HTTP Response Status Code Is 405
		Check Postcondition Thresholds Exist

		GET All Performance Thresholds as Paged Response
		[Documentation] Test ID: 5.3.4.4.9

Admin message