new documentation for tests

Giacomo Berninirequested to merge
(removed):master into master

Merge request reports

SOL002/VNFFaultManagement-API/environment/variables.txt

+8 −0
Changes for SOL002/VNFFaultManagement-API/environment/variables.txt: 8 added lines, 0 removed lines.
Original line number Diff line number Diff line
@@ -30,8 +30,16 @@ ${subscriptionId} 6fc3539c-e602-4afa-8e13-962fb5a7d81f 
${callback_uri}    http://localhost

${callback_port}    9091

${callback_endpoint}    /endpoint

${callback_endpoint_fwd}    /endpoint/check

${callback_endpoint_error}    /endpoint_404

${sleep_interval}    20s

${total_polling_time}   2 min

${polling_interval}     10 sec



${notification_request}    []

${notification_response}    []



${MOCK_SERVER_JAR}    ../../../bin/mockserver-netty-5.5.0-jar-with-dependencies.jar



${AlarmNotification}    {}

${AlarmClearedNotification}    {}

SOL002/VNFFaultManagement-API/NotificationEndpoint.robot

+126 −104
Changes for SOL002/VNFFaultManagement-API/NotificationEndpoint.robot: 126 added lines, 104 removed lines.
Original line number Diff line number Diff line 
*** Settings ***

Resource    environment/variables.txt 

Suite Setup    Create Sessions

Suite Teardown    Terminate All Processes    kill=true



Library    MockServerLibrary

Library    Process

Library    OperatingSystem

Library    Collections



Suite Setup    Create Sessions

Suite Teardown    Terminate All Processes    kill=true



*** Test Cases ***

Deliver a notification - Alarm

    [Documentation]    Test ID: 7.4.5.1

    ...    Test title: Deliver a notification - Alarm

    ...    Test objective: The objective is to notify a VNF alarm or that the alarm list has been rebuilt.

    ...    Pre-conditions: The VNF has subscribed to the VNFM alarm

    ...    Reference: section 7.4.5 - SOL002 v2.4.1

VNF Fault Alarm Notification

    [Documentation]    Test ID: 6.3.4.6.1

    ...    Test title: VNF Fault Alarm Notification

    ...    Test objective: The objective is to test the dispatch of VNF Fault Alarm Notification when a virtualised resource within an VNF instance fails, and perform a JSON schema and content validation of the delivered notification

    ...    Pre-conditions: A VNF instance is instantiated, and a subscription for fault alarm notifications is available in the VNFM.

    ...    Reference:  section 7.4.7.3.1 - SOL002 v2.4.1

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: 

    ...    Post-Conditions:   

    log    The POST method delivers a notification - Information of a VNF alarm.

    ${json}=	Get File	schemas/alarmNotification.schema.json

    ${BODY}=	evaluate	json.loads('''${json}''')	json

    Log  Creating mock request and response to handle alarmNotification

    &{req}=  Create Mock Request Matcher	POST  ${callback_endpoint}  body_type="JSON_SCHEMA"    body=${BODY}

    &{rsp}=  Create Mock Response	headers="Content-Type: application/json"  status_code=204

    Create Mock Expectation  ${req}  ${rsp}

    Log  Verifying results

    Wait Until Keyword Succeeds    ${sleep_interval}    Verify Mock Expectation    ${req}

    Log  Cleaning the endpoint

    Clear Requests  ${callback_endpoint}

    ...    Applicability: none

    ...    Post-Conditions: none 

    Trigger the fault of a virtualised resource in the VNF instance (external action) 

    Check Alarm Notification Http POST Request Body Json Schema Is    alarmNotification

    Check Alarm Notification Http POST Request Body notificationType attribute Is    alarmNotification



Deliver a notification - Alarm Clearance

    [Documentation]    Test ID: 7.4.5.2

    ...    Test title: Deliver a notification - Alarm Clearance

    ...    Test objective: The objective is to notify a VNF alarm or that the alarm list has been rebuilt.

    ...    Pre-conditions: The VNF has subscribed to the VNFM alarm

    ...    Reference: section 7.4.5 - SOL002 v2.4.1

VNF Fault Alarm Cleared Notification

    [Documentation]    Test ID: 6.3.4.6.2

    ...    Test title: VNF Fault Alarm Cleared Notification

    ...    Test objective: The objective is to test the dispatch of VNF Fault Alarm Cleared Notification when a faulty virtualised resource within an VNF instance is cleared, and perform a JSON schema and content validation of the delivered notification

    ...    Pre-conditions: A VNF instance is instantiated, a virtualised resource is in faulty state, and a subscription for fault alarm cleared notifications is available in the VNFM.

    ...    Reference:  section 7.4.7.3.1 - SOL002 v2.4.1

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: 

    ...    Post-Conditions:   

    log    The POST method delivers a notification - Information of a VNF alarm.

    ${json}=	Get File	schemas/alarmClearedNotification.schema.json

    ${BODY}=	evaluate	json.loads('''${json}''')	json

    Log  Creating mock request and response to handle alarmNotification

    &{req}=  Create Mock Request Matcher	POST  ${callback_endpoint}  body_type="JSON_SCHEMA"    body=${BODY}

    &{rsp}=  Create Mock Response	headers="Content-Type: application/json"  status_code=204

    Create Mock Expectation  ${req}  ${rsp}

    Log  Verifying results

    Wait Until Keyword Succeeds    ${sleep_interval}    Verify Mock Expectation    ${req}

    Log  Cleaning the endpoint

    Clear Requests  ${callback_endpoint}

    ...    Applicability: none

    ...    Post-Conditions: none 

    Trigger the fault cleared of a virtualised resource in the VNF instance (external action) 

    Check Alarm cleared Notification Http POST Request Body Json Schema Is    alarmClearedNotification

    Check Alarm cleared Notification Http POST Request Body notificationType attribute Is    alarmClearedNotification



Deliver a notification - Alarm List Rebuilt

    [Documentation]    Test ID: 7.4.5.3

    ...    Test title: Deliver a notification - Alarm List Rebuilt

    ...    Test objective: The objective is to notify a VNF alarm or that the alarm list has been rebuilt.

    ...    Pre-conditions: The VNF has subscribed to the VNFM alarm

    ...    Reference: section 7.4.5 - SOL002 v2.4.1

VNF Fault Alarm List Rebuilt Notification 

    [Documentation]    Test ID: 6.3.4.6.3

    ...    Test title: VNF Fault Alarm List Rebuilt Notification 

    ...    Test objective: The objective is to test the dispatch of VNF Fault Alarm List Rebuilt Notification when the VNFM decides to rebuild the list of its VNF alarms, e.g. due to a corruption in the alarm storage, and perform a JSON schema and content validation of the delivered notification

    ...    Pre-conditions: A VNF instance is instantiated, one or more virtualised resource are in faulty state, and a subscription for fault alarm list rebuilt notifications is available in the VNFM.

    ...    Reference:  section 7.4.7.3.1 - SOL002 v2.4.1

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: 

    ...    Post-Conditions:  

    log    The POST method delivers a notification - Information of a VNF alarm.

    ${json}=	Get File	schemas/alarmListRebuiltNotification.schema.json

    ${BODY}=	evaluate	json.loads('''${json}''')	json

    Log  Creating mock request and response to handle alarmNotification

    &{req}=  Create Mock Request Matcher  POST  ${callback_endpoint}  body_type="JSON_SCHEMA"    body=${BODY}

    &{rsp}=  Create Mock Response	headers="Content-Type: application/json"  status_code=204

    Create Mock Expectation  ${req}  ${rsp}

    Log  Verifying results

    Wait Until Keyword Succeeds    ${sleep_interval}    Verify Mock Expectation    ${req}

    Log  Cleaning the endpoint

    Clear Requests  ${callback_endpoint}

    ...    Applicability: none

    ...    Post-Conditions: none 

    Trigger the VNF fault alarm list rebuild in the NFVO (external action) 

    Check Alarm list rebuilt Notification Http POST Request Body Json Schema Is    alarmListRebuiltNotification

    Check Alarm list rebuilt Notification Http POST Request Body notificationType attribute Is    alarmListRebuiltNotification



Test a notification end point

    [Documentation]    Test ID: 7.4.5.4

    ...    Test title: Test a notification end point

    ...    Test objective: The objective is to allow the server to test the notification endpoint that is provided by the client, e.g. during subscription

    ...    Pre-conditions: 

    ...    Reference: section 7.4.5 - SOL002 v2.4.1

    ...    Config ID: Config_prod_VNFM

    ...    Applicability: 

    ...    Post-Conditions:  

    log    The GET method allows the server to test the notification endpoint

    &{req}=  Create Mock Request Matcher	GET  ${callback_endpoint}    

    &{rsp}=  Create Mock Response	headers="Content-Type: application/json"  status_code=204

    Create Mock Expectation  ${req}  ${rsp}

    Sleep  ${sleep_interval}

    Verify Mock Expectation  ${req}

    Clear Requests  ${callback_endpoint}



PUT notification - Method not implemented

    Log  PUT Method not implemented

    &{req}=  Create Mock Request Matcher	PUT  ${callback_endpoint}

    &{rsp}=  Create Mock Response  status_code=405

    Create Mock Expectation  ${req}  ${rsp}

    Sleep  ${sleep_interval}

    Log  Verifying results

    Verify Mock Expectation  ${req}

    Log  Cleaning the endpoint

*** Keywords ***

Trigger the fault of a virtualised resource in the VNF instance (external action)  

    #do nothing

    Log    do nothing



Trigger the fault cleared of a virtualised resource in the VNF instance (external action) 

    #do nothing

    Log    do nothing   



Trigger the VNF fault alarm list rebuild in the NFVO (external action) 

    #do nothing

    Log    do nothing 



Check Alarm List Rebuilt Notification Http POST Request Body Json Schema Is    

    [Arguments]    ${element}

    ${schema}=	Get File	schemas/${element}.schema.json

    Configure Notification Forward    ${schema}    ${callback_endpoint}    ${callback_endpoint_fwd}



Check Alarm List Rebuilt Notification Http POST Request Body notificationType attribute Is

    [Arguments]    ${type}

    Configure Notification Alarm List Rebuilt Handler    ${callback_endpoint_fwd}    ${type}

    Wait Until Keyword Succeeds    2 min   10 sec   Verify Mock Expectation    ${notification_request}

    Clear Requests    ${callback_endpoint}

    Clear Requests    ${callback_endpoint_fwd}



PATCH subscriptions - Method not implemented

    Log  PATCH Method not implemented

    &{req}=  Create Mock Request Matcher	PATCH  ${callback_endpoint}

    &{rsp}=  Create Mock Response  status_code=405

    Create Mock Expectation  ${req}  ${rsp}

    Sleep  ${sleep_interval}

    Log  Verifying results

    Verify Mock Expectation  ${req}

    Log  Cleaning the endpoint

Check Alarm Notification Http POST Request Body Json Schema Is    

    [Arguments]    ${element}

    ${schema}=	Get File	schemas/${element}.schema.json

    Configure Notification Forward    ${schema}    ${callback_endpoint}    ${callback_endpoint_fwd}



Check Alarm Notification Http POST Request Body notificationType attribute Is

    [Arguments]    ${type}

    Configure Notification Alarm Handler    ${callback_endpoint_fwd}    ${type}

    Wait Until Keyword Succeeds    2 min   10 sec   Verify Mock Expectation    ${notification_request}

    Clear Requests    ${callback_endpoint}

    Clear Requests    ${callback_endpoint_fwd}



Check Alarm cleared Notification Http POST Request Body Json Schema Is    

    [Arguments]    ${element}

    ${schema}=	Get File	schemas/${element}.schema.json

    Configure Notification Forward    ${schema}    ${callback_endpoint}    ${callback_endpoint_fwd}

    

DELETE subscriptions - Method not implemented

    Log  DELETE Method not implemented

    &{req}=  Create Mock Request Matcher	DELETE  ${callback_endpoint}

    &{rsp}=  Create Mock Response  status_code=405

    Create Mock Expectation  ${req}  ${rsp}

    Sleep  ${sleep_interval}

    Log  Verifying results

    Verify Mock Expectation  ${req}

    Log  Cleaning the endpoint



Check Alarm cleared Notification Http POST Request Body notificationType attribute Is

    [Arguments]    ${type}

    Configure Notification Alarm Cleareance Handler    ${callback_endpoint_fwd}    ${type}

    Wait Until Keyword Succeeds    2 min   10 sec   Verify Mock Expectation    ${notification_request}

    Clear Requests    ${callback_endpoint}

    Clear Requests    ${callback_endpoint_fwd}

    

    

Check Alarm Clerance Notification Http POST Request Body changeType attribute Is

    [Arguments]    ${type}

    #do nothing

    Log    do nothing 

    



Configure Notification Alarm List Rebuilt Handler

    [Arguments]    ${endpoint}    ${type}

    ${json}=    evaluate    {}

    set to dictionary    ${json}    notificationType    ${type}    

    ${BODY}=    evaluate    json.dumps(${json})    json

    Log  Creating mock request and response to handle status notification

    &{notification_request}=  Create Mock Request Matcher	POST  ${endpoint}  body_type="JSON"    body=${BODY}

    &{notification_response}=  Create Mock Response	headers="Content-Type: application/json"  status_code=204

    Create Mock Expectation  ${notification_request}  ${notification_response}



Configure Notification Alarm Handler

    [Arguments]    ${endpoint}    ${type}

    ${json}=    evaluate    {}

    set to dictionary    ${json}    notificationType    ${type}    

    ${BODY}=    evaluate    json.dumps(${json})    json

    Log  Creating mock request and response to handle status notification

    &{notification_request}=  Create Mock Request Matcher	POST  ${endpoint}  body_type="JSON"    body=${BODY}

    &{notification_response}=  Create Mock Response	headers="Content-Type: application/json"  status_code=204

    Create Mock Expectation  ${notification_request}  ${notification_response}



Configure Notification Alarm Cleareance Handler

    [Arguments]    ${endpoint}    ${type}

    ${json}=    evaluate    {}

    set to dictionary   ${json}    notificationType    ${type}

    ${BODY}=    evaluate    json.dumps(${json})    json

    Log  Creating mock request and response to handle status notification

    &{notification_request}=  Create Mock Request Matcher	POST  ${endpoint}  body_type="JSON"    body=${BODY}

    &{notification_response}=  Create Mock Response	headers="Content-Type: application/json"  status_code=204

    Create Mock Expectation  ${notification_request}  ${notification_response}

  

Configure Notification Forward

    [Arguments]    ${schema}    ${endpoint}    ${endpoint_fwd}    

    Log  Creating mock Http POST forward to handle ${schema}

    &{notification_tmp}=  Create Mock Request Matcher	POST  ${endpoint}  body_type="JSON_SCHEMA"    body=${schema}

    &{notification_fwd}=  Create Mock Http Forward	${endpoint_fwd}

    Create Mock Expectation With Http Forward  ${notification_tmp}  ${notification_fwd}

    

*** Keywords ***

Create Sessions

    Start Process  java  -jar  ../../bin/mockserver-netty-5.5.0-jar-with-dependencies.jar  -serverPort  ${callback_port}  alias=mockInstance

    Wait For Process  handle=mockInstance  timeout=5s  on_timeout=continue

    Create Mock Session  ${callback_uri}:${callback_port}     #The API producer is set to NFVO according to SOL002-7.3.4

SOL002/VNFIndicatorNotification-API/environment/variables.txt

+7 −0
Changes for SOL002/VNFIndicatorNotification-API/environment/variables.txt: 7 added lines, 0 removed lines.
Original line number Diff line number Diff line
@@ -2,6 +2,13 @@ 
${callback_uri}    http://localhost

${callback_port}    9091

${callback_endpoint}    /endpoint

${callback_endpoint_fwd}    /endpoint/check

${callback_endpoint_error}    /endpoint_404

${sleep_interval}    20s

${total_polling_time}   2 min

${polling_interval}     10 sec



${notification_request}    []

${notification_response}    []



${MOCK_SERVER_JAR}    ../../../bin/mockserver-netty-5.5.0-jar-with-dependencies.jar

SOL002/VNFIndicatorNotification-API/VnfIndicatorNotification.robot

+40 −65
Changes for SOL002/VNFIndicatorNotification-API/VnfIndicatorNotification.robot: 40 added lines, 65 removed lines.
Original line number Diff line number Diff line
@@ -11,81 +11,56 @@ Library String 




*** Test Cases ***

Check Notification Endpoint

    &{req}=  Create Mock Request Matcher	GET  ${callback_endpoint}    

    &{rsp}=  Create Mock Response	headers="Content-Type: application/json"  status_code=204

    Create Mock Expectation  ${req}  ${rsp}

    Sleep  ${sleep_interval}

    Verify Mock Expectation  ${req}

    Clear Requests  ${callback_endpoint}

VNF Indicator Value Change Notification

    [Documentation]    Test ID: 6.3.2.6.1

    ...    Test title: VNF Indicator Value Change Notification

    ...    Test objective: The objective is to test the dispatch of VNF Indicator Value Change Notification when new indicator values are available in the VNF, and perform a JSON schema and content validation of the delivered notification

    ...    Pre-conditions: A VNF is instantiated, and a subscription for indicator value change notifications is available in the VNF.

    ...    Reference:  section 8.4.7.3.1 - SOL002 v2.4.1

    ...    Config ID: Config_prod_VNF

    ...    Applicability: none

    ...    Post-Conditions: none 

    Trigger the availability of new indicator value in the VNF (external action) 

    Check Indicator Value Change Notification Http POST Request Body Json Schema Is    VnfIndicatorValueChangeNotification

    Check Indicator Value Change Notification Http POST Request Body notificationType attribute Is    VnfIndicatorValueChangeNotification



Post VNF Indicator Notification

    ${json}=	Get File	schemas/VnfIndicatorValueChangeNotification.schema.json

    ${BODY}=	evaluate	json.loads('''${json}''')	json

    Log  Creating mock request and response to handle VNF Indicator Notification

    &{req}=  Create Mock Request Matcher	POST  ${callback_endpoint}  body_type="JSON_SCHEMA"    body=${BODY}

    &{rsp}=  Create Mock Response	headers="Content-Type: application/json"  status_code=204

    Create Mock Expectation  ${req}  ${rsp}

    Sleep  ${sleep_interval}

    Log  Verifying results

    Verify Mock Expectation  ${req}

    Log  Cleaning the endpoint

    Clear Requests  ${callback_endpoint}



Post VNF Indicator Notification Negative 404 

    ${json}=	Get File	schemas/ProblemDetails.schema.json

    ${BODY}=	evaluate	json.loads('''${json}''')	json

    Log  Creating mock request and response to handle VNF Indicator Notification to handle 404 error

    &{req}=  Create Mock Request Matcher	POST  ${callback_endpoint_error}  body_type="JSON_SCHEMA"    body=${BODY}

    &{rsp}=  Create Mock Response	headers="Content-Type: application/json"  status_code=404

    Create Mock Expectation  ${req}  ${rsp}

    Sleep  ${sleep_interval}

    Log  Verifying results

    Verify Mock Expectation  ${req}

    Log  Cleaning the endpoint

    Clear Requests  ${callback_endpoint}

*** Keywords ***

Trigger the availability of new indicator value in the VNF (external action) 

    #do nothing

    Log    do nothing

 

  

Check Indicator Value Change Notification Http POST Request Body Json Schema Is    

    [Arguments]    ${element}

    ${schema}=	Get File	schemas/${element}.schema.json

    Configure Notification Forward    ${schema}    ${callback_endpoint}    ${callback_endpoint_fwd}



PUT VNF Indicator Notification 

    Log  PUT Method not implemented

    &{req}=  Create Mock Request Matcher	PUT  ${callback_endpoint}

    &{rsp}=  Create Mock Response  status_code=405

    Create Mock Expectation  ${req}  ${rsp}

    Sleep  ${sleep_interval}

    Log  Verifying results

    Verify Mock Expectation  ${req}

    Log  Cleaning the endpoint

Check Indicator Value Change Notification Http POST Request Body notificationType attribute Is

    [Arguments]    ${type}

    Configure Notification Indicator Value Change Handler    ${callback_endpoint_fwd}    ${type}

    Wait Until Keyword Succeeds    2 min   10 sec   Verify Mock Expectation    ${notification_request}

    Clear Requests    ${callback_endpoint}

    Clear Requests    ${callback_endpoint_fwd}  

    

Configure Notification Indicator Value Change Handler

    [Arguments]    ${endpoint}    ${type}

    ${json}=    evaluate    {}

    set to dictionary    ${json}    notificationType    ${type}    

    ${BODY}=    evaluate    json.dumps(${json})    json

    Log  Creating mock request and response to handle status notification

    &{notification_request}=  Create Mock Request Matcher	POST  ${endpoint}  body_type="JSON"    body=${BODY}

    &{notification_response}=  Create Mock Response	headers="Content-Type: application/json"  status_code=204

    Create Mock Expectation  ${notification_request}  ${notification_response}



PATCH VNF Indicator Notification 

    Log  PATCH Method not implemented

    &{req}=  Create Mock Request Matcher	PATCH  ${callback_endpoint}

    &{rsp}=  Create Mock Response  status_code=405

    Create Mock Expectation  ${req}  ${rsp}

    Sleep  ${sleep_interval}

    Log  Verifying results

    Verify Mock Expectation  ${req}

    Log  Cleaning the endpoint

    Clear Requests  ${callback_endpoint}

    

Configure Notification Forward

    [Arguments]    ${schema}    ${endpoint}    ${endpoint_fwd}    

    Log  Creating mock Http POST forward to handle ${schema}

    &{notification_tmp}=  Create Mock Request Matcher	POST  ${endpoint}  body_type="JSON_SCHEMA"    body=${schema}

    &{notification_fwd}=  Create Mock Http Forward	${endpoint_fwd}

    Create Mock Expectation With Http Forward  ${notification_tmp}  ${notification_fwd}



DELETE VNF Indicator Notification 

    Log  PATCH Method not implemented

    &{req}=  Create Mock Request Matcher	DELETE  ${callback_endpoint}

    &{rsp}=  Create Mock Response  status_code=405

    Create Mock Expectation  ${req}  ${rsp}

    Sleep  ${sleep_interval}

    Log  Verifying results

    Verify Mock Expectation  ${req}

    Log  Cleaning the endpoint

    Clear Requests  ${callback_endpoint}

    



*** Keywords ***

Create Sessions

    Start Process  java  -jar  ${MOCK_SERVER_JAR}  -serverPort  ${callback_port}  alias=mockInstance

    Wait For Process  handle=mockInstance  timeout=5s  on_timeout=continue

    Create Mock Session  ${callback_uri}:${callback_port}
 
 No newline at end of file
 
    
 No newline at end of file

SOL002/VNFPerformanceManagementNotification-API/environment/notifications.txt

0 → 100644
+12 −0
Changes for SOL002/VNFPerformanceManagementNotification-API/environment/notifications.txt: 12 added lines, 0 removed lines.
Original line number Diff line number Diff line 
*** Variables ***

${callback_uri}    http://localhost

${callback_port}    9091

${callback_endpoint}    /endpoint

${callback_endpoint_fwd}    /endpoint/check

${callback_endpoint_error}    /endpoint_404

${sleep_interval}    20s

${total_polling_time}   2 min

${polling_interval}     10 sec



${notification_request}    []

${notification_response}    []
 
 No newline at end of file