SuccessConsole Output

Skipping 214 KB.. Full Log
========================================
GET Individual VNF Package Content :: Test ID: 7.3.3.3.1              | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content with Range Request and NFVO sup... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content with Range Request and NFVO not... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content with invalid Range Request :: T... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content with invalid resource identifie... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content with conflict due to onboarding... | PASS |
------------------------------------------------------------------------------
POST Individual VNF Package Content - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PUT Individual VNF Package Content - Method not implemented :: Tes... | PASS |
------------------------------------------------------------------------------
PATCH Individual VNF Package Content - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Package Content - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
GET Individual OnBoarded VNF Package Content :: Test ID: 7.3.3.3.11   | PASS |
------------------------------------------------------------------------------
GET Individual OnBoarded VNF Package Content with Range Request an... | PASS |
------------------------------------------------------------------------------
GET Individual OnBoarded VNF Package Content with Range Request an... | PASS |
------------------------------------------------------------------------------
GET Individual OnBoarded VNF Package Content with invalid Range Re... | PASS |
------------------------------------------------------------------------------
GET Individual OnBoarded VNF Package Content with invalid resource... | PASS |
------------------------------------------------------------------------------
GET Individual OnBoarded VNF Package Content with conflict due to ... | PASS |
------------------------------------------------------------------------------
POST Individual OnBoarded VNF Package Content - Method not impleme... | PASS |
------------------------------------------------------------------------------
PUT Individual OnBoarded VNF Package Content - Method not implemen... | PASS |
------------------------------------------------------------------------------
PATCH Individual OnBoarded VNF Package Content - Method not implem... | PASS |
------------------------------------------------------------------------------
DELETE Individual OnBoarded VNF Package Content - Method not imple... | PASS |
------------------------------------------------------------------------------
VNFPackageContent                                                     | PASS |
20 critical tests, 20 passed, 0 failed
20 tests total, 20 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VNFPackageManagement-API/VNFPackages.robot
==============================================================================
VNFPackages                                                                   
==============================================================================
GET all VNF Packages :: Test ID: 7.3.3.1.1                            | PASS |
------------------------------------------------------------------------------
GET VNF Packages with attribute-based filter :: Test ID: 7.3.3.1.2    | PASS |
------------------------------------------------------------------------------
GET VNF Packages with invalid attribute-based filter :: Test ID: 7... | PASS |
------------------------------------------------------------------------------
GET VNF Packages with "all_fields" attribute selector :: Test ID: ... | PASS |
------------------------------------------------------------------------------
GET VNF Packages with "exclude_default" attribute selector :: Test... | PASS |
------------------------------------------------------------------------------
GET VNF Packages with "fields" attribute selector :: Test ID: 7.3.... | PASS |
------------------------------------------------------------------------------
GET VNF Packages with "exclude_fields" attribute selector :: Test ... | PASS |
------------------------------------------------------------------------------
GET all VNF Packages with invalid resource endpoint :: Test ID: 7.... | PASS |
------------------------------------------------------------------------------
POST all VNF Packages - Method not implemented :: Test ID: 7.3.3.1.9  | PASS |
------------------------------------------------------------------------------
PUT all VNF Packages - Method not implemented :: Test ID: 7.3.3.1.10  | PASS |
------------------------------------------------------------------------------
PATCH all VNF Packages - Method not implemented :: Test ID: 7.3.3.... | PASS |
------------------------------------------------------------------------------
DELETE all VNF Packages - Method not implemented :: Test ID: 7.3.3... | PASS |
------------------------------------------------------------------------------
GET all VNF Packages as a Paged Response :: Test ID: 7.3.3.1.13       | PASS |
------------------------------------------------------------------------------
GET VNF Packages - Bad Request Response too Big :: Test ID: 7.3.3.... | PASS |
------------------------------------------------------------------------------
GET all OnBoarded VNF Packages :: Test ID: 7.3.3.1.15                 | PASS |
------------------------------------------------------------------------------
GET OnBoarded VNF Packages with attribute-based filter :: Test ID:... | PASS |
------------------------------------------------------------------------------
GET OnBoarded VNF Packages with invalid attribute-based filter :: ... | PASS |
------------------------------------------------------------------------------
GET OnBoarded VNF Packages with "all_fields" attribute selector ::... | PASS |
------------------------------------------------------------------------------
GET OnBoarded VNF Packages with "exclude_default" attribute select... | PASS |
------------------------------------------------------------------------------
GET OnBoarded VNF Packages with "fields" attribute selector :: Tes... | PASS |
------------------------------------------------------------------------------
GET OnBoarded VNF Packages with "exclude_fields" attribute selecto... | PASS |
------------------------------------------------------------------------------
GET all OnBoarded VNF Packages with invalid resource endpoint :: T... | PASS |
------------------------------------------------------------------------------
POST all OnBoarded VNF Packages - Method not implemented :: Test I... | PASS |
------------------------------------------------------------------------------
PUT all OnBoarded VNF Packages - Method not implemented :: Test ID... | PASS |
------------------------------------------------------------------------------
PATCH all OnBoarded VNF Packages - Method not implemented :: Test ... | PASS |
------------------------------------------------------------------------------
DELETE all OnBoarded VNF Packages - Method not implemented :: Test... | PASS |
------------------------------------------------------------------------------
GET all OnBoarded VNF Packages as a Paged Response :: Test ID: 7.3... | PASS |
------------------------------------------------------------------------------
GET OnBoarded VNF Packages - Bad Request Response too Big :: Test ... | PASS |
------------------------------------------------------------------------------
VNFPackages                                                           | PASS |
28 critical tests, 28 passed, 0 failed
28 tests total, 28 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VNFPerformanceManagement-API/ApiVersion.robot
==============================================================================
ApiVersion                                                                    
==============================================================================
POST API Version - Method not implemented :: Test ID: 7.3.4.9.1       | PASS |
------------------------------------------------------------------------------
GET API Version :: Test ID: 7.3.4.9.2                                 | PASS |
------------------------------------------------------------------------------
PUT API Version - Method not implemented :: Test ID: 7.3.4.9.3        | PASS |
------------------------------------------------------------------------------
PATCH API Version - Method not implemented :: Test ID: 7.3.4.9.4      | PASS |
------------------------------------------------------------------------------
DELETE API Version - Method not implemented :: Test ID: 7.3.4.9.5     | PASS |
------------------------------------------------------------------------------
POST API Version with apiMajorVerion - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
GET API Version with apiMajorVerion :: Test ID: 7.3.4.9.7             | PASS |
------------------------------------------------------------------------------
PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS |
------------------------------------------------------------------------------
ApiVersion                                                            | PASS |
10 critical tests, 10 passed, 0 failed
10 tests total, 10 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualPmJob.robot
==============================================================================
IndividualPmJob                                                               
==============================================================================
GET individual VNF Performance Job :: Test ID: 7.3.4.2.1              | PASS |
------------------------------------------------------------------------------
GET individual VNF Performance Job with invalid resource identifie... | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Performance Job :: Test ID: 7.3.4.2.3           | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Performance Job with invalid resource identi... | PASS |
------------------------------------------------------------------------------
POST Individual VNF Performance Job - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PUT Individual VNF Performance Job - Method not implemented :: Tes... | PASS |
------------------------------------------------------------------------------
PATCH Individual VNF Performance Job - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
IndividualPmJob                                                       | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualReport.robot
==============================================================================
IndividualReport                                                              
==============================================================================
Get Individual Performance Report :: Test ID: 7.3.4.3.1               | PASS |
------------------------------------------------------------------------------
Get Individual Performance Report with invalid resource endpoint :... | PASS |
------------------------------------------------------------------------------
POST Individual Performance Report - Method not implemented :: Tes... | PASS |
------------------------------------------------------------------------------
PUT Individual Performance Report - Method not implemented :: Test... | PASS |
------------------------------------------------------------------------------
PATCH Individual Performance Report - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
DELETE Individual Performance Report - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
IndividualReport                                                      | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualSubscription.robot
==============================================================================
IndividualSubscription                                                        
==============================================================================
GET Individual VNF Performance Subscription :: Test ID: 7.3.4.7.1     | PASS |
------------------------------------------------------------------------------
GET Individual VNF Performance Subscription with invalid resource ... | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Performance Subscription :: Test ID: 7.3.4.7.3  | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Performance Subscription with invalid resour... | PASS |
------------------------------------------------------------------------------
POST Individual VNF Performance Subscription - Method not implemen... | PASS |
------------------------------------------------------------------------------
PUT Individual VNF Performance Subscription - Method not implement... | PASS |
------------------------------------------------------------------------------
PATCH Individual VNF Performance Subscription - Method not impleme... | PASS |
------------------------------------------------------------------------------
IndividualSubscription                                                | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualThreshold.robot
==============================================================================
IndividualThreshold                                                           
==============================================================================
GET Individual Threshold :: Test ID: 7.3.4.5.1                        | PASS |
------------------------------------------------------------------------------
GET Individual Threshold with invalid resource identifier :: Test ... | PASS |
------------------------------------------------------------------------------
DELETE Individual Threshold :: Test ID: 7.3.4.5.3                     | PASS |
------------------------------------------------------------------------------
DELETE Individual Threshold with invalid resource identifier :: Te... | PASS |
------------------------------------------------------------------------------
POST Individual Threshold - Method not implemented :: Test ID: 7.3... | PASS |
------------------------------------------------------------------------------
PUT Individual Threshold - Method not implemented :: Test ID: 7.3.... | PASS |
------------------------------------------------------------------------------
PATCH Individual Threshold - Method not implemented :: Test ID: 7.... | PASS |
------------------------------------------------------------------------------
IndividualThreshold                                                   | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VNFPerformanceManagement-API/PMJobs.robot
==============================================================================
PMJobs                                                                        
==============================================================================
GET all VNF Performance Monitoring Jobs :: Test ID: 7.3.4.1.1         | PASS |
------------------------------------------------------------------------------
GET VNF Performance Monitoring Jobs with attribute-based filter ::... | PASS |
------------------------------------------------------------------------------
GET all VNF Performance Monitoring Jobs with all_fields attribute ... | PASS |
------------------------------------------------------------------------------
GET all VNF Performance Monitoring Jobs with exclude_default attri... | PASS |
------------------------------------------------------------------------------
GET all VNF Performance Monitoring Jobs with fields attribute sele... | PASS |
------------------------------------------------------------------------------
GET all VNF Performance Monitoring Jobs with exclude_fields attrib... | PASS |
------------------------------------------------------------------------------
GET VNF Performance Monitoring Jobs with invalid attribute-based f... | PASS |
------------------------------------------------------------------------------
GET VNF Performance Monitoring Jobs with invalid resource endpoint... | PASS |
------------------------------------------------------------------------------
Create new VNF Performance Monitoring Job :: Test ID: 7.3.4.1.9       | PASS |
------------------------------------------------------------------------------
PUT all VNF Performance Monitoring Jobs - Method not implemented :... | PASS |
------------------------------------------------------------------------------
PATCH all VNF Performance Monitoring Jobs - (Method not implemente... | PASS |
------------------------------------------------------------------------------
DELETE all VNF Performance Monitoring Jobs - Method not implemente... | PASS |
------------------------------------------------------------------------------
GET all VNF Performance Monitoring Jobs as Paged Response :: Test ... | PASS |
------------------------------------------------------------------------------
GET VNF Performance Monitoring Jobs - Bad Request Response too Big... | PASS |
------------------------------------------------------------------------------
PMJobs                                                                | PASS |
14 critical tests, 14 passed, 0 failed
14 tests total, 14 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VNFPerformanceManagement-API/PerformanceManagementNotification.robot
==============================================================================
PerformanceManagementNotification                                             
==============================================================================
VNF Performance Information Availability Notification :: Test ID: ... | PASS |
------------------------------------------------------------------------------
VNF Threshold Crossed Notification :: Test ID: 7.3.4.8.2              | PASS |
------------------------------------------------------------------------------
PerformanceManagementNotification                                     | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VNFPerformanceManagement-API/Subscriptions.robot
==============================================================================
Subscriptions                                                                 
==============================================================================
GET all VNF Performance Subscriptions :: Test ID: 7.3.4.6.1           | PASS |
------------------------------------------------------------------------------
GET VNF Performance Subscriptions with attribute-based filter :: T... | PASS |
------------------------------------------------------------------------------
GET VNF Performance Management Subscriptions with invalid attribut... | PASS |
------------------------------------------------------------------------------
GET VNF Performance Subscriptions with invalid resource endpoint :... | PASS |
------------------------------------------------------------------------------
Create new VNF Performance subscription :: Test ID: 7.3.4.6.5         | PASS |
------------------------------------------------------------------------------
Create duplicated VNF Performance subscription with VNFM not creat... | PASS |
------------------------------------------------------------------------------
Create duplicated VNF Performance subscription with VNFM creating ... | PASS |
------------------------------------------------------------------------------
PUT VNF Performance Subscriptions - Method not implemented :: Test... | PASS |
------------------------------------------------------------------------------
PATCH VNF Performance Subscriptions - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
DELETE VNF Performance Subscriptions - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
GET all VNF Performance Subscriptions as Paged Response :: Test ID... | PASS |
------------------------------------------------------------------------------
GET VNF Performance Management Subscriptions - Bad Request Respons... | PASS |
------------------------------------------------------------------------------
Subscriptions                                                         | PASS |
12 critical tests, 12 passed, 0 failed
12 tests total, 12 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VNFPerformanceManagement-API/Thresholds.robot
==============================================================================
Thresholds                                                                    
==============================================================================
GET All Performance Thresholds :: Test ID: 7.3.4.4.1                  | PASS |
------------------------------------------------------------------------------
GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS |
------------------------------------------------------------------------------
GET Performance Thresholds with invalid attribute-based filter :: ... | PASS |
------------------------------------------------------------------------------
GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS |
------------------------------------------------------------------------------
Create new Performance Threshold :: Test ID: 7.3.4.4.5                | PASS |
------------------------------------------------------------------------------
PUT Performance Thresholds - Method not implemented :: Test ID: 7.... | PASS |
------------------------------------------------------------------------------
PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS |
------------------------------------------------------------------------------
DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS |
------------------------------------------------------------------------------
GET All Performance Thresholds as Paged Response :: Test ID: 7.3.4... | PASS |
------------------------------------------------------------------------------
GET Performance Thresholds - Bad Request Response too Big :: Test ... | PASS |
------------------------------------------------------------------------------
Thresholds                                                            | PASS |
10 critical tests, 10 passed, 0 failed
10 tests total, 10 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/ApiVersion.robot
==============================================================================
ApiVersion                                                                    
==============================================================================
POST API Version - Method not implemented :: Test ID: 7.3.7.3.1       | PASS |
------------------------------------------------------------------------------
GET API Version :: Test ID: 7.3.7.3.2                                 | PASS |
------------------------------------------------------------------------------
PUT API Version - Method not implemented :: Test ID: 7.3.7.3.3        | PASS |
------------------------------------------------------------------------------
PATCH API Version - Method not implemented :: Test ID: 7.3.7.3.4      | PASS |
------------------------------------------------------------------------------
DELETE API Version - Method not implemented :: Test ID: 7.3.7.3.5     | PASS |
------------------------------------------------------------------------------
POST API Version with apiMajorVerion - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
GET API Version with apiMajorVerion :: Test ID: 7.3.7.3.7             | PASS |
------------------------------------------------------------------------------
PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS |
------------------------------------------------------------------------------
ApiVersion                                                            | PASS |
10 critical tests, 10 passed, 0 failed
10 tests total, 10 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/IndividualSubscription.robot
==============================================================================
IndividualSubscription :: This resource represents an individual subscripti...
==============================================================================
Create new Virtualised Resources Quota Available Notification indi... | PASS |
------------------------------------------------------------------------------
Get Information about an individual subscription :: Test ID: 7.3.7... | PASS |
------------------------------------------------------------------------------
PUT an individual subscription - Method not implemented :: Test ID... | PASS |
------------------------------------------------------------------------------
PATCH an individual subscription - Method not implemented :: Test ... | PASS |
------------------------------------------------------------------------------
DELETE an individual subscription :: Test ID: 7.3.7.2.5               | PASS |
------------------------------------------------------------------------------
IndividualSubscription :: This resource represents an individual s... | PASS |
5 critical tests, 5 passed, 0 failed
5 tests total, 5 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/NotificationEndpoint.robot
==============================================================================
NotificationEndpoint                                                          
==============================================================================
Deliver a notification - Vr Quota Availibility :: Test ID: 11.4.4.1   | PASS |
------------------------------------------------------------------------------
Test a notification end point                                         | PASS |
------------------------------------------------------------------------------
PUT notification - Method not implemented                             | PASS |
------------------------------------------------------------------------------
PATCH subscriptions - Method not implemented                          | PASS |
------------------------------------------------------------------------------
DELETE subscriptions - Method not implemented                         | PASS |
------------------------------------------------------------------------------
NotificationEndpoint                                                  | PASS |
5 critical tests, 5 passed, 0 failed
5 tests total, 5 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/Subscriptions.robot
==============================================================================
Subscriptions                                                                 
==============================================================================
Create new Virtualised Resources Quota Available Notification subs... | PASS |
------------------------------------------------------------------------------
Create new Virtualised Resources Quota Available Notification subs... | PASS |
------------------------------------------------------------------------------
Create new Virtualised Resources Quota Available Notification subs... | PASS |
------------------------------------------------------------------------------
GET Virtualised Resources Quota Available Notification Subscriptio... | PASS |
------------------------------------------------------------------------------
GET Virtualised Resources Quota Available Notification Subscriptio... | PASS |
------------------------------------------------------------------------------
GET Virtualised Resources Quota Available Notification subscriptio... | PASS |
------------------------------------------------------------------------------
PUT Virtualised Resources Quota Available Notification subscriptio... | PASS |
------------------------------------------------------------------------------
PATCH Virtualised Resources Quota Available Notification subscript... | PASS |
------------------------------------------------------------------------------
DELETE Virtualised Resources Quota Available Notification subscrip... | PASS |
------------------------------------------------------------------------------
GET Virtualised Resources Quota Available Notification Subscriptio... | PASS |
------------------------------------------------------------------------------
GET Virtualised Resources Quota Available Notification subscriptio... | PASS |
------------------------------------------------------------------------------
Subscriptions                                                         | PASS |
11 critical tests, 11 passed, 0 failed
11 tests total, 11 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSDManagement-API/ApiVersion.robot
==============================================================================
ApiVersion                                                                    
==============================================================================
POST API Version - Method not implemented :: Test ID: 5.3.1.10.1      | PASS |
------------------------------------------------------------------------------
GET API Version :: Test ID: 5.3.1.10.2                                | PASS |
------------------------------------------------------------------------------
PUT API Version - Method not implemented :: Test ID: 5.3.1.10.3       | PASS |
------------------------------------------------------------------------------
PATCH API Version - Method not implemented :: Test ID: 5.3.1.10.4     | PASS |
------------------------------------------------------------------------------
DELETE API Version - Method not implemented :: Test ID: 5.3.1.10.5    | PASS |
------------------------------------------------------------------------------
POST API Version with apiMajorVerion - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
GET API Version with apiMajorVerion :: Test ID: 5.3.1.10.7            | PASS |
------------------------------------------------------------------------------
PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS |
------------------------------------------------------------------------------
ApiVersion                                                            | PASS |
10 critical tests, 10 passed, 0 failed
10 tests total, 10 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSDManagement-API/IndividualNSDescriptor.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
IndividualNSDescriptor :: This Clause defines all the resources and methods...
==============================================================================
GET Individual Network Service Descriptor Information :: Test ID: ... | PASS |
------------------------------------------------------------------------------
GET Individual Network Service Descriptor Information with invalid... | PASS |
------------------------------------------------------------------------------
Disable Individual Network Service Descriptor :: Test ID: 5.3.1.2.3   | PASS |
------------------------------------------------------------------------------
Enable Individual Network Service Descriptor :: Test ID: 5.3.1.2.4    | PASS |
------------------------------------------------------------------------------
Enable Individual Network Service Descriptor with conflict due to ... | PASS |
------------------------------------------------------------------------------
Enable Individual Network Service Descriptor with conflict due to ... | PASS |
------------------------------------------------------------------------------
Enable Individual Network Service Descriptor with HTTP Etag precon... | PASS |
------------------------------------------------------------------------------
DELETE Individual Network Service Descriptor :: Test ID: 5.3.1.2.9    | PASS |
------------------------------------------------------------------------------
DELETE Individual Network Service Descriptor in operational state ... | PASS |
------------------------------------------------------------------------------
POST Individual Network Service Descriptor - Method not implemente... | PASS |
------------------------------------------------------------------------------
PUT Individual Network Service Descriptor - Method not implemented... | PASS |
------------------------------------------------------------------------------
IndividualNSDescriptor :: This Clause defines all the resources an... | PASS |
11 critical tests, 11 passed, 0 failed
11 tests total, 11 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSDManagement-API/IndividualPnfDescriptor.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
IndividualPnfDescriptor :: This Clause defines all the resources and method...
==============================================================================
GET Individual PNF Descriptor Information :: Test ID: 5.3.1.5.1       | PASS |
------------------------------------------------------------------------------
GET Individual PNF Descriptor Information with invalid resource id... | PASS |
------------------------------------------------------------------------------
Update Individual PNF Descriptor :: Test ID: 5.3.1.5.3                | PASS |
------------------------------------------------------------------------------
Update Individual PNF Descriptor with HTTP Etag precondition failu... | PASS |
------------------------------------------------------------------------------
POST Individual PNF Descriptor - Method not implemented :: Test ID... | PASS |
------------------------------------------------------------------------------
PUT Individual PNF Descriptor - Method not implemented :: Test ID:... | PASS |
------------------------------------------------------------------------------
DELETE Individual PNF Descriptor :: Test ID: 5.3.1.5.7                | PASS |
------------------------------------------------------------------------------
IndividualPnfDescriptor :: This Clause defines all the resources a... | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSDManagement-API/IndividualSubscription.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
IndividualSubscription                                                        
==============================================================================
GET Individual NSD Management Subscription :: Test ID: 5.3.1.8.1      | PASS |
------------------------------------------------------------------------------
GET Individual NSD Management Subscription with invalid resource i... | PASS |
------------------------------------------------------------------------------
DELETE Individual NSD Management Subscription with invalid resourc... | PASS |
------------------------------------------------------------------------------
POST Individual NSD Management Subscription - Method not implement... | PASS |
------------------------------------------------------------------------------
PUT Individual NSD Management Subscription - Method not implemente... | PASS |
------------------------------------------------------------------------------
PATCH Individual NSD Management Subscription - Method not implemen... | PASS |
------------------------------------------------------------------------------
DELETE Individual NSD Management Subscription :: Test ID: 5.3.1.8.7   | PASS |
------------------------------------------------------------------------------
IndividualSubscription                                                | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSDManagement-API/NSDContent.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
NSDContent :: This Clause defines the content of the individual NS descript...
==============================================================================
Get single file NSD Content in Plain Format :: Test ID: 5.3.1.3.1     | PASS |
------------------------------------------------------------------------------
Get NSD Content in Zip Format :: Test ID: 5.3.1.3.2                   | PASS |
------------------------------------------------------------------------------
Get single file NSD Content in Plain or Zip Format :: Test ID: 5.3... | PASS |
------------------------------------------------------------------------------
Get multi file NSD Content in Plain or Zip Format :: Test ID: 5.3.... | PASS |
------------------------------------------------------------------------------
Get multi file NSD Content in Plain Format :: Test ID: 5.3.1.3.5      | PASS |
------------------------------------------------------------------------------
Get NSD Content with invalid resource identifier :: Test ID: 5.3.1... | PASS |
------------------------------------------------------------------------------
Get NSD Content with conflict due to onboarding state :: Test ID: ... | PASS |
------------------------------------------------------------------------------
GET NSD Content with Range Request and NFVO supporting Range Reque... | PASS |
------------------------------------------------------------------------------
GET NSD Content with Range Request and NFVO not supporting Range R... | PASS |
------------------------------------------------------------------------------
GET NSD Content with invalid Range Request :: Test ID: 5.3.1.3.10     | PASS |
------------------------------------------------------------------------------
Upload NSD Content as Zip file in asynchronous mode :: Test ID: 5.... | FAIL |
Several failures occurred:

1) No keyword with name 'Create Session' found. Did you mean:
    NSDManagementKeywords.Create Sessions

2) No keyword with name 'Put Request' found.
------------------------------------------------------------------------------
Upload NSD Content as plain text file in asynchronous mode :: Test... | FAIL |
Several failures occurred:

1) No keyword with name 'Create Session' found. Did you mean:
    NSDManagementKeywords.Create Sessions

2) No keyword with name 'Put Request' found.
------------------------------------------------------------------------------
Upload NSD Content as Zip file in synchronous mode :: Test ID: 5.3... | FAIL |
Several failures occurred:

1) No keyword with name 'Create Session' found. Did you mean:
    NSDManagementKeywords.Create Sessions

2) No keyword with name 'Put Request' found.
------------------------------------------------------------------------------
Upload NSD Content as plain text file in synchronous mode :: Test ... | FAIL |
Several failures occurred:

1) No keyword with name 'Create Session' found. Did you mean:
    NSDManagementKeywords.Create Sessions

2) No keyword with name 'Put Request' found.
------------------------------------------------------------------------------
Upload NSD Content with conflict due to onboarding state :: Test I... | FAIL |
Several failures occurred:

1) No keyword with name 'Create Session' found. Did you mean:
    NSDManagementKeywords.Create Sessions

2) No keyword with name 'Put Request' found.
------------------------------------------------------------------------------
POST NSD Content - Method not implemented :: Test ID: 5.3.1.3.16      | PASS |
------------------------------------------------------------------------------
PATCH NSD Content - Method not implemented :: Test ID: 5.3.1.3.17     | PASS |
------------------------------------------------------------------------------
DELETE NSD Content - Method not implemented :: Test ID: 5.3.1.3.18    | PASS |
------------------------------------------------------------------------------
NSDContent :: This Clause defines the content of the individual NS... | FAIL |
18 critical tests, 13 passed, 5 failed
18 tests total, 13 passed, 5 failed
==============================================================================
Output:  None
++++ Issues in file SOL005/NSDManagement-API/NSDContent.robot
++++ Dryrun SOL005/NSDManagement-API/NSDManagementNotification.robot
==============================================================================
NSDManagementNotification                                                     
==============================================================================
NSD Onboarding Notification :: Test ID: 5.3.1.9.1                     | PASS |
------------------------------------------------------------------------------
NSD Onboarding Failure Notification :: Test ID: 5.3.1.9.2             | PASS |
------------------------------------------------------------------------------
NSD Operational State Change Notification :: Test ID: 5.3.1.9.3       | PASS |
------------------------------------------------------------------------------
NSD Deletion Notification :: Test ID: 5.3.1.9.4                       | PASS |
------------------------------------------------------------------------------
PNFD Onboarding Notification :: Test ID: 5.3.1.9.5                    | PASS |
------------------------------------------------------------------------------
PNFD Onboarding Failure Notification :: Test ID: 5.3.1.9.6            | PASS |
------------------------------------------------------------------------------
PNFD Deletion Notification :: Test ID: 5.3.1.9.7                      | PASS |
------------------------------------------------------------------------------
NSDManagementNotification                                             | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSDManagement-API/NSDescriptors.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
NSDescriptors :: This Clause defines all the resources and methods provided...
==============================================================================
GET all Network Service Descriptors Information :: Test ID: 5.3.1.1.1 | PASS |
------------------------------------------------------------------------------
GET Network Service Descriptors Information with attribute-based f... | PASS |
------------------------------------------------------------------------------
GET Network Service Descriptors Information with invalid attribute... | PASS |
------------------------------------------------------------------------------
Get all Network Service Descriptors Information with malformed aut... | PASS |
------------------------------------------------------------------------------
Get all Network Service Descriptors Information without authorizat... | PASS |
------------------------------------------------------------------------------
GET all Network Service Descriptors Information with expired or re... | PASS |
------------------------------------------------------------------------------
GET all Network Service Descriptors Information with "all_fields" ... | PASS |
------------------------------------------------------------------------------
GET all Network Service Descriptors Information with "exclude_defa... | PASS |
------------------------------------------------------------------------------
GET all Network Service Descriptors Information with "fields" attr... | PASS |
------------------------------------------------------------------------------
GET all Network Service Descriptors Information with "exclude_fiel... | PASS |
------------------------------------------------------------------------------
Create new Network Service Descriptor Resource :: Test ID: 5.3.1.1.11 | PASS |
------------------------------------------------------------------------------
PUT all Network Service Descriptors - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PATCH all Network Service Descriptors - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
DELETE all Network Service Descriptors - Method not implemented ::... | PASS |
------------------------------------------------------------------------------
GET all Network Service Descriptors Information as Paged Response ... | PASS |
------------------------------------------------------------------------------
Get all Network Service Descriptors Information - Bad Request Resp... | PASS |
------------------------------------------------------------------------------
NSDescriptors :: This Clause defines all the resources and methods... | PASS |
16 critical tests, 16 passed, 0 failed
16 tests total, 16 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSDManagement-API/PNFDContent.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
PNFDContent :: This Clause defines the content of the individual NS descrip...
==============================================================================
Get PNFD Content :: Test ID: 5.3.1.6.1                                | PASS |
------------------------------------------------------------------------------
Get PNFD Content with invalid resource identifier :: Test ID: 5.3.... | PASS |
------------------------------------------------------------------------------
Get PNFD Content with conflict due to onboarding state :: Test ID:... | PASS |
------------------------------------------------------------------------------
Upload PNFD Content as plain text file :: Test ID: 5.3.1.6.4          | FAIL |
Several failures occurred:

1) No keyword with name 'Create Session' found. Did you mean:
    NSDManagementKeywords.Create Sessions

2) No keyword with name 'Put Request' found.
------------------------------------------------------------------------------
Upload PNFD Content with conflict due to onboarding state :: Test ... | PASS |
------------------------------------------------------------------------------
POST PNFD Content - Method not implemented :: Test ID: 5.3.1.6.6      | PASS |
------------------------------------------------------------------------------
PATCH PNFD Content - Method not implemented :: Test ID: 5.3.1.6.7     | PASS |
------------------------------------------------------------------------------
DELETE PNFD Content - Method not implemented :: Test ID: 5.3.1.6.8    | PASS |
------------------------------------------------------------------------------
PNFDContent :: This Clause defines the content of the individual N... | FAIL |
8 critical tests, 7 passed, 1 failed
8 tests total, 7 passed, 1 failed
==============================================================================
Output:  None
++++ Issues in file SOL005/NSDManagement-API/PNFDContent.robot
++++ Dryrun SOL005/NSDManagement-API/PNFDescriptors.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
PNFDescriptors :: This Clause defines all the resources and methods provide...
==============================================================================
GET all PNF Descriptors Information :: Test ID: 5.3.1.4.1             | PASS |
------------------------------------------------------------------------------
GET PNF Descriptors Information with attribute-based filter :: Tes... | PASS |
------------------------------------------------------------------------------
GET PNF Descriptors Information with invalid attribute-based filte... | PASS |
------------------------------------------------------------------------------
GET all PNF Descriptors Information with "all_fields" attribute se... | PASS |
------------------------------------------------------------------------------
GET all PNF Descriptors Information with "exclude_default" attribu... | PASS |
------------------------------------------------------------------------------
GET all PNF Descriptors Information with "fields" attribute select... | PASS |
------------------------------------------------------------------------------
GET all PNF Descriptors Information with "exclude_fields" attribut... | PASS |
------------------------------------------------------------------------------
Create new PNF Descriptor Resource :: Test ID: 5.3.1.4.8              | PASS |
------------------------------------------------------------------------------
PUT all PNF Descriptors - Method not implemented :: Test ID: 5.3.1... | PASS |
------------------------------------------------------------------------------
PATCH all PNF Descriptors - Method not implemented :: Test ID: 5.3... | PASS |
------------------------------------------------------------------------------
DELETE all PNF Descriptors - Method not implemented :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
GET all PNF Descriptors Information as Paged Response :: Test ID: ... | PASS |
------------------------------------------------------------------------------
GET PNF Descriptors Information - Bad Request Response too Big :: ... | PASS |
------------------------------------------------------------------------------
PNFDescriptors :: This Clause defines all the resources and method... | PASS |
13 critical tests, 13 passed, 0 failed
13 tests total, 13 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSDManagement-API/Subscriptions.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
Subscriptions                                                                 
==============================================================================
Get All NSD Management Subscriptions :: Test ID: 5.3.1.7.1            | PASS |
------------------------------------------------------------------------------
Get NSD Management Subscriptions with attribute-based filter :: Te... | PASS |
------------------------------------------------------------------------------
Get NSD Management Subscriptions with invalid attribute-based filt... | PASS |
------------------------------------------------------------------------------
GET NSD Management Subscription with invalid resource endpoint :: ... | PASS |
------------------------------------------------------------------------------
Create new NSD Management subscription :: Test ID: 5.3.1.7.5          | PASS |
------------------------------------------------------------------------------
Create duplicated NSD Management subscription with NFVO not creati... | PASS |
------------------------------------------------------------------------------
Create duplicated NSD Management subscription with NFVO creating d... | PASS |
------------------------------------------------------------------------------
PUT NSD Management Subscriptions - Method not implemented :: Test ... | PASS |
------------------------------------------------------------------------------
PATCH NSD Management Subscriptions - Method not implemented :: Tes... | PASS |
------------------------------------------------------------------------------
DELETE NSD Management Subscriptions - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
Get All NSD Management Subscriptions as Paged Response :: Test ID:... | PASS |
------------------------------------------------------------------------------
Get NSD Management Subscriptions - Bad Request Response too Big ::... | PASS |
------------------------------------------------------------------------------
Subscriptions                                                         | PASS |
12 critical tests, 12 passed, 0 failed
12 tests total, 12 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSFaultManagement-API/Alarms.robot
==============================================================================
Alarms                                                                        
==============================================================================
POST Alarms - Method not implemented :: Test ID: 5.3.3.1.1            | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms :: Test ID: 5.3.3.1.2           | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with filters :: Test ID: 5.3... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms Bad Request Invalid attribut... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with "all_fields" attribute ... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with exclude_default attribu... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with fields attribute select... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with "exclude_fields" attrib... | PASS |
------------------------------------------------------------------------------
PUT Alarms - Method not implemented :: Test ID: 5.3.3.1.5             | PASS |
------------------------------------------------------------------------------
PATCH Alarms - Method not implemented :: Test ID: 5.3.3.1.6           | PASS |
------------------------------------------------------------------------------
DELETE Alarms - Method not implemented :: Test ID: 5.3.3.1.7          | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms as Paged Response :: Test ID... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms - Bad Request Response too B... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with filter "id" :: Test ID:... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with filter "rootCauseFaulty... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with filter "rootCauseFaulty... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with filter "rootCauseFaulty... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with filter "rootCauseFaulty... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with filter "eventType" :: T... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with filter "perceivedSeveri... | PASS |
------------------------------------------------------------------------------
GET information about multiple alarms with filter "probableCause" ... | PASS |
------------------------------------------------------------------------------
Alarms                                                                | PASS |
21 critical tests, 21 passed, 0 failed
21 tests total, 21 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSFaultManagement-API/ApiVersion.robot
==============================================================================
ApiVersion                                                                    
==============================================================================
POST API Version - Method not implemented :: Test ID: 5.3.3.6.1       | PASS |
------------------------------------------------------------------------------
GET API Version :: Test ID: 5.3.3.6.2                                 | PASS |
------------------------------------------------------------------------------
PUT API Version - Method not implemented :: Test ID: 5.3.3.6.3        | PASS |
------------------------------------------------------------------------------
PATCH API Version - Method not implemented :: Test ID: 5.3.3.6.4      | PASS |
------------------------------------------------------------------------------
DELETE API Version - Method not implemented :: Test ID: 5.3.3.6.5     | PASS |
------------------------------------------------------------------------------
POST API Version with apiMajorVerion - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
GET API Version with apiMajorVerion :: Test ID: 5.3.3.6.7             | PASS |
------------------------------------------------------------------------------
PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS |
------------------------------------------------------------------------------
ApiVersion                                                            | PASS |
10 critical tests, 10 passed, 0 failed
10 tests total, 10 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSFaultManagement-API/IndividualAlarm.robot
==============================================================================
IndividualAlarm                                                               
==============================================================================
POST Individual Alarm - Method not implemented :: Test ID: 5.3.3.2.1  | PASS |
------------------------------------------------------------------------------
GET information about Individual Alarm :: Test ID: 5.3.3.2.2          | PASS |
------------------------------------------------------------------------------
GET information about Invalid Individual Alarm :: Test ID: 5.3.3.2.3  | PASS |
------------------------------------------------------------------------------
PUT Individual Alarm - Method not implemented :: Test ID: 5.3.3.2.4   | PASS |
------------------------------------------------------------------------------
PATCH Alarm :: Test ID: 5.3.3.2.5                                     | PASS |
------------------------------------------------------------------------------
PATCH Alarm - Conflict :: Test ID: 5.3.3.2.6                          | PASS |
------------------------------------------------------------------------------
PATCH Alarm - Precondition failed :: Test ID: 5.3.3.2.7               | PASS |
------------------------------------------------------------------------------
DELETE Individual Alarm - Method not implemented :: Test ID: 5.3.3... | PASS |
------------------------------------------------------------------------------
IndividualAlarm                                                       | PASS |
8 critical tests, 8 passed, 0 failed
8 tests total, 8 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSFaultManagement-API/IndividualSubscription.robot
==============================================================================
IndividualSubscription                                                        
==============================================================================
Post Individual Subscription - Method not implemented :: Test ID: ... | PASS |
------------------------------------------------------------------------------
Get Information about an individual subscription :: Test ID: 5.3.3... | PASS |
------------------------------------------------------------------------------
PUT an individual subscription - Method not implemented :: Test ID... | PASS |
------------------------------------------------------------------------------
PATCH an individual subscription - Method not implemented :: Test ... | PASS |
------------------------------------------------------------------------------
DELETE an individual subscription :: Test ID: 5.3.3.4.5               | PASS |
------------------------------------------------------------------------------
IndividualSubscription                                                | PASS |
5 critical tests, 5 passed, 0 failed
5 tests total, 5 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSFaultManagement-API/NotificationEndpoint.robot
==============================================================================
NotificationEndpoint                                                          
==============================================================================
NS Fault Alarm Notification :: Test ID: 5.3.3.5.1                     | PASS |
------------------------------------------------------------------------------
NS Fault Alarm Cleared Notification :: Test ID: 5.3.3.5.2             | PASS |
------------------------------------------------------------------------------
NS Fault Alarm List Rebuilt Notification :: Test ID: 5.3.3.5.3        | PASS |
------------------------------------------------------------------------------
NotificationEndpoint                                                  | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSFaultManagement-API/Subscriptions.robot
==============================================================================
Subscriptions                                                                 
==============================================================================
Create a new alarm subscription :: Test ID: 5.3.3.3.1                 | PASS |
------------------------------------------------------------------------------
Create a new alarm subscription - DUPLICATION :: Test ID: 5.3.3.3.2   | PASS |
------------------------------------------------------------------------------
Create a new alarm subscription - NO DUPLICATION :: Test ID: 5.3.3... | PASS |
------------------------------------------------------------------------------
Retrieve a list of alarm subscriptions :: Test ID: 5.3.3.3.4          | PASS |
------------------------------------------------------------------------------
Retrieve a list of alarm subscriptions - Filter :: Test ID: 5.3.3.3.5 | PASS |
------------------------------------------------------------------------------
GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS |
------------------------------------------------------------------------------
GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS |
------------------------------------------------------------------------------
GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS |
------------------------------------------------------------------------------
GET subscriptions with "fields" attribute selector :: Test ID: 5.3... | PASS |
------------------------------------------------------------------------------
GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS |
------------------------------------------------------------------------------
PUT subscriptions - Method not implemented :: Test ID: 5.3.3.3.11     | PASS |
------------------------------------------------------------------------------
PATCH subscriptions - Method not implemented :: Test ID: 5.3.3.3.12   | PASS |
------------------------------------------------------------------------------
DELETE subscriptions - Method not implemented :: Test ID: 5.3.3.3.13  | PASS |
------------------------------------------------------------------------------
Retrieve a list of alarm subscriptions as Paged Response :: Test I... | PASS |
------------------------------------------------------------------------------
GET subscriptions - Bad Request Response too Big :: Test ID: 5.3.3... | PASS |
------------------------------------------------------------------------------
Retrieve a list of alarm subscriptions with filter "id" :: Test ID... | PASS |
------------------------------------------------------------------------------
Retrieve a list of alarm subscriptions with filter "filter.notific... | PASS |
------------------------------------------------------------------------------
Retrieve a list of alarm subscriptions with filter "filter.faultyR... | PASS |
------------------------------------------------------------------------------
Retrieve a list of alarm subscriptions with filter "filter.perceiv... | PASS |
------------------------------------------------------------------------------
Retrieve a list of alarm subscriptions with filter "filter.eventTy... | PASS |
------------------------------------------------------------------------------
Retrieve a list of alarm subscriptions with filter "filter.probabl... | PASS |
------------------------------------------------------------------------------
Subscriptions                                                         | PASS |
21 critical tests, 21 passed, 0 failed
21 tests total, 21 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/ApiVersion.robot
==============================================================================
ApiVersion                                                                    
==============================================================================
POST API Version - Method not implemented :: Test ID: 5.3.2.25.1      | PASS |
------------------------------------------------------------------------------
GET API Version :: Test ID: 5.3.2.25.2                                | PASS |
------------------------------------------------------------------------------
PUT API Version - Method not implemented :: Test ID: 5.3.2.25.3       | PASS |
------------------------------------------------------------------------------
PATCH API Version - Method not implemented :: Test ID: 5.3.2.25.4     | PASS |
------------------------------------------------------------------------------
DELETE API Version - Method not implemented :: Test ID: 5.3.2.25.5    | PASS |
------------------------------------------------------------------------------
POST API Version with apiMajorVerion - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
GET API Version with apiMajorVerion :: Test ID: 5.3.2.25.7            | PASS |
------------------------------------------------------------------------------
PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS |
------------------------------------------------------------------------------
ApiVersion                                                            | PASS |
10 critical tests, 10 passed, 0 failed
10 tests total, 10 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/CancelOperationTask.robot
==============================================================================
CancelOperationTask                                                           
==============================================================================
POST Cancel operation task :: Test ID: 5.3.2.14.1                     | PASS |
------------------------------------------------------------------------------
POST Cancel operation task Not Found :: Test ID: 5.3.2.14.2           | PASS |
------------------------------------------------------------------------------
POST Cancel operation task Conflict :: Test ID: 5.3.2.14.3            | PASS |
------------------------------------------------------------------------------
GET Cancel operation task - Method not implemented :: Test ID: 5.3... | PASS |
------------------------------------------------------------------------------
PUT Cancel operation task - Method not implemented :: Test ID: 5.3... | PASS |
------------------------------------------------------------------------------
PATCH Cancel operation task - Method not implemented :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
DELETE Cancel operation task - Method not implemented :: Test ID: ... | PASS |
------------------------------------------------------------------------------
CancelOperationTask                                                   | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/ContinueOperationTask.robot
==============================================================================
ContinueOperationTask                                                         
==============================================================================
POST Continue operation task :: Test ID: 5.3.2.12.1                   | PASS |
------------------------------------------------------------------------------
POST Continue operation task Not Found :: Test ID: 5.3.2.12.2         | PASS |
------------------------------------------------------------------------------
POST Continue operation task Conflict :: Test ID: 5.3.2.12.3          | PASS |
------------------------------------------------------------------------------
GET Continue operation task - Method not implemented :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
PUT Continue operation task - Method not implemented :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
PATCH Continue operation task - Method not implemented :: Test ID:... | PASS |
------------------------------------------------------------------------------
DELETE Continue operation task - Method not implemented :: Test ID... | PASS |
------------------------------------------------------------------------------
ContinueOperationTask                                                 | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/CreateNSInstanceWorkflow.robot
==============================================================================
CreateNSInstanceWorkflow                                                      
==============================================================================
NS Instance Creation :: Test ID: 5.3.2.18.1                           | FAIL |
Keyword 'NSLCMOperationKeywords.Check resource not_instantiated' expected 0 arguments, got 1.
------------------------------------------------------------------------------
NS Instance Creation with DISABLED Network Service Descriptor :: T... | PASS |
------------------------------------------------------------------------------
CreateNSInstanceWorkflow                                              | FAIL |
2 critical tests, 1 passed, 1 failed
2 tests total, 1 passed, 1 failed
==============================================================================
Output:  None
++++ Issues in file SOL005/NSLifecycleManagement-API/CreateNSInstanceWorkflow.robot
++++ Dryrun SOL005/NSLifecycleManagement-API/DeleteNSInstanceWorkflow.robot
==============================================================================
DeleteNSInstanceWorkflow                                                      
==============================================================================
NS Instance Deletion :: Test ID: 5.3.2.19.1                           | PASS |
------------------------------------------------------------------------------
DeleteNSInstanceWorkflow                                              | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/FailOperationTask.robot
==============================================================================
FailOperationTask                                                             
==============================================================================
POST Fail operation task :: Test ID: 5.3.2.13.1                       | PASS |
------------------------------------------------------------------------------
POST Fail operation task Not Found :: Test ID: 5.3.2.13.2             | PASS |
------------------------------------------------------------------------------
POST Fail operation task Conflict :: Test ID: 5.3.2.13.3              | PASS |
------------------------------------------------------------------------------
GET Fail operation task - Method not implemented :: Test ID: 5.3.2... | PASS |
------------------------------------------------------------------------------
PUT Fail operation task - Method not implemented :: Test ID: 5.3.2... | PASS |
------------------------------------------------------------------------------
PATCH Fail operation task - Method not implemented :: Test ID: 5.3... | PASS |
------------------------------------------------------------------------------
DELETE Fail operation task - Method not implemented :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
FailOperationTask                                                     | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/HealNSTask.robot
==============================================================================
HealNSTask                                                                    
==============================================================================
POST Heal a NSInstance :: Test ID: 5.3.2.6.1                          | PASS |
------------------------------------------------------------------------------
POST Heal a NSInstance Conflict :: Test ID: 5.3.2.6.2                 | PASS |
------------------------------------------------------------------------------
GET Heal NSInstance- Method not implemented :: Test ID: 5.3.2.6.3     | PASS |
------------------------------------------------------------------------------
PUT Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.4    | PASS |
------------------------------------------------------------------------------
PATCH Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.5  | PASS |
------------------------------------------------------------------------------
DELETE Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.6 | PASS |
------------------------------------------------------------------------------
HealNSTask                                                            | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/HealNSTaskWorkflow.robot
==============================================================================
HealNSTaskWorkflow                                                            
==============================================================================
Heal Flow of NS lifecycle management operations :: Test ID: 5.3.2.... | PASS |
------------------------------------------------------------------------------
HealNSTaskWorkflow                                                    | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/IndividualNSInstance.robot
==============================================================================
IndividualNSInstance                                                          
==============================================================================
POST Individual NSInstance - Method not implemented :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
GET Information about an individual NS Instance :: Test ID: 5.3.2.2.2 | PASS |
------------------------------------------------------------------------------
PUT Individual NSInstance - Method not implemented :: Test ID: 5.3... | PASS |
------------------------------------------------------------------------------
PATCH Individual NSInstance - Method not implemented :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
DELETE Individual NSInstance :: Test ID: 5.3.2.2.5                    | PASS |
------------------------------------------------------------------------------
DELETE Individual NSInstance Conflict :: Test ID: 5.3.2.2.6           | PASS |
------------------------------------------------------------------------------
IndividualNSInstance                                                  | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/IndividualNSLCMOccurences.robot
==============================================================================
IndividualNSLCMOccurences                                                     
==============================================================================
Post Individual NS LCM occurrences - Method not implemented :: Tes... | PASS |
------------------------------------------------------------------------------
Get status information about Individual NS LCM occurrences :: Test... | PASS |
------------------------------------------------------------------------------
PUT status information about Individual NS LCM occurrences - Metho... | PASS |
------------------------------------------------------------------------------
PATCH status information about Individual NS LCM occurrences - Met... | PASS |
------------------------------------------------------------------------------
DELETE status information about Individual NS LCM occurrences - Me... | PASS |
------------------------------------------------------------------------------
IndividualNSLCMOccurences                                             | PASS |
5 critical tests, 5 passed, 0 failed
5 tests total, 5 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/IndividualSubscription.robot
==============================================================================
IndividualSubscription                                                        
==============================================================================
POST Individual Subscription - Method not implemented :: Test ID: ... | PASS |
------------------------------------------------------------------------------
GET Information about an individual subscription :: Test ID: 5.3.2... | PASS |
------------------------------------------------------------------------------
PUT an individual subscription - Method not implemented :: Test ID... | PASS |
------------------------------------------------------------------------------
PATCH an individual subscription - Method not implemented :: Test ... | PASS |
------------------------------------------------------------------------------
DELETE an individual subscription :: Test ID: 5.3.2.16.5              | PASS |
------------------------------------------------------------------------------
IndividualSubscription                                                | PASS |
5 critical tests, 5 passed, 0 failed
5 tests total, 5 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/InstanciateNSTaskWorkflow.robot
==============================================================================
InstanciateNSTaskWorkflow                                                     
==============================================================================
Instantiate Flow of NS lifecycle management operations :: Test ID:... | PASS |
------------------------------------------------------------------------------
InstanciateNSTaskWorkflow                                             | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/InstantiateNSTask.robot
==============================================================================
InstantiateNSTask                                                             
==============================================================================
POST Instantiate a nsInstance :: Test ID: 5.3.2.3.1                   | PASS |
------------------------------------------------------------------------------
POST Instantiate a nsInstance Conflict :: Test ID: 5.3.2.3.2          | PASS |
------------------------------------------------------------------------------
GET Instantiate NSInstance - Method not implemented :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
PUT Instantiate NSInstance - Method not implemented :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
PATCH Instantiate NSInstance - Method not implemented :: Test ID: ... | PASS |
------------------------------------------------------------------------------
DELETE Instantiate NSInstance - Method not implemented :: Test ID:... | PASS |
------------------------------------------------------------------------------
InstantiateNSTask                                                     | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/NSInstances.robot
==============================================================================
NSInstances                                                                   
==============================================================================
POST Create a new NsInstance :: Test ID: 5.3.2.1.1                    | PASS |
------------------------------------------------------------------------------
GET information about multiple NS instances :: Test ID: 5.3.2.1.2     | PASS |
------------------------------------------------------------------------------
GET information about multiple NS instances Bad Request Invalid at... | PASS |
------------------------------------------------------------------------------
GET information about multiple NS instances Bad Request Invalid at... | PASS |
------------------------------------------------------------------------------
GET NSInstances with "all_fields" attribute selector :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
GET NSInstances with "exclude_default" attribute selector :: Test ... | PASS |
------------------------------------------------------------------------------
GET NSInstances with "fields" attribute selector :: Test ID: 5.3.2... | PASS |
------------------------------------------------------------------------------
GET NSInstances with "exclude_fields" attribute selector :: Test I... | PASS |
------------------------------------------------------------------------------
PUT NSInstances - Method not implemented :: Test ID: 5.3.2.1.9        | PASS |
------------------------------------------------------------------------------
PATCH NSInstances - Method not implemented :: Test ID: 5.3.2.1.10     | PASS |
------------------------------------------------------------------------------
DELETE NSInstances - Method not implemented :: Test ID: 5.3.2.1.11    | PASS |
------------------------------------------------------------------------------
GET information about multiple NS instances as Paged Response :: T... | PASS |
------------------------------------------------------------------------------
GET information about multiple NS instances - Bad Request Response... | PASS |
------------------------------------------------------------------------------
NSInstances                                                           | PASS |
13 critical tests, 13 passed, 0 failed
13 tests total, 13 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/NSLCMOccurences.robot
==============================================================================
NSLCMOccurences                                                               
==============================================================================
POST NS LCM occurrences - Method not implemented :: Test ID: 5.3.2... | PASS |
------------------------------------------------------------------------------
GET status information about multiple NS LCM occurrences :: Test I... | PASS |
------------------------------------------------------------------------------
GET status information about multiple NS LCM occurrences Bad Reque... | PASS |
------------------------------------------------------------------------------
GET status information about multiple NS LCM occurrences Bad Reque... | PASS |
------------------------------------------------------------------------------
GET status information about multiple NS LCM occurrences with "all... | PASS |
------------------------------------------------------------------------------
GET status information about multiple NS LCM occurrences with "exc... | PASS |
------------------------------------------------------------------------------
GET status information about multiple NS LCM occurrences with "fie... | PASS |
------------------------------------------------------------------------------
GET status information about multiple NS LCM occurrences with "exc... | PASS |
------------------------------------------------------------------------------
PUT status information about multiple NS LCM occurrences - Method ... | PASS |
------------------------------------------------------------------------------
PATCH status information about multiple NS LCM occurrences - Metho... | PASS |
------------------------------------------------------------------------------
DELETE status information about multiple NS LCM occurrences - Meth... | PASS |
------------------------------------------------------------------------------
GET status information about multiple NS LCM occurrences as Paged ... | PASS |
------------------------------------------------------------------------------
GET status information about multiple NS LCM occurrences - Bad Req... | PASS |
------------------------------------------------------------------------------
NSLCMOccurences                                                       | PASS |
13 critical tests, 13 passed, 0 failed
13 tests total, 13 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/NotificationEndpoint.robot
==============================================================================
NotificationEndpoint                                                          
==============================================================================
NS LCM Operation Occurrence Start Notification :: Test ID: 5.3.2.17.1 | PASS |
------------------------------------------------------------------------------
NS LCM Operation Occurrence Result Notification :: Test ID: 5.3.2.... | PASS |
------------------------------------------------------------------------------
NS Identifier Creation Notification :: Test ID: 5.3.2.17.3            | PASS |
------------------------------------------------------------------------------
NS Identifier Deletion Notification :: Test ID: 5.3.2.17.4            | PASS |
------------------------------------------------------------------------------
NotificationEndpoint                                                  | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/RetryOperationTask.robot
==============================================================================
RetryOperationTask                                                            
==============================================================================
Post Retry operation task :: Test ID: 5.3.2.10.1                      | PASS |
------------------------------------------------------------------------------
Post Retry operation task Not Found :: Test ID: 5.3.2.10.2            | PASS |
------------------------------------------------------------------------------
Post Retry operation task Conflict :: Test ID: 5.3.2.10.3             | PASS |
------------------------------------------------------------------------------
GET Retry operation task - Method not implemented :: Test ID: 5.3.... | PASS |
------------------------------------------------------------------------------
PUT Retry operation task - Method not implemented :: Test ID: 5.3.... | PASS |
------------------------------------------------------------------------------
PATCH Retry operation task - Method not implemented :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
DELETE Retry operation task - Method not implemented :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
RetryOperationTask                                                    | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/RollbackOperationTask.robot
==============================================================================
RollbackOperationTask                                                         
==============================================================================
POST Rollback operation task :: Test ID: 5.3.2.11.1                   | PASS |
------------------------------------------------------------------------------
POST Rollback operation task Not Found :: Test ID: 5.3.2.11.2         | PASS |
------------------------------------------------------------------------------
POST Rollback operation task Conflict :: Test ID: 5.3.2.11.3          | PASS |
------------------------------------------------------------------------------
GET Rollback operation task - Method not implemented :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
PUT Rollback operation task - Method not implemented :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
PATCH Rollback operation task - Method not implemented :: Test ID:... | PASS |
------------------------------------------------------------------------------
DELETE Rollback operation task - Method not implemented :: Test ID... | PASS |
------------------------------------------------------------------------------
RollbackOperationTask                                                 | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/ScaleNSTask.robot
==============================================================================
ScaleNSTask                                                                   
==============================================================================
POST Scale a nsInstance :: Test ID: 5.3.2.4.1                         | PASS |
------------------------------------------------------------------------------
POST Instantiate a nsInstance Conflict :: Test ID: 5.3.2.4.2          | PASS |
------------------------------------------------------------------------------
GET Scale NSInstance- Method not implemented :: Test ID: 5.3.2.4.3    | PASS |
------------------------------------------------------------------------------
PUT Scale NSInstance - Method not implemented :: Test ID: 5.3.2.4.4   | PASS |
------------------------------------------------------------------------------
PATCH Scale NSInstance - Method not implemented :: Test ID: 5.3.2.4.5 | PASS |
------------------------------------------------------------------------------
DELETE Scale NSInstance - Method not implemented :: Test ID: 5.3.2... | PASS |
------------------------------------------------------------------------------
ScaleNSTask                                                           | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/ScaleNSTaskWorkflow.robot
==============================================================================
ScaleNSTaskWorkflow                                                           
==============================================================================
Scale Flow of NS lifecycle management operations :: Test ID: 5.3.2... | PASS |
------------------------------------------------------------------------------
ScaleNSTaskWorkflow                                                   | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/Subscriptions.robot
==============================================================================
Subscriptions                                                                 
==============================================================================
POST Create a new subscription :: Test ID: 5.3.2.15.1                 | PASS |
------------------------------------------------------------------------------
POST Create a new Subscription - DUPLICATION :: Test ID: 5.3.2.15.2   | PASS |
------------------------------------------------------------------------------
POST Create a new Subscription - NO-DUPLICATION :: Test ID: 5.3.2.... | PASS |
------------------------------------------------------------------------------
GET Subscriptions :: Test ID: 5.3.2.15.4                              | PASS |
------------------------------------------------------------------------------
GET Subscription - Filter :: Test ID: 5.3.2.15.5                      | PASS |
------------------------------------------------------------------------------
GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS |
------------------------------------------------------------------------------
GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS |
------------------------------------------------------------------------------
GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS |
------------------------------------------------------------------------------
GET subscriptions with "fields" attribute selector :: Test ID: 5.3... | PASS |
------------------------------------------------------------------------------
GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS |
------------------------------------------------------------------------------
PUT subscriptions - Method not implemented :: Test ID: 5.3.2.15.11    | PASS |
------------------------------------------------------------------------------
PATCH subscriptions - Method not implemented :: Test ID: 5.3.2.15.12  | PASS |
------------------------------------------------------------------------------
DELETE subscriptions - Method not implemented :: Test ID: 5.3.2.15.13 | PASS |
------------------------------------------------------------------------------
GET Subscriptions as Paged Response :: Test ID: 5.3.2.15.14           | PASS |
------------------------------------------------------------------------------
GET subscriptions - Bad Request Response too Big :: Test ID: 5.3.2... | PASS |
------------------------------------------------------------------------------
Subscriptions                                                         | PASS |
15 critical tests, 15 passed, 0 failed
15 tests total, 15 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/TerminateNSTask.robot
==============================================================================
TerminateNSTask                                                               
==============================================================================
POST Terminate a NSInstance :: Test ID: 5.3.2.7.1                     | PASS |
------------------------------------------------------------------------------
POST Terminate a NSInstance Conflict :: Test ID: 5.3.2.7.2            | PASS |
------------------------------------------------------------------------------
GET Terminate NSInstance- Method not implemented :: Test ID: 5.3.2... | PASS |
------------------------------------------------------------------------------
PUT Terminate NSInstance - Method not implemented :: Test ID: 5.3.... | PASS |
------------------------------------------------------------------------------
PATCH Terminate NSInstance - Method not implemented :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
DELETE Terminate NSInstance - Method not implemented :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
TerminateNSTask                                                       | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/TerminateNSTaskWorkflow.robot
==============================================================================
TerminateNSTaskWorkflow                                                       
==============================================================================
Terminate Flow of NS lifecycle management operations :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
TerminateNSTaskWorkflow                                               | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/UpdateNSTask.robot
==============================================================================
UpdateNSTask                                                                  
==============================================================================
POST Update a NSInstance :: Test ID: 5.3.2.5.1                        | PASS |
------------------------------------------------------------------------------
POST Update a NSInstance Conflict :: Test ID: 5.3.2.5.2               | PASS |
------------------------------------------------------------------------------
GET Update NSInstance- Method not implemented :: Test ID: 5.3.2.5.3   | PASS |
------------------------------------------------------------------------------
PUT Update NSInstance - Method not implemented :: Test ID: 5.3.2.5.4  | PASS |
------------------------------------------------------------------------------
PATCH Update NSInstance - Method not implemented :: Test ID: 5.3.2... | PASS |
------------------------------------------------------------------------------
DELETE Update NSInstance - Method not implemented :: Test ID: 5.3.... | PASS |
------------------------------------------------------------------------------
UpdateNSTask                                                          | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSLifecycleManagement-API/UpdateNSTaskWorkflow.robot
==============================================================================
UpdateNSTaskWorkflow                                                          
==============================================================================
Update Flow of NS lifecycle management operations :: Test ID: 5.3.... | PASS |
------------------------------------------------------------------------------
UpdateNSTaskWorkflow                                                  | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSPerformanceManagement-API/ApiVersion.robot
==============================================================================
ApiVersion                                                                    
==============================================================================
POST API Version - Method not implemented :: Test ID: 5.3.4.9.1       | PASS |
------------------------------------------------------------------------------
GET API Version :: Test ID: 5.3.4.9.2                                 | PASS |
------------------------------------------------------------------------------
PUT API Version - Method not implemented :: Test ID: 5.3.4.9.3        | PASS |
------------------------------------------------------------------------------
PATCH API Version - Method not implemented :: Test ID: 5.3.4.9.4      | PASS |
------------------------------------------------------------------------------
DELETE API Version - Method not implemented :: Test ID: 5.3.4.9.5     | PASS |
------------------------------------------------------------------------------
POST API Version with apiMajorVerion - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
GET API Version with apiMajorVerion :: Test ID: 5.3.4.9.7             | PASS |
------------------------------------------------------------------------------
PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS |
------------------------------------------------------------------------------
ApiVersion                                                            | PASS |
10 critical tests, 10 passed, 0 failed
10 tests total, 10 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualPmJob.robot
==============================================================================
IndividualPmJob                                                               
==============================================================================
GET individual NS Performance Job :: Test ID: 5.3.4.2.1               | PASS |
------------------------------------------------------------------------------
GET individual NS Performance Job with invalid resource identifier... | PASS |
------------------------------------------------------------------------------
DELETE Individual NS Performance Job with invalid resource identif... | PASS |
------------------------------------------------------------------------------
POST Individual NS Performance Job - Method not implemented :: Tes... | PASS |
------------------------------------------------------------------------------
PUT Individual NS Performance Job - Method not implemented :: Test... | PASS |
------------------------------------------------------------------------------
PATCH Individual NS Performance Job - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
DELETE Individual NS Performance Job :: Test ID: 5.3.4.2.7            | PASS |
------------------------------------------------------------------------------
IndividualPmJob                                                       | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualReport.robot
==============================================================================
IndividualReport                                                              
==============================================================================
Get Individual Performance Report :: Test ID: 5.3.4.3.1               | PASS |
------------------------------------------------------------------------------
Get Individual Performance Report with invalid resource endpoint :... | PASS |
------------------------------------------------------------------------------
POST Individual Performance Report - Method not implemented :: Tes... | PASS |
------------------------------------------------------------------------------
PUT Individual Performance Report - Method not implemented :: Test... | PASS |
------------------------------------------------------------------------------
PATCH Individual Performance Report - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
DELETE Individual Performance Report - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
IndividualReport                                                      | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualSubscription.robot
==============================================================================
IndividualSubscription :: This resource represents an individual subscripti...
==============================================================================
GET Individual NS Performance Subscription :: Test ID: 5.3.4.7.1      | PASS |
------------------------------------------------------------------------------
GET Individual NS Performance Subscription with invalid resource i... | PASS |
------------------------------------------------------------------------------
DELETE Individual NS Performance Subscription with invalid resourc... | PASS |
------------------------------------------------------------------------------
POST Individual NS Performance Subscription - Method not implement... | PASS |
------------------------------------------------------------------------------
PUT Individual NS Performance Subscription - Method not implemente... | PASS |
------------------------------------------------------------------------------
PATCH Individual NS Performance Subscription - Method not implemen... | PASS |
------------------------------------------------------------------------------
DELETE Individual NS Performance Subscription :: Test ID: 5.3.4.7.7   | PASS |
------------------------------------------------------------------------------
IndividualSubscription :: This resource represents an individual s... | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualThreshold.robot
==============================================================================
IndividualThreshold :: This resource represents an individual threshold.      
==============================================================================
GET Individual Threshold :: Test ID: 5.3.4.5.1                        | PASS |
------------------------------------------------------------------------------
GET Individual Threshold with invalid resource identifier :: Test ... | PASS |
------------------------------------------------------------------------------
DELETE Individual Threshold with invalid resource identifier :: Te... | PASS |
------------------------------------------------------------------------------
POST Individual Threshold - Method not implemented :: Test ID: 5.3... | PASS |
------------------------------------------------------------------------------
PUT Individual Threshold - Method not implemented :: Test ID: 5.3.... | PASS |
------------------------------------------------------------------------------
PATCH Individual Threshold - Method not implemented :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
DELETE Individual Threshold :: Test ID: 5.3.4.5.7                     | PASS |
------------------------------------------------------------------------------
IndividualThreshold :: This resource represents an individual thre... | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSPerformanceManagement-API/Notifications.robot
==============================================================================
Notifications                                                                 
==============================================================================
NS Performance Information Availability Notification :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
NS Threshold Crossed Notification :: Test ID: 5.3.4.8.2               | PASS |
------------------------------------------------------------------------------
Notifications                                                         | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSPerformanceManagement-API/PMJobs.robot
==============================================================================
PMJobs                                                                        
==============================================================================
GET all NS Performance Monitoring Jobs :: Test ID: 5.3.4.1.1          | PASS |
------------------------------------------------------------------------------
GET NS Performance Monitoring Jobs with attribute-based filter :: ... | PASS |
------------------------------------------------------------------------------
GET all NS Performance Monitoring Jobs with "all_fields" attribute... | PASS |
------------------------------------------------------------------------------
GET all NS Performance Monitoring Jobs with "exclude_default" attr... | PASS |
------------------------------------------------------------------------------
GET all NS Performance Monitoring Jobs with "include" attribute se... | PASS |
------------------------------------------------------------------------------
GET all NS Performance Monitoring Jobs with "exclude" attribute se... | PASS |
------------------------------------------------------------------------------
GET NS Performance Monitoring Jobs with invalid attribute-based fi... | PASS |
------------------------------------------------------------------------------
GET NS Performance Monitoring Jobs with invalid resource endpoint ... | PASS |
------------------------------------------------------------------------------
Create new NS Performance Monitoring Job :: Test ID: 5.3.4.1.9        | PASS |
------------------------------------------------------------------------------
PUT all NS Performance Monitoring Jobs - Method not implemented ::... | PASS |
------------------------------------------------------------------------------
PATCH all NS Performance Monitoring Jobs - Method not implemented ... | PASS |
------------------------------------------------------------------------------
DELETE all NS Performance Monitoring Jobs - Method not implemented... | PASS |
------------------------------------------------------------------------------
GET all NS Performance Monitoring Jobs as Paged Response :: Test I... | PASS |
------------------------------------------------------------------------------
GET NS Performance Monitoring Jobs - Bad Request Response too Big ... | PASS |
------------------------------------------------------------------------------
PMJobs                                                                | PASS |
14 critical tests, 14 passed, 0 failed
14 tests total, 14 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSPerformanceManagement-API/Subscriptions.robot
==============================================================================
Subscriptions                                                                 
==============================================================================
Get All NS Performance Subscriptions :: Test ID: 5.3.4.6.1            | PASS |
------------------------------------------------------------------------------
Get NS Performance Subscriptions with attribute-based filter :: Te... | PASS |
------------------------------------------------------------------------------
Get NS Performance Subscriptions with invalid attribute-based filt... | PASS |
------------------------------------------------------------------------------
GET NS Performance Subscription with invalid resource endpoint :: ... | PASS |
------------------------------------------------------------------------------
Create new NS Performance subscription :: Test ID: 5.3.4.6.5          | PASS |
------------------------------------------------------------------------------
Create duplicated NS Performance subscription with NFVO not creati... | PASS |
------------------------------------------------------------------------------
Create duplicated NS Performance subscription with NFVO creating d... | PASS |
------------------------------------------------------------------------------
PUT NSD Performance Subscriptions - Method not implemented :: Test... | PASS |
------------------------------------------------------------------------------
PATCH NSD Performance Subscriptions - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
DELETE NSD Performance Subscriptions - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
Get All NS Performance Subscriptions as Paged Response :: Test ID:... | PASS |
------------------------------------------------------------------------------
Get NS Performance Subscriptions - Bad Request Response too Big ::... | PASS |
------------------------------------------------------------------------------
Subscriptions                                                         | PASS |
12 critical tests, 12 passed, 0 failed
12 tests total, 12 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/NSPerformanceManagement-API/Thresholds.robot
==============================================================================
Thresholds :: This resource represents thresholds. The client can use this ...
==============================================================================
GET All Performance Thresholds :: Test ID: 5.3.4.4.1                  | PASS |
------------------------------------------------------------------------------
GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS |
------------------------------------------------------------------------------
GET Performance Thresholds with invalid attribute-based filter :: ... | PASS |
------------------------------------------------------------------------------
GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS |
------------------------------------------------------------------------------
Create new Performance Threshold :: Test ID: 5.3.4.4.5                | PASS |
------------------------------------------------------------------------------
PUT Performance Thresholds - Method not implemented :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS |
------------------------------------------------------------------------------
DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS |
------------------------------------------------------------------------------
GET All Performance Thresholds as Paged Response :: Test ID: 5.3.4... | PASS |
------------------------------------------------------------------------------
GET Performance Thresholds - Bad Request Response too Big :: Test ... | PASS |
------------------------------------------------------------------------------
Thresholds :: This resource represents thresholds. The client can ... | PASS |
10 critical tests, 10 passed, 0 failed
10 tests total, 10 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/VNFPackageManagement-API/ApiVersion.robot
==============================================================================
ApiVersion                                                                    
==============================================================================
POST API Version - Method not implemented :: Test ID: 5.3.5.10.1      | PASS |
------------------------------------------------------------------------------
GET API Version :: Test ID: 5.3.5.10.2                                | PASS |
------------------------------------------------------------------------------
PUT API Version - Method not implemented :: Test ID: 5.3.5.10.3       | PASS |
------------------------------------------------------------------------------
PATCH API Version - Method not implemented :: Test ID: 5.3.5.10.4     | PASS |
------------------------------------------------------------------------------
DELETE API Version - Method not implemented :: Test ID: 5.3.5.10.5    | PASS |
------------------------------------------------------------------------------
POST API Version with apiMajorVerion - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
GET API Version with apiMajorVerion :: Test ID: 5.3.5.10.7            | PASS |
------------------------------------------------------------------------------
PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS |
------------------------------------------------------------------------------
ApiVersion                                                            | PASS |
10 critical tests, 10 passed, 0 failed
10 tests total, 10 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/VNFPackageManagement-API/IndividualSubscription.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
IndividualSubscription                                                        
==============================================================================
GET Individual VNF Package Subscription :: Test ID: 5.3.5.8.1         | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Subscription with invalid resource iden... | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Package Subscription with invalid resource i... | PASS |
------------------------------------------------------------------------------
POST Individual VNF Package Subscription - Method not implemented ... | PASS |
------------------------------------------------------------------------------
PUT Individual VNF Package Subscription - Method not implemented :... | PASS |
------------------------------------------------------------------------------
PATCH Individual VNF Package Subscription - Method not implemented... | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Package Subscription :: Test ID: 5.3.5.8.7      | PASS |
------------------------------------------------------------------------------
IndividualSubscription                                                | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/VNFPackageManagement-API/IndividualVNFPackage.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
IndividualVNFPackage                                                          
==============================================================================
GET Individual VNF Package :: Test ID: 5.3.5.2.1                      | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package with invalid resource identifier :: Tes... | PASS |
------------------------------------------------------------------------------
POST Individual VNF Package - Method not implemented :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
PUT Individual VNF Package - Method not implemented :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
Disable Individual VNF Package :: Test ID: 5.3.5.2.5                  | PASS |
------------------------------------------------------------------------------
Disable Individual VNF Package with conflict due to operational st... | PASS |
------------------------------------------------------------------------------
Enable Individual VNF Package :: Test ID: 5.3.5.2.7                   | PASS |
------------------------------------------------------------------------------
Enable Individual VNF Package with conflict due to operational sta... | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Package :: Test ID: 5.3.5.2.9                   | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Package in operational state ENABLED :: Test... | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Package used for instantiated VNF instances ... | PASS |
------------------------------------------------------------------------------
IndividualVNFPackage                                                  | PASS |
11 critical tests, 11 passed, 0 failed
11 tests total, 11 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/VNFPackageManagement-API/Notifications.robot
==============================================================================
Notifications                                                                 
==============================================================================
VNF Package Onboarding Notification :: Test ID: 5.3.5.9.1             | PASS |
------------------------------------------------------------------------------
VNF Package Operational State Change Notification :: Test ID: 5.3.... | PASS |
------------------------------------------------------------------------------
VNF Package Deletion Notification :: Test ID: 5.3.5.9.3               | PASS |
------------------------------------------------------------------------------
Notifications                                                         | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/VNFPackageManagement-API/Subscriptions.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
Subscriptions                                                                 
==============================================================================
Get All VNF Package Subscriptions :: Test ID: 5.3.5.7.1               | PASS |
------------------------------------------------------------------------------
Get VNF Package Subscriptions with attribute-based filter :: Test ... | PASS |
------------------------------------------------------------------------------
Get VNF Package Subscriptions with invalid attribute-based filter ... | PASS |
------------------------------------------------------------------------------
GET VNF Package Subscription with invalid resource endpoint :: Tes... | PASS |
------------------------------------------------------------------------------
Create new VNF Package subscription :: Test ID: 5.3.5.7.5             | PASS |
------------------------------------------------------------------------------
Create duplicated VNF Package subscription with NFVO not creating ... | PASS |
------------------------------------------------------------------------------
Create duplicated VNF Package subscription with NFVO creating dupl... | PASS |
------------------------------------------------------------------------------
PUT VNF Package Subscriptions - Method not implemented :: Test ID:... | PASS |
------------------------------------------------------------------------------
PATCH VNF Package Subscriptions - Method not implemented :: Test I... | PASS |
------------------------------------------------------------------------------
DELETE VNF Package Subscriptions - Method not implemented :: Test ... | PASS |
------------------------------------------------------------------------------
Get All VNF Package Subscriptions as Paged Response :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
Get VNF Package Subscriptions - Bad Request Response too Big :: Te... | PASS |
------------------------------------------------------------------------------
Subscriptions                                                         | PASS |
12 critical tests, 12 passed, 0 failed
12 tests total, 12 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/VNFPackageManagement-API/VNFDInIndividualVNFPackage.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
VNFDInIndividualVNFPackage                                                    
==============================================================================
Get single file VNFD in Individual VNF Package in Plain Format :: ... | PASS |
------------------------------------------------------------------------------
Get VNFD in Individual VNF Package in Zip Format :: Test ID: 5.3.5... | PASS |
------------------------------------------------------------------------------
Get single file VNFD in Individual VNF Package in Plain or Zip For... | PASS |
------------------------------------------------------------------------------
Get multi file VNFD in Individual VNF Package in Plain or Zip Form... | PASS |
------------------------------------------------------------------------------
Get multi file VNFD in Individual VNF Package in Plain Format :: T... | PASS |
------------------------------------------------------------------------------
Get VNFD in Individual VNF Package with invalid resource identifie... | PASS |
------------------------------------------------------------------------------
Get VNFD in Individual VNF Package with conflict due to onboarding... | PASS |
------------------------------------------------------------------------------
POST VNFD in Individual VNF Package - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PUT VNFD in Individual VNF Package - Method not implemented :: Tes... | PASS |
------------------------------------------------------------------------------
PATCH VNFD in Individual VNF Package - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
DELETE VNFD in Individual VNF Package - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
VNFDInIndividualVNFPackage                                            | PASS |
11 critical tests, 11 passed, 0 failed
11 tests total, 11 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackageArtifacts.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
VNFPackageArtifacts                                                           
==============================================================================
GET Individual VNF Package Artifact :: Test ID: 5.3.5.6.1             | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Artifact in octet stream format :: Test... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Artifact with Range Request and NFVO su... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Artifact with Range Request and NFVO no... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Artifact with invalid Range Request :: ... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Artifact with invalid resource identifi... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Artifact with conflict due to onboardin... | PASS |
------------------------------------------------------------------------------
POST Individual VNF Package Artifact - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
PUT Individual VNF Package Artifact - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
PATCH Individual VNF Package Artifact - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Package Artifact - Method not implemented ::... | PASS |
------------------------------------------------------------------------------
VNFPackageArtifacts                                                   | PASS |
11 critical tests, 11 passed, 0 failed
11 tests total, 11 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackageContent.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
VNFPackageContent                                                             
==============================================================================
GET Individual VNF Package Content :: Test ID: 5.3.5.4.1              | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content with Range Request and NFVO sup... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content with Range Request and NFVO not... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content with invalid Range Request :: T... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content with invalid resource identifie... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content with conflict due to onboarding... | PASS |
------------------------------------------------------------------------------
POST Individual VNF Package Content - Method not implemented :: Te... | PASS |
------------------------------------------------------------------------------
Upload VNF Package Content :: Test ID: 5.3.5.4.8                      | FAIL |
Several failures occurred:

1) No keyword with name 'Create Session' found. Did you mean:
    VNFPackageManagementKeywords.Create Sessions

2) No keyword with name 'Put Request' found.
------------------------------------------------------------------------------
Upload VNF Package Content with conflict due to onboarding state :... | FAIL |
Several failures occurred:

1) No keyword with name 'Create Session' found. Did you mean:
    VNFPackageManagementKeywords.Create Sessions

2) No keyword with name 'Put Request' found.
------------------------------------------------------------------------------
PATCH Individual VNF Package Content - Method not implemented :: T... | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Package Content - Method not implemented :: ... | PASS |
------------------------------------------------------------------------------
VNFPackageContent                                                     | FAIL |
11 critical tests, 9 passed, 2 failed
11 tests total, 9 passed, 2 failed
==============================================================================
Output:  None
++++ Issues in file SOL005/VNFPackageManagement-API/VNFPackageContent.robot
++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackageContentViaURI.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
VNFPackageContentViaURI                                                       
==============================================================================
Upload VNF Package Content from URI :: Test ID: 5.3.5.5.1             | PASS |
------------------------------------------------------------------------------
Upload VNF Package Content from URI with conflict due to onboardin... | PASS |
------------------------------------------------------------------------------
GET Individual VNF Package Content from URI - Method not implement... | PASS |
------------------------------------------------------------------------------
PUT Individual VNF Package Content from URI - Method not implement... | PASS |
------------------------------------------------------------------------------
PATCH Individual VNF Package Content from URI - Method not impleme... | PASS |
------------------------------------------------------------------------------
DELETE Individual VNF Package Content from URI - Method not implem... | PASS |
------------------------------------------------------------------------------
VNFPackageContentViaURI                                               | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  None
++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackages.robot
[ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary'
Traceback (most recent call last):
  None
PYTHONPATH:
  /usr/local/bin
  /home/etsi/dev/robot/robotframework-mockserver/src
  /usr/lib/python35.zip
  /usr/lib/python3.5
  /usr/lib/python3.5/plat-x86_64-linux-gnu
  /usr/lib/python3.5/lib-dynload
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
==============================================================================
VNFPackages                                                                   
==============================================================================
GET all VNF Packages :: Test ID: 5.3.5.1.1                            | PASS |
------------------------------------------------------------------------------
GET VNF Packages with attribute-based filter :: Test ID: 5.3.5.1.2    | PASS |
------------------------------------------------------------------------------
GET VNF Packages with invalid attribute-based filter :: Test ID: 5... | PASS |
------------------------------------------------------------------------------
Get all VNF Packages with malformed authorization token :: Test ID... | PASS |
------------------------------------------------------------------------------
Get all VNF Packages without authorization token :: Test ID: 5.3.1... | PASS |
------------------------------------------------------------------------------
GET VNF Packages with "all_fields" attribute selector :: Test ID: ... | PASS |
------------------------------------------------------------------------------
GET VNF Packages with "exclude_default" attribute selector :: Test... | PASS |
------------------------------------------------------------------------------
GET VNF Packages with "fields" attribute selector :: Test ID: 5.3.... | PASS |
------------------------------------------------------------------------------
GET VNF Packages with "exclude_fields" attribute selector :: Test ... | PASS |
------------------------------------------------------------------------------
GET all VNF Packages with invalid resource endpoint :: Test ID: 5.... | PASS |
------------------------------------------------------------------------------
Create new VNF Package Resource :: Test ID: 5.3.5.1.11                | PASS |
------------------------------------------------------------------------------
PUT all VNF Packages - Method not implemented :: Test ID: 5.3.5.1.12  | PASS |
------------------------------------------------------------------------------
PATCH all VNF Packages - Method not implemented :: Test ID: 5.3.5.... | PASS |
------------------------------------------------------------------------------
DELETE all VNF Packages - Method not implemented :: Test ID: 5.3.5... | PASS |
------------------------------------------------------------------------------
GET all VNF Packages as Paged Response :: Test ID: 5.3.5.1.15         | PASS |
------------------------------------------------------------------------------
GET VNF Packages - Bad Request Response too Big :: Test ID: 5.3.5.... | PASS |
------------------------------------------------------------------------------
VNFPackages                                                           | PASS |
16 critical tests, 16 passed, 0 failed
16 tests total, 16 passed, 0 failed
==============================================================================
Output:  None
Finished: SUCCESS