Started by GitLab push by Michele Carignani Building remotely on build.forge.etsi.org (docker) in workspace /home/jenkins/workspace/NFV - Network Functions Virtualisation/api-tests using credential f9a9fd70-ea8b-4872-a9d5-d1fb1cf8123e > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git@forge.etsi.org:nfv/api-tests.git # timeout=10 Fetching upstream changes from git@forge.etsi.org:nfv/api-tests.git > git --version # timeout=10 using GIT_SSH to set credentials > git fetch --tags --progress git@forge.etsi.org:nfv/api-tests.git +refs/heads/*:refs/remotes/origin/* > git rev-parse remotes/origin/2.7.1-dev^{commit} # timeout=10 > git branch -a -v --no-abbrev --contains 5d7a4377727c856d1080516c81d50e857c19b03f # timeout=10 Checking out Revision 5d7a4377727c856d1080516c81d50e857c19b03f (origin/2.7.1-dev) > git config core.sparsecheckout # timeout=10 > git checkout -f 5d7a4377727c856d1080516c81d50e857c19b03f Commit message: "escape mounted dir for container" > git rev-list --no-walk 14efcd9e34ec9d1072ef1bbe2d4242fec0c6c2ce # timeout=10 [api-tests] $ /bin/bash /tmp/jenkins8964959549035330762.sh DOCKER_FILE=./scripts/docker/Dockerfile + DOCKER_FILE=./scripts/docker/Dockerfile if [ -f ${DOCKER_FILE} ] then #check and build stf583-rf-validation image DOCKER_ID=`docker ps -a | grep -e stf583-rf-validation | awk '{ print $1 }'` # if [ ! -z "${DOCKER_ID}" ] # then # docker rm --force stf583-rf-validation # fi docker build --tag stf583-rf-validation -f ${DOCKER_FILE} . if [ "$?" != "0" ] then echo "Docker build failed: $?" exit -1 fi # docker image ls -a # docker inspect stf583-rf-validation:latest # if [ "$?" != "0" ] # then # echo "Docker inspect failed: $?" # exit -2 # fi #else # exit -3 fi + '[' -f ./scripts/docker/Dockerfile ']' docker ps -a | grep -e stf583-rf-validation | awk '{ print $1 }' ++ grep -e stf583-rf-validation ++ docker ps -a ++ awk '{ print $1 }' + DOCKER_ID='3f782a374107 9ac63c7cfebc' + docker build --tag stf583-rf-validation -f ./scripts/docker/Dockerfile . Sending build context to Docker daemon 67.45MB Step 1/20 : FROM ubuntu:16.04 ---> 9499db781771 Step 2/20 : MAINTAINER ETSI STF 583 ---> Using cache ---> 56160b6afd3f Step 3/20 : LABEL description "SFT583 Robot Framework Docker Image" ---> Using cache ---> c104db916b12 Step 4/20 : ENV TERM xterm ---> Using cache ---> a2ac4c73c7dd Step 5/20 : ENV HOSTNAME docker-robot-STF583 ---> Using cache ---> 9f8097bebb01 Step 6/20 : ARG ssh_prv_key ---> Using cache ---> dc6961350e75 Step 7/20 : RUN DEBIAN_FRONTEND=noninteractive apt update && apt install python3 git -y && apt install python3-pip -y && DEBIAN_FRONTEND=noninteractive apt-get autoremove --purge -y && DEBIAN_FRONTEND=noninteractive apt-get autoclean && rm -rf /var/lib/apt/lists/* ---> Using cache ---> 1aa630265990 Step 8/20 : RUN echo "docker-robot-STF583" > /etc/hostname && echo "root:etsi" | chpasswd ---> Using cache ---> 7bd0f294567f Step 9/20 : RUN useradd --create-home --shell /bin/bash --user-group etsi --groups sudo && echo "etsi:etsi" | chpasswd && adduser etsi sudo && echo "etsi ALL=(ALL) NOPASSWD:ALL" >> /etc/sudoers ---> Using cache ---> 53cb248969ce Step 10/20 : RUN DEBIAN_FRONTEND=noninteractive && mkdir -p /home/etsi/dev/robot && cd /home/etsi/dev/robot ---> Using cache ---> 05bc0e6ad8d2 Step 11/20 : RUN pip3 install robotframework ---> Using cache ---> 14f8a9ed7f70 Step 12/20 : RUN DEBIAN_FRONTEND=noninteractive && cd /home/etsi/dev/robot && git clone https://github.com/etsi-cti-admin/robotframework-mockserver ---> Using cache ---> 938bbd21fc7b Step 13/20 : ADD requirements.txt /home/etsi/dev/robot/ ---> Using cache ---> b5c39bba8512 Step 14/20 : ADD extensions /home/etsi/dev/robot/extensions ---> Using cache ---> f0da6d3aa70f Step 15/20 : RUN ls /home/etsi/dev/robot ---> Using cache ---> 54239642f78d Step 16/20 : RUN DEBIAN_FRONTEND=noninteractive && cd /home/etsi/dev/robot && pip3 install -r requirements.txt && cd robotframework-mockserver && patch -p1 < ../extensions/mockserverlibrary.patch && python3 -m pip install -e . ---> Using cache ---> dae8960ead3d Step 17/20 : RUN DEBIAN_FRONTED=noninteractive cd /home/etsi/dev/ mkdir -p build && git clone https://forge.etsi.org/rep/forge-tools/robot2doc.git && cd robot2doc && pip3 install -r requirements.txt && python3 -m pip install -e . ---> Using cache ---> c68f8c51de9e Step 18/20 : ADD . /home/etsi/dev/robot ---> 0995c72d2b5f Removing intermediate container 2d94ad2b8fb0 Step 19/20 : RUN chmod +x /home/etsi/dev/robot/scripts/* ---> Running in b9c5dea3778b ---> 6241adf3afd5 Removing intermediate container b9c5dea3778b Step 20/20 : CMD tail -f /dev/null ---> Running in 0c07d82e5ac3 ---> 06d5a0a13682 Removing intermediate container 0c07d82e5ac3 Successfully built 06d5a0a13682 Successfully tagged stf583-rf-validation:latest + '[' 0 '!=' 0 ']' # That's all Floks exit 0 + exit 0 ++++ Dryrun file SOL002/VNFConfiguration-API/ApiVersion.robot ++++ Dryrun file SOL002/VNFConfiguration-API/Configuration.robot ++++ Dryrun file SOL002/VNFFaultManagement-API/Alarms.robot ++++ Issues found in file SOL002/VNFFaultManagement-API/Alarms.robot ============================================================================== Alarms ============================================================================== POST Alarms - Method not implemented :: Test ID: 6.3.4.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms :: Test ID: 6.3.4.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with invalid attribute-based... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "all_fields" attribute ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with exclude_default attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with fields attribute select... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "exclude_fields" attrib... | PASS | ------------------------------------------------------------------------------ PUT Alarms - Method not implemented :: Test ID: 6.3.4.1.9 | PASS | ------------------------------------------------------------------------------ PATCH Alarms - Method not implemented :: Test ID: 6.3.4.1.10 | PASS | ------------------------------------------------------------------------------ DELETE Alarms - Method not implemented :: Test ID: 6.3.4.1.11 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms to get Paged Response :: Tes... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms for Bad Request Response too... | PASS | ------------------------------------------------------------------------------ GET information about alarms with attribute-based filter "id" :: T... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Alarms | FAIL | 19 critical tests, 14 passed, 5 failed 19 tests total, 14 passed, 5 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFFaultManagement-API/ApiVersion.robot ++++ Dryrun file SOL002/VNFFaultManagement-API/EscalatePerceivedSeverityTask.robot ++++ Dryrun file SOL002/VNFFaultManagement-API/IndividualAlarm.robot ++++ Dryrun file SOL002/VNFFaultManagement-API/IndividualSubscription.robot ++++ Dryrun file SOL002/VNFFaultManagement-API/NotificationConsumer.robot ++++ Issues found in file SOL002/VNFFaultManagement-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== VNF Fault Alarm Notification :: Test ID: 6.3.4.8.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Fault Alarm Cleared Notification :: Test ID: 6.3.4.8.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Fault Alarm List Rebuilt Notification :: Test ID: 6.3.4.8.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 3 critical tests, 0 passed, 3 failed 3 tests total, 0 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFFaultManagement-API/NotificationEndpoint.robot ++++ Dryrun file SOL002/VNFFaultManagement-API/Subscriptions.robot ++++ Issues found in file SOL002/VNFFaultManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create a new subscription :: Test ID: 6.3.4.4.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create a new Subscription - DUPLICATION :: Test ID: 6.3.4.4.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create a new Subscription - NO-DUPLICATION :: Test ID: 6.3.4.4.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 6.3.4.4.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 6.3.4.4.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 6.3.4.4.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 6.3.4.4.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 6.3.4.4.13 | PASS | ------------------------------------------------------------------------------ GET Subscriptions to get Paged Response :: Test ID: 6.3.4.4.14 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 6.3.4... | PASS | ------------------------------------------------------------------------------ GET Subscription with attribute-based filter "id" :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.notificationTypes" :: Test I... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Get subscriptions with filter "filter.faultyResourceTypes" :: Test... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Get subscriptions with filter "filter.perceivedSeverities" :: Test... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Get subscriptions with filter "filter.eventTypes" :: Test ID: 6.3.... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Get subscriptions with filter "filter.probableCauses" :: Test ID: ... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ POST Create a new Subscription - Unprocessable Entity :: Test ID: ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Subscriptions | FAIL | 22 critical tests, 13 passed, 9 failed 22 tests total, 13 passed, 9 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFIndicator-API/ApiVersion.robot ++++ Dryrun file SOL002/VNFIndicator-API/IndividualSubscription.robot ++++ Dryrun file SOL002/VNFIndicator-API/IndividualVNFindicator.robot ++++ Dryrun file SOL002/VNFIndicator-API/NoificationConsumer.robot ++++ Issues found in file SOL002/VNFIndicator-API/NoificationConsumer.robot ============================================================================== NoificationConsumer ============================================================================== VNF Indicator Value Change Notification :: Test ID: 6.3.2.7.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NoificationConsumer | FAIL | 1 critical test, 0 passed, 1 failed 1 test total, 0 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFIndicator-API/Subscriptions.robot ++++ Issues found in file SOL002/VNFIndicator-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== GET VNF Indicators Subscriptions :: Test ID: 6.3.2.4.1 | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions with attribute-based filter :: Te... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions with invalid attribute-based filt... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions with invalid resource endpoint ::... | PASS | ------------------------------------------------------------------------------ Create new VNF indicator subscription :: Test ID: 6.3.2.4.5 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT VNF Indicator Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PATCH VNF Indicator Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ DELETE VNF Indicator Subscriptions - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions to get Paged Response :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions - Bad Request Response too Big ::... | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - Unprocessable Entity :: Test ID: ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create new VNF indicator Subscription - DUPLICATION :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ Create new VNF indicator Subscription - NO-DUPLICATION :: Test ID:... | PASS | ------------------------------------------------------------------------------ Subscriptions | FAIL | 13 critical tests, 11 passed, 2 failed 13 tests total, 11 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFIndicator-API/VNFIndicators.robot ++++ Dryrun file SOL002/VNFIndicator-API/VnfIndicatorsInVnfInstanceId.robot ++++ Dryrun file SOL002/VNFIndicatorNotification-API/VnfIndicatorNotification.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/ApiVersion.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/CancelOperationTask.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/ChangeExternalVNFConnectivityTask.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/ChangeVNFFlavourTask.robot ++++ Issues found in file SOL002/VNFLifecycleManagement-API/ChangeVNFFlavourTask.robot ============================================================================== ChangeVNFFlavourTask ============================================================================== POST Change deployment flavour of a vnfInstance :: Test ID: 6.3.5.6.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Conflict (Not-Inst... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Not Found :: Test ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PUT Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PATCH Change deployment flavour VNFInstance - Method not implement... | PASS | ------------------------------------------------------------------------------ DELETE Change deployment flavour VNFInstance - Method not implemen... | PASS | ------------------------------------------------------------------------------ ChangeVNFFlavourTask | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFLifecycleManagement-API/FailOperationTask.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/HealVNFTask.robot ++++ Issues found in file SOL002/VNFLifecycleManagement-API/HealVNFTask.robot ============================================================================== HealVNFTask ============================================================================== POST Heal a vnfInstance :: Test ID: 6.3.5.8.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Heal a vnfInstance Conflict (Not-Instantiated) :: Test ID: 6.... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Heal a vnfInstance Not Found :: Test ID: 6.3.5.8.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Heal VNFInstance - Method not implemented :: Test ID: 6.3.5.8.4 | PASS | ------------------------------------------------------------------------------ PUT Heal VNFInstance - Method not implemented :: Test ID: 6.3.5.8.5 | PASS | ------------------------------------------------------------------------------ PATCH Heal VNFInstance - Method not implemented :: Test ID: 6.3.5.8.6 | PASS | ------------------------------------------------------------------------------ DELETE Heal VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ HealVNFTask | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFLifecycleManagement-API/IndividualSubscription.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/IndividualVNFInstance.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/IndividualVnfLcmOperationOccurence.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/InstantiateVNFTask.robot ++++ Issues found in file SOL002/VNFLifecycleManagement-API/InstantiateVNFTask.robot ============================================================================== InstantiateVNFTask ============================================================================== POST Instantiate a vnfInstance :: Test ID: 6.3.5.3.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Instantiate a vnfInstance Conflict :: Test ID: 6.3.5.3.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Instantiate VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ PUT Instantiate VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ PATCH Instantiate VNFInstance - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Instantiate VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ InstantiateVNFTask | FAIL | 6 critical tests, 4 passed, 2 failed 6 tests total, 4 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFLifecycleManagement-API/NotificationConsumer.robot ++++ Issues found in file SOL002/VNFLifecycleManagement-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== VNF LCM Operation Occurrence Notification :: Test ID: 6.3.5.21.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Identifier Creation Notification :: Test ID: 6.3.5.21.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Identifier Deletion Notification :: Test ID: 6.3.5.21.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 3 critical tests, 0 passed, 3 failed 3 tests total, 0 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFLifecycleManagement-API/NotificationEndpoint.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/OperateVNFTask.robot ++++ Issues found in file SOL002/VNFLifecycleManagement-API/OperateVNFTask.robot ============================================================================== OperateVNFTask ============================================================================== POST Operate a vnfInstance :: Test ID: 6.3.5.9.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Operate a vnfInstance Conflict (Not-Instantiated) :: Test ID:... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Operate a vnfInstance Not Found :: Test ID: 6.3.5.9.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Operate VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PUT Operate VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PATCH Operate VNFInstance - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ DELETE Operate VNFInstance - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ OperateVNFTask | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFLifecycleManagement-API/RetryOperationTask.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/RollbackOperationTask.robot ++++ Dryrun file SOL002/VNFLifecycleManagement-API/ScaleVNFTask.robot ++++ Issues found in file SOL002/VNFLifecycleManagement-API/ScaleVNFTask.robot ============================================================================== ScaleVNFTask ============================================================================== POST Scale a vnfInstance :: Test ID: 6.3.5.4.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Scale a vnfInstance Conflict (Not-Instantiated) :: Test ID: 6... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Scale a vnfInstance Not Found :: Test ID: 6.3.5.4.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Scale VNFInstance - Method not implemented :: Test ID: 6.3.5.4.4 | PASS | ------------------------------------------------------------------------------ PUT Scale VNFInstance - Method not implemented :: Test ID: 6.3.5.4.5 | PASS | ------------------------------------------------------------------------------ PATCH Scale VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ DELETE Scale VNFInstance - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ ScaleVNFTask | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFLifecycleManagement-API/ScaleVNFToLevelTask.robot ++++ Issues found in file SOL002/VNFLifecycleManagement-API/ScaleVNFToLevelTask.robot ============================================================================== ScaleVNFToLevelTask ============================================================================== POST Scale a vnfInstance to level :: Test ID: 6.3.5.5.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Scale a vnfInstance to level Conflict (Not-Instantiated) :: T... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Scale a vnfInstance Not Found :: Test ID: 6.3.5.5.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PUT Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH Scale to level VNFInstance - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Scale to level VNFInstance - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ ScaleVNFToLevelTask | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFLifecycleManagement-API/Subscriptions.robot ++++ Issues found in file SOL002/VNFLifecycleManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== POST Create a new subscription :: Test ID: 6.3.5.17.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Create a new Subscription - DUPLICATION :: Test ID: 6.3.5.17.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Create a new Subscription - NO-DUPLICATION :: Test ID: 6.3.5.... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 6.3.5.17.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 6.3.5.17.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with all_fields attribute selector :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_default attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with fields attribute selector :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_fields attribute selector :: Test I... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 6.3.5.17.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 6.3.5.17.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 6.3.5.17.13 | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - Unprocessable Entity :: Test ID: ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET information about multiple subscriptions to get Paged Response... | PASS | ------------------------------------------------------------------------------ GET information about multiple subscriptions for Bad Request Respo... | PASS | ------------------------------------------------------------------------------ Subscriptions | FAIL | 16 critical tests, 12 passed, 4 failed 16 tests total, 12 passed, 4 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFLifecycleManagement-API/TerminateVNFTask.robot ++++ Issues found in file SOL002/VNFLifecycleManagement-API/TerminateVNFTask.robot ============================================================================== TerminateVNFTask ============================================================================== POST Terminate a vnfInstance :: Test ID: 6.3.5.7.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Terminate a vnfInstance Conflict (Not-Instantiated) :: Test I... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Terminate VNFInstance - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PUT Terminate VNFInstance - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PATCH Terminate VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ DELETE Terminate VNFInstance - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ TerminateVNFTask | FAIL | 6 critical tests, 4 passed, 2 failed 6 tests total, 4 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFLifecycleManagement-API/VNFInstances.robot ++++ Issues found in file SOL002/VNFLifecycleManagement-API/VNFInstances.robot ============================================================================== VNFInstances ============================================================================== POST Create a new vnfInstance :: Test ID: 6.3.5.1.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET information about multiple VNF instances :: Test ID: 6.3.5.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "all_fields" att... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_default... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "fields" attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_fields"... | PASS | ------------------------------------------------------------------------------ PUT VNFInstances - Method not implemented :: Test ID: 6.3.5.1.9 | PASS | ------------------------------------------------------------------------------ PATCH VNFInstances - Method not implemented :: Test ID: 6.3.5.1.10 | PASS | ------------------------------------------------------------------------------ DELETE VNFInstances - Method not implemented :: Test ID: 6.3.5.1.11 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_default... | PASS | ------------------------------------------------------------------------------ VNFInstances | FAIL | 12 critical tests, 11 passed, 1 failed 12 tests total, 11 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFLifecycleManagement-API/VnfLcmOperationOccurences.robot ++++ Dryrun file SOL002/VNFPerformanceManagement-API/ApiVersion.robot ++++ Dryrun file SOL002/VNFPerformanceManagement-API/IndividualPmJob.robot ++++ Dryrun file SOL002/VNFPerformanceManagement-API/IndividualReport.robot ++++ Dryrun file SOL002/VNFPerformanceManagement-API/IndividualThreshold.robot ++++ Dryrun file SOL002/VNFPerformanceManagement-API/NotificationConsumer.robot ++++ Issues found in file SOL002/VNFPerformanceManagement-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== VNF Performance Information Availability Notification :: Test ID: ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Threshold Crossed Notification :: Test ID: 6.3.3.10.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 2 critical tests, 0 passed, 2 failed 2 tests total, 0 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFPerformanceManagement-API/PMJobs.robot ++++ Issues found in file SOL002/VNFPerformanceManagement-API/PMJobs.robot ============================================================================== PMJobs ============================================================================== GET all VNF Performance Monitoring Jobs :: Test ID: 6.3.3.1.1 | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with attribute-based filter ::... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with all_fields attribute ... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_default attri... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with fields attribute sele... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_fields attrib... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid attribute-based f... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid resource endpoint... | PASS | ------------------------------------------------------------------------------ Create new VNF Performance Monitoring Job :: Test ID: 6.3.3.1.9 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT all VNF Performance Monitoring Jobs - Method not implemented :... | PASS | ------------------------------------------------------------------------------ PATCH all VNF Performance Monitoring Jobs - Method not implemented... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Performance Monitoring Jobs - Method not implemente... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs to get Paged Response :: Test ... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs for Bad Request Response too b... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_default and f... | PASS | ------------------------------------------------------------------------------ PMJobs | FAIL | 15 critical tests, 14 passed, 1 failed 15 tests total, 14 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFPerformanceManagement-API/Thresholds.robot ++++ Issues found in file SOL002/VNFPerformanceManagement-API/Thresholds.robot ============================================================================== Thresholds ============================================================================== GET All Performance Thresholds :: Test ID: 6.3.3.4.1 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS | ------------------------------------------------------------------------------ Create new Performance Threshold :: Test ID: 6.3.3.4.5 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT Performance Thresholds - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with Paged Response :: Test ID: 6.3.3.4.9 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds for Bad Request Response too big :: Tes... | PASS | ------------------------------------------------------------------------------ Thresholds | FAIL | 10 critical tests, 9 passed, 1 failed 10 tests total, 9 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL002/VNFPerformanceManagementNotification-API/PerformanceManagementNotification.robot ++++ Dryrun file SOL003/VNFFaultManagement-API/Alarms.robot ++++ Dryrun file SOL003/VNFFaultManagement-API/ApiVersion.robot ++++ Dryrun file SOL003/VNFFaultManagement-API/IndividualAlarm.robot ++++ Dryrun file SOL003/VNFFaultManagement-API/IndividualSubscription.robot ++++ Dryrun file SOL003/VNFFaultManagement-API/NotificationConsumer.robot ++++ Issues found in file SOL003/VNFFaultManagement-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== VNF Fault Alarm Notification :: Test ID: 7.3.5.7.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Fault Alarm Cleared Notification :: Test ID: 7.3.5.7.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Fault Alarm List Reulit Notification :: Test ID: 7.3.5.7.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 3 critical tests, 0 passed, 3 failed 3 tests total, 0 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFFaultManagement-API/Subscriptions.robot ++++ Issues found in file SOL003/VNFFaultManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create a new Fault Management alarm subscription :: Test ID: 7.3.5... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create a new alarm subscription - DUPLICATION :: Test ID: 7.3.5.3.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create a new alarm subscription - NO DUPLICATION :: Test ID: 7.3.5... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions :: Test ID: 7.3.5.3.4 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 7.3.5.3.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 7.3.5.3.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 7.3.5.3.13 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions as Paged Response :: Test I... | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 7.3.5... | PASS | ------------------------------------------------------------------------------ GET Subscription with attribute-based filter "id" :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.notificationTypes" :: Test I... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Get subscriptions with filter "filter.faultyResourceTypes" :: Test... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Get subscriptions with filter "filter.perceivedSeverities" :: Test... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Get subscriptions with filter "filter.eventTypes" :: Test ID: 7.3.... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Get subscriptions with filter "filter.probableCauses" :: Test ID: ... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ POST Create a new Subscription - Unprocessable Entity :: Test ID: ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Subscriptions | FAIL | 22 critical tests, 13 passed, 9 failed 22 tests total, 13 passed, 9 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFFaultManagementNotification-API/NotificationEndpoint.robot ++++ Dryrun file SOL003/VNFIndicator-API/ApiVersion.robot ++++ Dryrun file SOL003/VNFIndicator-API/IndividualSubscription.robot ++++ Dryrun file SOL003/VNFIndicator-API/IndividualVNFindicator.robot ++++ Dryrun file SOL003/VNFIndicator-API/NotificationConsumer.robot ++++ Issues found in file SOL003/VNFIndicator-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== VNF Indicator Value Change Notification :: Test ID: 7.3.6.7.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 1 critical test, 0 passed, 1 failed 1 test total, 0 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFIndicator-API/Subscriptions.robot ++++ Issues found in file SOL003/VNFIndicator-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== GET All VNF Indicator Subscriptions :: Test ID: 7.3.6.4.1 | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions with attribute-based filter :: Tes... | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions with invalid attribute-based filte... | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions with invalid resource endpoint :: ... | PASS | ------------------------------------------------------------------------------ Create new VNF indicator subscription :: Test ID: 7.3.6.4.5 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create duplicated VNF indicator subscription with VNFM not creatin... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create duplicated VNF indicator subscription with VNFM creating du... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT VNF Indicator Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PATCH VNF Indicator Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ DELETE VNF Indicator Subscriptions - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ GET All VNF Indicator Subscriptions as Paged Response :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions - Bad Request Response too Big :: ... | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - Unprocessable Entity :: Test ID: ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Subscriptions | FAIL | 13 critical tests, 9 passed, 4 failed 13 tests total, 9 passed, 4 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFIndicator-API/VNFIndicators.robot ++++ Dryrun file SOL003/VNFIndicator-API/VnfIndicatorNotification.robot ++++ Dryrun file SOL003/VNFIndicator-API/VnfIndicatorsInVnfInstanceId.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/ApiVersion.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/CancelOperationTask.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/CancelOperationWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/ChangeExternalVNFConnectivityTask.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/ChangeExternalVNFConnectivityWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/ChangeVNFFlavourTask.robot ++++ Issues found in file SOL003/VNFLifecycleManagement-API/ChangeVNFFlavourTask.robot ============================================================================== ChangeVNFFlavourTask ============================================================================== POST Change deployment flavour of a vnfInstance :: Test ID: 7.3.1.6.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Conflict (Not-Inst... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Not Found :: Test ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PUT Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PATCH Change deployment flavour VNFInstance - Method not implement... | PASS | ------------------------------------------------------------------------------ DELETE Change deployment flavour VNFInstance - Method not implemen... | PASS | ------------------------------------------------------------------------------ ChangeVNFFlavourTask | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFLifecycleManagement-API/ChangeVNFFlavourWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/CreateVNFWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/DeleteVNFWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/FailOperationTask.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/FailOperationWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/HealVNFTask.robot ++++ Issues found in file SOL003/VNFLifecycleManagement-API/HealVNFTask.robot ============================================================================== HealVNFTask ============================================================================== POST Heal a vnfInstance :: Test ID: 7.3.1.8.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Heal a vnfInstance Conflict (Not-Instantiated) :: Test ID: 7.... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Heal a vnfInstance Not Found :: Test ID: 7.3.1.8.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Heal VNFInstance - Method not implemented :: Test ID: 7.3.1.8.4 | PASS | ------------------------------------------------------------------------------ PUT Heal VNFInstance - Method not implemented :: Test ID: 7.3.1.8.5 | PASS | ------------------------------------------------------------------------------ PATCH Heal VNFInstance - Method not implemented :: Test ID: 7.3.1.8.6 | PASS | ------------------------------------------------------------------------------ DELETE Heal VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ HealVNFTask | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFLifecycleManagement-API/HealVNFWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/IndividualSubscription.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/IndividualVNFInstance.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/IndividualVnfLcmOperationOccurence.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/InstantiateVNFTask.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/InstantiateVNFTaskWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/ModifyVNFInformationWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/NotificationConsumer.robot ++++ Issues found in file SOL003/VNFLifecycleManagement-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== VNF LCM Operation Occurrence Notification :: Test ID: 7.3.1.36.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Identifier Creation Notification :: Test ID: 7.3.1.36.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Identifier Deletion Notification :: Test ID: 7.3.1.36.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 3 critical tests, 0 passed, 3 failed 3 tests total, 0 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFLifecycleManagement-API/NotificationEndpoint.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/OperateVNFTask.robot ++++ Issues found in file SOL003/VNFLifecycleManagement-API/OperateVNFTask.robot ============================================================================== OperateVNFTask ============================================================================== POST Operate a vnfInstance :: Test ID: 7.3.1.9.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Operate a vnfInstance Conflict (Not-Instantiated) :: Test ID:... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Operate a vnfInstance Not Found :: Test ID: 7.3.1.9.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Operate VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PUT Operate VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PATCH Operate VNFInstance - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ DELETE Operate VNFInstance - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ OperateVNFTask | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFLifecycleManagement-API/OperateVNFWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/RetryOperationTask.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/RetryOperationWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/RollBackOperationWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/RollbackOperationTask.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/ScaleVNFTask.robot ++++ Issues found in file SOL003/VNFLifecycleManagement-API/ScaleVNFTask.robot ============================================================================== ScaleVNFTask ============================================================================== POST Scale a vnfInstance :: Test ID: 7.3.1.4.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Scale a vnfInstance Conflict (Not-Instantiated) :: Test ID: 7... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Scale a vnfInstance Not Found :: Test ID: 7.3.1.4.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Scale VNFInstance - Method not implemented :: Test ID: 7.3.1.4.4 | PASS | ------------------------------------------------------------------------------ PUT Scale VNFInstance - Method not implemented :: Test ID: 7.3.1.4.5 | PASS | ------------------------------------------------------------------------------ PATCH Scale VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ DELETE Scale VNFInstance - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ ScaleVNFTask | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFLifecycleManagement-API/ScaleVNFToLevelTask.robot ++++ Issues found in file SOL003/VNFLifecycleManagement-API/ScaleVNFToLevelTask.robot ============================================================================== ScaleVNFToLevelTask ============================================================================== POST Scale a vnfInstance to level :: Test ID: 7.3.1.5.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Scale a vnfInstance to level Conflict (Not-Instantiated) :: T... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Scale a vnfInstance Not Found :: Test ID: 7.3.1.5.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PUT Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH Scale to level VNFInstance - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Scale to level VNFInstance - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ ScaleVNFToLevelTask | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFLifecycleManagement-API/ScaleVNFToLevelWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/ScaleVNFWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/Subscriptions.robot ++++ Issues found in file SOL003/VNFLifecycleManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== POST Create a new subscription :: Test ID: 7.3.1.17.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create a new Subscription - DUPLICATION :: Test ID: 7.3.1.17.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create a new Subscription - NO-DUPLICATION :: Test ID: 7.3.1.17.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 7.3.1.17.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 7.3.1.17.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with all_fields attribute selector :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_default attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with fields attribute selector :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_fields attribute selector :: Test I... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 7.3.1.17.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 7.3.1.17.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 7.3.1.17.13 | PASS | ------------------------------------------------------------------------------ GET Subscriptions as a Paged Response :: Test ID: 7.3.1.17.14 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - Unprocessable Entity :: Test ID: ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Subscriptions | FAIL | 16 critical tests, 12 passed, 4 failed 16 tests total, 12 passed, 4 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFLifecycleManagement-API/TerminateVNFTask.robot ++++ Issues found in file SOL003/VNFLifecycleManagement-API/TerminateVNFTask.robot ============================================================================== TerminateVNFTask ============================================================================== POST Terminate a vnfInstance :: Test ID: 7.3.1.7.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Terminate a vnfInstance Conflict (Not-Instantiated) :: Test I... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Terminate VNFInstance - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PUT Terminate VNFInstance - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PATCH Terminate VNFInstance - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ DELETE Terminate VNFInstance - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ TerminateVNFTask | FAIL | 6 critical tests, 4 passed, 2 failed 6 tests total, 4 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFLifecycleManagement-API/TerminateVNFWorkflow.robot ++++ Dryrun file SOL003/VNFLifecycleManagement-API/VNFInstances.robot ++++ Issues found in file SOL003/VNFLifecycleManagement-API/VNFInstances.robot ============================================================================== VNFInstances ============================================================================== POST Create a new vnfInstance :: Test ID: 7.3.1.1.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET information about multiple VNF instances :: Test ID: 7.3.1.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "all_fields" att... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_default... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "fields" attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_fields"... | PASS | ------------------------------------------------------------------------------ PUT multiples VNFInstances - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ PATCH multiples VNFInstances - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE VNFInstances - Method not implemented :: Test ID: 7.3.1.1.11 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances to get Paged Response... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances - Bad Request Respons... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_default... | PASS | ------------------------------------------------------------------------------ VNFInstances | FAIL | 14 critical tests, 13 passed, 1 failed 14 tests total, 13 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFLifecycleManagement-API/VnfLcmOperationOccurences.robot ++++ Dryrun file SOL003/VNFLifecycleOperationGranting-API/ApiVersion.robot ++++ Dryrun file SOL003/VNFLifecycleOperationGranting-API/Grants.robot ++++ Issues found in file SOL003/VNFLifecycleOperationGranting-API/Grants.robot ============================================================================== Grants :: This resource represents grants. The client can use this resource... ============================================================================== Requests a grant for a particular VNF lifecycle operation - Synchr... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Requests a grant for a particular VNF lifecycle operation - Asynch... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Requests a grant for a particular VNF lifecycle operation - Forbid... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Grants - Method not implemented :: Test ID: 7.3.2.1.4 | PASS | ------------------------------------------------------------------------------ PUT Grants - Method not implemented :: Test ID: 7.3.2.1.5 | PASS | ------------------------------------------------------------------------------ PATCH Grants - Method not implemented :: Test ID: 7.3.2.1.6 | PASS | ------------------------------------------------------------------------------ DELETE Grants - Method not implemented :: Test ID: 7.3.2.1.7 | PASS | ------------------------------------------------------------------------------ Grants :: This resource represents grants. The client can use this... | FAIL | 7 critical tests, 4 passed, 3 failed 7 tests total, 4 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFLifecycleOperationGranting-API/IndividualGrant.robot ++++ Dryrun file SOL003/VNFPackageManagement-API/ApiVersion.robot ++++ Dryrun file SOL003/VNFPackageManagement-API/IndividualSubscription.robot ++++ Dryrun file SOL003/VNFPackageManagement-API/IndividualVNFPackage.robot ++++ Dryrun file SOL003/VNFPackageManagement-API/IndividualVNFPackageArtifacts.robot ++++ Dryrun file SOL003/VNFPackageManagement-API/ManifestInIndividualVNFPackage.robot ++++ Dryrun file SOL003/VNFPackageManagement-API/NotificationConsumer.robot ++++ Issues found in file SOL003/VNFPackageManagement-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== VNF Package Onboarding Notification :: Test ID: 7.3.3.12.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Package Change Notification :: Test ID: 7.3.3.12.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 2 critical tests, 0 passed, 2 failed 2 tests total, 0 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFPackageManagement-API/PackageManagementNotification.robot ++++ Dryrun file SOL003/VNFPackageManagement-API/Subscriptions.robot ++++ Issues found in file SOL003/VNFPackageManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Get All VNF Package Subscriptions :: Test ID: 7.3.3.6.1 | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with attribute-based filter :: Test ... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with invalid attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET VNF Package Subscription with invalid resource endpoint :: Tes... | PASS | ------------------------------------------------------------------------------ Create new VNF Package subscription :: Test ID: 7.3.3.6.5 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO not creating ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO creating dupl... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT VNF Package Subscriptions - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ PATCH VNF Package Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ DELETE VNF Package Subscriptions - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ Get All VNF Package Subscriptions as Paged Response :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions - Bad Request Response too Big :: Te... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions - Unprocessable Entity :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ Subscriptions | FAIL | 13 critical tests, 10 passed, 3 failed 13 tests total, 10 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFPackageManagement-API/VNFDInIndividualVNFPackage.robot ++++ Dryrun file SOL003/VNFPackageManagement-API/VNFPackageArtifacts.robot ++++ Dryrun file SOL003/VNFPackageManagement-API/VNFPackageContent.robot ++++ Dryrun file SOL003/VNFPackageManagement-API/VNFPackages.robot ++++ Dryrun file SOL003/VNFPerformanceManagement-API/ApiVersion.robot ++++ Dryrun file SOL003/VNFPerformanceManagement-API/IndividualPmJob.robot ++++ Dryrun file SOL003/VNFPerformanceManagement-API/IndividualReport.robot ++++ Dryrun file SOL003/VNFPerformanceManagement-API/IndividualThreshold.robot ++++ Dryrun file SOL003/VNFPerformanceManagement-API/NotificationConsumer.robot ++++ Dryrun file SOL003/VNFPerformanceManagement-API/PMJobs.robot ++++ Issues found in file SOL003/VNFPerformanceManagement-API/PMJobs.robot ============================================================================== PMJobs ============================================================================== GET all VNF Performance Monitoring Jobs :: Test ID: 7.3.4.1.1 | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with attribute-based filter ::... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with all_fields attribute ... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_default attri... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with fields attribute sele... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_fields attrib... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid attribute-based f... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid resource endpoint... | PASS | ------------------------------------------------------------------------------ Create new VNF Performance Monitoring Job :: Test ID: 7.3.4.1.9 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT all VNF Performance Monitoring Jobs - Method not implemented :... | PASS | ------------------------------------------------------------------------------ PATCH all VNF Performance Monitoring Jobs - (Method not implemente... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Performance Monitoring Jobs - Method not implemente... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs as Paged Response :: Test ... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs - Bad Request Response too Big... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with fields and exclude_de... | PASS | ------------------------------------------------------------------------------ PMJobs | FAIL | 15 critical tests, 14 passed, 1 failed 15 tests total, 14 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VNFPerformanceManagement-API/PerformanceManagementNotification.robot ++++ Dryrun file SOL003/VNFPerformanceManagement-API/Thresholds.robot ++++ Issues found in file SOL003/VNFPerformanceManagement-API/Thresholds.robot ============================================================================== Thresholds ============================================================================== GET All Performance Thresholds :: Test ID: 7.3.4.4.1 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS | ------------------------------------------------------------------------------ Create new Performance Threshold :: Test ID: 7.3.4.4.5 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT Performance Thresholds - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET All Performance Thresholds as Paged Response :: Test ID: 7.3.4... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds - Bad Request Response too Big :: Test ... | PASS | ------------------------------------------------------------------------------ Thresholds | FAIL | 10 critical tests, 9 passed, 1 failed 10 tests total, 9 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VirtualisedResourcesQuotaAvailableNotification-API/ApiVersion.robot ++++ Dryrun file SOL003/VirtualisedResourcesQuotaAvailableNotification-API/IndividualSubscription.robot ++++ Dryrun file SOL003/VirtualisedResourcesQuotaAvailableNotification-API/NotificationConsumer.robot ++++ Issues found in file SOL003/VirtualisedResourcesQuotaAvailableNotification-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== Vr Quota Availibility Notification :: Test ID: 7.3.7.4.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 1 critical test, 0 passed, 1 failed 1 test total, 0 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL003/VirtualisedResourcesQuotaAvailableNotification-API/NotificationEndpoint.robot ++++ Dryrun file SOL003/VirtualisedResourcesQuotaAvailableNotification-API/Subscriptions.robot ++++ Issues found in file SOL003/VirtualisedResourcesQuotaAvailableNotification-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create new Virtualised Resources Quota Available Notification subs... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create new Virtualised Resources Quota Available Notification subs... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create new Virtualised Resources Quota Available Notification subs... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification Subscriptio... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification Subscriptio... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification subscriptio... | PASS | ------------------------------------------------------------------------------ PUT Virtualised Resources Quota Available Notification subscriptio... | PASS | ------------------------------------------------------------------------------ PATCH Virtualised Resources Quota Available Notification subscript... | PASS | ------------------------------------------------------------------------------ DELETE Virtualised Resources Quota Available Notification subscrip... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification Subscriptio... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification subscriptio... | PASS | ------------------------------------------------------------------------------ Create new Virtualised Resources Quota Available Notification Subs... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Subscriptions | FAIL | 12 critical tests, 8 passed, 4 failed 12 tests total, 8 passed, 4 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSDManagement-API/ApiVersion.robot ++++ Dryrun file SOL005/NSDManagement-API/IndividualNSDescriptor.robot ++++ Dryrun file SOL005/NSDManagement-API/IndividualPnfDescriptor.robot ++++ Dryrun file SOL005/NSDManagement-API/IndividualSubscription.robot ++++ Dryrun file SOL005/NSDManagement-API/NSD.robot ++++ Dryrun file SOL005/NSDManagement-API/NSDArchiveContent.robot ++++ Dryrun file SOL005/NSDManagement-API/NSDArchiveManifest.robot ++++ Dryrun file SOL005/NSDManagement-API/NSDManagementNotification.robot ++++ Dryrun file SOL005/NSDManagement-API/NSDescriptors.robot ++++ Dryrun file SOL005/NSDManagement-API/NotificationConsumer.robot ++++ Issues found in file SOL005/NSDManagement-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== NSD Onboarding Notification :: Test ID: 5.3.1.15.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NSD Onboarding Failure Notification :: Test ID: 5.3.1.15.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NSD Change Notification :: Test ID: 5.3.1.15.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NSD Deletion Notification :: Test ID: 5.3.1.15.4 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Pnfd Onboarding Notification :: Test ID: 5.3.1.15.5 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Pnfd Onboarding Failure Notification :: Test ID: 5.3.1.15.6 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Pnfd Deletion Notification :: Test ID: 5.3.1.15.7 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 7 critical tests, 0 passed, 7 failed 7 tests total, 0 passed, 7 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSDManagement-API/PNFD.robot ++++ Dryrun file SOL005/NSDManagement-API/PNFDArchiveContent.robot ++++ Dryrun file SOL005/NSDManagement-API/PNFDArchiveManifest.robot ++++ Dryrun file SOL005/NSDManagement-API/PNFDescriptors.robot ++++ Dryrun file SOL005/NSDManagement-API/Subscriptions.robot ++++ Issues found in file SOL005/NSDManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Get All NSD Management Subscriptions :: Test ID: 5.3.1.7.1 | PASS | ------------------------------------------------------------------------------ Get NSD Management Subscriptions with attribute-based filter :: Te... | PASS | ------------------------------------------------------------------------------ Get NSD Management Subscriptions with invalid attribute-based filt... | PASS | ------------------------------------------------------------------------------ GET NSD Management Subscription with invalid resource endpoint :: ... | PASS | ------------------------------------------------------------------------------ Create new NSD Management subscription :: Test ID: 5.3.1.7.5 | FAIL | Several failures occurred: 1) No keyword with name 'Format String' found. 2) No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create duplicated NSD Management subscription with NFVO not creati... | FAIL | Several failures occurred: 1) No keyword with name 'Format String' found. 2) No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create duplicated NSD Management subscription with NFVO creating d... | FAIL | Several failures occurred: 1) No keyword with name 'Format String' found. 2) No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT NSD Management Subscriptions - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ PATCH NSD Management Subscriptions - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ DELETE NSD Management Subscriptions - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ Get All NSD Management Subscriptions as Paged Response :: Test ID:... | PASS | ------------------------------------------------------------------------------ Get NSD Management Subscriptions - Bad Request Response too Big ::... | PASS | ------------------------------------------------------------------------------ Create new NSD Management subscription - Unprocessable Entity :: T... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Subscriptions | FAIL | 13 critical tests, 9 passed, 4 failed 13 tests total, 9 passed, 4 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSFaultManagement-API/Alarms.robot ++++ Issues found in file SOL005/NSFaultManagement-API/Alarms.robot ============================================================================== Alarms ============================================================================== POST Alarms - Method not implemented :: Test ID: 5.3.3.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms :: Test ID: 5.3.3.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filters :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms Bad Request Invalid attribut... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "all_fields" attribute ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with exclude_default attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with fields attribute select... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "exclude_fields" attrib... | PASS | ------------------------------------------------------------------------------ PUT Alarms - Method not implemented :: Test ID: 5.3.3.1.5 | PASS | ------------------------------------------------------------------------------ PATCH Alarms - Method not implemented :: Test ID: 5.3.3.1.6 | PASS | ------------------------------------------------------------------------------ DELETE Alarms - Method not implemented :: Test ID: 5.3.3.1.7 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms as Paged Response :: Test ID... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms - Bad Request Response too B... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "id" :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ GET information about multiple alarms with filter "eventType" :: T... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ GET information about multiple alarms with filter "perceivedSeveri... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ GET information about multiple alarms with filter "probableCause" ... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Alarms | FAIL | 21 critical tests, 14 passed, 7 failed 21 tests total, 14 passed, 7 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSFaultManagement-API/ApiVersion.robot ++++ Dryrun file SOL005/NSFaultManagement-API/IndividualAlarm.robot ++++ Dryrun file SOL005/NSFaultManagement-API/IndividualSubscription.robot ++++ Dryrun file SOL005/NSFaultManagement-API/NotificationConsumer.robot ++++ Issues found in file SOL005/NSFaultManagement-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== NS Fault Alarm Notification :: Test ID: 5.3.3.7.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NS Fault Alarm Cleared Notification :: Test ID: 5.3.3.7.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NS Fault Alarm List Rebuilt Notification :: Test ID: 5.3.3.7.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 3 critical tests, 0 passed, 3 failed 3 tests total, 0 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSFaultManagement-API/NotificationEndpoint.robot ++++ Dryrun file SOL005/NSFaultManagement-API/Subscriptions.robot ++++ Issues found in file SOL005/NSFaultManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create a new alarm subscription :: Test ID: 5.3.3.3.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create a new alarm subscription - DUPLICATION :: Test ID: 5.3.3.3.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create a new alarm subscription - NO DUPLICATION :: Test ID: 5.3.3... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions :: Test ID: 5.3.3.3.4 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions - Filter :: Test ID: 5.3.3.3.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 5.3.3.3.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 5.3.3.3.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 5.3.3.3.13 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions as Paged Response :: Test I... | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 5.3.3... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "id" :: Test ID... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.notific... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.faultyR... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.perceiv... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.eventTy... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.probabl... | FAIL | FOR loop contains no keywords. ------------------------------------------------------------------------------ Create a new alarm subscription - Unprocessable Entity :: Test ID:... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Subscriptions | FAIL | 22 critical tests, 13 passed, 9 failed 22 tests total, 13 passed, 9 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/ApiVersion.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/CancelOperationTask.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/ContinueOperationTask.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/CreateNSInstanceWorkflow.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/CreateNSInstanceWorkflow.robot ============================================================================== CreateNSInstanceWorkflow ============================================================================== NS Instance Creation :: Test ID: 5.3.2.18.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NS Instance Creation with DISABLED Network Service Descriptor :: T... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ CreateNSInstanceWorkflow | FAIL | 2 critical tests, 0 passed, 2 failed 2 tests total, 0 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/DeleteNSInstanceWorkflow.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/FailOperationTask.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/HealNSTask.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/HealNSTask.robot ============================================================================== HealNSTask ============================================================================== POST Heal a NSInstance :: Test ID: 5.3.2.6.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Heal a NSInstance - Conflict (Not Instantited) :: Test ID: 5.... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Heal NSInstance- Method not implemented :: Test ID: 5.3.2.6.3 | PASS | ------------------------------------------------------------------------------ PUT Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.4 | PASS | ------------------------------------------------------------------------------ PATCH Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.5 | PASS | ------------------------------------------------------------------------------ DELETE Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.6 | PASS | ------------------------------------------------------------------------------ HealNSTask | FAIL | 6 critical tests, 4 passed, 2 failed 6 tests total, 4 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/HealNSTaskWorkflow.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/HealNSTaskWorkflow.robot ============================================================================== HealNSTaskWorkflow ============================================================================== Heal Flow of NS lifecycle management operations :: Test ID: 5.3.2.... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ HealNSTaskWorkflow | FAIL | 1 critical test, 0 passed, 1 failed 1 test total, 0 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/IndividualNSInstance.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/IndividualNSLCMOccurences.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/IndividualSubscription.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/InstanciateNSTaskWorkflow.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/InstanciateNSTaskWorkflow.robot ============================================================================== InstanciateNSTaskWorkflow ============================================================================== Instantiate Flow of NS lifecycle management operations :: Test ID:... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ InstanciateNSTaskWorkflow | FAIL | 1 critical test, 0 passed, 1 failed 1 test total, 0 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/InstantiateNSTask.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/InstantiateNSTask.robot ============================================================================== InstantiateNSTask ============================================================================== POST Instantiate a nsInstance :: Test ID: 5.3.2.3.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Instantiate a nsInstance Conflict :: Test ID: 5.3.2.3.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Instantiate NSInstance - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ PUT Instantiate NSInstance - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ PATCH Instantiate NSInstance - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Instantiate NSInstance - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ InstantiateNSTask | FAIL | 6 critical tests, 4 passed, 2 failed 6 tests total, 4 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/NSInstances.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/NSInstances.robot ============================================================================== NSInstances ============================================================================== POST Create a new NsInstance :: Test ID: 5.3.2.1.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET information about multiple NS instances :: Test ID: 5.3.2.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances Bad Request Invalid at... | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances Bad Request Invalid at... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "all_fields" attribute selector :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "exclude_default" attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "fields" attribute selector :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "exclude_fields" attribute selector :: Test I... | PASS | ------------------------------------------------------------------------------ PUT NSInstances - Method not implemented :: Test ID: 5.3.2.1.9 | PASS | ------------------------------------------------------------------------------ PATCH NSInstances - Method not implemented :: Test ID: 5.3.2.1.10 | PASS | ------------------------------------------------------------------------------ DELETE NSInstances - Method not implemented :: Test ID: 5.3.2.1.11 | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances as Paged Response :: T... | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances - Bad Request Response... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "fields" and "exclude_default" attribute sele... | PASS | ------------------------------------------------------------------------------ NSInstances | FAIL | 14 critical tests, 13 passed, 1 failed 14 tests total, 13 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/NSLCMOccurences.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/NotificationConsumer.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== Ns Lcm Operation Occurrence Notification :: Test ID: 5.3.2.26.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Ns Identifier Creation Notification :: Test ID: 5.3.2.26.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Ns Identifier Deletion Notification :: Test ID: 5.3.2.26.3 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 3 critical tests, 0 passed, 3 failed 3 tests total, 0 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/NotificationEndpoint.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/RetryOperationTask.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/RollbackOperationTask.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/ScaleNSTask.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/ScaleNSTask.robot ============================================================================== ScaleNSTask ============================================================================== POST Scale a nsInstance :: Test ID: 5.3.2.4.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Scale a nsInstance - Conflict (Not Instantited) :: Test ID: 5... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Scale NSInstance- Method not implemented :: Test ID: 5.3.2.4.3 | PASS | ------------------------------------------------------------------------------ PUT Scale NSInstance - Method not implemented :: Test ID: 5.3.2.4.4 | PASS | ------------------------------------------------------------------------------ PATCH Scale NSInstance - Method not implemented :: Test ID: 5.3.2.4.5 | PASS | ------------------------------------------------------------------------------ DELETE Scale NSInstance - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ ScaleNSTask | FAIL | 6 critical tests, 4 passed, 2 failed 6 tests total, 4 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/ScaleNSTaskWorkflow.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/ScaleNSTaskWorkflow.robot ============================================================================== ScaleNSTaskWorkflow ============================================================================== Scale Flow of NS lifecycle management operations :: Test ID: 5.3.2... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ ScaleNSTaskWorkflow | FAIL | 1 critical test, 0 passed, 1 failed 1 test total, 0 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/Subscriptions.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== POST Create a new subscription :: Test ID: 5.3.2.15.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Create a new Subscription - DUPLICATION :: Test ID: 5.3.2.15.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Create a new Subscription - NO-DUPLICATION :: Test ID: 5.3.2.... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 5.3.2.15.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 5.3.2.15.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 5.3.2.15.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 5.3.2.15.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 5.3.2.15.13 | PASS | ------------------------------------------------------------------------------ GET Subscriptions as Paged Response :: Test ID: 5.3.2.15.14 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ POST Create a new subscription - Unprocessable Entity :: Test ID: ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Subscriptions | FAIL | 16 critical tests, 12 passed, 4 failed 16 tests total, 12 passed, 4 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/TerminateNSTask.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/TerminateNSTaskWorkflow.robot ++++ Dryrun file SOL005/NSLifecycleManagement-API/UpdateNSTask.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/UpdateNSTask.robot ============================================================================== UpdateNSTask ============================================================================== POST Update a NSInstance :: Test ID: 5.3.2.5.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ POST Update a NSInstance - Conflict (Not Instantited) :: Test ID: ... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Update NSInstance- Method not implemented :: Test ID: 5.3.2.5.3 | PASS | ------------------------------------------------------------------------------ PUT Update NSInstance - Method not implemented :: Test ID: 5.3.2.5.4 | PASS | ------------------------------------------------------------------------------ PATCH Update NSInstance - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ DELETE Update NSInstance - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ UpdateNSTask | FAIL | 6 critical tests, 4 passed, 2 failed 6 tests total, 4 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSLifecycleManagement-API/UpdateNSTaskWorkflow.robot ++++ Issues found in file SOL005/NSLifecycleManagement-API/UpdateNSTaskWorkflow.robot ============================================================================== UpdateNSTaskWorkflow ============================================================================== Update Flow of NS lifecycle management operations :: Test ID: 5.3.... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ UpdateNSTaskWorkflow | FAIL | 1 critical test, 0 passed, 1 failed 1 test total, 0 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSPerformanceManagement-API/ApiVersion.robot ++++ Dryrun file SOL005/NSPerformanceManagement-API/IndividualPmJob.robot ++++ Dryrun file SOL005/NSPerformanceManagement-API/IndividualReport.robot ++++ Dryrun file SOL005/NSPerformanceManagement-API/IndividualThreshold.robot ++++ Dryrun file SOL005/NSPerformanceManagement-API/NotificationConsumer.robot ++++ Dryrun file SOL005/NSPerformanceManagement-API/Notifications.robot ++++ Dryrun file SOL005/NSPerformanceManagement-API/PMJobs.robot ++++ Issues found in file SOL005/NSPerformanceManagement-API/PMJobs.robot ============================================================================== PMJobs ============================================================================== GET all NS Performance Monitoring Jobs :: Test ID: 5.3.4.1.1 | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs with attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "all_fields" attribute... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "exclude_default" attr... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "fields" attribute sel... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "exclude" attribute se... | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs with invalid attribute-based fi... | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs with invalid resource endpoint ... | PASS | ------------------------------------------------------------------------------ Create new NS Performance Monitoring Job :: Test ID: 5.3.4.1.9 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT all NS Performance Monitoring Jobs - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ PATCH all NS Performance Monitoring Jobs - Method not implemented ... | PASS | ------------------------------------------------------------------------------ DELETE all NS Performance Monitoring Jobs - Method not implemented... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs as Paged Response :: Test I... | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs - Bad Request Response too Big ... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "fields" and "exclude_... | PASS | ------------------------------------------------------------------------------ PMJobs | FAIL | 15 critical tests, 14 passed, 1 failed 15 tests total, 14 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL005/NSPerformanceManagement-API/Thresholds.robot ++++ Issues found in file SOL005/NSPerformanceManagement-API/Thresholds.robot ============================================================================== Thresholds :: This resource represents thresholds. The client can use this ... ============================================================================== GET All Performance Thresholds :: Test ID: 5.3.4.4.1 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS | ------------------------------------------------------------------------------ Create new Performance Threshold :: Test ID: 5.3.4.4.5 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT Performance Thresholds - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET All Performance Thresholds as Paged Response :: Test ID: 5.3.4... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds - Bad Request Response too Big :: Test ... | PASS | ------------------------------------------------------------------------------ Thresholds :: This resource represents thresholds. The client can ... | FAIL | 10 critical tests, 9 passed, 1 failed 10 tests total, 9 passed, 1 failed ============================================================================== Output: None ++++ Dryrun file SOL005/VNFPackageManagement-API/AccessConfigurationForExternalArtifacts.robot ++++ Dryrun file SOL005/VNFPackageManagement-API/ApiVersion.robot ++++ Dryrun file SOL005/VNFPackageManagement-API/IndividualSubscription.robot ++++ Dryrun file SOL005/VNFPackageManagement-API/IndividualVNFPackage.robot ++++ Dryrun file SOL005/VNFPackageManagement-API/IndividualVNFPackageArtifacts.robot ++++ Dryrun file SOL005/VNFPackageManagement-API/ManifestInIndividualVNFPackage.robot ++++ Dryrun file SOL005/VNFPackageManagement-API/NotificationConsumer.robot ++++ Issues found in file SOL005/VNFPackageManagement-API/NotificationConsumer.robot ============================================================================== NotificationConsumer ============================================================================== VNF Package Onboarding Notification :: Test ID: 5.3.5.13.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ VNF Package Change Notification :: Test ID: 5.3.5.13.2 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ NotificationConsumer | FAIL | 2 critical tests, 0 passed, 2 failed 2 tests total, 0 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL005/VNFPackageManagement-API/Notifications.robot ++++ Dryrun file SOL005/VNFPackageManagement-API/Subscriptions.robot ++++ Issues found in file SOL005/VNFPackageManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Get All VNF Package Subscriptions :: Test ID: 5.3.5.7.1 | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with attribute-based filter :: Test ... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with invalid attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET VNF Package Subscription with invalid resource endpoint :: Tes... | PASS | ------------------------------------------------------------------------------ Create new VNF Package subscription :: Test ID: 5.3.5.7.5 | FAIL | Several failures occurred: 1) No keyword with name 'Format String' found. 2) No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO not creating ... | FAIL | Several failures occurred: 1) No keyword with name 'Format String' found. 2) No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO creating dupl... | FAIL | Several failures occurred: 1) No keyword with name 'Format String' found. 2) No keyword with name 'Format String' found. ------------------------------------------------------------------------------ PUT VNF Package Subscriptions - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ PATCH VNF Package Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ DELETE VNF Package Subscriptions - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ Get All VNF Package Subscriptions as Paged Response :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions - Bad Request Response too Big :: Te... | PASS | ------------------------------------------------------------------------------ Subscriptions | FAIL | 12 critical tests, 9 passed, 3 failed 12 tests total, 9 passed, 3 failed ============================================================================== Output: None ++++ Dryrun file SOL005/VNFPackageManagement-API/VNFDInIndividualVNFPackage.robot ++++ Dryrun file SOL005/VNFPackageManagement-API/VNFPackageArtifacts.robot ++++ Dryrun file SOL005/VNFPackageManagement-API/VNFPackageContent.robot ++++ Dryrun file SOL005/VNFPackageManagement-API/VNFPackageContentViaURI.robot ++++ Issues found in file SOL005/VNFPackageManagement-API/VNFPackageContentViaURI.robot ============================================================================== VNFPackageContentViaURI ============================================================================== Upload VNF Package Content from URI :: Test ID: 5.3.5.5.1 | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ Upload VNF Package Content from URI with conflict due to onboardin... | FAIL | No keyword with name 'Format String' found. ------------------------------------------------------------------------------ GET Individual VNF Package Content from URI - Method not implement... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Content from URI - Method not implement... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Content from URI - Method not impleme... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Content from URI - Method not implem... | PASS | ------------------------------------------------------------------------------ VNFPackageContentViaURI | FAIL | 6 critical tests, 4 passed, 2 failed 6 tests total, 4 passed, 2 failed ============================================================================== Output: None ++++ Dryrun file SOL005/VNFPackageManagement-API/VNFPackages.robot Received arguments: ['create_sols.py', '../../robot', 'local', '../../build'] Using git ref: b'5d7a437 (commit) Generating entire SOL tests Opening doc: Tests-SOL002-VeVnfm_template.docx {'ref': '6,\tVe-Vnfm Reference Point, SOL002'} ../../robot SOL002 None Traceback (most recent call last): File "create_sols.py", line 205, in create_test_for_sol(solspec, spec_index, ROOT, COMMIT_ID, OUTDIR) File "create_sols.py", line 115, in create_test_for_sol raise err File "create_sols.py", line 96, in create_test_for_sol ref = lib.DocReference.from_str(item["ref"]) File "/home/etsi/dev/robot2doc/robot2doc/lib.py", line 62, in from_str return DocReference(string.split(".")) File "/home/etsi/dev/robot2doc/robot2doc/lib.py", line 37, in __init__ self._nums = [int(i) for i in sec_num_list] File "/home/etsi/dev/robot2doc/robot2doc/lib.py", line 37, in self._nums = [int(i) for i in sec_num_list] ValueError: invalid literal for int() with base 10: '6,\tVe-Vnfm Reference Point, SOL002' Final validation result: 1 Build step 'Execute shell' marked build as failure Archiving artifacts Finished: FAILURE