Started by GitLab push by Michele Carignani Building remotely on build.forge.etsi.org (docker) in workspace /home/jenkins/workspace/NFV - Network Functions Virtualisation/api-tests using credential f9a9fd70-ea8b-4872-a9d5-d1fb1cf8123e > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git@forge.etsi.org:nfv/api-tests.git # timeout=10 Fetching upstream changes from git@forge.etsi.org:nfv/api-tests.git > git --version # timeout=10 using GIT_SSH to set credentials > git fetch --tags --progress git@forge.etsi.org:nfv/api-tests.git +refs/heads/*:refs/remotes/origin/* > git rev-parse remotes/origin/2.7.1-dev-cicd^{commit} # timeout=10 > git branch -a -v --no-abbrev --contains 16b7ac7ba3f6e7b90e2b325d91e66a5aa80d8b2a # timeout=10 Checking out Revision 16b7ac7ba3f6e7b90e2b325d91e66a5aa80d8b2a (origin/2.7.1-dev-cicd) > git config core.sparsecheckout # timeout=10 > git checkout -f 16b7ac7ba3f6e7b90e2b325d91e66a5aa80d8b2a Commit message: "fix shell usage" > git rev-list --no-walk b42db06674ee802e51af3f2ac48505111316d299 # timeout=10 [api-tests] $ /bin/bash /tmp/jenkins691772150801560741.sh DOCKER_FILE=./scripts/docker/Dockerfile + DOCKER_FILE=./scripts/docker/Dockerfile if [ -f ${DOCKER_FILE} ] then #check and build stf583-rf-validation image DOCKER_ID=`docker ps -a | grep -e stf583-rf-validation | awk '{ print $1 }'` if [ ! -z "${DOCKER_ID}" ] then docker rm --force stf583-rf-validation fi docker build --tag stf583-rf-validation --force-rm -f ${DOCKER_FILE} . if [ "$?" != "0" ] then echo "Docker build failed: $?" exit -1 fi docker image ls -a docker inspect stf583-rf-validation:latest if [ "$?" != "0" ] then echo "Docker inspect failed: $?" exit -2 fi else exit -3 fi + '[' -f ./scripts/docker/Dockerfile ']' docker ps -a | grep -e stf583-rf-validation | awk '{ print $1 }' ++ docker ps -a ++ grep -e stf583-rf-validation ++ awk '{ print $1 }' + DOCKER_ID=87a9a51c6b57 + '[' '!' -z 87a9a51c6b57 ']' + docker rm --force stf583-rf-validation Error response from daemon: No such container: stf583-rf-validation + docker build --tag stf583-rf-validation --force-rm -f ./scripts/docker/Dockerfile . Sending build context to Docker daemon 66.64MB Step 1/14 : FROM ubuntu:16.04 ---> dfeff22e96ae Step 2/14 : MAINTAINER ETSI STF 583 ---> Using cache ---> c3e28c2ab3a7 Step 3/14 : LABEL description "SFT583 Robot Framework Docker Image" ---> Using cache ---> 06b4784845f3 Step 4/14 : ENV TERM xterm ---> Using cache ---> 24be069a7d43 Step 5/14 : ENV HOSTNAME docker-robot-STF583 ---> Using cache ---> 69a9664a053d Step 6/14 : ARG ssh_prv_key ---> Using cache ---> 28335c635305 Step 7/14 : RUN DEBIAN_FRONTEND=noninteractive apt update && apt install python3 git -y && apt install python3-pip -y && apt install openssh-server -y && DEBIAN_FRONTEND=noninteractive apt-get autoremove --purge -y && DEBIAN_FRONTEND=noninteractive apt-get autoclean && rm -rf /var/lib/apt/lists/* ---> Using cache ---> 8fcadd01096b Step 8/14 : RUN echo "docker-robot-STF583" > /etc/hostname && echo "root:etsi" | chpasswd ---> Using cache ---> a10d35cdb954 Step 9/14 : RUN useradd --create-home --shell /bin/bash --user-group etsi --groups sudo && echo "etsi:etsi" | chpasswd && adduser etsi sudo && echo "etsi ALL=(ALL) NOPASSWD:ALL" >> /etc/sudoers ---> Using cache ---> 69c04d92151b Step 10/14 : RUN DEBIAN_FRONTEND=noninteractive && mkdir -p /home/etsi/dev/robot && cd /home/etsi/dev/robot ---> Using cache ---> 87269185f5aa Step 11/14 : ADD . /home/etsi/dev/robot ---> 5c7b92406dd2 Removing intermediate container 2ae2b68fbfa2 Step 12/14 : RUN pip3 install robotframework ---> Running in 975c93643cb4 Collecting robotframework Downloading https://files.pythonhosted.org/packages/38/43/e03efaa547a3158f0745c5ea7f1eafebd69d46f2c9aece3a8ba21992adc9/robotframework-3.2.2-py2.py3-none-any.whl (623kB) Installing collected packages: robotframework Successfully installed robotframework-3.2.2 You are using pip version 8.1.1, however version 20.2.4 is available. You should consider upgrading via the 'pip install --upgrade pip' command.  ---> 0a44455e9f46 Removing intermediate container 975c93643cb4 Step 13/14 : RUN DEBIAN_FRONTEND=noninteractive && cd /home/etsi/dev/robot && pip3 install -r requirements.txt && chmod +x /home/etsi/dev/robot/scripts/* && git clone https://github.com/etsi-cti-admin/robotframework-mockserver && cd robotframework-mockserver && patch -p1 < ../extensions/mockserverlibrary.patch && python3 -m pip install -e . ---> Running in dd8ba9546efa Collecting robotframework==3.1 (from -r requirements.txt (line 6)) Downloading https://files.pythonhosted.org/packages/78/c3/9a5af726bef21c2b0946a81a3348e946764a72ae5a2c45beaeee43e7d8a8/robotframework-3.1-py2.py3-none-any.whl (597kB) Collecting RESTinstance==1.0.0rc4 (from -r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/1a/27/e6781c2a19471d6b9e54cd943c695668ca84c1b393f48f3b441ca7db520f/RESTinstance-1.0.0rc4-py2.py3-none-any.whl Collecting robotframework-dependencylibrary==1.0.0.post1 (from -r requirements.txt (line 8)) Downloading https://files.pythonhosted.org/packages/7c/46/c09b5ebb178a85bdeba8d0e66d4b6747657bacbc96cec01c2aedf43d0b82/robotframework_dependencylibrary-1.0.0.post1-py3-none-any.whl Collecting robotframework-jsonlibrary==0.3 (from -r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/91/05/bc535d666491d0856516cb6efed2736a5242bd70555c4f80df89755cc69b/robotframework-jsonlibrary-0.3.tar.gz Collecting robotframework-jsonschemalibrary==1.0 (from -r requirements.txt (line 10)) Downloading https://files.pythonhosted.org/packages/e6/0d/5d4162af1b87260f633cbd402cbe4bd263efa057bb9799c97e8e5676b241/robotframework-jsonschemalibrary-1.0.tar.gz Collecting robotframework-mockserver==0.0.4 (from -r requirements.txt (line 11)) Downloading https://files.pythonhosted.org/packages/00/62/736ae14f6c99964dc82c14cc37e49a9f9171962efd4021e1acfed7317264/robotframework-mockserver-0.0.4.tar.gz Collecting pygments==2.2.0 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/02/ee/b6e02dc6529e82b75bb06823ff7d005b141037cb1416b10c6f00fc419dca/Pygments-2.2.0-py2.py3-none-any.whl (841kB) Collecting requests==2.20.0 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/f1/ca/10332a30cb25b627192b4ea272c351bce3ca1091e541245cccbace6051d8/requests-2.20.0-py2.py3-none-any.whl (60kB) Collecting GenSON==1.0.1 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/00/ed/4b249d723b330e5856ab1c2f09dfa298f997630fa2bc5cfb50247cf1d8d2/genson-1.0.1.tar.gz Collecting flex==6.13.2 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/8d/3d/7075e8a5844e485d80972f4f6e9aef287f5b898312524f58d96a203b794d/flex-6.13.2-py3-none-any.whl (77kB) Collecting strict-rfc3339==0.7 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/56/e4/879ef1dbd6ddea1c77c0078cd59b503368b0456bcca7d063a870ca2119d3/strict-rfc3339-0.7.tar.gz Collecting tzlocal==1.5.1 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/cb/89/e3687d3ed99bc882793f82634e9824e62499fdfdc4b1ae39e211c5b05017/tzlocal-1.5.1.tar.gz Collecting jsonpath-ng==1.4.3 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/95/32/ab29fef829c129e5847b8241541bec858515af2bd57a845fad78efde25f5/jsonpath_ng-1.4.3-py2.py3-none-any.whl Collecting pytz==2018.5 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/30/4e/27c34b62430286c6d59177a0842ed90dc789ce5d1ed740887653b898779a/pytz-2018.5-py2.py3-none-any.whl (510kB) Collecting jsonschema==3.0.0a3 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/e3/df/b85ecaf1e9d4a8e9aa958517edeb3d933b9ce23d5c19ad3873ce1ac7d57b/jsonschema-3.0.0a3-py2.py3-none-any.whl (49kB) Collecting rfc3987==1.3.8 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/65/d4/f7407c3d15d5ac779c3dd34fbbc6ea2090f77bd7dd12f207ccf881551208/rfc3987-1.3.8-py2.py3-none-any.whl Collecting tox (from robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/e0/79/5915b9dad867e89bb6495456acfe5d4e2287e74dfa29c059f7b127d5480e/tox-3.20.1-py2.py3-none-any.whl (83kB) Collecting coverage (from robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/35/58/e38636e8233b49982efca6a69c9974f2575439f637dc3b0e8ac0e77c550c/coverage-5.3-cp35-cp35m-manylinux1_x86_64.whl (229kB) Collecting jsonpath-rw==1.4.0 (from robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/71/7c/45001b1f19af8c4478489fbae4fc657b21c4c669d7a5a036a86882581d85/jsonpath-rw-1.4.0.tar.gz Collecting jsonpath-rw-ext>=0.1.9 (from robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/eb/69/e46a4866c6afa52861bcd9bf8909a4b76fd7ac68b227b2d5673f109f0aa3/jsonpath_rw_ext-1.2.2-py2.py3-none-any.whl Collecting idna<2.8,>=2.5 (from requests==2.20.0->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/4b/2a/0276479a4b3caeb8a8c1af2f8e4355746a97fab05a372e4a2c6a6b876165/idna-2.7-py2.py3-none-any.whl (58kB) Collecting certifi>=2017.4.17 (from requests==2.20.0->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/c1/6f/3d85f0850962279a7e4c622695d7b3171e95ac65308a57d3b29738b27149/certifi-2020.11.8-py2.py3-none-any.whl (155kB) Collecting chardet<3.1.0,>=3.0.2 (from requests==2.20.0->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) Collecting urllib3<1.25,>=1.21.1 (from requests==2.20.0->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/01/11/525b02e4acc0c747de8b6ccdab376331597c569c42ea66ab0a1dbd36eca2/urllib3-1.24.3-py2.py3-none-any.whl (118kB) Collecting click<7,>=3.3 (from flex==6.13.2->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/34/c1/8806f99713ddb993c5366c362b2f908f18269f8d792aff1abfd700775a77/click-6.7-py2.py3-none-any.whl (71kB) Collecting jsonpointer<2,>=1.7 (from flex==6.13.2->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/7b/f4/90449441c1c011a733ee85739a680f2442eda2130e6a88f51804660a0289/jsonpointer-1.14-py2.py3-none-any.whl Requirement already satisfied (use --upgrade to upgrade): six<2,>=1.7.3 in /usr/lib/python3/dist-packages (from flex==6.13.2->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Collecting validate-email<2,>=1.2 (from flex==6.13.2->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/84/a0/cb53fb64b52123513d04f9b913b905f3eb6fda7264e639b4573cc715c29f/validate_email-1.3.tar.gz Collecting PyYAML<4,>=3.11 (from flex==6.13.2->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/9e/a3/1d13970c3f36777c583f136c136f804d70f500168edc1edea6daa7200769/PyYAML-3.13.tar.gz (270kB) Collecting ply (from jsonpath-ng==1.4.3->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/a3/58/35da89ee790598a0700ea49b2a66594140f44dec458c07e8e3d4979137fc/ply-3.11-py2.py3-none-any.whl (49kB) Collecting decorator (from jsonpath-ng==1.4.3->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/ed/1b/72a1821152d07cf1d8b6fce298aeb06a7eb90f4d6d41acec9861e7cc6df0/decorator-4.4.2-py2.py3-none-any.whl Collecting pyrsistent>=0.14.0 (from jsonschema==3.0.0a3->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/4d/70/fd441df751ba8b620e03fd2d2d9ca902103119616f0f6cc42e6405035062/pyrsistent-0.17.3.tar.gz (106kB) Collecting attrs>=17.4.0 (from jsonschema==3.0.0a3->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/c3/aa/cb45262569fcc047bf070b5de61813724d6726db83259222cd7b4c79821a/attrs-20.3.0-py2.py3-none-any.whl (49kB) Collecting packaging>=14 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/46/19/c5ab91b1b05cfe63cccd5cfc971db9214c6dd6ced54e33c30d5af1d2bc43/packaging-20.4-py2.py3-none-any.whl Collecting importlib-metadata<3,>=0.12; python_version < "3.8" (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/6d/6d/f4bb28424bc677bce1210bc19f69a43efe823e294325606ead595211f93e/importlib_metadata-2.0.0-py2.py3-none-any.whl Collecting toml>=0.9.4 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl Collecting py>=1.4.17 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/68/0f/41a43535b52a81e4f29e420a151032d26f08b62206840c48d14b70e53376/py-1.9.0-py2.py3-none-any.whl (99kB) Collecting filelock>=3.0.0 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/93/83/71a2ee6158bb9f39a90c0dea1637f81d5eef866e188e1971a1b1ab01a35a/filelock-3.0.12-py3-none-any.whl Collecting pluggy>=0.12.0 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/a0/28/85c7aa31b80d150b772fbe4a229487bc6644da9ccb7e427dd8cc60cb8a62/pluggy-0.13.1-py2.py3-none-any.whl Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/97/f3/c064343ac58d1a54c393a3f66483a29500f644a5918deeb935d28673edd9/virtualenv-20.1.0-py2.py3-none-any.whl (4.9MB) Collecting pbr>=1.8 (from jsonpath-rw-ext>=0.1.9->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/fb/48/69046506f6ac61c1eaa9a0d42d22d54673b69e176d30ca98e3f61513e980/pbr-5.5.1-py2.py3-none-any.whl (106kB) Collecting pyparsing>=2.0.2 (from packaging>=14->tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/8a/bb/488841f56197b13700afd5658fc279a2025a39e22449b7cf29864669b15d/pyparsing-2.4.7-py2.py3-none-any.whl (67kB) Collecting zipp>=0.5 (from importlib-metadata<3,>=0.12; python_version < "3.8"->tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/41/ad/6a4f1a124b325618a7fb758b885b68ff7b058eec47d9220a12ab38d90b1f/zipp-3.4.0-py3-none-any.whl Collecting appdirs<2,>=1.4.3 (from virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/3b/00/2344469e2084fb287c2e0b57b72910309874c3245463acd6cf5e3db69324/appdirs-1.4.4-py2.py3-none-any.whl Collecting importlib-resources>=1.0; python_version < "3.7" (from virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/c5/1f/ec86d2a5c48ac6490d4471b297885603cf0e8da89d5ffbf0bce6e57f4d64/importlib_resources-3.3.0-py2.py3-none-any.whl Collecting distlib<1,>=0.3.1 (from virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/f5/0a/490fa011d699bb5a5f3a0cf57de82237f52a6db9d40f33c53b2736c9a1f9/distlib-0.3.1-py2.py3-none-any.whl (335kB) Building wheels for collected packages: robotframework-jsonlibrary, robotframework-jsonschemalibrary, robotframework-mockserver, GenSON, strict-rfc3339, tzlocal, jsonpath-rw, validate-email, PyYAML, pyrsistent Running setup.py bdist_wheel for robotframework-jsonlibrary: started Running setup.py bdist_wheel for robotframework-jsonlibrary: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/5f/70/4e/099c5b627ea3eb9aed2794f477b45b15ac1a1e7a210a88090f Running setup.py bdist_wheel for robotframework-jsonschemalibrary: started Running setup.py bdist_wheel for robotframework-jsonschemalibrary: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/0c/9c/f0/680efb7acfc611d50bf85f1cc0e1773dfb5dfd0975a0f515f6 Running setup.py bdist_wheel for robotframework-mockserver: started Running setup.py bdist_wheel for robotframework-mockserver: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/24/a7/5d/f7fec7865a502e1b7369bf88c484f86348640bcb3247e380ba Running setup.py bdist_wheel for GenSON: started Running setup.py bdist_wheel for GenSON: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/c7/8d/68/e7d5111969fea6f6a53ec10803d1bca5118b79b5bb2d559122 Running setup.py bdist_wheel for strict-rfc3339: started Running setup.py bdist_wheel for strict-rfc3339: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/bb/af/c9/b6e9fb5f9b2470e4ed2a7241c9ab3a8cdd3bc8555ae02ca2e6 Running setup.py bdist_wheel for tzlocal: started Running setup.py bdist_wheel for tzlocal: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/15/ae/df/a67bf1ed84e9bf230187d36d8dcfd30072bea0236cb059ed91 Running setup.py bdist_wheel for jsonpath-rw: started Running setup.py bdist_wheel for jsonpath-rw: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/5c/00/9a/82822db383c2d96dcebf839786665a185f92d37e5026f9806f Running setup.py bdist_wheel for validate-email: started Running setup.py bdist_wheel for validate-email: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/14/46/e7/4a2edb0d03a802cb59a75668734c04cceacdd6c0c585448773 Running setup.py bdist_wheel for PyYAML: started Running setup.py bdist_wheel for PyYAML: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/ad/da/0c/74eb680767247273e2cf2723482cb9c924fe70af57c334513f Running setup.py bdist_wheel for pyrsistent: started Running setup.py bdist_wheel for pyrsistent: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/f0/b8/de/b593ad311be4eb458499d100db081e453576032272398b7ddc Successfully built robotframework-jsonlibrary robotframework-jsonschemalibrary robotframework-mockserver GenSON strict-rfc3339 tzlocal jsonpath-rw validate-email PyYAML pyrsistent Installing collected packages: robotframework, pygments, idna, certifi, chardet, urllib3, requests, GenSON, click, rfc3987, jsonpointer, strict-rfc3339, validate-email, PyYAML, flex, pytz, tzlocal, ply, decorator, jsonpath-ng, pyrsistent, attrs, jsonschema, RESTinstance, robotframework-dependencylibrary, pyparsing, packaging, zipp, importlib-metadata, toml, py, filelock, pluggy, appdirs, importlib-resources, distlib, virtualenv, tox, coverage, jsonpath-rw, pbr, jsonpath-rw-ext, robotframework-jsonlibrary, robotframework-jsonschemalibrary, robotframework-mockserver Found existing installation: robotframework 3.2.2 Uninstalling robotframework-3.2.2: Successfully uninstalled robotframework-3.2.2 Found existing installation: chardet 2.3.0 Not uninstalling chardet at /usr/lib/python3/dist-packages, outside environment /usr Found existing installation: urllib3 1.13.1 Not uninstalling urllib3 at /usr/lib/python3/dist-packages, outside environment /usr Found existing installation: requests 2.9.1 Not uninstalling requests at /usr/lib/python3/dist-packages, outside environment /usr Successfully installed GenSON-1.0.1 PyYAML-3.13 RESTinstance-1.0.0rc4 appdirs-1.4.4 attrs-20.3.0 certifi-2020.11.8 chardet-3.0.4 click-6.7 coverage-5.3 decorator-4.4.2 distlib-0.3.1 filelock-3.0.12 flex-6.13.2 idna-2.7 importlib-metadata-2.0.0 importlib-resources-3.3.0 jsonpath-ng-1.4.3 jsonpath-rw-1.4.0 jsonpath-rw-ext-1.2.2 jsonpointer-1.14 jsonschema-3.0.0a3 packaging-20.4 pbr-5.5.1 pluggy-0.13.1 ply-3.11 py-1.9.0 pygments-2.2.0 pyparsing-2.4.7 pyrsistent-0.17.3 pytz-2018.5 requests-2.20.0 rfc3987-1.3.8 robotframework-3.1 robotframework-dependencylibrary-1.0.0.post1 robotframework-jsonlibrary-0.3 robotframework-jsonschemalibrary-1.0 robotframework-mockserver-0.0.4 strict-rfc3339-0.7 toml-0.10.2 tox-3.20.1 tzlocal-1.5.1 urllib3-1.24.3 validate-email-1.3 virtualenv-20.1.0 zipp-3.4.0 You are using pip version 8.1.1, however version 20.2.4 is available. You should consider upgrading via the 'pip install --upgrade pip' command. Cloning into 'robotframework-mockserver'... patching file src/MockServerLibrary/library.py Hunk #1 succeeded at 73 with fuzz 2 (offset 7 lines). Hunk #2 succeeded at 143 with fuzz 2 (offset 43 lines). Obtaining file:///home/etsi/dev/robot/robotframework-mockserver Installing collected packages: robotframework-mockserver Running setup.py develop for robotframework-mockserver Successfully installed robotframework-mockserver-0.0.4 You are using pip version 8.1.1, however version 20.2.4 is available. You should consider upgrading via the 'pip install --upgrade pip' command.  ---> 35cfdf464b71 Removing intermediate container dd8ba9546efa Step 14/14 : CMD tail -f /dev/null ---> Running in c8c382b3ac79 ---> 6d94e7f282fb Removing intermediate container c8c382b3ac79 Successfully built 6d94e7f282fb Successfully tagged stf583-rf-validation:latest + '[' 0 '!=' 0 ']' + docker image ls -a REPOSITORY TAG IMAGE ID CREATED SIZE <none> <none> 35cfdf464b71 Less than a second ago 573MB stf583-rf-validation latest 6d94e7f282fb Less than a second ago 573MB <none> <none> 0a44455e9f46 34 seconds ago 536MB <none> <none> 5c7b92406dd2 37 seconds ago 531MB <none> <none> ab6dbd95ecdf 5 minutes ago 573MB <none> <none> 6579d60b93a5 5 minutes ago 573MB <none> <none> 1b5ca655d0a3 6 minutes ago 536MB <none> <none> e4f4d6cf6514 6 minutes ago 531MB <none> <none> 87269185f5aa 6 minutes ago 465MB <none> <none> 69c04d92151b 6 minutes ago 465MB <none> <none> a10d35cdb954 6 minutes ago 465MB <none> <none> 8fcadd01096b 6 minutes ago 465MB <none> <none> 28335c635305 7 minutes ago 131MB <none> <none> 24be069a7d43 7 minutes ago 131MB <none> <none> 69a9664a053d 7 minutes ago 131MB <none> <none> c3e28c2ab3a7 7 minutes ago 131MB <none> <none> 06b4784845f3 7 minutes ago 131MB 4ec03dd9ecbe67e2ba004ea16b76cf2330c3d869 latest f9583c85b2eb 16 hours ago 93.4MB <none> <none> b9f2656e8dd8 16 hours ago 93.4MB <none> <none> 16f96a0ec1f9 16 hours ago 93.2MB <none> <none> 6f2aa5724ebe 13 days ago 224MB <none> <none> 49c2e44cf414 13 days ago 224MB <none> <none> f292874f6334 13 days ago 224MB <none> <none> 5404d0bde354 13 days ago 224MB <none> <none> faa78c58459a 13 days ago 224MB <none> <none> 348876f81ed4 13 days ago 224MB <none> <none> 500f197bc30e 13 days ago 224MB <none> <none> 50dadb49c240 13 days ago 224MB openapivalidator latest 3399a60ada3f 13 days ago 224MB <none> <none> d7b0c952fa18 13 days ago 224MB <none> <none> 374dfe44f785 13 days ago 224MB <none> <none> 00f8ba24379b 13 days ago 224MB <none> <none> 808faca21532 13 days ago 224MB <none> <none> 261de29c25d2 13 days ago 224MB <none> <none> 71f14f57d3ea 13 days ago 224MB <none> <none> 11d5296cb6e3 13 days ago 223MB <none> <none> f4d81cd29e36 13 days ago 212MB <none> <none> 91638a196f16 13 days ago 206MB <none> <none> b23fedc8dd94 13 days ago 206MB <none> <none> ce077e02bff8 13 days ago 191MB <none> <none> 352b01bc416e 13 days ago 171MB <none> <none> c9c08c112472 13 days ago 167MB <none> <none> 54afa303828c 13 days ago 166MB <none> <none> 56a612d9bba4 13 days ago 165MB <none> <none> 48f0b705cc06 13 days ago 66.2MB <none> <none> cb2256300214 13 days ago 52.9MB <none> <none> 24860c3b2063 13 days ago 36.3MB <none> <none> e6615b737995 13 days ago 9MB <none> <none> 12029cc0f39f 13 days ago 7MB <none> <none> 3dd37f88f48b 13 days ago 5.58MB <none> <none> 4d33b22eee40 2 weeks ago 228MB <none> <none> 64889590f48f 2 weeks ago 228MB <none> <none> d27d8b238c15 2 weeks ago 228MB <none> <none> 79c64096c8a8 2 weeks ago 228MB <none> <none> 129f626ec7f6 2 weeks ago 228MB <none> <none> 357b2d773bed 2 weeks ago 228MB <none> <none> b3d8bc7e9284 2 weeks ago 228MB <none> <none> 190a33d54e88 2 weeks ago 228MB <none> <none> 7e51c511c61c 2 weeks ago 226MB <none> <none> 1d3870bfc0f0 2 weeks ago 228MB <none> <none> 8905566d055b 2 weeks ago 228MB <none> <none> f8bc7786b127 2 weeks ago 228MB <none> <none> 9da5d43fb7e9 2 weeks ago 228MB <none> <none> e2cf9a6cff5d 2 weeks ago 228MB <none> <none> 3f8019cd7f43 2 weeks ago 228MB <none> <none> d617ede32235 2 weeks ago 228MB <none> <none> 4b2702d64e34 2 weeks ago 228MB <none> <none> 773c948f828d 2 weeks ago 226MB <none> <none> 396bd7f75b5c 2 weeks ago 217MB <none> <none> 53549525d310 2 weeks ago 187MB <none> <none> aa86e98b758a 2 weeks ago 187MB <none> <none> bbb28d0f93e8 2 weeks ago 172MB <none> <none> 31742a01de3d 2 weeks ago 151MB <none> <none> de7de1dafcce 2 weeks ago 148MB <none> <none> f183fdcad5bc 2 weeks ago 147MB <none> <none> 705fb9a0af3e 2 weeks ago 145MB <none> <none> 14e283a59fea 2 weeks ago 54.3MB <none> <none> cc26942c1f05 2 weeks ago 40.7MB <none> <none> 6a7e36d52a5e 2 weeks ago 31.7MB <none> <none> eeb9af854748 2 weeks ago 8.68MB <none> <none> 593ca0db9007 2 weeks ago 5.13MB <none> <none> 1e1c09059592 2 weeks ago 4.03MB ubuntu 16.04 dfeff22e96ae 2 weeks ago 131MB tosca-ie-sample latest 2849e4604273 4 months ago 505MB <none> <none> 1005d8be9b4d 4 months ago 505MB <none> <none> f66d62d774c5 4 months ago 505MB <none> <none> fd3eab8cffb9 4 months ago 505MB <none> <none> fb9201ee6cca 4 months ago 505MB <none> <none> d05408cbae85 4 months ago 505MB <none> <none> 5b7f77c730a1 4 months ago 505MB <none> <none> 9dec18c5f564 4 months ago 502MB <none> <none> 25752aa1054f 4 months ago 472MB <none> <none> 74891ab99e7d 4 months ago 472MB <none> <none> 6842a41beb93 4 months ago 472MB <none> <none> c60779c28f1b 4 months ago 472MB <none> <none> e3eec2a02452 4 months ago 472MB <none> <none> eeae7e4a26e6 4 months ago 472MB <none> <none> 95d37c469efb 4 months ago 472MB <none> <none> 53eea4b91e17 4 months ago 469MB <none> <none> 43db6ca060fe 4 months ago 73.9MB <none> <none> aea93ab56909 4 months ago 73.9MB <none> <none> 35b89258858f 4 months ago 73.9MB <none> <none> 74435f89ab78 4 months ago 73.9MB robotframework/rfdocker 3.1.2 78d04f0de2cd 17 months ago 89.8MB <none> <none> 4d90542f0623 17 months ago 5.58MB <none> <none> 43773d1dba76 20 months ago 4.03MB plantuml/plantuml-server tomcat 805a4b03284f 2 years ago 729MB + docker inspect stf583-rf-validation:latest [ { "Id": "sha256:6d94e7f282fb0dfaac8c300a5182a62c01aaec50afe20846c1bfd7ef6579f425", "RepoTags": [ "stf583-rf-validation:latest" ], "RepoDigests": [], "Parent": "sha256:35cfdf464b71a5b2c894ec228681b36559f0c3fa799462c3c713a772a9046037", "Comment": "", "Created": "2020-11-12T18:16:42.356253975Z", "Container": "c8c382b3ac79273615d3cdaeed19bd13d21f3222415ea16d5e41494f9ce1f576", "ContainerConfig": { "Hostname": "c8c382b3ac79", "Domainname": "", "User": "", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": [ "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin", "TERM=xterm", "HOSTNAME=docker-robot-STF583" ], "Cmd": [ "/bin/sh", "-c", "#(nop) ", "CMD [\"/bin/sh\" \"-c\" \"tail -f /dev/null\"]" ], "ArgsEscaped": true, "Image": "sha256:35cfdf464b71a5b2c894ec228681b36559f0c3fa799462c3c713a772a9046037", "Volumes": null, "WorkingDir": "", "Entrypoint": null, "OnBuild": [], "Labels": { "description": "SFT583 Robot Framework Docker Image" } }, "DockerVersion": "17.06.2-ce", "Author": "ETSI STF 583", "Config": { "Hostname": "", "Domainname": "", "User": "", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": [ "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin", "TERM=xterm", "HOSTNAME=docker-robot-STF583" ], "Cmd": [ "/bin/sh", "-c", "tail -f /dev/null" ], "ArgsEscaped": true, "Image": "sha256:35cfdf464b71a5b2c894ec228681b36559f0c3fa799462c3c713a772a9046037", "Volumes": null, "WorkingDir": "", "Entrypoint": null, "OnBuild": [], "Labels": { "description": "SFT583 Robot Framework Docker Image" } }, "Architecture": "amd64", "Os": "linux", "Size": 573171712, "VirtualSize": 573171712, "GraphDriver": { "Data": null, "Name": "aufs" }, "RootFS": { "Type": "layers", "Layers": [ "sha256:61727f5e6796a2d90ed9d0dc385a3c1a3b6ded69a5bc4709542a4f47e877ba03", "sha256:eff16de3ff6467c1bc2afd0bae39c7ee86725e42f6a3cfb691c7688767c89ed9", "sha256:62fdddf6a67c88f7d7f9f19c0ebd6651be77b93ce6d99ca67018df7714e775e3", "sha256:9edaa71ce2334d676da80820de71477b34b1e04078dfe0c2ca735f5d951a4c70", "sha256:4ca2c1b5fde630062a0e5525ffa8e9dfdb7318f38e8c6c4db6c9477d96289b18", "sha256:7545c24a88195a3c36c846855685b99b2b42bece7a57b35b4d9eccaa9fff1832", "sha256:45574d84a591d3c3f162cba497a21e769ade05eedd2b533aea9fdee5f12fbd38", "sha256:f6f946e8aa8d6900541b38b2618d3e5abfeea884ce2ed99ac5e48366bb5f157b", "sha256:4fd2e13a06cbabd6194348d7e4b9859c89ec835502eceb8e2f725df81080095b", "sha256:152a1b467235ebb8419ca2ad02f13f3eda16d66407e969eeebc5e92bb7883c55", "sha256:e48b01092dd92e4d97723c7e76b4e5841ebf1d3d7e1d6b11b75ba1e0759983ce" ] } } ] + '[' 0 '!=' 0 ']' # That's all Floks exit 0 + exit 0 ++++ Dryrun SOL002/VNFConfiguration-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 6.3.1.2.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 6.3.1.2.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 6.3.1.2.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 6.3.1.2.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 6.3.1.2.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 6.3.1.2.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFConfiguration-API/Configuration.robot ============================================================================== Configuration ============================================================================== Set new VNF Configuration :: Test ID: 6.3.1.1.1 | PASS | ------------------------------------------------------------------------------ Get information about a VNF configuration :: Test ID: 6.3.1.1.2 | PASS | ------------------------------------------------------------------------------ Get information about a VNF configuration with HTTP Etag :: Test I... | PASS | ------------------------------------------------------------------------------ Set new VNF Configuration - HTTP Etag precondition unsuccessful ::... | PASS | ------------------------------------------------------------------------------ POST VNF Configuration - Method not implemented :: Test ID: 6.3.1.1.5 | PASS | ------------------------------------------------------------------------------ PUT VNF Configuration - Method not implemented :: Test ID: 6.3.1.1.6 | PASS | ------------------------------------------------------------------------------ DELETE VNF Configuration - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Configuration | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/Alarms.robot ============================================================================== Alarms ============================================================================== POST Alarms - Method not implemented :: Test ID: 6.3.4.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms :: Test ID: 6.3.4.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with invalid attribute-based... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "all_fields" attribute ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with exclude_default attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with fields attribute select... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "exclude_fields" attrib... | PASS | ------------------------------------------------------------------------------ PUT Alarms - Method not implemented :: Test ID: 6.3.4.1.9 | PASS | ------------------------------------------------------------------------------ PATCH Alarms - Method not implemented :: Test ID: 6.3.4.1.10 | PASS | ------------------------------------------------------------------------------ DELETE Alarms - Method not implemented :: Test ID: 6.3.4.1.11 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms to get Paged Response :: Tes... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms for Bad Request Response too... | PASS | ------------------------------------------------------------------------------ GET information about alarms with attribute-based filter "id" :: T... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ Alarms | PASS | 19 critical tests, 19 passed, 0 failed 19 tests total, 19 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 6.3.4.7.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 6.3.4.7.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 6.3.4.7.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 6.3.4.7.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 6.3.4.7.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 6.3.4.7.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/EscalatePerceivedSeverityTask.robot ============================================================================== EscalatePerceivedSeverityTask ============================================================================== Escalate the perceived severity :: Test ID: 6.3.4.3.1 | PASS | ------------------------------------------------------------------------------ GET Escalate the perceived severity - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PUT Escalate the perceived severity - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH Escalate the perceived severity - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE Escalate the perceived severity - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ EscalatePerceivedSeverityTask | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/IndividualAlarm.robot ============================================================================== IndividualAlarm ============================================================================== POST Alarm - Method not implemented :: Test ID: 6.3.4.2.1 | PASS | ------------------------------------------------------------------------------ GET information about an individual alarm :: Test ID: 6.3.4.2.2 | PASS | ------------------------------------------------------------------------------ PUT Individual Alarm - Method not implemented :: Test ID: 6.3.4.2.3 | PASS | ------------------------------------------------------------------------------ PATCH Individual Alarm :: Test ID: 6.3.4.2.4 | PASS | ------------------------------------------------------------------------------ PATCH Individual Alarm - Precondition failed :: Test ID: 6.3.4.2.5 | PASS | ------------------------------------------------------------------------------ PATCH Individual Alarm - Conflict :: Test ID: 6.3.4.2.6 | PASS | ------------------------------------------------------------------------------ DELETE Individual Alarm - Method not implemented :: Test ID: 6.3.4... | PASS | ------------------------------------------------------------------------------ IndividualAlarm | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription :: This resource represents an individual subscripti... ============================================================================== POST Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET Information about an individual subscription :: Test ID: 6.3.4... | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 6.3.4.5.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription :: This resource represents an individual s... | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== VNF Fault Alarm Notification :: Test ID: 6.3.4.6.1 | PASS | ------------------------------------------------------------------------------ VNF Fault Alarm Cleared Notification :: Test ID: 6.3.4.6.2 | PASS | ------------------------------------------------------------------------------ VNF Fault Alarm List Rebuilt Notification :: Test ID: 6.3.4.6.3 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create a new subscription :: Test ID: 6.3.4.4.1 | PASS | ------------------------------------------------------------------------------ Create a new Subscription - DUPLICATION :: Test ID: 6.3.4.4.2 | PASS | ------------------------------------------------------------------------------ Create a new Subscription - NO-DUPLICATION :: Test ID: 6.3.4.4.3 | PASS | ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 6.3.4.4.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 6.3.4.4.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 6.3.4.4.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 6.3.4.4.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 6.3.4.4.13 | PASS | ------------------------------------------------------------------------------ GET Subscriptions to get Paged Response :: Test ID: 6.3.4.4.14 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 6.3.4... | PASS | ------------------------------------------------------------------------------ GET Subscription with attribute-based filter "id" :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.notificationTypes" :: Test I... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.faultyResourceTypes" :: Test... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.perceivedSeverities" :: Test... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.eventTypes" :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.probableCauses" :: Test ID: ... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 6.3.2.7.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 6.3.2.7.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 6.3.2.7.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 6.3.2.7.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 6.3.2.7.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 6.3.2.7.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Indicator Subscription :: Test ID: 6.3.2.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Indicator Subscription with invalid resource id... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator Subscription :: Test ID: 6.3.2.5.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator Subscription with invalid resource... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Indicator Subscription - Method not implemented... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Indicator Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Indicator Subscription - Method not implemente... | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/IndividualVNFindicator.robot ============================================================================== IndividualVNFindicator ============================================================================== Get Individual Indicator for VNF Instance :: Test ID: 6.3.2.3.1 | PASS | ------------------------------------------------------------------------------ Get Individual Indicator for VNF Instance with invalid indicator i... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Indicator - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Indicator - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Indicator - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ Get Individual Performance Indicator :: Test ID: 6.3.2.3.7 | PASS | ------------------------------------------------------------------------------ Get Individual Performance Indicator with invalid indicator identi... | PASS | ------------------------------------------------------------------------------ POST Individual Performance Indicator - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ PUT Individual Performance Indicator - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PATCH Individual Performance Indicator - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ DELETE Individual Performance Indicator - Method not implemented :... | PASS | ------------------------------------------------------------------------------ IndividualVNFindicator | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== GET VNF Indicators Subscriptions :: Test ID: 6.3.2.4.1 | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions with attribute-based filter :: Te... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions with invalid attribute-based filt... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions with invalid resource endpoint ::... | PASS | ------------------------------------------------------------------------------ Create new VNF indicator subscription :: Test ID: 6.3.2.4.5 | PASS | ------------------------------------------------------------------------------ PUT VNF Indicator Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PATCH VNF Indicator Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ DELETE VNF Indicator Subscriptions - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions to get Paged Response :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions - Bad Request Response too Big ::... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/VNFIndicators.robot ============================================================================== VNFIndicators :: This Clause defines all the resources and methods provided... ============================================================================== Get all VNF Indicators :: Test ID: 6.3.2.1.1 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators with attribute-based filter :: Test ID: 6.3.2.1.2 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators with invalid attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators with malformed authorization token :: Test ... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators without authorization token :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ GET all VNF Indicators with expired or revoked authorization token... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators with invalid resource endpoint :: Test ID: ... | PASS | ------------------------------------------------------------------------------ POST all VNF Indicators - Method not implemented :: Test ID: 6.3.2... | PASS | ------------------------------------------------------------------------------ PUT all VNF Indicators - Method not implemented :: Test ID: 6.3.2.1.9 | PASS | ------------------------------------------------------------------------------ PATCH all VNF Indicators - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Indicators - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ Get VNF Indicators to get Paged Response :: Test ID: 6.3.2.1.12 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators - Bad Request Response too Big :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ VNFIndicators :: This Clause defines all the resources and methods... | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/VnfIndicatorsInVnfInstanceId.robot ============================================================================== VnfIndicatorsInVnfInstanceId :: This resource represents VNF indicators rel... ============================================================================== Get Indicators for VNF Instance :: Test ID: 6.3.2.2.1 | PASS | ------------------------------------------------------------------------------ GET Indicators for VNF Instance with attribute-based filter :: Tes... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance with invalid attribute-based filte... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance with invalid resource identifier :... | PASS | ------------------------------------------------------------------------------ POST Indicators for VNF instance - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ PUT Indicators for VNF instance - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PATCH Indicators for VNF instance - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ DELETE Indicators for VNF instance - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance to get Paged Response :: Test ID: ... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance - Bad Request Response too Big :: ... | PASS | ------------------------------------------------------------------------------ VnfIndicatorsInVnfInstanceId :: This resource represents VNF indic... | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicatorNotification-API/VnfIndicatorNotification.robot ============================================================================== VnfIndicatorNotification ============================================================================== VNF Indicator Value Change Notification :: Test ID: 6.3.2.6.1 | PASS | ------------------------------------------------------------------------------ VnfIndicatorNotification | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 6.3.5.20.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 6.3.5.20.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 6.3.5.20.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 6.3.5.20.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 6.3.5.20.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 6.3.5.20.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/CancelOperationTask.robot ============================================================================== CancelOperationTask :: This task resource represents the "Cancel operation"... ============================================================================== Post Cancel operation task :: Test ID: 6.3.5.16.1 | PASS | ------------------------------------------------------------------------------ Post Cancel operation task Conflict :: Test ID: 6.3.5.16.2 | PASS | ------------------------------------------------------------------------------ Post Cancel operation task Not Found :: Test ID: 6.3.5.16.3 | PASS | ------------------------------------------------------------------------------ GET Cancel operation task - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PUT Cancel operation task - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PATCH Cancel operation task - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ DELETE Cancel operation task - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ CancelOperationTask :: This task resource represents the "Cancel o... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/ChangeExternalVNFConnectivityTask.robot ============================================================================== ChangeExternalVNFConnectivityTask ============================================================================== POST Change external VNF connectivity :: Test ID: 6.3.5.10.1 | PASS | ------------------------------------------------------------------------------ GET Change external VNF connectivity - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PUT Change external VNF connectivity - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PATCH Change external VNF connectivity - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ DELETE Change external VNF connectivity - Method not implemented :... | PASS | ------------------------------------------------------------------------------ ChangeExternalVNFConnectivityTask | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/ChangeVNFFlavourTask.robot ============================================================================== ChangeVNFFlavourTask ============================================================================== POST Change deployment flavour of a vnfInstance :: Test ID: 6.3.5.6.1 | PASS | ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Conflict (Not-Inst... | PASS | ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Not Found :: Test ... | PASS | ------------------------------------------------------------------------------ GET Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PUT Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PATCH Change deployment flavour VNFInstance - Method not implement... | PASS | ------------------------------------------------------------------------------ DELETE Change deployment flavour VNFInstance - Method not implemen... | PASS | ------------------------------------------------------------------------------ ChangeVNFFlavourTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/FailOperationTask.robot ============================================================================== FailOperationTask ============================================================================== POST Fail operation task :: Test ID: 6.3.5.15.1 | PASS | ------------------------------------------------------------------------------ POST Fail operation task Conflict (Not-FAILED_TEMP) :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ POST Fail operation task Not Found :: Test ID: 6.3.5.15.3 | PASS | ------------------------------------------------------------------------------ GET Fail operation task - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PUT Fail operation task - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PATCH Fail operation task - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ DELETE Fail operation task - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ FailOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/HealVNFTask.robot ============================================================================== HealVNFTask ============================================================================== POST Heal a vnfInstance :: Test ID: 6.3.5.8.1 | PASS | ------------------------------------------------------------------------------ POST Heal a vnfInstance Conflict (Not-Instantiated) :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ POST Heal a vnfInstance Not Found :: Test ID: 6.3.5.8.3 | PASS | ------------------------------------------------------------------------------ GET Heal VNFInstance - Method not implemented :: Test ID: 6.3.5.8.4 | PASS | ------------------------------------------------------------------------------ PUT Heal VNFInstance - Method not implemented :: Test ID: 6.3.5.8.5 | PASS | ------------------------------------------------------------------------------ PATCH Heal VNFInstance - Method not implemented :: Test ID: 6.3.5.8.6 | PASS | ------------------------------------------------------------------------------ DELETE Heal VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ HealVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== POST Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET Individual Subscription :: Test ID: 6.3.5.18.2 | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 6.3.5.18.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/IndividualVNFInstance.robot ============================================================================== IndividualVNFInstance ============================================================================== POST Individual VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ GET Information about an individual VNF Instance :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PUT Individual VNFInstance - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance :: Test ID: 6.3.5.2.4 | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance Precondition failed :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance Conflict :: Test ID: 6.3.5.2.6 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNFInstance :: Test ID: 6.3.5.2.7 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNFInstance Conflict :: Test ID: 6.3.5.2.8 | PASS | ------------------------------------------------------------------------------ IndividualVNFInstance | PASS | 8 critical tests, 8 passed, 0 failed 8 tests total, 8 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/IndividualVnfLcmOperationOccurence.robot ============================================================================== IndividualVnfLcmOperationOccurence ============================================================================== Post Individual VNF LCM OP occurrences - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ Get status information about multiple VNF instances :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ PUT status information about multiple VNF instances - Method not i... | PASS | ------------------------------------------------------------------------------ PATCH status information about multiple VNF instances - Method not... | PASS | ------------------------------------------------------------------------------ DELETE status information about multiple VNF instances - Method no... | PASS | ------------------------------------------------------------------------------ IndividualVnfLcmOperationOccurence | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/InstantiateVNFTask.robot ============================================================================== InstantiateVNFTask ============================================================================== POST Instantiate a vnfInstance :: Test ID: 6.3.5.3.1 | PASS | ------------------------------------------------------------------------------ POST Instantiate a vnfInstance Conflict :: Test ID: 6.3.5.3.2 | PASS | ------------------------------------------------------------------------------ GET Instantiate VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ PUT Instantiate VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ PATCH Instantiate VNFInstance - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Instantiate VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ InstantiateVNFTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== VNF LCM Operation Occurrence Start Notification :: Test ID: 6.3.5.... | PASS | ------------------------------------------------------------------------------ VNF LCM Operation Occurrence Result Notification :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ VNF Identifier Creation Notification :: Test ID: 6.3.5.19.3 | PASS | ------------------------------------------------------------------------------ VNF Identifier Deletion Notification :: Test ID: 6.3.5.19.4 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/OperateVNFTask.robot ============================================================================== OperateVNFTask ============================================================================== POST Operate a vnfInstance :: Test ID: 6.3.5.9.1 | PASS | ------------------------------------------------------------------------------ POST Operate a vnfInstance Conflict (Not-Instantiated) :: Test ID:... | PASS | ------------------------------------------------------------------------------ POST Operate a vnfInstance Not Found :: Test ID: 6.3.5.9.3 | PASS | ------------------------------------------------------------------------------ GET Operate VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PUT Operate VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PATCH Operate VNFInstance - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ DELETE Operate VNFInstance - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ OperateVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/RetryOperationTask.robot ============================================================================== RetryOperationTask :: This task resource represents the "Retry operation" o... ============================================================================== POST Retry operation task :: Test ID: 6.3.5.13.1 | PASS | ------------------------------------------------------------------------------ POST Retry operation task Conflict (Not-FAILED_TEMP) :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ POST Retry operation task Not Found :: Test ID: 6.3.5.13.3 | PASS | ------------------------------------------------------------------------------ GET Retry operation task - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ PUT Retry operation task - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ PATCH Retry operation task - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ DELETE Retry operation task - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ RetryOperationTask :: This task resource represents the "Retry ope... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/RollbackOperationTask.robot ============================================================================== RollbackOperationTask :: This task resource represents the "Rollback operat... ============================================================================== POST Rollback operation task :: Test ID: 6.3.5.14.1 | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Conflict (Not-FAILED_TEMP) :: Test ID... | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Not Found :: Test ID: 6.3.5.14.3 | PASS | ------------------------------------------------------------------------------ GET Rollback operation task - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ PUT Rollback operation task - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ PATCH Rollback operation task - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Rollback operation task - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ RollbackOperationTask :: This task resource represents the "Rollba... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/ScaleVNFTask.robot ============================================================================== ScaleVNFTask ============================================================================== POST Scale a vnfInstance :: Test ID: 6.3.5.4.1 | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance Conflict (Not-Instantiated) :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance Not Found :: Test ID: 6.3.5.4.3 | PASS | ------------------------------------------------------------------------------ GET Scale VNFInstance - Method not implemented :: Test ID: 6.3.5.4.4 | PASS | ------------------------------------------------------------------------------ PUT Scale VNFInstance - Method not implemented :: Test ID: 6.3.5.4.5 | PASS | ------------------------------------------------------------------------------ PATCH Scale VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ DELETE Scale VNFInstance - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ ScaleVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/ScaleVNFToLevelTask.robot ============================================================================== ScaleVNFToLevelTask ============================================================================== POST Scale a vnfInstance to level :: Test ID: 6.3.5.5.1 | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance to level Conflict (Not-Instantiated) :: T... | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance Not Found :: Test ID: 6.3.5.5.3 | PASS | ------------------------------------------------------------------------------ GET Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PUT Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH Scale to level VNFInstance - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Scale to level VNFInstance - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ ScaleVNFToLevelTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== POST Create a new subscription :: Test ID: 6.3.5.17.1 | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - DUPLICATION :: Test ID: 6.3.5.17.2 | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - NO-DUPLICATION :: Test ID: 6.3.5.... | PASS | ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 6.3.5.17.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 6.3.5.17.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with all_fields attribute selector :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_default attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with fields attribute selector :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_fields attribute selector :: Test I... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 6.3.5.17.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 6.3.5.17.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 6.3.5.17.13 | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/TerminateVNFTask.robot ============================================================================== TerminateVNFTask ============================================================================== POST Terminate a vnfInstance :: Test ID: 6.3.5.7.1 | PASS | ------------------------------------------------------------------------------ POST Terminate a vnfInstance Conflict (Not-Instantiated) :: Test I... | PASS | ------------------------------------------------------------------------------ GET Terminate VNFInstance - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PUT Terminate VNFInstance - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PATCH Terminate VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ DELETE Terminate VNFInstance - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ TerminateVNFTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/VNFInstances.robot ============================================================================== VNFInstances ============================================================================== POST Create a new vnfInstance :: Test ID: 6.3.5.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances :: Test ID: 6.3.5.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "all_fields" att... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_default... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "fields" attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_fields"... | PASS | ------------------------------------------------------------------------------ PUT VNFInstances - Method not implemented :: Test ID: 6.3.5.1.9 | PASS | ------------------------------------------------------------------------------ PATCH VNFInstances - Method not implemented :: Test ID: 6.3.5.1.10 | PASS | ------------------------------------------------------------------------------ DELETE VNFInstances - Method not implemented :: Test ID: 6.3.5.1.11 | PASS | ------------------------------------------------------------------------------ VNFInstances | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/VnfLcmOperationOccurences.robot ============================================================================== VnfLcmOperationOccurences :: This resource represents VNF lifecycle managem... ============================================================================== POST VNF LCM operation occurrences - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM operation occurrence... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM operation occurrence... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation occurrence... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ PUT status information about multiple VNF LCM operation occurrence... | PASS | ------------------------------------------------------------------------------ PATCH status information about multiple VNF LCM operation occurren... | PASS | ------------------------------------------------------------------------------ DELETE status information about multiple VNF LCM operation occurre... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM operation occurances... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation occurrence... | PASS | ------------------------------------------------------------------------------ VnfLcmOperationOccurences :: This resource represents VNF lifecycl... | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 6.3.2.7.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 6.3.2.7.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 6.3.2.7.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 6.3.2.7.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 6.3.2.7.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 6.3.2.7.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/IndividualPmJob.robot ============================================================================== IndividualPmJob ============================================================================== GET individual VNF Performance Job :: Test ID: 6.3.3.2.1 | PASS | ------------------------------------------------------------------------------ GET individual VNF Performance Job with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Job :: Test ID: 6.3.3.2.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Job with invalid resource identi... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Performance Job - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Performance Job - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Performance Job - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ IndividualPmJob | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/IndividualReport.robot ============================================================================== IndividualReport ============================================================================== Get Individual Performance Report :: Test ID: 6.3.3.3.1 | PASS | ------------------------------------------------------------------------------ Get Individual Performance Report with invalid resource endpoint :... | PASS | ------------------------------------------------------------------------------ POST Individual Performance Report - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PUT Individual Performance Report - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH Individual Performance Report - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE Individual Performance Report - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ IndividualReport | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Performance Subscription :: Test ID: 6.3.3.7.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Performance Subscription with invalid resource ... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Subscription :: Test ID: 6.3.3.7.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Subscription with invalid resour... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Performance Subscription - Method not implemen... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Performance Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Performance Subscription - Method not impleme... | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/IndividualThreshold.robot ============================================================================== IndividualThreshold ============================================================================== GET Individual Threshold :: Test ID: 6.3.3.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual Threshold with invalid resource identifier :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold :: Test ID: 6.3.3.5.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold with invalid resource identifier :: Te... | PASS | ------------------------------------------------------------------------------ POST Individual Threshold - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PUT Individual Threshold - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ PATCH Individual Threshold - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ IndividualThreshold | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/PMJobs.robot ============================================================================== PMJobs ============================================================================== GET all VNF Performance Monitoring Jobs :: Test ID: 6.3.3.1.1 | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with attribute-based filter ::... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with all_fields attribute ... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_default attri... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with fields attribute sele... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_fields attrib... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid attribute-based f... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid resource endpoint... | PASS | ------------------------------------------------------------------------------ Create new VNF Performance Monitoring Job :: Test ID: 6.3.3.1.9 | PASS | ------------------------------------------------------------------------------ PUT all VNF Performance Monitoring Jobs - Method not implemented :... | PASS | ------------------------------------------------------------------------------ PATCH all VNF Performance Monitoring Jobs - (Method not implemente... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Performance Monitoring Jobs - Method not implemente... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs to get Paged Response :: Test ... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs for Bad Request Response too b... | PASS | ------------------------------------------------------------------------------ PMJobs | PASS | 14 critical tests, 14 passed, 0 failed 14 tests total, 14 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== GET all VNF Performance Subscriptions :: Test ID: 6.3.3.6.1 | PASS | ------------------------------------------------------------------------------ GET VNF Performance Subscriptions with attribute-based filter :: T... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Management Subscriptions with invalid attribut... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Subscriptions with invalid resource endpoint :... | PASS | ------------------------------------------------------------------------------ Create new VNF Performance subscription :: Test ID: 6.3.3.6.5 | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Performance subscription with VNFM not creat... | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Performance subscription with VNFM creating ... | PASS | ------------------------------------------------------------------------------ PUT VNF Performance Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH VNF Performance Subscriptions - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE VNF Performance Subscriptions - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Subscriptions to get Paged Response :: Test ID... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Management Subscriptions for Bad Request Respo... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/Thresholds.robot ============================================================================== Thresholds ============================================================================== GET All Performance Thresholds :: Test ID: 6.3.3.4.1 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS | ------------------------------------------------------------------------------ Create new Performance Threshold :: Test ID: 6.3.3.4.5 | PASS | ------------------------------------------------------------------------------ PUT Performance Thresholds - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with Paged Response :: Test ID: 6.3.3.4.9 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds for Bad Request Response too big :: Tes... | PASS | ------------------------------------------------------------------------------ Thresholds | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagementNotification-API/PerformanceManagementNotification.robot ============================================================================== PerformanceManagementNotification ============================================================================== VNF Performance Information Availability Notification :: Test ID: ... | PASS | ------------------------------------------------------------------------------ VNF Threshold Crossed Notification :: Test ID: 6.3.3.8.2 | PASS | ------------------------------------------------------------------------------ PerformanceManagementNotification | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagement-API/Alarms.robot ============================================================================== Alarms ============================================================================== POST Alarms - Method not implemented :: Test ID: 7.3.5.1.1 | PASS | ------------------------------------------------------------------------------ Get information about multiple alarms :: Test ID: 7.3.5.1.2 | PASS | ------------------------------------------------------------------------------ Get information about multiple alarms with filter :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ Get information about multiple alarms Bad Request Invalid attribut... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "all_fields" attribute ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with exclude_default attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with fields attribute select... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "exclude_fields" attrib... | PASS | ------------------------------------------------------------------------------ PUT Alarms - Method not implemented :: Test ID: 7.3.5.1.9 | PASS | ------------------------------------------------------------------------------ PATCH Alarms - Method not implemented :: Test ID: 7.3.5.1.10 | PASS | ------------------------------------------------------------------------------ DELETE Alarms - Method not implemented :: Test ID: 7.3.5.1.11 | PASS | ------------------------------------------------------------------------------ Get information about multiple alarms as a Paged Response :: Test ... | PASS | ------------------------------------------------------------------------------ Get information about multiple alarms - Bad Request Response too B... | PASS | ------------------------------------------------------------------------------ Alarms | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.5.6.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.5.6.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.5.6.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.5.6.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.5.6.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.5.6.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagement-API/IndividualAlarm.robot ============================================================================== IndividualAlarm ============================================================================== POST Alarm - Method not implemented :: Test ID: 7.3.5.2.1 | PASS | ------------------------------------------------------------------------------ Get information about an fault management individual alarm :: Test... | PASS | ------------------------------------------------------------------------------ PUT Alarm - Method not implemented :: Test ID: 7.3.5.2.3 | PASS | ------------------------------------------------------------------------------ PATCH Fault Management Individual Alarm :: Test ID: 7.3.5.2.4 | PASS | ------------------------------------------------------------------------------ Modify an individual alarm resource - Precondition failed :: Test ... | PASS | ------------------------------------------------------------------------------ Modify an individual alarm resource - Conflict :: Test ID: 7.3.5.2.6 | PASS | ------------------------------------------------------------------------------ DELETE Alarm - Method not implemented :: Test ID: 7.3.5.2.7 | PASS | ------------------------------------------------------------------------------ IndividualAlarm | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== Post Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ Get Information about an individual subscription :: Test ID: 7.3.5... | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 7.3.5.4.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create a new Fault Management alarm subscription :: Test ID: 7.3.5... | PASS | ------------------------------------------------------------------------------ Create a new alarm subscription - DUPLICATION :: Test ID: 7.3.5.3.2 | PASS | ------------------------------------------------------------------------------ Create a new alarm subscription - NO DUPLICATION :: Test ID: 7.3.5... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions :: Test ID: 7.3.5.3.4 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 7.3.5.3.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 7.3.5.3.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 7.3.5.3.13 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions as Paged Response :: Test I... | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 7.3.5... | PASS | ------------------------------------------------------------------------------ GET Subscription with attribute-based filter "id" :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.notificationTypes" :: Test I... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.faultyResourceTypes" :: Test... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.perceivedSeverities" :: Test... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.eventTypes" :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.probableCauses" :: Test ID: ... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagementNotification-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== VNF Fault Alarm Notification :: Test ID: 7.3.5.5.1 | PASS | ------------------------------------------------------------------------------ VNF Fault Alarm Cleared Notification :: Test ID: 7.3.5.5.2 | PASS | ------------------------------------------------------------------------------ VNF Fault Alarm List Rebuilt Notification :: Test ID: 7.3.5.5.3 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.6.7.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.6.7.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.6.7.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.6.7.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.6.7.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.6.7.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Indicator Subscription :: Test ID: 7.3.6.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Indicator Subscription with invalid resource id... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator Subscription :: Test ID: 7.3.6.5.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator Subscription with invalid resource... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Indicator Subscription - Method not implemented... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Indicator Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Indicator Subscription - Method not implemente... | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/IndividualVNFindicator.robot ============================================================================== IndividualVNFindicator ============================================================================== Get Individual Indicator for VNF Instance :: Test ID: 7.3.6.3.1 | PASS | ------------------------------------------------------------------------------ Get Individual Indicator for VNF Instance with invalid indicator i... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Indicator for VNF Instance - Method not implem... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Indicator for VNF Instance - Method not impleme... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Indicator for VNF Instance - Method not imple... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator for VNF Instance - Method not impl... | PASS | ------------------------------------------------------------------------------ IndividualVNFindicator | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== GET All VNF Indicator Subscriptions :: Test ID: 7.3.6.4.1 | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions with attribute-based filter :: Tes... | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions with invalid attribute-based filte... | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions with invalid resource endpoint :: ... | PASS | ------------------------------------------------------------------------------ Create new VNF indicator subscription :: Test ID: 7.3.6.4.5 | PASS | ------------------------------------------------------------------------------ Create duplicated VNF indicator subscription with VNFM not creatin... | PASS | ------------------------------------------------------------------------------ Create duplicated VNF indicator subscription with VNFM creating du... | PASS | ------------------------------------------------------------------------------ PUT VNF Indicator Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PATCH VNF Indicator Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ DELETE VNF Indicator Subscriptions - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ GET All VNF Indicator Subscriptions as Paged Response :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions - Bad Request Response too Big :: ... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/VNFIndicators.robot ============================================================================== VNFIndicators ============================================================================== Get all VNF Indicators :: Test ID: 7.3.6.1.1 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators with attribute-based filter :: Test ID: 7.3.6.1.2 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators with invalid attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators with malformed authorization token :: Test ... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators without authorization token :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ GET all VNF Indicators with expired or revoked authorization token... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators with invalid resource endpoint :: Test ID: ... | PASS | ------------------------------------------------------------------------------ POST all VNF Indicators - Method not implemented :: Test ID: 7.3.6... | PASS | ------------------------------------------------------------------------------ PUT all VNF Indicators - Method not implemented :: Test ID: 7.3.6.1.9 | PASS | ------------------------------------------------------------------------------ PATCH all VNF Indicators - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Indicators - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators as Paged Response :: Test ID: 7.3.6.1.12 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators - Bad Request Response too Big :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ VNFIndicators | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/VnfIndicatorNotification.robot ============================================================================== VnfIndicatorNotification ============================================================================== VNF Indicator Value Change Notification :: Test ID: 7.3.6.6.1 | PASS | ------------------------------------------------------------------------------ VnfIndicatorNotification | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/VnfIndicatorsInVnfInstanceId.robot ============================================================================== VnfIndicatorsInVnfInstanceId ============================================================================== Get Indicators for VNF Instance :: Test ID: 7.3.6.2.1 | PASS | ------------------------------------------------------------------------------ GET Indicators for VNF Instance with attribute-based filter :: Tes... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance with invalid attribute-based filte... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance with invalid resource identifier :... | PASS | ------------------------------------------------------------------------------ POST Indicators for VNF instance - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ PUT Indicators for VNF instance - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PATCH Indicators for VNF instance - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ DELETE Indicators for VNF instance - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance as Paged Response :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance - Bad Request Response too Big :: ... | PASS | ------------------------------------------------------------------------------ VnfIndicatorsInVnfInstanceId | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.1.35.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.1.35.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.1.35.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.1.35.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.1.35.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.1.35.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/CancelOperationTask.robot ============================================================================== CancelOperationTask ============================================================================== POST Cancel operation task :: Test ID: 7.3.1.16.1 | PASS | ------------------------------------------------------------------------------ POST Cancel operation task Conflict :: Test ID: 7.3.1.16.2 | PASS | ------------------------------------------------------------------------------ POST Cancel operation task Not Found :: Test ID: 7.3.1.16.3 | PASS | ------------------------------------------------------------------------------ GET Cancel operation task - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PUT Cancel operation task - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PATCH Cancel operation task - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ DELETE Cancel operation task - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ CancelOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/CancelOperationWorkflow.robot ============================================================================== CancelOperationWorkflow ============================================================================== Cancel a VNF LCM Operation - STARTING :: Test ID: 7.3.1.19.1 | PASS | ------------------------------------------------------------------------------ Cancel a VNF LCM Operation - PROCESSING - ROLLING_BACK :: Test ID:... | PASS | ------------------------------------------------------------------------------ CancelOperationWorkflow | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ChangeExternalVNFConnectivityTask.robot ============================================================================== ChangeExternalVNFConnectivityTask ============================================================================== POST Change external VNF connectivity :: Test ID: 7.3.1.10.1 | PASS | ------------------------------------------------------------------------------ GET Change external VNF connectivity - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PUT Change external VNF connectivity - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PATCH Change external VNF connectivity - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ DELETE Change external VNF connectivity - Method not implemented :... | PASS | ------------------------------------------------------------------------------ ChangeExternalVNFConnectivityTask | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ChangeExternalVNFConnectivityWorkflow.robot ============================================================================== ChangeExternalVNFConnectivityWorkflow ============================================================================== Change external connectivity of VNF Workflow :: Test ID: 7.3.1.20.1 | PASS | ------------------------------------------------------------------------------ ChangeExternalVNFConnectivityWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ChangeVNFFlavourTask.robot ============================================================================== ChangeVNFFlavourTask ============================================================================== POST Change deployment flavour of a vnfInstance :: Test ID: 7.3.1.6.1 | PASS | ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Conflict (Not-Inst... | PASS | ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Not Found :: Test ... | PASS | ------------------------------------------------------------------------------ GET Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PUT Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PATCH Change deployment flavour VNFInstance - Method not implement... | PASS | ------------------------------------------------------------------------------ DELETE Change deployment flavour VNFInstance - Method not implemen... | PASS | ------------------------------------------------------------------------------ ChangeVNFFlavourTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ChangeVNFFlavourWorkflow.robot ============================================================================== ChangeVNFFlavourWorkflow ============================================================================== Change VNF Flavour Workflow :: Test ID: 7.3.1.21.1 | PASS | ------------------------------------------------------------------------------ ChangeVNFFlavourWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/CreateVNFWorkflow.robot ============================================================================== CreateVNFWorkflow ============================================================================== Create VNF Instance Resource :: Test ID: 7.3.1.22.1 | PASS | ------------------------------------------------------------------------------ CreateVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/DeleteVNFWorkflow.robot ============================================================================== DeleteVNFWorkflow ============================================================================== Delete VNF Instance Resource :: Test ID: 7.3.1.23.1 | PASS | ------------------------------------------------------------------------------ DeleteVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/FailOperationTask.robot ============================================================================== FailOperationTask ============================================================================== POST Fail operation task :: Test ID: 7.3.1.15.1 | PASS | ------------------------------------------------------------------------------ Post Fail operation task Conflict (Not-FAILED_TEMP) :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ Post Fail operation task Not Found :: Test ID: 7.3.1.15.3 | PASS | ------------------------------------------------------------------------------ GET Fail operation task - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PUT Fail operation task - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PATCH Fail operation task - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ DELETE Fail operation task - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ FailOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/FailOperationWorkflow.robot ============================================================================== FailOperationWorkflow ============================================================================== Fail a VNF LCM Operation Workflow :: Test ID: 7.3.1.24.1 | PASS | ------------------------------------------------------------------------------ FailOperationWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/HealVNFTask.robot ============================================================================== HealVNFTask ============================================================================== POST Heal a vnfInstance :: Test ID: 7.3.1.8.1 | PASS | ------------------------------------------------------------------------------ POST Heal a vnfInstance Conflict (Not-Instantiated) :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ POST Heal a vnfInstance Not Found :: Test ID: 7.3.1.8.3 | PASS | ------------------------------------------------------------------------------ GET Heal VNFInstance - Method not implemented :: Test ID: 7.3.1.8.4 | PASS | ------------------------------------------------------------------------------ PUT Heal VNFInstance - Method not implemented :: Test ID: 7.3.1.8.5 | PASS | ------------------------------------------------------------------------------ PATCH Heal VNFInstance - Method not implemented :: Test ID: 7.3.1.8.6 | PASS | ------------------------------------------------------------------------------ DELETE Heal VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ HealVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/HealVNFWorkflow.robot ============================================================================== HealVNFWorkflow ============================================================================== Heal a VNF Instance :: Test ID: 7.3.1.25.1 | PASS | ------------------------------------------------------------------------------ HealVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== POST Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET Individual Subscription :: Test ID: 7.3.1.18.2 | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 7.3.1.18.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/IndividualVNFInstance.robot ============================================================================== IndividualVNFInstance ============================================================================== Post Individual VNFInstance - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ Get Information about an individual VNF Instance :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PUT Individual VNFInstance - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance :: Test ID: 7.3.1.2.4 | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance Precondition failed :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance Conflict :: Test ID: 7.3.1.2.6 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNFInstance :: Test ID: 7.3.1.2.7 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNFInstance Conflict :: Test ID: 7.3.1.2.8 | PASS | ------------------------------------------------------------------------------ IndividualVNFInstance | PASS | 8 critical tests, 8 passed, 0 failed 8 tests total, 8 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/IndividualVnfLcmOperationOccurence.robot ============================================================================== IndividualVnfLcmOperationOccurence ============================================================================== Post Individual VNF LCM Operation occurrences - Method not impleme... | PASS | ------------------------------------------------------------------------------ Get information about multiple VNF instances :: Test ID: 7.3.1.12.2 | PASS | ------------------------------------------------------------------------------ PUT Individual VNF LCM Operation occurrences - Method not implemen... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF LCM Operation occurrences - Method not implem... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF LCM Operation occurrences - Method not imple... | PASS | ------------------------------------------------------------------------------ IndividualVnfLcmOperationOccurence | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/InstantiateVNFTask.robot ============================================================================== InstantiateVNFTask ============================================================================== Instantiate a vnfInstance :: Test ID: 7.3.1.3.1 | PASS | ------------------------------------------------------------------------------ Instantiate a vnfInstance Conflict :: Test ID: 7.3.1.3.2 | PASS | ------------------------------------------------------------------------------ GET Instantiate VNFInstance - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ PUT Instantiate VNFInstance - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ PATCH Instantiate VNFInstance - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Instantiate VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ InstantiateVNFTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/InstantiateVNFTaskWorkflow.robot ============================================================================== InstantiateVNFTaskWorkflow ============================================================================== VNF Instantiation :: Test ID: 7.3.1.26.1 | PASS | ------------------------------------------------------------------------------ InstantiateVNFTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ModifyVNFInformationWorkflow.robot ============================================================================== ModifyVNFInformationWorkflow ============================================================================== Modify info of a VNF Instance :: Test ID: 7.3.1.27.1 | PASS | ------------------------------------------------------------------------------ ModifyVNFInformationWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== VNF LCM Operation Occurrence Start Notification :: Test ID: 7.3.1.... | PASS | ------------------------------------------------------------------------------ VNF LCM Operation Occurrence Result Notification :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ VNF Identifier Creation Notification :: Test ID: 7.3.1.34.3 | PASS | ------------------------------------------------------------------------------ VNF Identifier Deletion Notification :: Test ID: 7.3.1.34.4 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/OperateVNFTask.robot ============================================================================== OperateVNFTask ============================================================================== POST Operate a vnfInstance :: Test ID: 7.3.1.9.1 | PASS | ------------------------------------------------------------------------------ POST Operate a vnfInstance Conflict (Not-Instantiated) :: Test ID:... | PASS | ------------------------------------------------------------------------------ POST Operate a vnfInstance Not Found :: Test ID: 7.3.1.9.3 | PASS | ------------------------------------------------------------------------------ GET Operate VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PUT Operate VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PATCH Operate VNFInstance - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ DELETE Operate VNFInstance - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ OperateVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/OperateVNFWorkflow.robot ============================================================================== OperateVNFWorkflow ============================================================================== Operate a VNF Instance :: Test ID: 7.3.1.28.1 | PASS | ------------------------------------------------------------------------------ OperateVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/RetryOperationTask.robot ============================================================================== RetryOperationTask :: This task resource represents the "Retry operation" o... ============================================================================== Post Retry operation task :: Test ID: 7.3.1.13.1 | PASS | ------------------------------------------------------------------------------ Post Retry operation task Conflict (Not-FAILED_TEMP) :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ Post Retry operation task Not Found :: Test ID: 7.3.1.13.3 | PASS | ------------------------------------------------------------------------------ GET Retry operation task - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ PUT Retry operation task - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ PATCH Retry operation task - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ DELETE Retry operation task - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ RetryOperationTask :: This task resource represents the "Retry ope... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/RetryOperationWorkflow.robot ============================================================================== RetryOperationWorkflow ============================================================================== Retry VNF LCM Operation - Successful :: Test ID: 7.3.1.29.1 | PASS | ------------------------------------------------------------------------------ Retry VNF LCM Operation - Unsuccessful :: Test ID: 7.3.1.29.2 | PASS | ------------------------------------------------------------------------------ RetryOperationWorkflow | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/RollBackOperationWorkflow.robot ============================================================================== RollBackOperationWorkflow ============================================================================== Rollback a VNF LCM Operation - Successful :: Test ID: 7.3.1.30.1 | PASS | ------------------------------------------------------------------------------ Rollback VNF LCM Operation - Unsuccessful :: Test ID: 7.3.1.30.2 | PASS | ------------------------------------------------------------------------------ RollBackOperationWorkflow | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/RollbackOperationTask.robot ============================================================================== RollbackOperationTask :: This task resource represents the "Rollback operat... ============================================================================== Post Rollback operation task :: Test ID: 7.3.1.14.1 | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Conflict (Not-FAILED_TEMP) :: Test ID... | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Not Found :: Test ID: 7.3.1.14.3 | PASS | ------------------------------------------------------------------------------ GET Rollback operation task - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ PUT Rollback operation task - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ PATCH Rollback operation task - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Rollback operation task - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ RollbackOperationTask :: This task resource represents the "Rollba... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ScaleVNFTask.robot ============================================================================== ScaleVNFTask ============================================================================== POST Scale a vnfInstance :: Test ID: 7.3.1.4.1 | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance Conflict (Not-Instantiated) :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance Not Found :: Test ID: 7.3.1.4.3 | PASS | ------------------------------------------------------------------------------ GET Scale VNFInstance - Method not implemented :: Test ID: 7.3.1.4.4 | PASS | ------------------------------------------------------------------------------ PUT Scale VNFInstance - Method not implemented :: Test ID: 7.3.1.4.5 | PASS | ------------------------------------------------------------------------------ PATCH Scale VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ DELETE Scale VNFInstance - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ ScaleVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ScaleVNFToLevelTask.robot ============================================================================== ScaleVNFToLevelTask ============================================================================== POST Scale a vnfInstance to level :: Test ID: 7.3.1.5.1 | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance to level Conflict (Not-Instantiated) :: T... | PASS | ------------------------------------------------------------------------------ Scale a vnfInstance Not Found :: Test ID: 7.3.1.5.3 | PASS | ------------------------------------------------------------------------------ GET Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PUT Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH Scale to level VNFInstance - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Scale to level VNFInstance - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ ScaleVNFToLevelTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ScaleVNFToLevelWorkflow.robot ============================================================================== ScaleVNFToLevelWorkflow ============================================================================== VNF Instance Scale To Level :: Test ID: 7.3.1.31.1 | PASS | ------------------------------------------------------------------------------ ScaleVNFToLevelWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ScaleVNFWorkflow.robot ============================================================================== ScaleVNFWorkflow ============================================================================== VNF Instance Scale Out :: Test ID: 7.3.1.32.1 | PASS | ------------------------------------------------------------------------------ ScaleVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== POST Create a new subscription :: Test ID: 7.3.1.17.1 | PASS | ------------------------------------------------------------------------------ Create a new Subscription - DUPLICATION :: Test ID: 7.3.1.17.2 | PASS | ------------------------------------------------------------------------------ Create a new Subscription - NO-DUPLICATION :: Test ID: 7.3.1.17.3 | PASS | ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 7.3.1.17.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 7.3.1.17.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with all_fields attribute selector :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_default attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with fields attribute selector :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_fields attribute selector :: Test I... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 7.3.1.17.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 7.3.1.17.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 7.3.1.17.13 | PASS | ------------------------------------------------------------------------------ GET Subscriptions as a Paged Response :: Test ID: 7.3.1.17.14 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 15 critical tests, 15 passed, 0 failed 15 tests total, 15 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/TerminateVNFTask.robot ============================================================================== TerminateVNFTask ============================================================================== POST Terminate a vnfInstance :: Test ID: 7.3.1.7.1 | PASS | ------------------------------------------------------------------------------ POST Terminate a vnfInstance Conflict (Not-Instantiated) :: Test I... | PASS | ------------------------------------------------------------------------------ GET Terminate VNFInstance - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PUT Terminate VNFInstance - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PATCH Terminate VNFInstance - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ DELETE Terminate VNFInstance - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ TerminateVNFTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/TerminateVNFWorkflow.robot ============================================================================== TerminateVNFWorkflow ============================================================================== Terminate a VNF Instance :: Test ID: 7.3.1.33.1 | PASS | ------------------------------------------------------------------------------ TerminateVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/VNFInstances.robot ============================================================================== VNFInstances ============================================================================== POST Create a new vnfInstance :: Test ID: 7.3.1.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances :: Test ID: 7.3.1.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "all_fields" att... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_default... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "fields" attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_fields"... | PASS | ------------------------------------------------------------------------------ PUT multiples VNFInstances - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ PATCH multiples VNFInstances - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE VNFInstances - Method not implemented :: Test ID: 7.3.1.1.11 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances to get Paged Response... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances - Bad Request Respons... | PASS | ------------------------------------------------------------------------------ VNFInstances | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/VnfLcmOperationOccurences.robot ============================================================================== VnfLcmOperationOccurences ============================================================================== POST VNF LCM Operation occurrences - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC :: Tes... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC Bad Re... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC Bad Re... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ PUT status information about multiple VNF LCM Operation OCC - Meth... | PASS | ------------------------------------------------------------------------------ PATCH status information about multiple VNF LCM Operation OCC - Me... | PASS | ------------------------------------------------------------------------------ DELETE status information about multiple VNF LCM Operation OCC - M... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC to get... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC - Bad ... | PASS | ------------------------------------------------------------------------------ VnfLcmOperationOccurences | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleOperationGranting-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.2.3.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.2.3.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.2.3.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.2.3.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.2.3.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.2.3.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleOperationGranting-API/Grants.robot ============================================================================== Grants :: This resource represents grants. The client can use this resource... ============================================================================== Requests a grant for a particular VNF lifecycle operation - Synchr... | PASS | ------------------------------------------------------------------------------ Requests a grant for a particular VNF lifecycle operation - Asynch... | PASS | ------------------------------------------------------------------------------ Requests a grant for a particular VNF lifecycle operation - Forbid... | PASS | ------------------------------------------------------------------------------ GET Grants - Method not implemented :: Test ID: 7.3.2.1.4 | PASS | ------------------------------------------------------------------------------ PUT Grants - Method not implemented :: Test ID: 7.3.2.1.5 | PASS | ------------------------------------------------------------------------------ PATCH Grants - Method not implemented :: Test ID: 7.3.2.1.6 | PASS | ------------------------------------------------------------------------------ DELETE Grants - Method not implemented :: Test ID: 7.3.2.1.7 | PASS | ------------------------------------------------------------------------------ Grants :: This resource represents grants. The client can use this... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleOperationGranting-API/IndividualGrant.robot ============================================================================== IndividualGrant :: This resource represents an individual grant. The client... ============================================================================== POST Individual Grant - Method not implemented :: Test ID: 7.3.2.2.1 | PASS | ------------------------------------------------------------------------------ GET an individual grant - Successful :: Test ID: 7.3.2.2.2 | PASS | ------------------------------------------------------------------------------ GET an individual grant - Process ongoing :: Test ID: 7.3.2.2.3 | PASS | ------------------------------------------------------------------------------ GET an individual grant - grant rejected :: Test ID: 7.3.2.2.4 | PASS | ------------------------------------------------------------------------------ PUT an individual grant - Method not implemented :: Test ID: 7.3.2... | PASS | ------------------------------------------------------------------------------ PATCH an individual grant - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ DELETE an individual grant - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ IndividualGrant :: This resource represents an individual grant. T... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.3.9.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.3.9.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.3.9.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.3.9.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.3.9.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.3.9.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Package Subscription :: Test ID: 7.3.3.7.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Subscription with invalid resource iden... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Subscription with invalid resource i... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Subscription - Method not implemented ... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Subscription - Method not implemented :... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Subscription - Method not implemented... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Subscription :: Test ID: 7.3.3.7.7 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/IndividualVNFPackage.robot ============================================================================== IndividualVNFPackage ============================================================================== GET Individual VNF Package :: Test ID: 7.3.3.2.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package with invalid resource identifier :: Tes... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package :: Test ID: 7.3.3.2.7 | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package with invalid resource identif... | PASS | ------------------------------------------------------------------------------ POST Individual OnBoarded VNF Package - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ PUT Individual OnBoarded VNF Package - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PATCH Individual OnBoarded VNF Package - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ DELETE Individual OnBoarded VNF Package - Method not implemented :... | PASS | ------------------------------------------------------------------------------ IndividualVNFPackage | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/PackageManagementNotification.robot ============================================================================== PackageManagementNotification ============================================================================== VNF Package Onboarding Notification :: Test ID: 7.3.3.8.1 | PASS | ------------------------------------------------------------------------------ VNF Package Operational State Change Notification :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ VNF Package Deletion Notification :: Test ID: 7.3.3.8.3 | PASS | ------------------------------------------------------------------------------ PackageManagementNotification | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Get All VNF Package Subscriptions :: Test ID: 7.3.3.6.1 | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with attribute-based filter :: Test ... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with invalid attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET VNF Package Subscription with invalid resource endpoint :: Tes... | PASS | ------------------------------------------------------------------------------ Create new VNF Package subscription :: Test ID: 7.3.3.6.5 | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO not creating ... | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO creating dupl... | PASS | ------------------------------------------------------------------------------ PUT VNF Package Subscriptions - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ PATCH VNF Package Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ DELETE VNF Package Subscriptions - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ Get All VNF Package Subscriptions as Paged Response :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions - Bad Request Response too Big :: Te... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/VNFDInIndividualVNFPackage.robot ============================================================================== VNFDInIndividualVNFPackage ============================================================================== Get single file VNFD in Individual VNF Package in Plain Format :: ... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package in Zip Format :: Test ID: 7.3.3... | PASS | ------------------------------------------------------------------------------ Get single file VNFD in Individual VNF Package in Plain or Zip For... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual VNF Package in Plain or Zip Form... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual VNF Package in Plain Format :: T... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package Content with conflict due to on... | PASS | ------------------------------------------------------------------------------ POST VNFD in Individual VNF Package Content - Method not implement... | PASS | ------------------------------------------------------------------------------ PUT VNFD in Individual VNF Package Content - Method not implemente... | PASS | ------------------------------------------------------------------------------ PATCH VNFD in Individual VNF Package Content - Method not implemen... | PASS | ------------------------------------------------------------------------------ DELETE VNFD in Individual VNF Package Content - Method not impleme... | PASS | ------------------------------------------------------------------------------ Get single file VNFD in Individual OnBoarded VNF Package in Plain ... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual OnBoarded VNF Package in Zip Format :: Test... | PASS | ------------------------------------------------------------------------------ Get single file VNFD in Individual OnBoarded VNF Package in Plain ... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual OnBoarded VNF Package in Plain o... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual OnBoarded VNF Package in Plain F... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual OnBoarded VNF Package with invalid resource... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual OnBoarded VNF Package Content with conflict... | PASS | ------------------------------------------------------------------------------ POST VNFD in Individual OnBoarded VNF Package Content - Method not... | PASS | ------------------------------------------------------------------------------ PUT VNFD in Individual OnBoarded VNF Package Content - Method not ... | PASS | ------------------------------------------------------------------------------ PATCH VNFD in Individual OnBoarded VNF Package Content - Method no... | PASS | ------------------------------------------------------------------------------ DELETE VNFD in Individual OnBoarded VNF Package Content - Method n... | PASS | ------------------------------------------------------------------------------ VNFDInIndividualVNFPackage | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/VNFPackageArtifacts.robot ============================================================================== VNFPackageArtifacts ============================================================================== GET Individual VNF Package Artifact :: Test ID: 7.3.3.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact in octet stream format :: Test... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with Range Request and NFVO su... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with Range Request and NFVO no... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with invalid Range Request :: ... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with invalid resource identifi... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with conflict due to onboardin... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Artifact - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Artifact - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Artifact - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Artifact - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact :: Test ID: 7.3.3.5.12 | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact in octet stream form... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact with Range Request a... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact with Range Request a... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact with invalid Range R... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact with invalid resourc... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact with conflict due to... | PASS | ------------------------------------------------------------------------------ POST Individual OnBoarded VNF Package Artifact - Method not implem... | PASS | ------------------------------------------------------------------------------ PUT Individual OnBoarded VNF Package Artifact - Method not impleme... | PASS | ------------------------------------------------------------------------------ PATCH Individual OnBoarded VNF Package Artifact - Method not imple... | PASS | ------------------------------------------------------------------------------ DELETE Individual OnBoarded VNF Package Artifact - Method not impl... | PASS | ------------------------------------------------------------------------------ VNFPackageArtifacts | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/VNFPackageContent.robot ============================================================================== VNFPackageContent ============================================================================== GET Individual VNF Package Content :: Test ID: 7.3.3.3.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with Range Request and NFVO sup... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with Range Request and NFVO not... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with invalid Range Request :: T... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with conflict due to onboarding... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Content - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Content - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Content - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Content - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content :: Test ID: 7.3.3.3.11 | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content with Range Request an... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content with Range Request an... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content with invalid Range Re... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content with invalid resource... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content with conflict due to ... | PASS | ------------------------------------------------------------------------------ POST Individual OnBoarded VNF Package Content - Method not impleme... | PASS | ------------------------------------------------------------------------------ PUT Individual OnBoarded VNF Package Content - Method not implemen... | PASS | ------------------------------------------------------------------------------ PATCH Individual OnBoarded VNF Package Content - Method not implem... | PASS | ------------------------------------------------------------------------------ DELETE Individual OnBoarded VNF Package Content - Method not imple... | PASS | ------------------------------------------------------------------------------ VNFPackageContent | PASS | 20 critical tests, 20 passed, 0 failed 20 tests total, 20 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/VNFPackages.robot ============================================================================== VNFPackages ============================================================================== GET all VNF Packages :: Test ID: 7.3.3.1.1 | PASS | ------------------------------------------------------------------------------ GET VNF Packages with attribute-based filter :: Test ID: 7.3.3.1.2 | PASS | ------------------------------------------------------------------------------ GET VNF Packages with invalid attribute-based filter :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "all_fields" attribute selector :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "exclude_default" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "fields" attribute selector :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "exclude_fields" attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET all VNF Packages with invalid resource endpoint :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ POST all VNF Packages - Method not implemented :: Test ID: 7.3.3.1.9 | PASS | ------------------------------------------------------------------------------ PUT all VNF Packages - Method not implemented :: Test ID: 7.3.3.1.10 | PASS | ------------------------------------------------------------------------------ PATCH all VNF Packages - Method not implemented :: Test ID: 7.3.3.... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Packages - Method not implemented :: Test ID: 7.3.3... | PASS | ------------------------------------------------------------------------------ GET all VNF Packages as a Paged Response :: Test ID: 7.3.3.1.13 | PASS | ------------------------------------------------------------------------------ GET VNF Packages - Bad Request Response too Big :: Test ID: 7.3.3.... | PASS | ------------------------------------------------------------------------------ GET all OnBoarded VNF Packages :: Test ID: 7.3.3.1.15 | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with "all_fields" attribute selector ::... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with "exclude_default" attribute select... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with "fields" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with "exclude_fields" attribute selecto... | PASS | ------------------------------------------------------------------------------ GET all OnBoarded VNF Packages with invalid resource endpoint :: T... | PASS | ------------------------------------------------------------------------------ POST all OnBoarded VNF Packages - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PUT all OnBoarded VNF Packages - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH all OnBoarded VNF Packages - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE all OnBoarded VNF Packages - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ GET all OnBoarded VNF Packages as a Paged Response :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages - Bad Request Response too Big :: Test ... | PASS | ------------------------------------------------------------------------------ VNFPackages | PASS | 28 critical tests, 28 passed, 0 failed 28 tests total, 28 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.4.9.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.4.9.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.4.9.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.4.9.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.4.9.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.4.9.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualPmJob.robot ============================================================================== IndividualPmJob ============================================================================== GET individual VNF Performance Job :: Test ID: 7.3.4.2.1 | PASS | ------------------------------------------------------------------------------ GET individual VNF Performance Job with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Job :: Test ID: 7.3.4.2.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Job with invalid resource identi... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Performance Job - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Performance Job - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Performance Job - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ IndividualPmJob | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualReport.robot ============================================================================== IndividualReport ============================================================================== Get Individual Performance Report :: Test ID: 7.3.4.3.1 | PASS | ------------------------------------------------------------------------------ Get Individual Performance Report with invalid resource endpoint :... | PASS | ------------------------------------------------------------------------------ POST Individual Performance Report - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PUT Individual Performance Report - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH Individual Performance Report - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE Individual Performance Report - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ IndividualReport | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Performance Subscription :: Test ID: 7.3.4.7.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Performance Subscription with invalid resource ... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Subscription :: Test ID: 7.3.4.7.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Subscription with invalid resour... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Performance Subscription - Method not implemen... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Performance Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Performance Subscription - Method not impleme... | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualThreshold.robot ============================================================================== IndividualThreshold ============================================================================== GET Individual Threshold :: Test ID: 7.3.4.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual Threshold with invalid resource identifier :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold :: Test ID: 7.3.4.5.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold with invalid resource identifier :: Te... | PASS | ------------------------------------------------------------------------------ POST Individual Threshold - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PUT Individual Threshold - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ PATCH Individual Threshold - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ IndividualThreshold | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/PMJobs.robot ============================================================================== PMJobs ============================================================================== GET all VNF Performance Monitoring Jobs :: Test ID: 7.3.4.1.1 | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with attribute-based filter ::... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with all_fields attribute ... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_default attri... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with fields attribute sele... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_fields attrib... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid attribute-based f... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid resource endpoint... | PASS | ------------------------------------------------------------------------------ Create new VNF Performance Monitoring Job :: Test ID: 7.3.4.1.9 | PASS | ------------------------------------------------------------------------------ PUT all VNF Performance Monitoring Jobs - Method not implemented :... | PASS | ------------------------------------------------------------------------------ PATCH all VNF Performance Monitoring Jobs - (Method not implemente... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Performance Monitoring Jobs - Method not implemente... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs as Paged Response :: Test ... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs - Bad Request Response too Big... | PASS | ------------------------------------------------------------------------------ PMJobs | PASS | 14 critical tests, 14 passed, 0 failed 14 tests total, 14 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/PerformanceManagementNotification.robot ============================================================================== PerformanceManagementNotification ============================================================================== VNF Performance Information Availability Notification :: Test ID: ... | PASS | ------------------------------------------------------------------------------ VNF Threshold Crossed Notification :: Test ID: 7.3.4.8.2 | PASS | ------------------------------------------------------------------------------ PerformanceManagementNotification | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== GET all VNF Performance Subscriptions :: Test ID: 7.3.4.6.1 | PASS | ------------------------------------------------------------------------------ GET VNF Performance Subscriptions with attribute-based filter :: T... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Management Subscriptions with invalid attribut... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Subscriptions with invalid resource endpoint :... | PASS | ------------------------------------------------------------------------------ Create new VNF Performance subscription :: Test ID: 7.3.4.6.5 | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Performance subscription with VNFM not creat... | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Performance subscription with VNFM creating ... | PASS | ------------------------------------------------------------------------------ PUT VNF Performance Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH VNF Performance Subscriptions - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE VNF Performance Subscriptions - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Subscriptions as Paged Response :: Test ID... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Management Subscriptions - Bad Request Respons... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/Thresholds.robot ============================================================================== Thresholds ============================================================================== GET All Performance Thresholds :: Test ID: 7.3.4.4.1 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS | ------------------------------------------------------------------------------ Create new Performance Threshold :: Test ID: 7.3.4.4.5 | PASS | ------------------------------------------------------------------------------ PUT Performance Thresholds - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET All Performance Thresholds as Paged Response :: Test ID: 7.3.4... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds - Bad Request Response too Big :: Test ... | PASS | ------------------------------------------------------------------------------ Thresholds | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.7.3.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.7.3.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.7.3.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.7.3.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.7.3.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.7.3.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/IndividualSubscription.robot ============================================================================== IndividualSubscription :: This resource represents an individual subscripti... ============================================================================== Create new Virtualised Resources Quota Available Notification indi... | PASS | ------------------------------------------------------------------------------ Get Information about an individual subscription :: Test ID: 7.3.7... | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 7.3.7.2.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription :: This resource represents an individual s... | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== Deliver a notification - Vr Quota Availibility :: Test ID: 11.4.4.1 | PASS | ------------------------------------------------------------------------------ Test a notification end point | PASS | ------------------------------------------------------------------------------ PUT notification - Method not implemented | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create new Virtualised Resources Quota Available Notification subs... | PASS | ------------------------------------------------------------------------------ Create new Virtualised Resources Quota Available Notification subs... | PASS | ------------------------------------------------------------------------------ Create new Virtualised Resources Quota Available Notification subs... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification Subscriptio... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification Subscriptio... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification subscriptio... | PASS | ------------------------------------------------------------------------------ PUT Virtualised Resources Quota Available Notification subscriptio... | PASS | ------------------------------------------------------------------------------ PATCH Virtualised Resources Quota Available Notification subscript... | PASS | ------------------------------------------------------------------------------ DELETE Virtualised Resources Quota Available Notification subscrip... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification Subscriptio... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification subscriptio... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 5.3.1.10.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 5.3.1.10.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 5.3.1.10.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 5.3.1.10.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 5.3.1.10.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 5.3.1.10.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/IndividualNSDescriptor.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== IndividualNSDescriptor :: This Clause defines all the resources and methods... ============================================================================== GET Individual Network Service Descriptor Information :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET Individual Network Service Descriptor Information with invalid... | PASS | ------------------------------------------------------------------------------ Disable Individual Network Service Descriptor :: Test ID: 5.3.1.2.3 | PASS | ------------------------------------------------------------------------------ Enable Individual Network Service Descriptor :: Test ID: 5.3.1.2.4 | PASS | ------------------------------------------------------------------------------ Enable Individual Network Service Descriptor with conflict due to ... | PASS | ------------------------------------------------------------------------------ Enable Individual Network Service Descriptor with conflict due to ... | PASS | ------------------------------------------------------------------------------ Enable Individual Network Service Descriptor with HTTP Etag precon... | PASS | ------------------------------------------------------------------------------ DELETE Individual Network Service Descriptor :: Test ID: 5.3.1.2.9 | PASS | ------------------------------------------------------------------------------ DELETE Individual Network Service Descriptor in operational state ... | PASS | ------------------------------------------------------------------------------ POST Individual Network Service Descriptor - Method not implemente... | PASS | ------------------------------------------------------------------------------ PUT Individual Network Service Descriptor - Method not implemented... | PASS | ------------------------------------------------------------------------------ IndividualNSDescriptor :: This Clause defines all the resources an... | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/IndividualPnfDescriptor.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== IndividualPnfDescriptor :: This Clause defines all the resources and method... ============================================================================== GET Individual PNF Descriptor Information :: Test ID: 5.3.1.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual PNF Descriptor Information with invalid resource id... | PASS | ------------------------------------------------------------------------------ Update Individual PNF Descriptor :: Test ID: 5.3.1.5.3 | PASS | ------------------------------------------------------------------------------ Update Individual PNF Descriptor with HTTP Etag precondition failu... | PASS | ------------------------------------------------------------------------------ POST Individual PNF Descriptor - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PUT Individual PNF Descriptor - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Individual PNF Descriptor :: Test ID: 5.3.1.5.7 | PASS | ------------------------------------------------------------------------------ IndividualPnfDescriptor :: This Clause defines all the resources a... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/IndividualSubscription.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== IndividualSubscription ============================================================================== GET Individual NSD Management Subscription :: Test ID: 5.3.1.8.1 | PASS | ------------------------------------------------------------------------------ GET Individual NSD Management Subscription with invalid resource i... | PASS | ------------------------------------------------------------------------------ DELETE Individual NSD Management Subscription with invalid resourc... | PASS | ------------------------------------------------------------------------------ POST Individual NSD Management Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ PUT Individual NSD Management Subscription - Method not implemente... | PASS | ------------------------------------------------------------------------------ PATCH Individual NSD Management Subscription - Method not implemen... | PASS | ------------------------------------------------------------------------------ DELETE Individual NSD Management Subscription :: Test ID: 5.3.1.8.7 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/NSDContent.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== NSDContent :: This Clause defines the content of the individual NS descript... ============================================================================== Get single file NSD Content in Plain Format :: Test ID: 5.3.1.3.1 | PASS | ------------------------------------------------------------------------------ Get NSD Content in Zip Format :: Test ID: 5.3.1.3.2 | PASS | ------------------------------------------------------------------------------ Get single file NSD Content in Plain or Zip Format :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ Get multi file NSD Content in Plain or Zip Format :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ Get multi file NSD Content in Plain Format :: Test ID: 5.3.1.3.5 | PASS | ------------------------------------------------------------------------------ Get NSD Content with invalid resource identifier :: Test ID: 5.3.1... | PASS | ------------------------------------------------------------------------------ Get NSD Content with conflict due to onboarding state :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET NSD Content with Range Request and NFVO supporting Range Reque... | PASS | ------------------------------------------------------------------------------ GET NSD Content with Range Request and NFVO not supporting Range R... | PASS | ------------------------------------------------------------------------------ GET NSD Content with invalid Range Request :: Test ID: 5.3.1.3.10 | PASS | ------------------------------------------------------------------------------ Upload NSD Content as Zip file in asynchronous mode :: Test ID: 5.... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload NSD Content as plain text file in asynchronous mode :: Test... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload NSD Content as Zip file in synchronous mode :: Test ID: 5.3... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload NSD Content as plain text file in synchronous mode :: Test ... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload NSD Content with conflict due to onboarding state :: Test I... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ POST NSD Content - Method not implemented :: Test ID: 5.3.1.3.16 | PASS | ------------------------------------------------------------------------------ PATCH NSD Content - Method not implemented :: Test ID: 5.3.1.3.17 | PASS | ------------------------------------------------------------------------------ DELETE NSD Content - Method not implemented :: Test ID: 5.3.1.3.18 | PASS | ------------------------------------------------------------------------------ NSDContent :: This Clause defines the content of the individual NS... | FAIL | 18 critical tests, 13 passed, 5 failed 18 tests total, 13 passed, 5 failed ============================================================================== Output: None ++++ Issues in file SOL005/NSDManagement-API/NSDContent.robot ++++ Dryrun SOL005/NSDManagement-API/NSDManagementNotification.robot ============================================================================== NSDManagementNotification ============================================================================== NSD Onboarding Notification :: Test ID: 5.3.1.9.1 | PASS | ------------------------------------------------------------------------------ NSD Onboarding Failure Notification :: Test ID: 5.3.1.9.2 | PASS | ------------------------------------------------------------------------------ NSD Operational State Change Notification :: Test ID: 5.3.1.9.3 | PASS | ------------------------------------------------------------------------------ NSD Deletion Notification :: Test ID: 5.3.1.9.4 | PASS | ------------------------------------------------------------------------------ PNFD Onboarding Notification :: Test ID: 5.3.1.9.5 | PASS | ------------------------------------------------------------------------------ PNFD Onboarding Failure Notification :: Test ID: 5.3.1.9.6 | PASS | ------------------------------------------------------------------------------ PNFD Deletion Notification :: Test ID: 5.3.1.9.7 | PASS | ------------------------------------------------------------------------------ NSDManagementNotification | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/NSDescriptors.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== NSDescriptors :: This Clause defines all the resources and methods provided... ============================================================================== GET all Network Service Descriptors Information :: Test ID: 5.3.1.1.1 | PASS | ------------------------------------------------------------------------------ GET Network Service Descriptors Information with attribute-based f... | PASS | ------------------------------------------------------------------------------ GET Network Service Descriptors Information with invalid attribute... | PASS | ------------------------------------------------------------------------------ Get all Network Service Descriptors Information with malformed aut... | PASS | ------------------------------------------------------------------------------ Get all Network Service Descriptors Information without authorizat... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information with expired or re... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information with "all_fields" ... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information with "exclude_defa... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information with "fields" attr... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information with "exclude_fiel... | PASS | ------------------------------------------------------------------------------ Create new Network Service Descriptor Resource :: Test ID: 5.3.1.1.11 | PASS | ------------------------------------------------------------------------------ PUT all Network Service Descriptors - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH all Network Service Descriptors - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE all Network Service Descriptors - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information as Paged Response ... | PASS | ------------------------------------------------------------------------------ Get all Network Service Descriptors Information - Bad Request Resp... | PASS | ------------------------------------------------------------------------------ NSDescriptors :: This Clause defines all the resources and methods... | PASS | 16 critical tests, 16 passed, 0 failed 16 tests total, 16 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/PNFDContent.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== PNFDContent :: This Clause defines the content of the individual NS descrip... ============================================================================== Get PNFD Content :: Test ID: 5.3.1.6.1 | PASS | ------------------------------------------------------------------------------ Get PNFD Content with invalid resource identifier :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ Get PNFD Content with conflict due to onboarding state :: Test ID:... | PASS | ------------------------------------------------------------------------------ Upload PNFD Content as plain text file :: Test ID: 5.3.1.6.4 | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload PNFD Content with conflict due to onboarding state :: Test ... | PASS | ------------------------------------------------------------------------------ POST PNFD Content - Method not implemented :: Test ID: 5.3.1.6.6 | PASS | ------------------------------------------------------------------------------ PATCH PNFD Content - Method not implemented :: Test ID: 5.3.1.6.7 | PASS | ------------------------------------------------------------------------------ DELETE PNFD Content - Method not implemented :: Test ID: 5.3.1.6.8 | PASS | ------------------------------------------------------------------------------ PNFDContent :: This Clause defines the content of the individual N... | FAIL | 8 critical tests, 7 passed, 1 failed 8 tests total, 7 passed, 1 failed ============================================================================== Output: None ++++ Issues in file SOL005/NSDManagement-API/PNFDContent.robot ++++ Dryrun SOL005/NSDManagement-API/PNFDescriptors.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== PNFDescriptors :: This Clause defines all the resources and methods provide... ============================================================================== GET all PNF Descriptors Information :: Test ID: 5.3.1.4.1 | PASS | ------------------------------------------------------------------------------ GET PNF Descriptors Information with attribute-based filter :: Tes... | PASS | ------------------------------------------------------------------------------ GET PNF Descriptors Information with invalid attribute-based filte... | PASS | ------------------------------------------------------------------------------ GET all PNF Descriptors Information with "all_fields" attribute se... | PASS | ------------------------------------------------------------------------------ GET all PNF Descriptors Information with "exclude_default" attribu... | PASS | ------------------------------------------------------------------------------ GET all PNF Descriptors Information with "fields" attribute select... | PASS | ------------------------------------------------------------------------------ GET all PNF Descriptors Information with "exclude_fields" attribut... | PASS | ------------------------------------------------------------------------------ Create new PNF Descriptor Resource :: Test ID: 5.3.1.4.8 | PASS | ------------------------------------------------------------------------------ PUT all PNF Descriptors - Method not implemented :: Test ID: 5.3.1... | PASS | ------------------------------------------------------------------------------ PATCH all PNF Descriptors - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ DELETE all PNF Descriptors - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ GET all PNF Descriptors Information as Paged Response :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET PNF Descriptors Information - Bad Request Response too Big :: ... | PASS | ------------------------------------------------------------------------------ PNFDescriptors :: This Clause defines all the resources and method... | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/Subscriptions.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== Subscriptions ============================================================================== Get All NSD Management Subscriptions :: Test ID: 5.3.1.7.1 | PASS | ------------------------------------------------------------------------------ Get NSD Management Subscriptions with attribute-based filter :: Te... | PASS | ------------------------------------------------------------------------------ Get NSD Management Subscriptions with invalid attribute-based filt... | PASS | ------------------------------------------------------------------------------ GET NSD Management Subscription with invalid resource endpoint :: ... | PASS | ------------------------------------------------------------------------------ Create new NSD Management subscription :: Test ID: 5.3.1.7.5 | PASS | ------------------------------------------------------------------------------ Create duplicated NSD Management subscription with NFVO not creati... | PASS | ------------------------------------------------------------------------------ Create duplicated NSD Management subscription with NFVO creating d... | PASS | ------------------------------------------------------------------------------ PUT NSD Management Subscriptions - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ PATCH NSD Management Subscriptions - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ DELETE NSD Management Subscriptions - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ Get All NSD Management Subscriptions as Paged Response :: Test ID:... | PASS | ------------------------------------------------------------------------------ Get NSD Management Subscriptions - Bad Request Response too Big ::... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/Alarms.robot ============================================================================== Alarms ============================================================================== POST Alarms - Method not implemented :: Test ID: 5.3.3.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms :: Test ID: 5.3.3.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filters :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms Bad Request Invalid attribut... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "all_fields" attribute ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with exclude_default attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with fields attribute select... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "exclude_fields" attrib... | PASS | ------------------------------------------------------------------------------ PUT Alarms - Method not implemented :: Test ID: 5.3.3.1.5 | PASS | ------------------------------------------------------------------------------ PATCH Alarms - Method not implemented :: Test ID: 5.3.3.1.6 | PASS | ------------------------------------------------------------------------------ DELETE Alarms - Method not implemented :: Test ID: 5.3.3.1.7 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms as Paged Response :: Test ID... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms - Bad Request Response too B... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "id" :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "eventType" :: T... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "perceivedSeveri... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "probableCause" ... | PASS | ------------------------------------------------------------------------------ Alarms | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 5.3.3.6.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 5.3.3.6.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 5.3.3.6.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 5.3.3.6.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 5.3.3.6.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 5.3.3.6.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/IndividualAlarm.robot ============================================================================== IndividualAlarm ============================================================================== POST Individual Alarm - Method not implemented :: Test ID: 5.3.3.2.1 | PASS | ------------------------------------------------------------------------------ GET information about Individual Alarm :: Test ID: 5.3.3.2.2 | PASS | ------------------------------------------------------------------------------ GET information about Invalid Individual Alarm :: Test ID: 5.3.3.2.3 | PASS | ------------------------------------------------------------------------------ PUT Individual Alarm - Method not implemented :: Test ID: 5.3.3.2.4 | PASS | ------------------------------------------------------------------------------ PATCH Alarm :: Test ID: 5.3.3.2.5 | PASS | ------------------------------------------------------------------------------ PATCH Alarm - Conflict :: Test ID: 5.3.3.2.6 | PASS | ------------------------------------------------------------------------------ PATCH Alarm - Precondition failed :: Test ID: 5.3.3.2.7 | PASS | ------------------------------------------------------------------------------ DELETE Individual Alarm - Method not implemented :: Test ID: 5.3.3... | PASS | ------------------------------------------------------------------------------ IndividualAlarm | PASS | 8 critical tests, 8 passed, 0 failed 8 tests total, 8 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== Post Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ Get Information about an individual subscription :: Test ID: 5.3.3... | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 5.3.3.4.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== NS Fault Alarm Notification :: Test ID: 5.3.3.5.1 | PASS | ------------------------------------------------------------------------------ NS Fault Alarm Cleared Notification :: Test ID: 5.3.3.5.2 | PASS | ------------------------------------------------------------------------------ NS Fault Alarm List Rebuilt Notification :: Test ID: 5.3.3.5.3 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create a new alarm subscription :: Test ID: 5.3.3.3.1 | PASS | ------------------------------------------------------------------------------ Create a new alarm subscription - DUPLICATION :: Test ID: 5.3.3.3.2 | PASS | ------------------------------------------------------------------------------ Create a new alarm subscription - NO DUPLICATION :: Test ID: 5.3.3... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions :: Test ID: 5.3.3.3.4 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions - Filter :: Test ID: 5.3.3.3.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 5.3.3.3.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 5.3.3.3.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 5.3.3.3.13 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions as Paged Response :: Test I... | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 5.3.3... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "id" :: Test ID... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.notific... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.faultyR... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.perceiv... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.eventTy... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.probabl... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 5.3.2.25.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 5.3.2.25.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 5.3.2.25.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 5.3.2.25.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 5.3.2.25.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 5.3.2.25.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/CancelOperationTask.robot ============================================================================== CancelOperationTask ============================================================================== POST Cancel operation task :: Test ID: 5.3.2.14.1 | PASS | ------------------------------------------------------------------------------ POST Cancel operation task Not Found :: Test ID: 5.3.2.14.2 | PASS | ------------------------------------------------------------------------------ POST Cancel operation task Conflict :: Test ID: 5.3.2.14.3 | PASS | ------------------------------------------------------------------------------ GET Cancel operation task - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ PUT Cancel operation task - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ PATCH Cancel operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ DELETE Cancel operation task - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ CancelOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/ContinueOperationTask.robot ============================================================================== ContinueOperationTask ============================================================================== POST Continue operation task :: Test ID: 5.3.2.12.1 | PASS | ------------------------------------------------------------------------------ POST Continue operation task Not Found :: Test ID: 5.3.2.12.2 | PASS | ------------------------------------------------------------------------------ POST Continue operation task Conflict :: Test ID: 5.3.2.12.3 | PASS | ------------------------------------------------------------------------------ GET Continue operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ PUT Continue operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ PATCH Continue operation task - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Continue operation task - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ ContinueOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/CreateNSInstanceWorkflow.robot ============================================================================== CreateNSInstanceWorkflow ============================================================================== NS Instance Creation :: Test ID: 5.3.2.18.1 | FAIL | Keyword 'NSLCMOperationKeywords.Check resource not_instantiated' expected 0 arguments, got 1. ------------------------------------------------------------------------------ NS Instance Creation with DISABLED Network Service Descriptor :: T... | PASS | ------------------------------------------------------------------------------ CreateNSInstanceWorkflow | FAIL | 2 critical tests, 1 passed, 1 failed 2 tests total, 1 passed, 1 failed ============================================================================== Output: None ++++ Issues in file SOL005/NSLifecycleManagement-API/CreateNSInstanceWorkflow.robot ++++ Dryrun SOL005/NSLifecycleManagement-API/DeleteNSInstanceWorkflow.robot ============================================================================== DeleteNSInstanceWorkflow ============================================================================== NS Instance Deletion :: Test ID: 5.3.2.19.1 | PASS | ------------------------------------------------------------------------------ DeleteNSInstanceWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/FailOperationTask.robot ============================================================================== FailOperationTask ============================================================================== POST Fail operation task :: Test ID: 5.3.2.13.1 | PASS | ------------------------------------------------------------------------------ POST Fail operation task Not Found :: Test ID: 5.3.2.13.2 | PASS | ------------------------------------------------------------------------------ POST Fail operation task Conflict :: Test ID: 5.3.2.13.3 | PASS | ------------------------------------------------------------------------------ GET Fail operation task - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ PUT Fail operation task - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ PATCH Fail operation task - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ DELETE Fail operation task - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ FailOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/HealNSTask.robot ============================================================================== HealNSTask ============================================================================== POST Heal a NSInstance :: Test ID: 5.3.2.6.1 | PASS | ------------------------------------------------------------------------------ POST Heal a NSInstance Conflict :: Test ID: 5.3.2.6.2 | PASS | ------------------------------------------------------------------------------ GET Heal NSInstance- Method not implemented :: Test ID: 5.3.2.6.3 | PASS | ------------------------------------------------------------------------------ PUT Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.4 | PASS | ------------------------------------------------------------------------------ PATCH Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.5 | PASS | ------------------------------------------------------------------------------ DELETE Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.6 | PASS | ------------------------------------------------------------------------------ HealNSTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/HealNSTaskWorkflow.robot ============================================================================== HealNSTaskWorkflow ============================================================================== Heal Flow of NS lifecycle management operations :: Test ID: 5.3.2.... | PASS | ------------------------------------------------------------------------------ HealNSTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/IndividualNSInstance.robot ============================================================================== IndividualNSInstance ============================================================================== POST Individual NSInstance - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ GET Information about an individual NS Instance :: Test ID: 5.3.2.2.2 | PASS | ------------------------------------------------------------------------------ PUT Individual NSInstance - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ PATCH Individual NSInstance - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ DELETE Individual NSInstance :: Test ID: 5.3.2.2.5 | PASS | ------------------------------------------------------------------------------ DELETE Individual NSInstance Conflict :: Test ID: 5.3.2.2.6 | PASS | ------------------------------------------------------------------------------ IndividualNSInstance | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/IndividualNSLCMOccurences.robot ============================================================================== IndividualNSLCMOccurences ============================================================================== Post Individual NS LCM occurrences - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ Get status information about Individual NS LCM occurrences :: Test... | PASS | ------------------------------------------------------------------------------ PUT status information about Individual NS LCM occurrences - Metho... | PASS | ------------------------------------------------------------------------------ PATCH status information about Individual NS LCM occurrences - Met... | PASS | ------------------------------------------------------------------------------ DELETE status information about Individual NS LCM occurrences - Me... | PASS | ------------------------------------------------------------------------------ IndividualNSLCMOccurences | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== POST Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET Information about an individual subscription :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 5.3.2.16.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/InstanciateNSTaskWorkflow.robot ============================================================================== InstanciateNSTaskWorkflow ============================================================================== Instantiate Flow of NS lifecycle management operations :: Test ID:... | PASS | ------------------------------------------------------------------------------ InstanciateNSTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/InstantiateNSTask.robot ============================================================================== InstantiateNSTask ============================================================================== POST Instantiate a nsInstance :: Test ID: 5.3.2.3.1 | PASS | ------------------------------------------------------------------------------ POST Instantiate a nsInstance Conflict :: Test ID: 5.3.2.3.2 | PASS | ------------------------------------------------------------------------------ GET Instantiate NSInstance - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ PUT Instantiate NSInstance - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ PATCH Instantiate NSInstance - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Instantiate NSInstance - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ InstantiateNSTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/NSInstances.robot ============================================================================== NSInstances ============================================================================== POST Create a new NsInstance :: Test ID: 5.3.2.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances :: Test ID: 5.3.2.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances Bad Request Invalid at... | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances Bad Request Invalid at... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "all_fields" attribute selector :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "exclude_default" attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "fields" attribute selector :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "exclude_fields" attribute selector :: Test I... | PASS | ------------------------------------------------------------------------------ PUT NSInstances - Method not implemented :: Test ID: 5.3.2.1.9 | PASS | ------------------------------------------------------------------------------ PATCH NSInstances - Method not implemented :: Test ID: 5.3.2.1.10 | PASS | ------------------------------------------------------------------------------ DELETE NSInstances - Method not implemented :: Test ID: 5.3.2.1.11 | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances as Paged Response :: T... | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances - Bad Request Response... | PASS | ------------------------------------------------------------------------------ NSInstances | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/NSLCMOccurences.robot ============================================================================== NSLCMOccurences ============================================================================== POST NS LCM occurrences - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences :: Test I... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences Bad Reque... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences Bad Reque... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences with "all... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences with "exc... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences with "fie... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences with "exc... | PASS | ------------------------------------------------------------------------------ PUT status information about multiple NS LCM occurrences - Method ... | PASS | ------------------------------------------------------------------------------ PATCH status information about multiple NS LCM occurrences - Metho... | PASS | ------------------------------------------------------------------------------ DELETE status information about multiple NS LCM occurrences - Meth... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences as Paged ... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences - Bad Req... | PASS | ------------------------------------------------------------------------------ NSLCMOccurences | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== NS LCM Operation Occurrence Start Notification :: Test ID: 5.3.2.17.1 | PASS | ------------------------------------------------------------------------------ NS LCM Operation Occurrence Result Notification :: Test ID: 5.3.2.... | PASS | ------------------------------------------------------------------------------ NS Identifier Creation Notification :: Test ID: 5.3.2.17.3 | PASS | ------------------------------------------------------------------------------ NS Identifier Deletion Notification :: Test ID: 5.3.2.17.4 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/RetryOperationTask.robot ============================================================================== RetryOperationTask ============================================================================== Post Retry operation task :: Test ID: 5.3.2.10.1 | PASS | ------------------------------------------------------------------------------ Post Retry operation task Not Found :: Test ID: 5.3.2.10.2 | PASS | ------------------------------------------------------------------------------ Post Retry operation task Conflict :: Test ID: 5.3.2.10.3 | PASS | ------------------------------------------------------------------------------ GET Retry operation task - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ PUT Retry operation task - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ PATCH Retry operation task - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ DELETE Retry operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ RetryOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/RollbackOperationTask.robot ============================================================================== RollbackOperationTask ============================================================================== POST Rollback operation task :: Test ID: 5.3.2.11.1 | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Not Found :: Test ID: 5.3.2.11.2 | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Conflict :: Test ID: 5.3.2.11.3 | PASS | ------------------------------------------------------------------------------ GET Rollback operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ PUT Rollback operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ PATCH Rollback operation task - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Rollback operation task - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ RollbackOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/ScaleNSTask.robot ============================================================================== ScaleNSTask ============================================================================== POST Scale a nsInstance :: Test ID: 5.3.2.4.1 | PASS | ------------------------------------------------------------------------------ POST Instantiate a nsInstance Conflict :: Test ID: 5.3.2.4.2 | PASS | ------------------------------------------------------------------------------ GET Scale NSInstance- Method not implemented :: Test ID: 5.3.2.4.3 | PASS | ------------------------------------------------------------------------------ PUT Scale NSInstance - Method not implemented :: Test ID: 5.3.2.4.4 | PASS | ------------------------------------------------------------------------------ PATCH Scale NSInstance - Method not implemented :: Test ID: 5.3.2.4.5 | PASS | ------------------------------------------------------------------------------ DELETE Scale NSInstance - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ ScaleNSTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/ScaleNSTaskWorkflow.robot ============================================================================== ScaleNSTaskWorkflow ============================================================================== Scale Flow of NS lifecycle management operations :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ ScaleNSTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== POST Create a new subscription :: Test ID: 5.3.2.15.1 | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - DUPLICATION :: Test ID: 5.3.2.15.2 | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - NO-DUPLICATION :: Test ID: 5.3.2.... | PASS | ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 5.3.2.15.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 5.3.2.15.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 5.3.2.15.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 5.3.2.15.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 5.3.2.15.13 | PASS | ------------------------------------------------------------------------------ GET Subscriptions as Paged Response :: Test ID: 5.3.2.15.14 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 15 critical tests, 15 passed, 0 failed 15 tests total, 15 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/TerminateNSTask.robot ============================================================================== TerminateNSTask ============================================================================== POST Terminate a NSInstance :: Test ID: 5.3.2.7.1 | PASS | ------------------------------------------------------------------------------ POST Terminate a NSInstance Conflict :: Test ID: 5.3.2.7.2 | PASS | ------------------------------------------------------------------------------ GET Terminate NSInstance- Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ PUT Terminate NSInstance - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ PATCH Terminate NSInstance - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ DELETE Terminate NSInstance - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ TerminateNSTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/TerminateNSTaskWorkflow.robot ============================================================================== TerminateNSTaskWorkflow ============================================================================== Terminate Flow of NS lifecycle management operations :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ TerminateNSTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/UpdateNSTask.robot ============================================================================== UpdateNSTask ============================================================================== POST Update a NSInstance :: Test ID: 5.3.2.5.1 | PASS | ------------------------------------------------------------------------------ POST Update a NSInstance Conflict :: Test ID: 5.3.2.5.2 | PASS | ------------------------------------------------------------------------------ GET Update NSInstance- Method not implemented :: Test ID: 5.3.2.5.3 | PASS | ------------------------------------------------------------------------------ PUT Update NSInstance - Method not implemented :: Test ID: 5.3.2.5.4 | PASS | ------------------------------------------------------------------------------ PATCH Update NSInstance - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ DELETE Update NSInstance - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ UpdateNSTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/UpdateNSTaskWorkflow.robot ============================================================================== UpdateNSTaskWorkflow ============================================================================== Update Flow of NS lifecycle management operations :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ UpdateNSTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 5.3.4.9.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 5.3.4.9.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 5.3.4.9.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 5.3.4.9.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 5.3.4.9.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 5.3.4.9.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualPmJob.robot ============================================================================== IndividualPmJob ============================================================================== GET individual NS Performance Job :: Test ID: 5.3.4.2.1 | PASS | ------------------------------------------------------------------------------ GET individual NS Performance Job with invalid resource identifier... | PASS | ------------------------------------------------------------------------------ DELETE Individual NS Performance Job with invalid resource identif... | PASS | ------------------------------------------------------------------------------ POST Individual NS Performance Job - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PUT Individual NS Performance Job - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH Individual NS Performance Job - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE Individual NS Performance Job :: Test ID: 5.3.4.2.7 | PASS | ------------------------------------------------------------------------------ IndividualPmJob | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualReport.robot ============================================================================== IndividualReport ============================================================================== Get Individual Performance Report :: Test ID: 5.3.4.3.1 | PASS | ------------------------------------------------------------------------------ Get Individual Performance Report with invalid resource endpoint :... | PASS | ------------------------------------------------------------------------------ POST Individual Performance Report - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PUT Individual Performance Report - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH Individual Performance Report - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE Individual Performance Report - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ IndividualReport | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription :: This resource represents an individual subscripti... ============================================================================== GET Individual NS Performance Subscription :: Test ID: 5.3.4.7.1 | PASS | ------------------------------------------------------------------------------ GET Individual NS Performance Subscription with invalid resource i... | PASS | ------------------------------------------------------------------------------ DELETE Individual NS Performance Subscription with invalid resourc... | PASS | ------------------------------------------------------------------------------ POST Individual NS Performance Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ PUT Individual NS Performance Subscription - Method not implemente... | PASS | ------------------------------------------------------------------------------ PATCH Individual NS Performance Subscription - Method not implemen... | PASS | ------------------------------------------------------------------------------ DELETE Individual NS Performance Subscription :: Test ID: 5.3.4.7.7 | PASS | ------------------------------------------------------------------------------ IndividualSubscription :: This resource represents an individual s... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualThreshold.robot ============================================================================== IndividualThreshold :: This resource represents an individual threshold. ============================================================================== GET Individual Threshold :: Test ID: 5.3.4.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual Threshold with invalid resource identifier :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold with invalid resource identifier :: Te... | PASS | ------------------------------------------------------------------------------ POST Individual Threshold - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ PUT Individual Threshold - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ PATCH Individual Threshold - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold :: Test ID: 5.3.4.5.7 | PASS | ------------------------------------------------------------------------------ IndividualThreshold :: This resource represents an individual thre... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/Notifications.robot ============================================================================== Notifications ============================================================================== NS Performance Information Availability Notification :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ NS Threshold Crossed Notification :: Test ID: 5.3.4.8.2 | PASS | ------------------------------------------------------------------------------ Notifications | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/PMJobs.robot ============================================================================== PMJobs ============================================================================== GET all NS Performance Monitoring Jobs :: Test ID: 5.3.4.1.1 | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs with attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "all_fields" attribute... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "exclude_default" attr... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "include" attribute se... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "exclude" attribute se... | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs with invalid attribute-based fi... | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs with invalid resource endpoint ... | PASS | ------------------------------------------------------------------------------ Create new NS Performance Monitoring Job :: Test ID: 5.3.4.1.9 | PASS | ------------------------------------------------------------------------------ PUT all NS Performance Monitoring Jobs - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ PATCH all NS Performance Monitoring Jobs - Method not implemented ... | PASS | ------------------------------------------------------------------------------ DELETE all NS Performance Monitoring Jobs - Method not implemented... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs as Paged Response :: Test I... | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs - Bad Request Response too Big ... | PASS | ------------------------------------------------------------------------------ PMJobs | PASS | 14 critical tests, 14 passed, 0 failed 14 tests total, 14 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Get All NS Performance Subscriptions :: Test ID: 5.3.4.6.1 | PASS | ------------------------------------------------------------------------------ Get NS Performance Subscriptions with attribute-based filter :: Te... | PASS | ------------------------------------------------------------------------------ Get NS Performance Subscriptions with invalid attribute-based filt... | PASS | ------------------------------------------------------------------------------ GET NS Performance Subscription with invalid resource endpoint :: ... | PASS | ------------------------------------------------------------------------------ Create new NS Performance subscription :: Test ID: 5.3.4.6.5 | PASS | ------------------------------------------------------------------------------ Create duplicated NS Performance subscription with NFVO not creati... | PASS | ------------------------------------------------------------------------------ Create duplicated NS Performance subscription with NFVO creating d... | PASS | ------------------------------------------------------------------------------ PUT NSD Performance Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH NSD Performance Subscriptions - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE NSD Performance Subscriptions - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ Get All NS Performance Subscriptions as Paged Response :: Test ID:... | PASS | ------------------------------------------------------------------------------ Get NS Performance Subscriptions - Bad Request Response too Big ::... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/Thresholds.robot ============================================================================== Thresholds :: This resource represents thresholds. The client can use this ... ============================================================================== GET All Performance Thresholds :: Test ID: 5.3.4.4.1 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS | ------------------------------------------------------------------------------ Create new Performance Threshold :: Test ID: 5.3.4.4.5 | PASS | ------------------------------------------------------------------------------ PUT Performance Thresholds - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET All Performance Thresholds as Paged Response :: Test ID: 5.3.4... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds - Bad Request Response too Big :: Test ... | PASS | ------------------------------------------------------------------------------ Thresholds :: This resource represents thresholds. The client can ... | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 5.3.5.10.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 5.3.5.10.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 5.3.5.10.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 5.3.5.10.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 5.3.5.10.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 5.3.5.10.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/IndividualSubscription.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Package Subscription :: Test ID: 5.3.5.8.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Subscription with invalid resource iden... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Subscription with invalid resource i... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Subscription - Method not implemented ... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Subscription - Method not implemented :... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Subscription - Method not implemented... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Subscription :: Test ID: 5.3.5.8.7 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/IndividualVNFPackage.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== IndividualVNFPackage ============================================================================== GET Individual VNF Package :: Test ID: 5.3.5.2.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package with invalid resource identifier :: Tes... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ Disable Individual VNF Package :: Test ID: 5.3.5.2.5 | PASS | ------------------------------------------------------------------------------ Disable Individual VNF Package with conflict due to operational st... | PASS | ------------------------------------------------------------------------------ Enable Individual VNF Package :: Test ID: 5.3.5.2.7 | PASS | ------------------------------------------------------------------------------ Enable Individual VNF Package with conflict due to operational sta... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package :: Test ID: 5.3.5.2.9 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package in operational state ENABLED :: Test... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package used for instantiated VNF instances ... | PASS | ------------------------------------------------------------------------------ IndividualVNFPackage | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/Notifications.robot ============================================================================== Notifications ============================================================================== VNF Package Onboarding Notification :: Test ID: 5.3.5.9.1 | PASS | ------------------------------------------------------------------------------ VNF Package Operational State Change Notification :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ VNF Package Deletion Notification :: Test ID: 5.3.5.9.3 | PASS | ------------------------------------------------------------------------------ Notifications | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/Subscriptions.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== Subscriptions ============================================================================== Get All VNF Package Subscriptions :: Test ID: 5.3.5.7.1 | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with attribute-based filter :: Test ... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with invalid attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET VNF Package Subscription with invalid resource endpoint :: Tes... | PASS | ------------------------------------------------------------------------------ Create new VNF Package subscription :: Test ID: 5.3.5.7.5 | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO not creating ... | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO creating dupl... | PASS | ------------------------------------------------------------------------------ PUT VNF Package Subscriptions - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ PATCH VNF Package Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ DELETE VNF Package Subscriptions - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ Get All VNF Package Subscriptions as Paged Response :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions - Bad Request Response too Big :: Te... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/VNFDInIndividualVNFPackage.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== VNFDInIndividualVNFPackage ============================================================================== Get single file VNFD in Individual VNF Package in Plain Format :: ... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package in Zip Format :: Test ID: 5.3.5... | PASS | ------------------------------------------------------------------------------ Get single file VNFD in Individual VNF Package in Plain or Zip For... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual VNF Package in Plain or Zip Form... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual VNF Package in Plain Format :: T... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package with conflict due to onboarding... | PASS | ------------------------------------------------------------------------------ POST VNFD in Individual VNF Package - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PUT VNFD in Individual VNF Package - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PATCH VNFD in Individual VNF Package - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ DELETE VNFD in Individual VNF Package - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ VNFDInIndividualVNFPackage | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackageArtifacts.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== VNFPackageArtifacts ============================================================================== GET Individual VNF Package Artifact :: Test ID: 5.3.5.6.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact in octet stream format :: Test... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with Range Request and NFVO su... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with Range Request and NFVO no... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with invalid Range Request :: ... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with invalid resource identifi... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with conflict due to onboardin... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Artifact - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Artifact - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Artifact - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Artifact - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ VNFPackageArtifacts | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackageContent.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== VNFPackageContent ============================================================================== GET Individual VNF Package Content :: Test ID: 5.3.5.4.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with Range Request and NFVO sup... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with Range Request and NFVO not... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with invalid Range Request :: T... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with conflict due to onboarding... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Content - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ Upload VNF Package Content :: Test ID: 5.3.5.4.8 | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: VNFPackageManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload VNF Package Content with conflict due to onboarding state :... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: VNFPackageManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ PATCH Individual VNF Package Content - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Content - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ VNFPackageContent | FAIL | 11 critical tests, 9 passed, 2 failed 11 tests total, 9 passed, 2 failed ============================================================================== Output: None ++++ Issues in file SOL005/VNFPackageManagement-API/VNFPackageContent.robot ++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackageContentViaURI.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== VNFPackageContentViaURI ============================================================================== Upload VNF Package Content from URI :: Test ID: 5.3.5.5.1 | PASS | ------------------------------------------------------------------------------ Upload VNF Package Content from URI with conflict due to onboardin... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content from URI - Method not implement... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Content from URI - Method not implement... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Content from URI - Method not impleme... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Content from URI - Method not implem... | PASS | ------------------------------------------------------------------------------ VNFPackageContentViaURI | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackages.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== VNFPackages ============================================================================== GET all VNF Packages :: Test ID: 5.3.5.1.1 | PASS | ------------------------------------------------------------------------------ GET VNF Packages with attribute-based filter :: Test ID: 5.3.5.1.2 | PASS | ------------------------------------------------------------------------------ GET VNF Packages with invalid attribute-based filter :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ Get all VNF Packages with malformed authorization token :: Test ID... | PASS | ------------------------------------------------------------------------------ Get all VNF Packages without authorization token :: Test ID: 5.3.1... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "all_fields" attribute selector :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "exclude_default" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "fields" attribute selector :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "exclude_fields" attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET all VNF Packages with invalid resource endpoint :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ Create new VNF Package Resource :: Test ID: 5.3.5.1.11 | PASS | ------------------------------------------------------------------------------ PUT all VNF Packages - Method not implemented :: Test ID: 5.3.5.1.12 | PASS | ------------------------------------------------------------------------------ PATCH all VNF Packages - Method not implemented :: Test ID: 5.3.5.... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Packages - Method not implemented :: Test ID: 5.3.5... | PASS | ------------------------------------------------------------------------------ GET all VNF Packages as Paged Response :: Test ID: 5.3.5.1.15 | PASS | ------------------------------------------------------------------------------ GET VNF Packages - Bad Request Response too Big :: Test ID: 5.3.5.... | PASS | ------------------------------------------------------------------------------ VNFPackages | PASS | 16 critical tests, 16 passed, 0 failed 16 tests total, 16 passed, 0 failed ============================================================================== Output: None Finished: SUCCESS