Started by GitLab push by Michele Carignani Building remotely on build.forge.etsi.org (docker) in workspace /home/jenkins/workspace/NFV - Network Functions Virtualisation/api-tests using credential f9a9fd70-ea8b-4872-a9d5-d1fb1cf8123e > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git@forge.etsi.org:nfv/api-tests.git # timeout=10 Fetching upstream changes from git@forge.etsi.org:nfv/api-tests.git > git --version # timeout=10 using GIT_SSH to set credentials > git fetch --tags --progress git@forge.etsi.org:nfv/api-tests.git +refs/heads/*:refs/remotes/origin/* > git rev-parse remotes/origin/2.7.1-dev-cicd^{commit} # timeout=10 > git branch -a -v --no-abbrev --contains 16b7ac7ba3f6e7b90e2b325d91e66a5aa80d8b2a # timeout=10 Checking out Revision 16b7ac7ba3f6e7b90e2b325d91e66a5aa80d8b2a (origin/2.7.1-dev-cicd) > git config core.sparsecheckout # timeout=10 > git checkout -f 16b7ac7ba3f6e7b90e2b325d91e66a5aa80d8b2a Commit message: "fix shell usage" > git rev-list --no-walk b42db06674ee802e51af3f2ac48505111316d299 # timeout=10 [api-tests] $ /bin/bash /tmp/jenkins691772150801560741.sh DOCKER_FILE=./scripts/docker/Dockerfile + DOCKER_FILE=./scripts/docker/Dockerfile if [ -f ${DOCKER_FILE} ] then #check and build stf583-rf-validation image DOCKER_ID=`docker ps -a | grep -e stf583-rf-validation | awk '{ print $1 }'` if [ ! -z "${DOCKER_ID}" ] then docker rm --force stf583-rf-validation fi docker build --tag stf583-rf-validation --force-rm -f ${DOCKER_FILE} . if [ "$?" != "0" ] then echo "Docker build failed: $?" exit -1 fi docker image ls -a docker inspect stf583-rf-validation:latest if [ "$?" != "0" ] then echo "Docker inspect failed: $?" exit -2 fi else exit -3 fi + '[' -f ./scripts/docker/Dockerfile ']' docker ps -a | grep -e stf583-rf-validation | awk '{ print $1 }' ++ docker ps -a ++ grep -e stf583-rf-validation ++ awk '{ print $1 }' + DOCKER_ID=87a9a51c6b57 + '[' '!' -z 87a9a51c6b57 ']' + docker rm --force stf583-rf-validation Error response from daemon: No such container: stf583-rf-validation + docker build --tag stf583-rf-validation --force-rm -f ./scripts/docker/Dockerfile . Sending build context to Docker daemon 66.64MB Step 1/14 : FROM ubuntu:16.04 ---> dfeff22e96ae Step 2/14 : MAINTAINER ETSI STF 583 ---> Using cache ---> c3e28c2ab3a7 Step 3/14 : LABEL description "SFT583 Robot Framework Docker Image" ---> Using cache ---> 06b4784845f3 Step 4/14 : ENV TERM xterm ---> Using cache ---> 24be069a7d43 Step 5/14 : ENV HOSTNAME docker-robot-STF583 ---> Using cache ---> 69a9664a053d Step 6/14 : ARG ssh_prv_key ---> Using cache ---> 28335c635305 Step 7/14 : RUN DEBIAN_FRONTEND=noninteractive apt update && apt install python3 git -y && apt install python3-pip -y && apt install openssh-server -y && DEBIAN_FRONTEND=noninteractive apt-get autoremove --purge -y && DEBIAN_FRONTEND=noninteractive apt-get autoclean && rm -rf /var/lib/apt/lists/* ---> Using cache ---> 8fcadd01096b Step 8/14 : RUN echo "docker-robot-STF583" > /etc/hostname && echo "root:etsi" | chpasswd ---> Using cache ---> a10d35cdb954 Step 9/14 : RUN useradd --create-home --shell /bin/bash --user-group etsi --groups sudo && echo "etsi:etsi" | chpasswd && adduser etsi sudo && echo "etsi ALL=(ALL) NOPASSWD:ALL" >> /etc/sudoers ---> Using cache ---> 69c04d92151b Step 10/14 : RUN DEBIAN_FRONTEND=noninteractive && mkdir -p /home/etsi/dev/robot && cd /home/etsi/dev/robot ---> Using cache ---> 87269185f5aa Step 11/14 : ADD . /home/etsi/dev/robot ---> 5c7b92406dd2 Removing intermediate container 2ae2b68fbfa2 Step 12/14 : RUN pip3 install robotframework ---> Running in 975c93643cb4 Collecting robotframework Downloading https://files.pythonhosted.org/packages/38/43/e03efaa547a3158f0745c5ea7f1eafebd69d46f2c9aece3a8ba21992adc9/robotframework-3.2.2-py2.py3-none-any.whl (623kB) Installing collected packages: robotframework Successfully installed robotframework-3.2.2 You are using pip version 8.1.1, however version 20.2.4 is available. You should consider upgrading via the 'pip install --upgrade pip' command.  ---> 0a44455e9f46 Removing intermediate container 975c93643cb4 Step 13/14 : RUN DEBIAN_FRONTEND=noninteractive && cd /home/etsi/dev/robot && pip3 install -r requirements.txt && chmod +x /home/etsi/dev/robot/scripts/* && git clone https://github.com/etsi-cti-admin/robotframework-mockserver && cd robotframework-mockserver && patch -p1 < ../extensions/mockserverlibrary.patch && python3 -m pip install -e . ---> Running in dd8ba9546efa Collecting robotframework==3.1 (from -r requirements.txt (line 6)) Downloading https://files.pythonhosted.org/packages/78/c3/9a5af726bef21c2b0946a81a3348e946764a72ae5a2c45beaeee43e7d8a8/robotframework-3.1-py2.py3-none-any.whl (597kB) Collecting RESTinstance==1.0.0rc4 (from -r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/1a/27/e6781c2a19471d6b9e54cd943c695668ca84c1b393f48f3b441ca7db520f/RESTinstance-1.0.0rc4-py2.py3-none-any.whl Collecting robotframework-dependencylibrary==1.0.0.post1 (from -r requirements.txt (line 8)) Downloading https://files.pythonhosted.org/packages/7c/46/c09b5ebb178a85bdeba8d0e66d4b6747657bacbc96cec01c2aedf43d0b82/robotframework_dependencylibrary-1.0.0.post1-py3-none-any.whl Collecting robotframework-jsonlibrary==0.3 (from -r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/91/05/bc535d666491d0856516cb6efed2736a5242bd70555c4f80df89755cc69b/robotframework-jsonlibrary-0.3.tar.gz Collecting robotframework-jsonschemalibrary==1.0 (from -r requirements.txt (line 10)) Downloading https://files.pythonhosted.org/packages/e6/0d/5d4162af1b87260f633cbd402cbe4bd263efa057bb9799c97e8e5676b241/robotframework-jsonschemalibrary-1.0.tar.gz Collecting robotframework-mockserver==0.0.4 (from -r requirements.txt (line 11)) Downloading https://files.pythonhosted.org/packages/00/62/736ae14f6c99964dc82c14cc37e49a9f9171962efd4021e1acfed7317264/robotframework-mockserver-0.0.4.tar.gz Collecting pygments==2.2.0 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/02/ee/b6e02dc6529e82b75bb06823ff7d005b141037cb1416b10c6f00fc419dca/Pygments-2.2.0-py2.py3-none-any.whl (841kB) Collecting requests==2.20.0 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/f1/ca/10332a30cb25b627192b4ea272c351bce3ca1091e541245cccbace6051d8/requests-2.20.0-py2.py3-none-any.whl (60kB) Collecting GenSON==1.0.1 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/00/ed/4b249d723b330e5856ab1c2f09dfa298f997630fa2bc5cfb50247cf1d8d2/genson-1.0.1.tar.gz Collecting flex==6.13.2 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/8d/3d/7075e8a5844e485d80972f4f6e9aef287f5b898312524f58d96a203b794d/flex-6.13.2-py3-none-any.whl (77kB) Collecting strict-rfc3339==0.7 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/56/e4/879ef1dbd6ddea1c77c0078cd59b503368b0456bcca7d063a870ca2119d3/strict-rfc3339-0.7.tar.gz Collecting tzlocal==1.5.1 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/cb/89/e3687d3ed99bc882793f82634e9824e62499fdfdc4b1ae39e211c5b05017/tzlocal-1.5.1.tar.gz Collecting jsonpath-ng==1.4.3 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/95/32/ab29fef829c129e5847b8241541bec858515af2bd57a845fad78efde25f5/jsonpath_ng-1.4.3-py2.py3-none-any.whl Collecting pytz==2018.5 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/30/4e/27c34b62430286c6d59177a0842ed90dc789ce5d1ed740887653b898779a/pytz-2018.5-py2.py3-none-any.whl (510kB) Collecting jsonschema==3.0.0a3 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/e3/df/b85ecaf1e9d4a8e9aa958517edeb3d933b9ce23d5c19ad3873ce1ac7d57b/jsonschema-3.0.0a3-py2.py3-none-any.whl (49kB) Collecting rfc3987==1.3.8 (from RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/65/d4/f7407c3d15d5ac779c3dd34fbbc6ea2090f77bd7dd12f207ccf881551208/rfc3987-1.3.8-py2.py3-none-any.whl Collecting tox (from robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/e0/79/5915b9dad867e89bb6495456acfe5d4e2287e74dfa29c059f7b127d5480e/tox-3.20.1-py2.py3-none-any.whl (83kB) Collecting coverage (from robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/35/58/e38636e8233b49982efca6a69c9974f2575439f637dc3b0e8ac0e77c550c/coverage-5.3-cp35-cp35m-manylinux1_x86_64.whl (229kB) Collecting jsonpath-rw==1.4.0 (from robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/71/7c/45001b1f19af8c4478489fbae4fc657b21c4c669d7a5a036a86882581d85/jsonpath-rw-1.4.0.tar.gz Collecting jsonpath-rw-ext>=0.1.9 (from robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/eb/69/e46a4866c6afa52861bcd9bf8909a4b76fd7ac68b227b2d5673f109f0aa3/jsonpath_rw_ext-1.2.2-py2.py3-none-any.whl Collecting idna<2.8,>=2.5 (from requests==2.20.0->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/4b/2a/0276479a4b3caeb8a8c1af2f8e4355746a97fab05a372e4a2c6a6b876165/idna-2.7-py2.py3-none-any.whl (58kB) Collecting certifi>=2017.4.17 (from requests==2.20.0->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/c1/6f/3d85f0850962279a7e4c622695d7b3171e95ac65308a57d3b29738b27149/certifi-2020.11.8-py2.py3-none-any.whl (155kB) Collecting chardet<3.1.0,>=3.0.2 (from requests==2.20.0->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) Collecting urllib3<1.25,>=1.21.1 (from requests==2.20.0->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/01/11/525b02e4acc0c747de8b6ccdab376331597c569c42ea66ab0a1dbd36eca2/urllib3-1.24.3-py2.py3-none-any.whl (118kB) Collecting click<7,>=3.3 (from flex==6.13.2->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/34/c1/8806f99713ddb993c5366c362b2f908f18269f8d792aff1abfd700775a77/click-6.7-py2.py3-none-any.whl (71kB) Collecting jsonpointer<2,>=1.7 (from flex==6.13.2->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/7b/f4/90449441c1c011a733ee85739a680f2442eda2130e6a88f51804660a0289/jsonpointer-1.14-py2.py3-none-any.whl Requirement already satisfied (use --upgrade to upgrade): six<2,>=1.7.3 in /usr/lib/python3/dist-packages (from flex==6.13.2->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Collecting validate-email<2,>=1.2 (from flex==6.13.2->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/84/a0/cb53fb64b52123513d04f9b913b905f3eb6fda7264e639b4573cc715c29f/validate_email-1.3.tar.gz Collecting PyYAML<4,>=3.11 (from flex==6.13.2->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/9e/a3/1d13970c3f36777c583f136c136f804d70f500168edc1edea6daa7200769/PyYAML-3.13.tar.gz (270kB) Collecting ply (from jsonpath-ng==1.4.3->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/a3/58/35da89ee790598a0700ea49b2a66594140f44dec458c07e8e3d4979137fc/ply-3.11-py2.py3-none-any.whl (49kB) Collecting decorator (from jsonpath-ng==1.4.3->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/ed/1b/72a1821152d07cf1d8b6fce298aeb06a7eb90f4d6d41acec9861e7cc6df0/decorator-4.4.2-py2.py3-none-any.whl Collecting pyrsistent>=0.14.0 (from jsonschema==3.0.0a3->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/4d/70/fd441df751ba8b620e03fd2d2d9ca902103119616f0f6cc42e6405035062/pyrsistent-0.17.3.tar.gz (106kB) Collecting attrs>=17.4.0 (from jsonschema==3.0.0a3->RESTinstance==1.0.0rc4->-r requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/c3/aa/cb45262569fcc047bf070b5de61813724d6726db83259222cd7b4c79821a/attrs-20.3.0-py2.py3-none-any.whl (49kB) Collecting packaging>=14 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/46/19/c5ab91b1b05cfe63cccd5cfc971db9214c6dd6ced54e33c30d5af1d2bc43/packaging-20.4-py2.py3-none-any.whl Collecting importlib-metadata<3,>=0.12; python_version < "3.8" (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/6d/6d/f4bb28424bc677bce1210bc19f69a43efe823e294325606ead595211f93e/importlib_metadata-2.0.0-py2.py3-none-any.whl Collecting toml>=0.9.4 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl Collecting py>=1.4.17 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/68/0f/41a43535b52a81e4f29e420a151032d26f08b62206840c48d14b70e53376/py-1.9.0-py2.py3-none-any.whl (99kB) Collecting filelock>=3.0.0 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/93/83/71a2ee6158bb9f39a90c0dea1637f81d5eef866e188e1971a1b1ab01a35a/filelock-3.0.12-py3-none-any.whl Collecting pluggy>=0.12.0 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/a0/28/85c7aa31b80d150b772fbe4a229487bc6644da9ccb7e427dd8cc60cb8a62/pluggy-0.13.1-py2.py3-none-any.whl Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 (from tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/97/f3/c064343ac58d1a54c393a3f66483a29500f644a5918deeb935d28673edd9/virtualenv-20.1.0-py2.py3-none-any.whl (4.9MB) Collecting pbr>=1.8 (from jsonpath-rw-ext>=0.1.9->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/fb/48/69046506f6ac61c1eaa9a0d42d22d54673b69e176d30ca98e3f61513e980/pbr-5.5.1-py2.py3-none-any.whl (106kB) Collecting pyparsing>=2.0.2 (from packaging>=14->tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/8a/bb/488841f56197b13700afd5658fc279a2025a39e22449b7cf29864669b15d/pyparsing-2.4.7-py2.py3-none-any.whl (67kB) Collecting zipp>=0.5 (from importlib-metadata<3,>=0.12; python_version < "3.8"->tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/41/ad/6a4f1a124b325618a7fb758b885b68ff7b058eec47d9220a12ab38d90b1f/zipp-3.4.0-py3-none-any.whl Collecting appdirs<2,>=1.4.3 (from virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/3b/00/2344469e2084fb287c2e0b57b72910309874c3245463acd6cf5e3db69324/appdirs-1.4.4-py2.py3-none-any.whl Collecting importlib-resources>=1.0; python_version < "3.7" (from virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/c5/1f/ec86d2a5c48ac6490d4471b297885603cf0e8da89d5ffbf0bce6e57f4d64/importlib_resources-3.3.0-py2.py3-none-any.whl Collecting distlib<1,>=0.3.1 (from virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox->robotframework-jsonlibrary==0.3->-r requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/f5/0a/490fa011d699bb5a5f3a0cf57de82237f52a6db9d40f33c53b2736c9a1f9/distlib-0.3.1-py2.py3-none-any.whl (335kB) Building wheels for collected packages: robotframework-jsonlibrary, robotframework-jsonschemalibrary, robotframework-mockserver, GenSON, strict-rfc3339, tzlocal, jsonpath-rw, validate-email, PyYAML, pyrsistent Running setup.py bdist_wheel for robotframework-jsonlibrary: started Running setup.py bdist_wheel for robotframework-jsonlibrary: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/5f/70/4e/099c5b627ea3eb9aed2794f477b45b15ac1a1e7a210a88090f Running setup.py bdist_wheel for robotframework-jsonschemalibrary: started Running setup.py bdist_wheel for robotframework-jsonschemalibrary: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/0c/9c/f0/680efb7acfc611d50bf85f1cc0e1773dfb5dfd0975a0f515f6 Running setup.py bdist_wheel for robotframework-mockserver: started Running setup.py bdist_wheel for robotframework-mockserver: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/24/a7/5d/f7fec7865a502e1b7369bf88c484f86348640bcb3247e380ba Running setup.py bdist_wheel for GenSON: started Running setup.py bdist_wheel for GenSON: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/c7/8d/68/e7d5111969fea6f6a53ec10803d1bca5118b79b5bb2d559122 Running setup.py bdist_wheel for strict-rfc3339: started Running setup.py bdist_wheel for strict-rfc3339: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/bb/af/c9/b6e9fb5f9b2470e4ed2a7241c9ab3a8cdd3bc8555ae02ca2e6 Running setup.py bdist_wheel for tzlocal: started Running setup.py bdist_wheel for tzlocal: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/15/ae/df/a67bf1ed84e9bf230187d36d8dcfd30072bea0236cb059ed91 Running setup.py bdist_wheel for jsonpath-rw: started Running setup.py bdist_wheel for jsonpath-rw: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/5c/00/9a/82822db383c2d96dcebf839786665a185f92d37e5026f9806f Running setup.py bdist_wheel for validate-email: started Running setup.py bdist_wheel for validate-email: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/14/46/e7/4a2edb0d03a802cb59a75668734c04cceacdd6c0c585448773 Running setup.py bdist_wheel for PyYAML: started Running setup.py bdist_wheel for PyYAML: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/ad/da/0c/74eb680767247273e2cf2723482cb9c924fe70af57c334513f Running setup.py bdist_wheel for pyrsistent: started Running setup.py bdist_wheel for pyrsistent: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/f0/b8/de/b593ad311be4eb458499d100db081e453576032272398b7ddc Successfully built robotframework-jsonlibrary robotframework-jsonschemalibrary robotframework-mockserver GenSON strict-rfc3339 tzlocal jsonpath-rw validate-email PyYAML pyrsistent Installing collected packages: robotframework, pygments, idna, certifi, chardet, urllib3, requests, GenSON, click, rfc3987, jsonpointer, strict-rfc3339, validate-email, PyYAML, flex, pytz, tzlocal, ply, decorator, jsonpath-ng, pyrsistent, attrs, jsonschema, RESTinstance, robotframework-dependencylibrary, pyparsing, packaging, zipp, importlib-metadata, toml, py, filelock, pluggy, appdirs, importlib-resources, distlib, virtualenv, tox, coverage, jsonpath-rw, pbr, jsonpath-rw-ext, robotframework-jsonlibrary, robotframework-jsonschemalibrary, robotframework-mockserver Found existing installation: robotframework 3.2.2 Uninstalling robotframework-3.2.2: Successfully uninstalled robotframework-3.2.2 Found existing installation: chardet 2.3.0 Not uninstalling chardet at /usr/lib/python3/dist-packages, outside environment /usr Found existing installation: urllib3 1.13.1 Not uninstalling urllib3 at /usr/lib/python3/dist-packages, outside environment /usr Found existing installation: requests 2.9.1 Not uninstalling requests at /usr/lib/python3/dist-packages, outside environment /usr Successfully installed GenSON-1.0.1 PyYAML-3.13 RESTinstance-1.0.0rc4 appdirs-1.4.4 attrs-20.3.0 certifi-2020.11.8 chardet-3.0.4 click-6.7 coverage-5.3 decorator-4.4.2 distlib-0.3.1 filelock-3.0.12 flex-6.13.2 idna-2.7 importlib-metadata-2.0.0 importlib-resources-3.3.0 jsonpath-ng-1.4.3 jsonpath-rw-1.4.0 jsonpath-rw-ext-1.2.2 jsonpointer-1.14 jsonschema-3.0.0a3 packaging-20.4 pbr-5.5.1 pluggy-0.13.1 ply-3.11 py-1.9.0 pygments-2.2.0 pyparsing-2.4.7 pyrsistent-0.17.3 pytz-2018.5 requests-2.20.0 rfc3987-1.3.8 robotframework-3.1 robotframework-dependencylibrary-1.0.0.post1 robotframework-jsonlibrary-0.3 robotframework-jsonschemalibrary-1.0 robotframework-mockserver-0.0.4 strict-rfc3339-0.7 toml-0.10.2 tox-3.20.1 tzlocal-1.5.1 urllib3-1.24.3 validate-email-1.3 virtualenv-20.1.0 zipp-3.4.0 You are using pip version 8.1.1, however version 20.2.4 is available. You should consider upgrading via the 'pip install --upgrade pip' command. Cloning into 'robotframework-mockserver'... patching file src/MockServerLibrary/library.py Hunk #1 succeeded at 73 with fuzz 2 (offset 7 lines). Hunk #2 succeeded at 143 with fuzz 2 (offset 43 lines). Obtaining file:///home/etsi/dev/robot/robotframework-mockserver Installing collected packages: robotframework-mockserver Running setup.py develop for robotframework-mockserver Successfully installed robotframework-mockserver-0.0.4 You are using pip version 8.1.1, however version 20.2.4 is available. You should consider upgrading via the 'pip install --upgrade pip' command.  ---> 35cfdf464b71 Removing intermediate container dd8ba9546efa Step 14/14 : CMD tail -f /dev/null ---> Running in c8c382b3ac79 ---> 6d94e7f282fb Removing intermediate container c8c382b3ac79 Successfully built 6d94e7f282fb Successfully tagged stf583-rf-validation:latest + '[' 0 '!=' 0 ']' + docker image ls -a REPOSITORY TAG IMAGE ID CREATED SIZE 35cfdf464b71 Less than a second ago 573MB stf583-rf-validation latest 6d94e7f282fb Less than a second ago 573MB 0a44455e9f46 34 seconds ago 536MB 5c7b92406dd2 37 seconds ago 531MB ab6dbd95ecdf 5 minutes ago 573MB 6579d60b93a5 5 minutes ago 573MB 1b5ca655d0a3 6 minutes ago 536MB e4f4d6cf6514 6 minutes ago 531MB 87269185f5aa 6 minutes ago 465MB 69c04d92151b 6 minutes ago 465MB a10d35cdb954 6 minutes ago 465MB 8fcadd01096b 6 minutes ago 465MB 28335c635305 7 minutes ago 131MB 24be069a7d43 7 minutes ago 131MB 69a9664a053d 7 minutes ago 131MB c3e28c2ab3a7 7 minutes ago 131MB 06b4784845f3 7 minutes ago 131MB 4ec03dd9ecbe67e2ba004ea16b76cf2330c3d869 latest f9583c85b2eb 16 hours ago 93.4MB b9f2656e8dd8 16 hours ago 93.4MB 16f96a0ec1f9 16 hours ago 93.2MB 6f2aa5724ebe 13 days ago 224MB 49c2e44cf414 13 days ago 224MB f292874f6334 13 days ago 224MB 5404d0bde354 13 days ago 224MB faa78c58459a 13 days ago 224MB 348876f81ed4 13 days ago 224MB 500f197bc30e 13 days ago 224MB 50dadb49c240 13 days ago 224MB openapivalidator latest 3399a60ada3f 13 days ago 224MB d7b0c952fa18 13 days ago 224MB 374dfe44f785 13 days ago 224MB 00f8ba24379b 13 days ago 224MB 808faca21532 13 days ago 224MB 261de29c25d2 13 days ago 224MB 71f14f57d3ea 13 days ago 224MB 11d5296cb6e3 13 days ago 223MB f4d81cd29e36 13 days ago 212MB 91638a196f16 13 days ago 206MB b23fedc8dd94 13 days ago 206MB ce077e02bff8 13 days ago 191MB 352b01bc416e 13 days ago 171MB c9c08c112472 13 days ago 167MB 54afa303828c 13 days ago 166MB 56a612d9bba4 13 days ago 165MB 48f0b705cc06 13 days ago 66.2MB cb2256300214 13 days ago 52.9MB 24860c3b2063 13 days ago 36.3MB e6615b737995 13 days ago 9MB 12029cc0f39f 13 days ago 7MB 3dd37f88f48b 13 days ago 5.58MB 4d33b22eee40 2 weeks ago 228MB 64889590f48f 2 weeks ago 228MB d27d8b238c15 2 weeks ago 228MB 79c64096c8a8 2 weeks ago 228MB 129f626ec7f6 2 weeks ago 228MB 357b2d773bed 2 weeks ago 228MB b3d8bc7e9284 2 weeks ago 228MB 190a33d54e88 2 weeks ago 228MB 7e51c511c61c 2 weeks ago 226MB 1d3870bfc0f0 2 weeks ago 228MB 8905566d055b 2 weeks ago 228MB f8bc7786b127 2 weeks ago 228MB 9da5d43fb7e9 2 weeks ago 228MB e2cf9a6cff5d 2 weeks ago 228MB 3f8019cd7f43 2 weeks ago 228MB d617ede32235 2 weeks ago 228MB 4b2702d64e34 2 weeks ago 228MB 773c948f828d 2 weeks ago 226MB 396bd7f75b5c 2 weeks ago 217MB 53549525d310 2 weeks ago 187MB aa86e98b758a 2 weeks ago 187MB bbb28d0f93e8 2 weeks ago 172MB 31742a01de3d 2 weeks ago 151MB de7de1dafcce 2 weeks ago 148MB f183fdcad5bc 2 weeks ago 147MB 705fb9a0af3e 2 weeks ago 145MB 14e283a59fea 2 weeks ago 54.3MB cc26942c1f05 2 weeks ago 40.7MB 6a7e36d52a5e 2 weeks ago 31.7MB eeb9af854748 2 weeks ago 8.68MB 593ca0db9007 2 weeks ago 5.13MB 1e1c09059592 2 weeks ago 4.03MB ubuntu 16.04 dfeff22e96ae 2 weeks ago 131MB tosca-ie-sample latest 2849e4604273 4 months ago 505MB 1005d8be9b4d 4 months ago 505MB f66d62d774c5 4 months ago 505MB fd3eab8cffb9 4 months ago 505MB fb9201ee6cca 4 months ago 505MB d05408cbae85 4 months ago 505MB 5b7f77c730a1 4 months ago 505MB 9dec18c5f564 4 months ago 502MB 25752aa1054f 4 months ago 472MB 74891ab99e7d 4 months ago 472MB 6842a41beb93 4 months ago 472MB c60779c28f1b 4 months ago 472MB e3eec2a02452 4 months ago 472MB eeae7e4a26e6 4 months ago 472MB 95d37c469efb 4 months ago 472MB 53eea4b91e17 4 months ago 469MB 43db6ca060fe 4 months ago 73.9MB aea93ab56909 4 months ago 73.9MB 35b89258858f 4 months ago 73.9MB 74435f89ab78 4 months ago 73.9MB robotframework/rfdocker 3.1.2 78d04f0de2cd 17 months ago 89.8MB 4d90542f0623 17 months ago 5.58MB 43773d1dba76 20 months ago 4.03MB plantuml/plantuml-server tomcat 805a4b03284f 2 years ago 729MB + docker inspect stf583-rf-validation:latest [ { "Id": "sha256:6d94e7f282fb0dfaac8c300a5182a62c01aaec50afe20846c1bfd7ef6579f425", "RepoTags": [ "stf583-rf-validation:latest" ], "RepoDigests": [], "Parent": "sha256:35cfdf464b71a5b2c894ec228681b36559f0c3fa799462c3c713a772a9046037", "Comment": "", "Created": "2020-11-12T18:16:42.356253975Z", "Container": "c8c382b3ac79273615d3cdaeed19bd13d21f3222415ea16d5e41494f9ce1f576", "ContainerConfig": { "Hostname": "c8c382b3ac79", "Domainname": "", "User": "", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": [ "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin", "TERM=xterm", "HOSTNAME=docker-robot-STF583" ], "Cmd": [ "/bin/sh", "-c", "#(nop) ", "CMD [\"/bin/sh\" \"-c\" \"tail -f /dev/null\"]" ], "ArgsEscaped": true, "Image": "sha256:35cfdf464b71a5b2c894ec228681b36559f0c3fa799462c3c713a772a9046037", "Volumes": null, "WorkingDir": "", "Entrypoint": null, "OnBuild": [], "Labels": { "description": "SFT583 Robot Framework Docker Image" } }, "DockerVersion": "17.06.2-ce", "Author": "ETSI STF 583", "Config": { "Hostname": "", "Domainname": "", "User": "", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": [ "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin", "TERM=xterm", "HOSTNAME=docker-robot-STF583" ], "Cmd": [ "/bin/sh", "-c", "tail -f /dev/null" ], "ArgsEscaped": true, "Image": "sha256:35cfdf464b71a5b2c894ec228681b36559f0c3fa799462c3c713a772a9046037", "Volumes": null, "WorkingDir": "", "Entrypoint": null, "OnBuild": [], "Labels": { "description": "SFT583 Robot Framework Docker Image" } }, "Architecture": "amd64", "Os": "linux", "Size": 573171712, "VirtualSize": 573171712, "GraphDriver": { "Data": null, "Name": "aufs" }, "RootFS": { "Type": "layers", "Layers": [ "sha256:61727f5e6796a2d90ed9d0dc385a3c1a3b6ded69a5bc4709542a4f47e877ba03", "sha256:eff16de3ff6467c1bc2afd0bae39c7ee86725e42f6a3cfb691c7688767c89ed9", "sha256:62fdddf6a67c88f7d7f9f19c0ebd6651be77b93ce6d99ca67018df7714e775e3", "sha256:9edaa71ce2334d676da80820de71477b34b1e04078dfe0c2ca735f5d951a4c70", "sha256:4ca2c1b5fde630062a0e5525ffa8e9dfdb7318f38e8c6c4db6c9477d96289b18", "sha256:7545c24a88195a3c36c846855685b99b2b42bece7a57b35b4d9eccaa9fff1832", "sha256:45574d84a591d3c3f162cba497a21e769ade05eedd2b533aea9fdee5f12fbd38", "sha256:f6f946e8aa8d6900541b38b2618d3e5abfeea884ce2ed99ac5e48366bb5f157b", "sha256:4fd2e13a06cbabd6194348d7e4b9859c89ec835502eceb8e2f725df81080095b", "sha256:152a1b467235ebb8419ca2ad02f13f3eda16d66407e969eeebc5e92bb7883c55", "sha256:e48b01092dd92e4d97723c7e76b4e5841ebf1d3d7e1d6b11b75ba1e0759983ce" ] } } ] + '[' 0 '!=' 0 ']' # That's all Floks exit 0 + exit 0 ++++ Dryrun SOL002/VNFConfiguration-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 6.3.1.2.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 6.3.1.2.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 6.3.1.2.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 6.3.1.2.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 6.3.1.2.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 6.3.1.2.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFConfiguration-API/Configuration.robot ============================================================================== Configuration ============================================================================== Set new VNF Configuration :: Test ID: 6.3.1.1.1 | PASS | ------------------------------------------------------------------------------ Get information about a VNF configuration :: Test ID: 6.3.1.1.2 | PASS | ------------------------------------------------------------------------------ Get information about a VNF configuration with HTTP Etag :: Test I... | PASS | ------------------------------------------------------------------------------ Set new VNF Configuration - HTTP Etag precondition unsuccessful ::... | PASS | ------------------------------------------------------------------------------ POST VNF Configuration - Method not implemented :: Test ID: 6.3.1.1.5 | PASS | ------------------------------------------------------------------------------ PUT VNF Configuration - Method not implemented :: Test ID: 6.3.1.1.6 | PASS | ------------------------------------------------------------------------------ DELETE VNF Configuration - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Configuration | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/Alarms.robot ============================================================================== Alarms ============================================================================== POST Alarms - Method not implemented :: Test ID: 6.3.4.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms :: Test ID: 6.3.4.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with invalid attribute-based... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "all_fields" attribute ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with exclude_default attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with fields attribute select... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "exclude_fields" attrib... | PASS | ------------------------------------------------------------------------------ PUT Alarms - Method not implemented :: Test ID: 6.3.4.1.9 | PASS | ------------------------------------------------------------------------------ PATCH Alarms - Method not implemented :: Test ID: 6.3.4.1.10 | PASS | ------------------------------------------------------------------------------ DELETE Alarms - Method not implemented :: Test ID: 6.3.4.1.11 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms to get Paged Response :: Tes... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms for Bad Request Response too... | PASS | ------------------------------------------------------------------------------ GET information about alarms with attribute-based filter "id" :: T... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with attribute-based filter ... | PASS | ------------------------------------------------------------------------------ Alarms | PASS | 19 critical tests, 19 passed, 0 failed 19 tests total, 19 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 6.3.4.7.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 6.3.4.7.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 6.3.4.7.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 6.3.4.7.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 6.3.4.7.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 6.3.4.7.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/EscalatePerceivedSeverityTask.robot ============================================================================== EscalatePerceivedSeverityTask ============================================================================== Escalate the perceived severity :: Test ID: 6.3.4.3.1 | PASS | ------------------------------------------------------------------------------ GET Escalate the perceived severity - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PUT Escalate the perceived severity - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH Escalate the perceived severity - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE Escalate the perceived severity - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ EscalatePerceivedSeverityTask | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/IndividualAlarm.robot ============================================================================== IndividualAlarm ============================================================================== POST Alarm - Method not implemented :: Test ID: 6.3.4.2.1 | PASS | ------------------------------------------------------------------------------ GET information about an individual alarm :: Test ID: 6.3.4.2.2 | PASS | ------------------------------------------------------------------------------ PUT Individual Alarm - Method not implemented :: Test ID: 6.3.4.2.3 | PASS | ------------------------------------------------------------------------------ PATCH Individual Alarm :: Test ID: 6.3.4.2.4 | PASS | ------------------------------------------------------------------------------ PATCH Individual Alarm - Precondition failed :: Test ID: 6.3.4.2.5 | PASS | ------------------------------------------------------------------------------ PATCH Individual Alarm - Conflict :: Test ID: 6.3.4.2.6 | PASS | ------------------------------------------------------------------------------ DELETE Individual Alarm - Method not implemented :: Test ID: 6.3.4... | PASS | ------------------------------------------------------------------------------ IndividualAlarm | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription :: This resource represents an individual subscripti... ============================================================================== POST Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET Information about an individual subscription :: Test ID: 6.3.4... | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 6.3.4.5.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription :: This resource represents an individual s... | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== VNF Fault Alarm Notification :: Test ID: 6.3.4.6.1 | PASS | ------------------------------------------------------------------------------ VNF Fault Alarm Cleared Notification :: Test ID: 6.3.4.6.2 | PASS | ------------------------------------------------------------------------------ VNF Fault Alarm List Rebuilt Notification :: Test ID: 6.3.4.6.3 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFFaultManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create a new subscription :: Test ID: 6.3.4.4.1 | PASS | ------------------------------------------------------------------------------ Create a new Subscription - DUPLICATION :: Test ID: 6.3.4.4.2 | PASS | ------------------------------------------------------------------------------ Create a new Subscription - NO-DUPLICATION :: Test ID: 6.3.4.4.3 | PASS | ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 6.3.4.4.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 6.3.4.4.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 6.3.4.4.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 6.3.4.4.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 6.3.4.4.13 | PASS | ------------------------------------------------------------------------------ GET Subscriptions to get Paged Response :: Test ID: 6.3.4.4.14 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 6.3.4... | PASS | ------------------------------------------------------------------------------ GET Subscription with attribute-based filter "id" :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.notificationTypes" :: Test I... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.faultyResourceTypes" :: Test... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.perceivedSeverities" :: Test... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.eventTypes" :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.probableCauses" :: Test ID: ... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 6.3.2.7.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 6.3.2.7.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 6.3.2.7.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 6.3.2.7.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 6.3.2.7.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 6.3.2.7.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Indicator Subscription :: Test ID: 6.3.2.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Indicator Subscription with invalid resource id... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator Subscription :: Test ID: 6.3.2.5.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator Subscription with invalid resource... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Indicator Subscription - Method not implemented... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Indicator Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Indicator Subscription - Method not implemente... | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/IndividualVNFindicator.robot ============================================================================== IndividualVNFindicator ============================================================================== Get Individual Indicator for VNF Instance :: Test ID: 6.3.2.3.1 | PASS | ------------------------------------------------------------------------------ Get Individual Indicator for VNF Instance with invalid indicator i... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Indicator - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Indicator - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Indicator - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ Get Individual Performance Indicator :: Test ID: 6.3.2.3.7 | PASS | ------------------------------------------------------------------------------ Get Individual Performance Indicator with invalid indicator identi... | PASS | ------------------------------------------------------------------------------ POST Individual Performance Indicator - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ PUT Individual Performance Indicator - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PATCH Individual Performance Indicator - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ DELETE Individual Performance Indicator - Method not implemented :... | PASS | ------------------------------------------------------------------------------ IndividualVNFindicator | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== GET VNF Indicators Subscriptions :: Test ID: 6.3.2.4.1 | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions with attribute-based filter :: Te... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions with invalid attribute-based filt... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions with invalid resource endpoint ::... | PASS | ------------------------------------------------------------------------------ Create new VNF indicator subscription :: Test ID: 6.3.2.4.5 | PASS | ------------------------------------------------------------------------------ PUT VNF Indicator Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PATCH VNF Indicator Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ DELETE VNF Indicator Subscriptions - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions to get Paged Response :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET VNF Indicators Subscriptions - Bad Request Response too Big ::... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/VNFIndicators.robot ============================================================================== VNFIndicators :: This Clause defines all the resources and methods provided... ============================================================================== Get all VNF Indicators :: Test ID: 6.3.2.1.1 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators with attribute-based filter :: Test ID: 6.3.2.1.2 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators with invalid attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators with malformed authorization token :: Test ... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators without authorization token :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ GET all VNF Indicators with expired or revoked authorization token... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators with invalid resource endpoint :: Test ID: ... | PASS | ------------------------------------------------------------------------------ POST all VNF Indicators - Method not implemented :: Test ID: 6.3.2... | PASS | ------------------------------------------------------------------------------ PUT all VNF Indicators - Method not implemented :: Test ID: 6.3.2.1.9 | PASS | ------------------------------------------------------------------------------ PATCH all VNF Indicators - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Indicators - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ Get VNF Indicators to get Paged Response :: Test ID: 6.3.2.1.12 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators - Bad Request Response too Big :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ VNFIndicators :: This Clause defines all the resources and methods... | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicator-API/VnfIndicatorsInVnfInstanceId.robot ============================================================================== VnfIndicatorsInVnfInstanceId :: This resource represents VNF indicators rel... ============================================================================== Get Indicators for VNF Instance :: Test ID: 6.3.2.2.1 | PASS | ------------------------------------------------------------------------------ GET Indicators for VNF Instance with attribute-based filter :: Tes... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance with invalid attribute-based filte... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance with invalid resource identifier :... | PASS | ------------------------------------------------------------------------------ POST Indicators for VNF instance - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ PUT Indicators for VNF instance - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PATCH Indicators for VNF instance - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ DELETE Indicators for VNF instance - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance to get Paged Response :: Test ID: ... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance - Bad Request Response too Big :: ... | PASS | ------------------------------------------------------------------------------ VnfIndicatorsInVnfInstanceId :: This resource represents VNF indic... | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFIndicatorNotification-API/VnfIndicatorNotification.robot ============================================================================== VnfIndicatorNotification ============================================================================== VNF Indicator Value Change Notification :: Test ID: 6.3.2.6.1 | PASS | ------------------------------------------------------------------------------ VnfIndicatorNotification | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 6.3.5.20.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 6.3.5.20.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 6.3.5.20.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 6.3.5.20.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 6.3.5.20.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 6.3.5.20.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/CancelOperationTask.robot ============================================================================== CancelOperationTask :: This task resource represents the "Cancel operation"... ============================================================================== Post Cancel operation task :: Test ID: 6.3.5.16.1 | PASS | ------------------------------------------------------------------------------ Post Cancel operation task Conflict :: Test ID: 6.3.5.16.2 | PASS | ------------------------------------------------------------------------------ Post Cancel operation task Not Found :: Test ID: 6.3.5.16.3 | PASS | ------------------------------------------------------------------------------ GET Cancel operation task - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PUT Cancel operation task - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PATCH Cancel operation task - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ DELETE Cancel operation task - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ CancelOperationTask :: This task resource represents the "Cancel o... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/ChangeExternalVNFConnectivityTask.robot ============================================================================== ChangeExternalVNFConnectivityTask ============================================================================== POST Change external VNF connectivity :: Test ID: 6.3.5.10.1 | PASS | ------------------------------------------------------------------------------ GET Change external VNF connectivity - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PUT Change external VNF connectivity - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PATCH Change external VNF connectivity - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ DELETE Change external VNF connectivity - Method not implemented :... | PASS | ------------------------------------------------------------------------------ ChangeExternalVNFConnectivityTask | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/ChangeVNFFlavourTask.robot ============================================================================== ChangeVNFFlavourTask ============================================================================== POST Change deployment flavour of a vnfInstance :: Test ID: 6.3.5.6.1 | PASS | ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Conflict (Not-Inst... | PASS | ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Not Found :: Test ... | PASS | ------------------------------------------------------------------------------ GET Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PUT Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PATCH Change deployment flavour VNFInstance - Method not implement... | PASS | ------------------------------------------------------------------------------ DELETE Change deployment flavour VNFInstance - Method not implemen... | PASS | ------------------------------------------------------------------------------ ChangeVNFFlavourTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/FailOperationTask.robot ============================================================================== FailOperationTask ============================================================================== POST Fail operation task :: Test ID: 6.3.5.15.1 | PASS | ------------------------------------------------------------------------------ POST Fail operation task Conflict (Not-FAILED_TEMP) :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ POST Fail operation task Not Found :: Test ID: 6.3.5.15.3 | PASS | ------------------------------------------------------------------------------ GET Fail operation task - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PUT Fail operation task - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PATCH Fail operation task - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ DELETE Fail operation task - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ FailOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/HealVNFTask.robot ============================================================================== HealVNFTask ============================================================================== POST Heal a vnfInstance :: Test ID: 6.3.5.8.1 | PASS | ------------------------------------------------------------------------------ POST Heal a vnfInstance Conflict (Not-Instantiated) :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ POST Heal a vnfInstance Not Found :: Test ID: 6.3.5.8.3 | PASS | ------------------------------------------------------------------------------ GET Heal VNFInstance - Method not implemented :: Test ID: 6.3.5.8.4 | PASS | ------------------------------------------------------------------------------ PUT Heal VNFInstance - Method not implemented :: Test ID: 6.3.5.8.5 | PASS | ------------------------------------------------------------------------------ PATCH Heal VNFInstance - Method not implemented :: Test ID: 6.3.5.8.6 | PASS | ------------------------------------------------------------------------------ DELETE Heal VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ HealVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== POST Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET Individual Subscription :: Test ID: 6.3.5.18.2 | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 6.3.5.18.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/IndividualVNFInstance.robot ============================================================================== IndividualVNFInstance ============================================================================== POST Individual VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ GET Information about an individual VNF Instance :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PUT Individual VNFInstance - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance :: Test ID: 6.3.5.2.4 | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance Precondition failed :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance Conflict :: Test ID: 6.3.5.2.6 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNFInstance :: Test ID: 6.3.5.2.7 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNFInstance Conflict :: Test ID: 6.3.5.2.8 | PASS | ------------------------------------------------------------------------------ IndividualVNFInstance | PASS | 8 critical tests, 8 passed, 0 failed 8 tests total, 8 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/IndividualVnfLcmOperationOccurence.robot ============================================================================== IndividualVnfLcmOperationOccurence ============================================================================== Post Individual VNF LCM OP occurrences - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ Get status information about multiple VNF instances :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ PUT status information about multiple VNF instances - Method not i... | PASS | ------------------------------------------------------------------------------ PATCH status information about multiple VNF instances - Method not... | PASS | ------------------------------------------------------------------------------ DELETE status information about multiple VNF instances - Method no... | PASS | ------------------------------------------------------------------------------ IndividualVnfLcmOperationOccurence | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/InstantiateVNFTask.robot ============================================================================== InstantiateVNFTask ============================================================================== POST Instantiate a vnfInstance :: Test ID: 6.3.5.3.1 | PASS | ------------------------------------------------------------------------------ POST Instantiate a vnfInstance Conflict :: Test ID: 6.3.5.3.2 | PASS | ------------------------------------------------------------------------------ GET Instantiate VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ PUT Instantiate VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ PATCH Instantiate VNFInstance - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Instantiate VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ InstantiateVNFTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== VNF LCM Operation Occurrence Start Notification :: Test ID: 6.3.5.... | PASS | ------------------------------------------------------------------------------ VNF LCM Operation Occurrence Result Notification :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ VNF Identifier Creation Notification :: Test ID: 6.3.5.19.3 | PASS | ------------------------------------------------------------------------------ VNF Identifier Deletion Notification :: Test ID: 6.3.5.19.4 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/OperateVNFTask.robot ============================================================================== OperateVNFTask ============================================================================== POST Operate a vnfInstance :: Test ID: 6.3.5.9.1 | PASS | ------------------------------------------------------------------------------ POST Operate a vnfInstance Conflict (Not-Instantiated) :: Test ID:... | PASS | ------------------------------------------------------------------------------ POST Operate a vnfInstance Not Found :: Test ID: 6.3.5.9.3 | PASS | ------------------------------------------------------------------------------ GET Operate VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PUT Operate VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ PATCH Operate VNFInstance - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ DELETE Operate VNFInstance - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ OperateVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/RetryOperationTask.robot ============================================================================== RetryOperationTask :: This task resource represents the "Retry operation" o... ============================================================================== POST Retry operation task :: Test ID: 6.3.5.13.1 | PASS | ------------------------------------------------------------------------------ POST Retry operation task Conflict (Not-FAILED_TEMP) :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ POST Retry operation task Not Found :: Test ID: 6.3.5.13.3 | PASS | ------------------------------------------------------------------------------ GET Retry operation task - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ PUT Retry operation task - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ PATCH Retry operation task - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ DELETE Retry operation task - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ RetryOperationTask :: This task resource represents the "Retry ope... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/RollbackOperationTask.robot ============================================================================== RollbackOperationTask :: This task resource represents the "Rollback operat... ============================================================================== POST Rollback operation task :: Test ID: 6.3.5.14.1 | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Conflict (Not-FAILED_TEMP) :: Test ID... | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Not Found :: Test ID: 6.3.5.14.3 | PASS | ------------------------------------------------------------------------------ GET Rollback operation task - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ PUT Rollback operation task - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ PATCH Rollback operation task - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Rollback operation task - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ RollbackOperationTask :: This task resource represents the "Rollba... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/ScaleVNFTask.robot ============================================================================== ScaleVNFTask ============================================================================== POST Scale a vnfInstance :: Test ID: 6.3.5.4.1 | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance Conflict (Not-Instantiated) :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance Not Found :: Test ID: 6.3.5.4.3 | PASS | ------------------------------------------------------------------------------ GET Scale VNFInstance - Method not implemented :: Test ID: 6.3.5.4.4 | PASS | ------------------------------------------------------------------------------ PUT Scale VNFInstance - Method not implemented :: Test ID: 6.3.5.4.5 | PASS | ------------------------------------------------------------------------------ PATCH Scale VNFInstance - Method not implemented :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ DELETE Scale VNFInstance - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ ScaleVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/ScaleVNFToLevelTask.robot ============================================================================== ScaleVNFToLevelTask ============================================================================== POST Scale a vnfInstance to level :: Test ID: 6.3.5.5.1 | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance to level Conflict (Not-Instantiated) :: T... | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance Not Found :: Test ID: 6.3.5.5.3 | PASS | ------------------------------------------------------------------------------ GET Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PUT Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH Scale to level VNFInstance - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Scale to level VNFInstance - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ ScaleVNFToLevelTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== POST Create a new subscription :: Test ID: 6.3.5.17.1 | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - DUPLICATION :: Test ID: 6.3.5.17.2 | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - NO-DUPLICATION :: Test ID: 6.3.5.... | PASS | ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 6.3.5.17.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 6.3.5.17.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with all_fields attribute selector :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_default attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with fields attribute selector :: Test ID: 6.3.5... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_fields attribute selector :: Test I... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 6.3.5.17.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 6.3.5.17.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 6.3.5.17.13 | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/TerminateVNFTask.robot ============================================================================== TerminateVNFTask ============================================================================== POST Terminate a vnfInstance :: Test ID: 6.3.5.7.1 | PASS | ------------------------------------------------------------------------------ POST Terminate a vnfInstance Conflict (Not-Instantiated) :: Test I... | PASS | ------------------------------------------------------------------------------ GET Terminate VNFInstance - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PUT Terminate VNFInstance - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PATCH Terminate VNFInstance - Method not implemented :: Test ID: 6... | PASS | ------------------------------------------------------------------------------ DELETE Terminate VNFInstance - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ TerminateVNFTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/VNFInstances.robot ============================================================================== VNFInstances ============================================================================== POST Create a new vnfInstance :: Test ID: 6.3.5.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances :: Test ID: 6.3.5.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "all_fields" att... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_default... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "fields" attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_fields"... | PASS | ------------------------------------------------------------------------------ PUT VNFInstances - Method not implemented :: Test ID: 6.3.5.1.9 | PASS | ------------------------------------------------------------------------------ PATCH VNFInstances - Method not implemented :: Test ID: 6.3.5.1.10 | PASS | ------------------------------------------------------------------------------ DELETE VNFInstances - Method not implemented :: Test ID: 6.3.5.1.11 | PASS | ------------------------------------------------------------------------------ VNFInstances | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFLifecycleManagement-API/VnfLcmOperationOccurences.robot ============================================================================== VnfLcmOperationOccurences :: This resource represents VNF lifecycle managem... ============================================================================== POST VNF LCM operation occurrences - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM operation occurrence... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM operation occurrence... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation occurrence... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ PUT status information about multiple VNF LCM operation occurrence... | PASS | ------------------------------------------------------------------------------ PATCH status information about multiple VNF LCM operation occurren... | PASS | ------------------------------------------------------------------------------ DELETE status information about multiple VNF LCM operation occurre... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM operation occurances... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation occurrence... | PASS | ------------------------------------------------------------------------------ VnfLcmOperationOccurences :: This resource represents VNF lifecycl... | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 6.3.2.7.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 6.3.2.7.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 6.3.2.7.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 6.3.2.7.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 6.3.2.7.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 6.3.2.7.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/IndividualPmJob.robot ============================================================================== IndividualPmJob ============================================================================== GET individual VNF Performance Job :: Test ID: 6.3.3.2.1 | PASS | ------------------------------------------------------------------------------ GET individual VNF Performance Job with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Job :: Test ID: 6.3.3.2.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Job with invalid resource identi... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Performance Job - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Performance Job - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Performance Job - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ IndividualPmJob | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/IndividualReport.robot ============================================================================== IndividualReport ============================================================================== Get Individual Performance Report :: Test ID: 6.3.3.3.1 | PASS | ------------------------------------------------------------------------------ Get Individual Performance Report with invalid resource endpoint :... | PASS | ------------------------------------------------------------------------------ POST Individual Performance Report - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PUT Individual Performance Report - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH Individual Performance Report - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE Individual Performance Report - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ IndividualReport | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Performance Subscription :: Test ID: 6.3.3.7.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Performance Subscription with invalid resource ... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Subscription :: Test ID: 6.3.3.7.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Subscription with invalid resour... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Performance Subscription - Method not implemen... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Performance Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Performance Subscription - Method not impleme... | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/IndividualThreshold.robot ============================================================================== IndividualThreshold ============================================================================== GET Individual Threshold :: Test ID: 6.3.3.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual Threshold with invalid resource identifier :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold :: Test ID: 6.3.3.5.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold with invalid resource identifier :: Te... | PASS | ------------------------------------------------------------------------------ POST Individual Threshold - Method not implemented :: Test ID: 6.3... | PASS | ------------------------------------------------------------------------------ PUT Individual Threshold - Method not implemented :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ PATCH Individual Threshold - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ IndividualThreshold | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/PMJobs.robot ============================================================================== PMJobs ============================================================================== GET all VNF Performance Monitoring Jobs :: Test ID: 6.3.3.1.1 | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with attribute-based filter ::... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with all_fields attribute ... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_default attri... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with fields attribute sele... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_fields attrib... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid attribute-based f... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid resource endpoint... | PASS | ------------------------------------------------------------------------------ Create new VNF Performance Monitoring Job :: Test ID: 6.3.3.1.9 | PASS | ------------------------------------------------------------------------------ PUT all VNF Performance Monitoring Jobs - Method not implemented :... | PASS | ------------------------------------------------------------------------------ PATCH all VNF Performance Monitoring Jobs - (Method not implemente... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Performance Monitoring Jobs - Method not implemente... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs to get Paged Response :: Test ... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs for Bad Request Response too b... | PASS | ------------------------------------------------------------------------------ PMJobs | PASS | 14 critical tests, 14 passed, 0 failed 14 tests total, 14 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== GET all VNF Performance Subscriptions :: Test ID: 6.3.3.6.1 | PASS | ------------------------------------------------------------------------------ GET VNF Performance Subscriptions with attribute-based filter :: T... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Management Subscriptions with invalid attribut... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Subscriptions with invalid resource endpoint :... | PASS | ------------------------------------------------------------------------------ Create new VNF Performance subscription :: Test ID: 6.3.3.6.5 | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Performance subscription with VNFM not creat... | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Performance subscription with VNFM creating ... | PASS | ------------------------------------------------------------------------------ PUT VNF Performance Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH VNF Performance Subscriptions - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE VNF Performance Subscriptions - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Subscriptions to get Paged Response :: Test ID... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Management Subscriptions for Bad Request Respo... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagement-API/Thresholds.robot ============================================================================== Thresholds ============================================================================== GET All Performance Thresholds :: Test ID: 6.3.3.4.1 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS | ------------------------------------------------------------------------------ Create new Performance Threshold :: Test ID: 6.3.3.4.5 | PASS | ------------------------------------------------------------------------------ PUT Performance Thresholds - Method not implemented :: Test ID: 6.... | PASS | ------------------------------------------------------------------------------ PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with Paged Response :: Test ID: 6.3.3.4.9 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds for Bad Request Response too big :: Tes... | PASS | ------------------------------------------------------------------------------ Thresholds | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL002/VNFPerformanceManagementNotification-API/PerformanceManagementNotification.robot ============================================================================== PerformanceManagementNotification ============================================================================== VNF Performance Information Availability Notification :: Test ID: ... | PASS | ------------------------------------------------------------------------------ VNF Threshold Crossed Notification :: Test ID: 6.3.3.8.2 | PASS | ------------------------------------------------------------------------------ PerformanceManagementNotification | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagement-API/Alarms.robot ============================================================================== Alarms ============================================================================== POST Alarms - Method not implemented :: Test ID: 7.3.5.1.1 | PASS | ------------------------------------------------------------------------------ Get information about multiple alarms :: Test ID: 7.3.5.1.2 | PASS | ------------------------------------------------------------------------------ Get information about multiple alarms with filter :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ Get information about multiple alarms Bad Request Invalid attribut... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "all_fields" attribute ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with exclude_default attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with fields attribute select... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "exclude_fields" attrib... | PASS | ------------------------------------------------------------------------------ PUT Alarms - Method not implemented :: Test ID: 7.3.5.1.9 | PASS | ------------------------------------------------------------------------------ PATCH Alarms - Method not implemented :: Test ID: 7.3.5.1.10 | PASS | ------------------------------------------------------------------------------ DELETE Alarms - Method not implemented :: Test ID: 7.3.5.1.11 | PASS | ------------------------------------------------------------------------------ Get information about multiple alarms as a Paged Response :: Test ... | PASS | ------------------------------------------------------------------------------ Get information about multiple alarms - Bad Request Response too B... | PASS | ------------------------------------------------------------------------------ Alarms | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.5.6.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.5.6.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.5.6.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.5.6.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.5.6.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.5.6.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagement-API/IndividualAlarm.robot ============================================================================== IndividualAlarm ============================================================================== POST Alarm - Method not implemented :: Test ID: 7.3.5.2.1 | PASS | ------------------------------------------------------------------------------ Get information about an fault management individual alarm :: Test... | PASS | ------------------------------------------------------------------------------ PUT Alarm - Method not implemented :: Test ID: 7.3.5.2.3 | PASS | ------------------------------------------------------------------------------ PATCH Fault Management Individual Alarm :: Test ID: 7.3.5.2.4 | PASS | ------------------------------------------------------------------------------ Modify an individual alarm resource - Precondition failed :: Test ... | PASS | ------------------------------------------------------------------------------ Modify an individual alarm resource - Conflict :: Test ID: 7.3.5.2.6 | PASS | ------------------------------------------------------------------------------ DELETE Alarm - Method not implemented :: Test ID: 7.3.5.2.7 | PASS | ------------------------------------------------------------------------------ IndividualAlarm | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== Post Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ Get Information about an individual subscription :: Test ID: 7.3.5... | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 7.3.5.4.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create a new Fault Management alarm subscription :: Test ID: 7.3.5... | PASS | ------------------------------------------------------------------------------ Create a new alarm subscription - DUPLICATION :: Test ID: 7.3.5.3.2 | PASS | ------------------------------------------------------------------------------ Create a new alarm subscription - NO DUPLICATION :: Test ID: 7.3.5... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions :: Test ID: 7.3.5.3.4 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 7.3.5.3.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 7.3.5.3.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 7.3.5.3.13 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions as Paged Response :: Test I... | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 7.3.5... | PASS | ------------------------------------------------------------------------------ GET Subscription with attribute-based filter "id" :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.notificationTypes" :: Test I... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.faultyResourceTypes" :: Test... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.perceivedSeverities" :: Test... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.eventTypes" :: Test ID: 6.3.... | PASS | ------------------------------------------------------------------------------ Get subscriptions with filter "filter.probableCauses" :: Test ID: ... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFFaultManagementNotification-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== VNF Fault Alarm Notification :: Test ID: 7.3.5.5.1 | PASS | ------------------------------------------------------------------------------ VNF Fault Alarm Cleared Notification :: Test ID: 7.3.5.5.2 | PASS | ------------------------------------------------------------------------------ VNF Fault Alarm List Rebuilt Notification :: Test ID: 7.3.5.5.3 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.6.7.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.6.7.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.6.7.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.6.7.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.6.7.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.6.7.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Indicator Subscription :: Test ID: 7.3.6.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Indicator Subscription with invalid resource id... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator Subscription :: Test ID: 7.3.6.5.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator Subscription with invalid resource... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Indicator Subscription - Method not implemented... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Indicator Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Indicator Subscription - Method not implemente... | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/IndividualVNFindicator.robot ============================================================================== IndividualVNFindicator ============================================================================== Get Individual Indicator for VNF Instance :: Test ID: 7.3.6.3.1 | PASS | ------------------------------------------------------------------------------ Get Individual Indicator for VNF Instance with invalid indicator i... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Indicator for VNF Instance - Method not implem... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Indicator for VNF Instance - Method not impleme... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Indicator for VNF Instance - Method not imple... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Indicator for VNF Instance - Method not impl... | PASS | ------------------------------------------------------------------------------ IndividualVNFindicator | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== GET All VNF Indicator Subscriptions :: Test ID: 7.3.6.4.1 | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions with attribute-based filter :: Tes... | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions with invalid attribute-based filte... | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions with invalid resource endpoint :: ... | PASS | ------------------------------------------------------------------------------ Create new VNF indicator subscription :: Test ID: 7.3.6.4.5 | PASS | ------------------------------------------------------------------------------ Create duplicated VNF indicator subscription with VNFM not creatin... | PASS | ------------------------------------------------------------------------------ Create duplicated VNF indicator subscription with VNFM creating du... | PASS | ------------------------------------------------------------------------------ PUT VNF Indicator Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PATCH VNF Indicator Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ DELETE VNF Indicator Subscriptions - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ GET All VNF Indicator Subscriptions as Paged Response :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET VNF Indicator Subscriptions - Bad Request Response too Big :: ... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/VNFIndicators.robot ============================================================================== VNFIndicators ============================================================================== Get all VNF Indicators :: Test ID: 7.3.6.1.1 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators with attribute-based filter :: Test ID: 7.3.6.1.2 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators with invalid attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators with malformed authorization token :: Test ... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators without authorization token :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ GET all VNF Indicators with expired or revoked authorization token... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators with invalid resource endpoint :: Test ID: ... | PASS | ------------------------------------------------------------------------------ POST all VNF Indicators - Method not implemented :: Test ID: 7.3.6... | PASS | ------------------------------------------------------------------------------ PUT all VNF Indicators - Method not implemented :: Test ID: 7.3.6.1.9 | PASS | ------------------------------------------------------------------------------ PATCH all VNF Indicators - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Indicators - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ Get all VNF Indicators as Paged Response :: Test ID: 7.3.6.1.12 | PASS | ------------------------------------------------------------------------------ Get VNF Indicators - Bad Request Response too Big :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ VNFIndicators | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/VnfIndicatorNotification.robot ============================================================================== VnfIndicatorNotification ============================================================================== VNF Indicator Value Change Notification :: Test ID: 7.3.6.6.1 | PASS | ------------------------------------------------------------------------------ VnfIndicatorNotification | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFIndicator-API/VnfIndicatorsInVnfInstanceId.robot ============================================================================== VnfIndicatorsInVnfInstanceId ============================================================================== Get Indicators for VNF Instance :: Test ID: 7.3.6.2.1 | PASS | ------------------------------------------------------------------------------ GET Indicators for VNF Instance with attribute-based filter :: Tes... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance with invalid attribute-based filte... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance with invalid resource identifier :... | PASS | ------------------------------------------------------------------------------ POST Indicators for VNF instance - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ PUT Indicators for VNF instance - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PATCH Indicators for VNF instance - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ DELETE Indicators for VNF instance - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance as Paged Response :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ Get Indicators for VNF Instance - Bad Request Response too Big :: ... | PASS | ------------------------------------------------------------------------------ VnfIndicatorsInVnfInstanceId | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.1.35.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.1.35.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.1.35.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.1.35.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.1.35.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.1.35.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/CancelOperationTask.robot ============================================================================== CancelOperationTask ============================================================================== POST Cancel operation task :: Test ID: 7.3.1.16.1 | PASS | ------------------------------------------------------------------------------ POST Cancel operation task Conflict :: Test ID: 7.3.1.16.2 | PASS | ------------------------------------------------------------------------------ POST Cancel operation task Not Found :: Test ID: 7.3.1.16.3 | PASS | ------------------------------------------------------------------------------ GET Cancel operation task - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PUT Cancel operation task - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PATCH Cancel operation task - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ DELETE Cancel operation task - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ CancelOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/CancelOperationWorkflow.robot ============================================================================== CancelOperationWorkflow ============================================================================== Cancel a VNF LCM Operation - STARTING :: Test ID: 7.3.1.19.1 | PASS | ------------------------------------------------------------------------------ Cancel a VNF LCM Operation - PROCESSING - ROLLING_BACK :: Test ID:... | PASS | ------------------------------------------------------------------------------ CancelOperationWorkflow | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ChangeExternalVNFConnectivityTask.robot ============================================================================== ChangeExternalVNFConnectivityTask ============================================================================== POST Change external VNF connectivity :: Test ID: 7.3.1.10.1 | PASS | ------------------------------------------------------------------------------ GET Change external VNF connectivity - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PUT Change external VNF connectivity - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PATCH Change external VNF connectivity - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ DELETE Change external VNF connectivity - Method not implemented :... | PASS | ------------------------------------------------------------------------------ ChangeExternalVNFConnectivityTask | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ChangeExternalVNFConnectivityWorkflow.robot ============================================================================== ChangeExternalVNFConnectivityWorkflow ============================================================================== Change external connectivity of VNF Workflow :: Test ID: 7.3.1.20.1 | PASS | ------------------------------------------------------------------------------ ChangeExternalVNFConnectivityWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ChangeVNFFlavourTask.robot ============================================================================== ChangeVNFFlavourTask ============================================================================== POST Change deployment flavour of a vnfInstance :: Test ID: 7.3.1.6.1 | PASS | ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Conflict (Not-Inst... | PASS | ------------------------------------------------------------------------------ POST Change deployment flavour of a vnfInstance Not Found :: Test ... | PASS | ------------------------------------------------------------------------------ GET Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PUT Change deployment flavour VNFInstance - Method not implemented... | PASS | ------------------------------------------------------------------------------ PATCH Change deployment flavour VNFInstance - Method not implement... | PASS | ------------------------------------------------------------------------------ DELETE Change deployment flavour VNFInstance - Method not implemen... | PASS | ------------------------------------------------------------------------------ ChangeVNFFlavourTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ChangeVNFFlavourWorkflow.robot ============================================================================== ChangeVNFFlavourWorkflow ============================================================================== Change VNF Flavour Workflow :: Test ID: 7.3.1.21.1 | PASS | ------------------------------------------------------------------------------ ChangeVNFFlavourWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/CreateVNFWorkflow.robot ============================================================================== CreateVNFWorkflow ============================================================================== Create VNF Instance Resource :: Test ID: 7.3.1.22.1 | PASS | ------------------------------------------------------------------------------ CreateVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/DeleteVNFWorkflow.robot ============================================================================== DeleteVNFWorkflow ============================================================================== Delete VNF Instance Resource :: Test ID: 7.3.1.23.1 | PASS | ------------------------------------------------------------------------------ DeleteVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/FailOperationTask.robot ============================================================================== FailOperationTask ============================================================================== POST Fail operation task :: Test ID: 7.3.1.15.1 | PASS | ------------------------------------------------------------------------------ Post Fail operation task Conflict (Not-FAILED_TEMP) :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ Post Fail operation task Not Found :: Test ID: 7.3.1.15.3 | PASS | ------------------------------------------------------------------------------ GET Fail operation task - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PUT Fail operation task - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PATCH Fail operation task - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ DELETE Fail operation task - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ FailOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/FailOperationWorkflow.robot ============================================================================== FailOperationWorkflow ============================================================================== Fail a VNF LCM Operation Workflow :: Test ID: 7.3.1.24.1 | PASS | ------------------------------------------------------------------------------ FailOperationWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/HealVNFTask.robot ============================================================================== HealVNFTask ============================================================================== POST Heal a vnfInstance :: Test ID: 7.3.1.8.1 | PASS | ------------------------------------------------------------------------------ POST Heal a vnfInstance Conflict (Not-Instantiated) :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ POST Heal a vnfInstance Not Found :: Test ID: 7.3.1.8.3 | PASS | ------------------------------------------------------------------------------ GET Heal VNFInstance - Method not implemented :: Test ID: 7.3.1.8.4 | PASS | ------------------------------------------------------------------------------ PUT Heal VNFInstance - Method not implemented :: Test ID: 7.3.1.8.5 | PASS | ------------------------------------------------------------------------------ PATCH Heal VNFInstance - Method not implemented :: Test ID: 7.3.1.8.6 | PASS | ------------------------------------------------------------------------------ DELETE Heal VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ HealVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/HealVNFWorkflow.robot ============================================================================== HealVNFWorkflow ============================================================================== Heal a VNF Instance :: Test ID: 7.3.1.25.1 | PASS | ------------------------------------------------------------------------------ HealVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== POST Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET Individual Subscription :: Test ID: 7.3.1.18.2 | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 7.3.1.18.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/IndividualVNFInstance.robot ============================================================================== IndividualVNFInstance ============================================================================== Post Individual VNFInstance - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ Get Information about an individual VNF Instance :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PUT Individual VNFInstance - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance :: Test ID: 7.3.1.2.4 | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance Precondition failed :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNFInstance Conflict :: Test ID: 7.3.1.2.6 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNFInstance :: Test ID: 7.3.1.2.7 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNFInstance Conflict :: Test ID: 7.3.1.2.8 | PASS | ------------------------------------------------------------------------------ IndividualVNFInstance | PASS | 8 critical tests, 8 passed, 0 failed 8 tests total, 8 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/IndividualVnfLcmOperationOccurence.robot ============================================================================== IndividualVnfLcmOperationOccurence ============================================================================== Post Individual VNF LCM Operation occurrences - Method not impleme... | PASS | ------------------------------------------------------------------------------ Get information about multiple VNF instances :: Test ID: 7.3.1.12.2 | PASS | ------------------------------------------------------------------------------ PUT Individual VNF LCM Operation occurrences - Method not implemen... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF LCM Operation occurrences - Method not implem... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF LCM Operation occurrences - Method not imple... | PASS | ------------------------------------------------------------------------------ IndividualVnfLcmOperationOccurence | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/InstantiateVNFTask.robot ============================================================================== InstantiateVNFTask ============================================================================== Instantiate a vnfInstance :: Test ID: 7.3.1.3.1 | PASS | ------------------------------------------------------------------------------ Instantiate a vnfInstance Conflict :: Test ID: 7.3.1.3.2 | PASS | ------------------------------------------------------------------------------ GET Instantiate VNFInstance - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ PUT Instantiate VNFInstance - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ PATCH Instantiate VNFInstance - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Instantiate VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ InstantiateVNFTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/InstantiateVNFTaskWorkflow.robot ============================================================================== InstantiateVNFTaskWorkflow ============================================================================== VNF Instantiation :: Test ID: 7.3.1.26.1 | PASS | ------------------------------------------------------------------------------ InstantiateVNFTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ModifyVNFInformationWorkflow.robot ============================================================================== ModifyVNFInformationWorkflow ============================================================================== Modify info of a VNF Instance :: Test ID: 7.3.1.27.1 | PASS | ------------------------------------------------------------------------------ ModifyVNFInformationWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== VNF LCM Operation Occurrence Start Notification :: Test ID: 7.3.1.... | PASS | ------------------------------------------------------------------------------ VNF LCM Operation Occurrence Result Notification :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ VNF Identifier Creation Notification :: Test ID: 7.3.1.34.3 | PASS | ------------------------------------------------------------------------------ VNF Identifier Deletion Notification :: Test ID: 7.3.1.34.4 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/OperateVNFTask.robot ============================================================================== OperateVNFTask ============================================================================== POST Operate a vnfInstance :: Test ID: 7.3.1.9.1 | PASS | ------------------------------------------------------------------------------ POST Operate a vnfInstance Conflict (Not-Instantiated) :: Test ID:... | PASS | ------------------------------------------------------------------------------ POST Operate a vnfInstance Not Found :: Test ID: 7.3.1.9.3 | PASS | ------------------------------------------------------------------------------ GET Operate VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PUT Operate VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ PATCH Operate VNFInstance - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ DELETE Operate VNFInstance - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ OperateVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/OperateVNFWorkflow.robot ============================================================================== OperateVNFWorkflow ============================================================================== Operate a VNF Instance :: Test ID: 7.3.1.28.1 | PASS | ------------------------------------------------------------------------------ OperateVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/RetryOperationTask.robot ============================================================================== RetryOperationTask :: This task resource represents the "Retry operation" o... ============================================================================== Post Retry operation task :: Test ID: 7.3.1.13.1 | PASS | ------------------------------------------------------------------------------ Post Retry operation task Conflict (Not-FAILED_TEMP) :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ Post Retry operation task Not Found :: Test ID: 7.3.1.13.3 | PASS | ------------------------------------------------------------------------------ GET Retry operation task - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ PUT Retry operation task - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ PATCH Retry operation task - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ DELETE Retry operation task - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ RetryOperationTask :: This task resource represents the "Retry ope... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/RetryOperationWorkflow.robot ============================================================================== RetryOperationWorkflow ============================================================================== Retry VNF LCM Operation - Successful :: Test ID: 7.3.1.29.1 | PASS | ------------------------------------------------------------------------------ Retry VNF LCM Operation - Unsuccessful :: Test ID: 7.3.1.29.2 | PASS | ------------------------------------------------------------------------------ RetryOperationWorkflow | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/RollBackOperationWorkflow.robot ============================================================================== RollBackOperationWorkflow ============================================================================== Rollback a VNF LCM Operation - Successful :: Test ID: 7.3.1.30.1 | PASS | ------------------------------------------------------------------------------ Rollback VNF LCM Operation - Unsuccessful :: Test ID: 7.3.1.30.2 | PASS | ------------------------------------------------------------------------------ RollBackOperationWorkflow | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/RollbackOperationTask.robot ============================================================================== RollbackOperationTask :: This task resource represents the "Rollback operat... ============================================================================== Post Rollback operation task :: Test ID: 7.3.1.14.1 | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Conflict (Not-FAILED_TEMP) :: Test ID... | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Not Found :: Test ID: 7.3.1.14.3 | PASS | ------------------------------------------------------------------------------ GET Rollback operation task - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ PUT Rollback operation task - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ PATCH Rollback operation task - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Rollback operation task - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ RollbackOperationTask :: This task resource represents the "Rollba... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ScaleVNFTask.robot ============================================================================== ScaleVNFTask ============================================================================== POST Scale a vnfInstance :: Test ID: 7.3.1.4.1 | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance Conflict (Not-Instantiated) :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance Not Found :: Test ID: 7.3.1.4.3 | PASS | ------------------------------------------------------------------------------ GET Scale VNFInstance - Method not implemented :: Test ID: 7.3.1.4.4 | PASS | ------------------------------------------------------------------------------ PUT Scale VNFInstance - Method not implemented :: Test ID: 7.3.1.4.5 | PASS | ------------------------------------------------------------------------------ PATCH Scale VNFInstance - Method not implemented :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ DELETE Scale VNFInstance - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ ScaleVNFTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ScaleVNFToLevelTask.robot ============================================================================== ScaleVNFToLevelTask ============================================================================== POST Scale a vnfInstance to level :: Test ID: 7.3.1.5.1 | PASS | ------------------------------------------------------------------------------ POST Scale a vnfInstance to level Conflict (Not-Instantiated) :: T... | PASS | ------------------------------------------------------------------------------ Scale a vnfInstance Not Found :: Test ID: 7.3.1.5.3 | PASS | ------------------------------------------------------------------------------ GET Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PUT Scale to level VNFInstance - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH Scale to level VNFInstance - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Scale to level VNFInstance - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ ScaleVNFToLevelTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ScaleVNFToLevelWorkflow.robot ============================================================================== ScaleVNFToLevelWorkflow ============================================================================== VNF Instance Scale To Level :: Test ID: 7.3.1.31.1 | PASS | ------------------------------------------------------------------------------ ScaleVNFToLevelWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/ScaleVNFWorkflow.robot ============================================================================== ScaleVNFWorkflow ============================================================================== VNF Instance Scale Out :: Test ID: 7.3.1.32.1 | PASS | ------------------------------------------------------------------------------ ScaleVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== POST Create a new subscription :: Test ID: 7.3.1.17.1 | PASS | ------------------------------------------------------------------------------ Create a new Subscription - DUPLICATION :: Test ID: 7.3.1.17.2 | PASS | ------------------------------------------------------------------------------ Create a new Subscription - NO-DUPLICATION :: Test ID: 7.3.1.17.3 | PASS | ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 7.3.1.17.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 7.3.1.17.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with all_fields attribute selector :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_default attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with fields attribute selector :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ GET subscriptions with exclude_fields attribute selector :: Test I... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 7.3.1.17.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 7.3.1.17.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 7.3.1.17.13 | PASS | ------------------------------------------------------------------------------ GET Subscriptions as a Paged Response :: Test ID: 7.3.1.17.14 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 7.3.1... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 15 critical tests, 15 passed, 0 failed 15 tests total, 15 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/TerminateVNFTask.robot ============================================================================== TerminateVNFTask ============================================================================== POST Terminate a vnfInstance :: Test ID: 7.3.1.7.1 | PASS | ------------------------------------------------------------------------------ POST Terminate a vnfInstance Conflict (Not-Instantiated) :: Test I... | PASS | ------------------------------------------------------------------------------ GET Terminate VNFInstance - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PUT Terminate VNFInstance - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PATCH Terminate VNFInstance - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ DELETE Terminate VNFInstance - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ TerminateVNFTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/TerminateVNFWorkflow.robot ============================================================================== TerminateVNFWorkflow ============================================================================== Terminate a VNF Instance :: Test ID: 7.3.1.33.1 | PASS | ------------------------------------------------------------------------------ TerminateVNFWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/VNFInstances.robot ============================================================================== VNFInstances ============================================================================== POST Create a new vnfInstance :: Test ID: 7.3.1.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances :: Test ID: 7.3.1.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances Bad Request Invalid a... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "all_fields" att... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_default... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "fields" attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances with "exclude_fields"... | PASS | ------------------------------------------------------------------------------ PUT multiples VNFInstances - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ PATCH multiples VNFInstances - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE VNFInstances - Method not implemented :: Test ID: 7.3.1.1.11 | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances to get Paged Response... | PASS | ------------------------------------------------------------------------------ GET information about multiple VNF instances - Bad Request Respons... | PASS | ------------------------------------------------------------------------------ VNFInstances | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleManagement-API/VnfLcmOperationOccurences.robot ============================================================================== VnfLcmOperationOccurences ============================================================================== POST VNF LCM Operation occurrences - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC :: Tes... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC Bad Re... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC Bad Re... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC with "... | PASS | ------------------------------------------------------------------------------ PUT status information about multiple VNF LCM Operation OCC - Meth... | PASS | ------------------------------------------------------------------------------ PATCH status information about multiple VNF LCM Operation OCC - Me... | PASS | ------------------------------------------------------------------------------ DELETE status information about multiple VNF LCM Operation OCC - M... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC to get... | PASS | ------------------------------------------------------------------------------ GET status information about multiple VNF LCM Operation OCC - Bad ... | PASS | ------------------------------------------------------------------------------ VnfLcmOperationOccurences | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleOperationGranting-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.2.3.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.2.3.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.2.3.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.2.3.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.2.3.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.2.3.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleOperationGranting-API/Grants.robot ============================================================================== Grants :: This resource represents grants. The client can use this resource... ============================================================================== Requests a grant for a particular VNF lifecycle operation - Synchr... | PASS | ------------------------------------------------------------------------------ Requests a grant for a particular VNF lifecycle operation - Asynch... | PASS | ------------------------------------------------------------------------------ Requests a grant for a particular VNF lifecycle operation - Forbid... | PASS | ------------------------------------------------------------------------------ GET Grants - Method not implemented :: Test ID: 7.3.2.1.4 | PASS | ------------------------------------------------------------------------------ PUT Grants - Method not implemented :: Test ID: 7.3.2.1.5 | PASS | ------------------------------------------------------------------------------ PATCH Grants - Method not implemented :: Test ID: 7.3.2.1.6 | PASS | ------------------------------------------------------------------------------ DELETE Grants - Method not implemented :: Test ID: 7.3.2.1.7 | PASS | ------------------------------------------------------------------------------ Grants :: This resource represents grants. The client can use this... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFLifecycleOperationGranting-API/IndividualGrant.robot ============================================================================== IndividualGrant :: This resource represents an individual grant. The client... ============================================================================== POST Individual Grant - Method not implemented :: Test ID: 7.3.2.2.1 | PASS | ------------------------------------------------------------------------------ GET an individual grant - Successful :: Test ID: 7.3.2.2.2 | PASS | ------------------------------------------------------------------------------ GET an individual grant - Process ongoing :: Test ID: 7.3.2.2.3 | PASS | ------------------------------------------------------------------------------ GET an individual grant - grant rejected :: Test ID: 7.3.2.2.4 | PASS | ------------------------------------------------------------------------------ PUT an individual grant - Method not implemented :: Test ID: 7.3.2... | PASS | ------------------------------------------------------------------------------ PATCH an individual grant - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ DELETE an individual grant - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ IndividualGrant :: This resource represents an individual grant. T... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.3.9.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.3.9.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.3.9.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.3.9.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.3.9.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.3.9.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Package Subscription :: Test ID: 7.3.3.7.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Subscription with invalid resource iden... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Subscription with invalid resource i... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Subscription - Method not implemented ... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Subscription - Method not implemented :... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Subscription - Method not implemented... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Subscription :: Test ID: 7.3.3.7.7 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/IndividualVNFPackage.robot ============================================================================== IndividualVNFPackage ============================================================================== GET Individual VNF Package :: Test ID: 7.3.3.2.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package with invalid resource identifier :: Tes... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package - Method not implemented :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package :: Test ID: 7.3.3.2.7 | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package with invalid resource identif... | PASS | ------------------------------------------------------------------------------ POST Individual OnBoarded VNF Package - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ PUT Individual OnBoarded VNF Package - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PATCH Individual OnBoarded VNF Package - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ DELETE Individual OnBoarded VNF Package - Method not implemented :... | PASS | ------------------------------------------------------------------------------ IndividualVNFPackage | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/PackageManagementNotification.robot ============================================================================== PackageManagementNotification ============================================================================== VNF Package Onboarding Notification :: Test ID: 7.3.3.8.1 | PASS | ------------------------------------------------------------------------------ VNF Package Operational State Change Notification :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ VNF Package Deletion Notification :: Test ID: 7.3.3.8.3 | PASS | ------------------------------------------------------------------------------ PackageManagementNotification | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Get All VNF Package Subscriptions :: Test ID: 7.3.3.6.1 | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with attribute-based filter :: Test ... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with invalid attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET VNF Package Subscription with invalid resource endpoint :: Tes... | PASS | ------------------------------------------------------------------------------ Create new VNF Package subscription :: Test ID: 7.3.3.6.5 | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO not creating ... | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO creating dupl... | PASS | ------------------------------------------------------------------------------ PUT VNF Package Subscriptions - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ PATCH VNF Package Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ DELETE VNF Package Subscriptions - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ Get All VNF Package Subscriptions as Paged Response :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions - Bad Request Response too Big :: Te... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/VNFDInIndividualVNFPackage.robot ============================================================================== VNFDInIndividualVNFPackage ============================================================================== Get single file VNFD in Individual VNF Package in Plain Format :: ... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package in Zip Format :: Test ID: 7.3.3... | PASS | ------------------------------------------------------------------------------ Get single file VNFD in Individual VNF Package in Plain or Zip For... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual VNF Package in Plain or Zip Form... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual VNF Package in Plain Format :: T... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package Content with conflict due to on... | PASS | ------------------------------------------------------------------------------ POST VNFD in Individual VNF Package Content - Method not implement... | PASS | ------------------------------------------------------------------------------ PUT VNFD in Individual VNF Package Content - Method not implemente... | PASS | ------------------------------------------------------------------------------ PATCH VNFD in Individual VNF Package Content - Method not implemen... | PASS | ------------------------------------------------------------------------------ DELETE VNFD in Individual VNF Package Content - Method not impleme... | PASS | ------------------------------------------------------------------------------ Get single file VNFD in Individual OnBoarded VNF Package in Plain ... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual OnBoarded VNF Package in Zip Format :: Test... | PASS | ------------------------------------------------------------------------------ Get single file VNFD in Individual OnBoarded VNF Package in Plain ... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual OnBoarded VNF Package in Plain o... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual OnBoarded VNF Package in Plain F... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual OnBoarded VNF Package with invalid resource... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual OnBoarded VNF Package Content with conflict... | PASS | ------------------------------------------------------------------------------ POST VNFD in Individual OnBoarded VNF Package Content - Method not... | PASS | ------------------------------------------------------------------------------ PUT VNFD in Individual OnBoarded VNF Package Content - Method not ... | PASS | ------------------------------------------------------------------------------ PATCH VNFD in Individual OnBoarded VNF Package Content - Method no... | PASS | ------------------------------------------------------------------------------ DELETE VNFD in Individual OnBoarded VNF Package Content - Method n... | PASS | ------------------------------------------------------------------------------ VNFDInIndividualVNFPackage | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/VNFPackageArtifacts.robot ============================================================================== VNFPackageArtifacts ============================================================================== GET Individual VNF Package Artifact :: Test ID: 7.3.3.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact in octet stream format :: Test... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with Range Request and NFVO su... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with Range Request and NFVO no... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with invalid Range Request :: ... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with invalid resource identifi... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with conflict due to onboardin... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Artifact - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Artifact - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Artifact - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Artifact - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact :: Test ID: 7.3.3.5.12 | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact in octet stream form... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact with Range Request a... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact with Range Request a... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact with invalid Range R... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact with invalid resourc... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Artifact with conflict due to... | PASS | ------------------------------------------------------------------------------ POST Individual OnBoarded VNF Package Artifact - Method not implem... | PASS | ------------------------------------------------------------------------------ PUT Individual OnBoarded VNF Package Artifact - Method not impleme... | PASS | ------------------------------------------------------------------------------ PATCH Individual OnBoarded VNF Package Artifact - Method not imple... | PASS | ------------------------------------------------------------------------------ DELETE Individual OnBoarded VNF Package Artifact - Method not impl... | PASS | ------------------------------------------------------------------------------ VNFPackageArtifacts | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/VNFPackageContent.robot ============================================================================== VNFPackageContent ============================================================================== GET Individual VNF Package Content :: Test ID: 7.3.3.3.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with Range Request and NFVO sup... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with Range Request and NFVO not... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with invalid Range Request :: T... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with conflict due to onboarding... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Content - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Content - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Content - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Content - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content :: Test ID: 7.3.3.3.11 | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content with Range Request an... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content with Range Request an... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content with invalid Range Re... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content with invalid resource... | PASS | ------------------------------------------------------------------------------ GET Individual OnBoarded VNF Package Content with conflict due to ... | PASS | ------------------------------------------------------------------------------ POST Individual OnBoarded VNF Package Content - Method not impleme... | PASS | ------------------------------------------------------------------------------ PUT Individual OnBoarded VNF Package Content - Method not implemen... | PASS | ------------------------------------------------------------------------------ PATCH Individual OnBoarded VNF Package Content - Method not implem... | PASS | ------------------------------------------------------------------------------ DELETE Individual OnBoarded VNF Package Content - Method not imple... | PASS | ------------------------------------------------------------------------------ VNFPackageContent | PASS | 20 critical tests, 20 passed, 0 failed 20 tests total, 20 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPackageManagement-API/VNFPackages.robot ============================================================================== VNFPackages ============================================================================== GET all VNF Packages :: Test ID: 7.3.3.1.1 | PASS | ------------------------------------------------------------------------------ GET VNF Packages with attribute-based filter :: Test ID: 7.3.3.1.2 | PASS | ------------------------------------------------------------------------------ GET VNF Packages with invalid attribute-based filter :: Test ID: 7... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "all_fields" attribute selector :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "exclude_default" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "fields" attribute selector :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "exclude_fields" attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET all VNF Packages with invalid resource endpoint :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ POST all VNF Packages - Method not implemented :: Test ID: 7.3.3.1.9 | PASS | ------------------------------------------------------------------------------ PUT all VNF Packages - Method not implemented :: Test ID: 7.3.3.1.10 | PASS | ------------------------------------------------------------------------------ PATCH all VNF Packages - Method not implemented :: Test ID: 7.3.3.... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Packages - Method not implemented :: Test ID: 7.3.3... | PASS | ------------------------------------------------------------------------------ GET all VNF Packages as a Paged Response :: Test ID: 7.3.3.1.13 | PASS | ------------------------------------------------------------------------------ GET VNF Packages - Bad Request Response too Big :: Test ID: 7.3.3.... | PASS | ------------------------------------------------------------------------------ GET all OnBoarded VNF Packages :: Test ID: 7.3.3.1.15 | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with "all_fields" attribute selector ::... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with "exclude_default" attribute select... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with "fields" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages with "exclude_fields" attribute selecto... | PASS | ------------------------------------------------------------------------------ GET all OnBoarded VNF Packages with invalid resource endpoint :: T... | PASS | ------------------------------------------------------------------------------ POST all OnBoarded VNF Packages - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ PUT all OnBoarded VNF Packages - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH all OnBoarded VNF Packages - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE all OnBoarded VNF Packages - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ GET all OnBoarded VNF Packages as a Paged Response :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ GET OnBoarded VNF Packages - Bad Request Response too Big :: Test ... | PASS | ------------------------------------------------------------------------------ VNFPackages | PASS | 28 critical tests, 28 passed, 0 failed 28 tests total, 28 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.4.9.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.4.9.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.4.9.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.4.9.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.4.9.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.4.9.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualPmJob.robot ============================================================================== IndividualPmJob ============================================================================== GET individual VNF Performance Job :: Test ID: 7.3.4.2.1 | PASS | ------------------------------------------------------------------------------ GET individual VNF Performance Job with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Job :: Test ID: 7.3.4.2.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Job with invalid resource identi... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Performance Job - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Performance Job - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Performance Job - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ IndividualPmJob | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualReport.robot ============================================================================== IndividualReport ============================================================================== Get Individual Performance Report :: Test ID: 7.3.4.3.1 | PASS | ------------------------------------------------------------------------------ Get Individual Performance Report with invalid resource endpoint :... | PASS | ------------------------------------------------------------------------------ POST Individual Performance Report - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PUT Individual Performance Report - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH Individual Performance Report - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE Individual Performance Report - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ IndividualReport | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Performance Subscription :: Test ID: 7.3.4.7.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Performance Subscription with invalid resource ... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Subscription :: Test ID: 7.3.4.7.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Performance Subscription with invalid resour... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Performance Subscription - Method not implemen... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Performance Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Performance Subscription - Method not impleme... | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/IndividualThreshold.robot ============================================================================== IndividualThreshold ============================================================================== GET Individual Threshold :: Test ID: 7.3.4.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual Threshold with invalid resource identifier :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold :: Test ID: 7.3.4.5.3 | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold with invalid resource identifier :: Te... | PASS | ------------------------------------------------------------------------------ POST Individual Threshold - Method not implemented :: Test ID: 7.3... | PASS | ------------------------------------------------------------------------------ PUT Individual Threshold - Method not implemented :: Test ID: 7.3.... | PASS | ------------------------------------------------------------------------------ PATCH Individual Threshold - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ IndividualThreshold | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/PMJobs.robot ============================================================================== PMJobs ============================================================================== GET all VNF Performance Monitoring Jobs :: Test ID: 7.3.4.1.1 | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with attribute-based filter ::... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with all_fields attribute ... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_default attri... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with fields attribute sele... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs with exclude_fields attrib... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid attribute-based f... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs with invalid resource endpoint... | PASS | ------------------------------------------------------------------------------ Create new VNF Performance Monitoring Job :: Test ID: 7.3.4.1.9 | PASS | ------------------------------------------------------------------------------ PUT all VNF Performance Monitoring Jobs - Method not implemented :... | PASS | ------------------------------------------------------------------------------ PATCH all VNF Performance Monitoring Jobs - (Method not implemente... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Performance Monitoring Jobs - Method not implemente... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Monitoring Jobs as Paged Response :: Test ... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Monitoring Jobs - Bad Request Response too Big... | PASS | ------------------------------------------------------------------------------ PMJobs | PASS | 14 critical tests, 14 passed, 0 failed 14 tests total, 14 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/PerformanceManagementNotification.robot ============================================================================== PerformanceManagementNotification ============================================================================== VNF Performance Information Availability Notification :: Test ID: ... | PASS | ------------------------------------------------------------------------------ VNF Threshold Crossed Notification :: Test ID: 7.3.4.8.2 | PASS | ------------------------------------------------------------------------------ PerformanceManagementNotification | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== GET all VNF Performance Subscriptions :: Test ID: 7.3.4.6.1 | PASS | ------------------------------------------------------------------------------ GET VNF Performance Subscriptions with attribute-based filter :: T... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Management Subscriptions with invalid attribut... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Subscriptions with invalid resource endpoint :... | PASS | ------------------------------------------------------------------------------ Create new VNF Performance subscription :: Test ID: 7.3.4.6.5 | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Performance subscription with VNFM not creat... | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Performance subscription with VNFM creating ... | PASS | ------------------------------------------------------------------------------ PUT VNF Performance Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH VNF Performance Subscriptions - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE VNF Performance Subscriptions - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET all VNF Performance Subscriptions as Paged Response :: Test ID... | PASS | ------------------------------------------------------------------------------ GET VNF Performance Management Subscriptions - Bad Request Respons... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VNFPerformanceManagement-API/Thresholds.robot ============================================================================== Thresholds ============================================================================== GET All Performance Thresholds :: Test ID: 7.3.4.4.1 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS | ------------------------------------------------------------------------------ Create new Performance Threshold :: Test ID: 7.3.4.4.5 | PASS | ------------------------------------------------------------------------------ PUT Performance Thresholds - Method not implemented :: Test ID: 7.... | PASS | ------------------------------------------------------------------------------ PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET All Performance Thresholds as Paged Response :: Test ID: 7.3.4... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds - Bad Request Response too Big :: Test ... | PASS | ------------------------------------------------------------------------------ Thresholds | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 7.3.7.3.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 7.3.7.3.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 7.3.7.3.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 7.3.7.3.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 7.3.7.3.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 7.3.7.3.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/IndividualSubscription.robot ============================================================================== IndividualSubscription :: This resource represents an individual subscripti... ============================================================================== Create new Virtualised Resources Quota Available Notification indi... | PASS | ------------------------------------------------------------------------------ Get Information about an individual subscription :: Test ID: 7.3.7... | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 7.3.7.2.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription :: This resource represents an individual s... | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== Deliver a notification - Vr Quota Availibility :: Test ID: 11.4.4.1 | PASS | ------------------------------------------------------------------------------ Test a notification end point | PASS | ------------------------------------------------------------------------------ PUT notification - Method not implemented | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL003/VirtualisedResourcesQuotaAvailableNotification-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create new Virtualised Resources Quota Available Notification subs... | PASS | ------------------------------------------------------------------------------ Create new Virtualised Resources Quota Available Notification subs... | PASS | ------------------------------------------------------------------------------ Create new Virtualised Resources Quota Available Notification subs... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification Subscriptio... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification Subscriptio... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification subscriptio... | PASS | ------------------------------------------------------------------------------ PUT Virtualised Resources Quota Available Notification subscriptio... | PASS | ------------------------------------------------------------------------------ PATCH Virtualised Resources Quota Available Notification subscript... | PASS | ------------------------------------------------------------------------------ DELETE Virtualised Resources Quota Available Notification subscrip... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification Subscriptio... | PASS | ------------------------------------------------------------------------------ GET Virtualised Resources Quota Available Notification subscriptio... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 5.3.1.10.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 5.3.1.10.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 5.3.1.10.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 5.3.1.10.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 5.3.1.10.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 5.3.1.10.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/IndividualNSDescriptor.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== IndividualNSDescriptor :: This Clause defines all the resources and methods... ============================================================================== GET Individual Network Service Descriptor Information :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET Individual Network Service Descriptor Information with invalid... | PASS | ------------------------------------------------------------------------------ Disable Individual Network Service Descriptor :: Test ID: 5.3.1.2.3 | PASS | ------------------------------------------------------------------------------ Enable Individual Network Service Descriptor :: Test ID: 5.3.1.2.4 | PASS | ------------------------------------------------------------------------------ Enable Individual Network Service Descriptor with conflict due to ... | PASS | ------------------------------------------------------------------------------ Enable Individual Network Service Descriptor with conflict due to ... | PASS | ------------------------------------------------------------------------------ Enable Individual Network Service Descriptor with HTTP Etag precon... | PASS | ------------------------------------------------------------------------------ DELETE Individual Network Service Descriptor :: Test ID: 5.3.1.2.9 | PASS | ------------------------------------------------------------------------------ DELETE Individual Network Service Descriptor in operational state ... | PASS | ------------------------------------------------------------------------------ POST Individual Network Service Descriptor - Method not implemente... | PASS | ------------------------------------------------------------------------------ PUT Individual Network Service Descriptor - Method not implemented... | PASS | ------------------------------------------------------------------------------ IndividualNSDescriptor :: This Clause defines all the resources an... | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/IndividualPnfDescriptor.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== IndividualPnfDescriptor :: This Clause defines all the resources and method... ============================================================================== GET Individual PNF Descriptor Information :: Test ID: 5.3.1.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual PNF Descriptor Information with invalid resource id... | PASS | ------------------------------------------------------------------------------ Update Individual PNF Descriptor :: Test ID: 5.3.1.5.3 | PASS | ------------------------------------------------------------------------------ Update Individual PNF Descriptor with HTTP Etag precondition failu... | PASS | ------------------------------------------------------------------------------ POST Individual PNF Descriptor - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PUT Individual PNF Descriptor - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Individual PNF Descriptor :: Test ID: 5.3.1.5.7 | PASS | ------------------------------------------------------------------------------ IndividualPnfDescriptor :: This Clause defines all the resources a... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/IndividualSubscription.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== IndividualSubscription ============================================================================== GET Individual NSD Management Subscription :: Test ID: 5.3.1.8.1 | PASS | ------------------------------------------------------------------------------ GET Individual NSD Management Subscription with invalid resource i... | PASS | ------------------------------------------------------------------------------ DELETE Individual NSD Management Subscription with invalid resourc... | PASS | ------------------------------------------------------------------------------ POST Individual NSD Management Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ PUT Individual NSD Management Subscription - Method not implemente... | PASS | ------------------------------------------------------------------------------ PATCH Individual NSD Management Subscription - Method not implemen... | PASS | ------------------------------------------------------------------------------ DELETE Individual NSD Management Subscription :: Test ID: 5.3.1.8.7 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/NSDContent.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== NSDContent :: This Clause defines the content of the individual NS descript... ============================================================================== Get single file NSD Content in Plain Format :: Test ID: 5.3.1.3.1 | PASS | ------------------------------------------------------------------------------ Get NSD Content in Zip Format :: Test ID: 5.3.1.3.2 | PASS | ------------------------------------------------------------------------------ Get single file NSD Content in Plain or Zip Format :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ Get multi file NSD Content in Plain or Zip Format :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ Get multi file NSD Content in Plain Format :: Test ID: 5.3.1.3.5 | PASS | ------------------------------------------------------------------------------ Get NSD Content with invalid resource identifier :: Test ID: 5.3.1... | PASS | ------------------------------------------------------------------------------ Get NSD Content with conflict due to onboarding state :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET NSD Content with Range Request and NFVO supporting Range Reque... | PASS | ------------------------------------------------------------------------------ GET NSD Content with Range Request and NFVO not supporting Range R... | PASS | ------------------------------------------------------------------------------ GET NSD Content with invalid Range Request :: Test ID: 5.3.1.3.10 | PASS | ------------------------------------------------------------------------------ Upload NSD Content as Zip file in asynchronous mode :: Test ID: 5.... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload NSD Content as plain text file in asynchronous mode :: Test... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload NSD Content as Zip file in synchronous mode :: Test ID: 5.3... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload NSD Content as plain text file in synchronous mode :: Test ... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload NSD Content with conflict due to onboarding state :: Test I... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ POST NSD Content - Method not implemented :: Test ID: 5.3.1.3.16 | PASS | ------------------------------------------------------------------------------ PATCH NSD Content - Method not implemented :: Test ID: 5.3.1.3.17 | PASS | ------------------------------------------------------------------------------ DELETE NSD Content - Method not implemented :: Test ID: 5.3.1.3.18 | PASS | ------------------------------------------------------------------------------ NSDContent :: This Clause defines the content of the individual NS... | FAIL | 18 critical tests, 13 passed, 5 failed 18 tests total, 13 passed, 5 failed ============================================================================== Output: None ++++ Issues in file SOL005/NSDManagement-API/NSDContent.robot ++++ Dryrun SOL005/NSDManagement-API/NSDManagementNotification.robot ============================================================================== NSDManagementNotification ============================================================================== NSD Onboarding Notification :: Test ID: 5.3.1.9.1 | PASS | ------------------------------------------------------------------------------ NSD Onboarding Failure Notification :: Test ID: 5.3.1.9.2 | PASS | ------------------------------------------------------------------------------ NSD Operational State Change Notification :: Test ID: 5.3.1.9.3 | PASS | ------------------------------------------------------------------------------ NSD Deletion Notification :: Test ID: 5.3.1.9.4 | PASS | ------------------------------------------------------------------------------ PNFD Onboarding Notification :: Test ID: 5.3.1.9.5 | PASS | ------------------------------------------------------------------------------ PNFD Onboarding Failure Notification :: Test ID: 5.3.1.9.6 | PASS | ------------------------------------------------------------------------------ PNFD Deletion Notification :: Test ID: 5.3.1.9.7 | PASS | ------------------------------------------------------------------------------ NSDManagementNotification | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/NSDescriptors.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== NSDescriptors :: This Clause defines all the resources and methods provided... ============================================================================== GET all Network Service Descriptors Information :: Test ID: 5.3.1.1.1 | PASS | ------------------------------------------------------------------------------ GET Network Service Descriptors Information with attribute-based f... | PASS | ------------------------------------------------------------------------------ GET Network Service Descriptors Information with invalid attribute... | PASS | ------------------------------------------------------------------------------ Get all Network Service Descriptors Information with malformed aut... | PASS | ------------------------------------------------------------------------------ Get all Network Service Descriptors Information without authorizat... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information with expired or re... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information with "all_fields" ... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information with "exclude_defa... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information with "fields" attr... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information with "exclude_fiel... | PASS | ------------------------------------------------------------------------------ Create new Network Service Descriptor Resource :: Test ID: 5.3.1.1.11 | PASS | ------------------------------------------------------------------------------ PUT all Network Service Descriptors - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH all Network Service Descriptors - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE all Network Service Descriptors - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ GET all Network Service Descriptors Information as Paged Response ... | PASS | ------------------------------------------------------------------------------ Get all Network Service Descriptors Information - Bad Request Resp... | PASS | ------------------------------------------------------------------------------ NSDescriptors :: This Clause defines all the resources and methods... | PASS | 16 critical tests, 16 passed, 0 failed 16 tests total, 16 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/PNFDContent.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== PNFDContent :: This Clause defines the content of the individual NS descrip... ============================================================================== Get PNFD Content :: Test ID: 5.3.1.6.1 | PASS | ------------------------------------------------------------------------------ Get PNFD Content with invalid resource identifier :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ Get PNFD Content with conflict due to onboarding state :: Test ID:... | PASS | ------------------------------------------------------------------------------ Upload PNFD Content as plain text file :: Test ID: 5.3.1.6.4 | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: NSDManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload PNFD Content with conflict due to onboarding state :: Test ... | PASS | ------------------------------------------------------------------------------ POST PNFD Content - Method not implemented :: Test ID: 5.3.1.6.6 | PASS | ------------------------------------------------------------------------------ PATCH PNFD Content - Method not implemented :: Test ID: 5.3.1.6.7 | PASS | ------------------------------------------------------------------------------ DELETE PNFD Content - Method not implemented :: Test ID: 5.3.1.6.8 | PASS | ------------------------------------------------------------------------------ PNFDContent :: This Clause defines the content of the individual N... | FAIL | 8 critical tests, 7 passed, 1 failed 8 tests total, 7 passed, 1 failed ============================================================================== Output: None ++++ Issues in file SOL005/NSDManagement-API/PNFDContent.robot ++++ Dryrun SOL005/NSDManagement-API/PNFDescriptors.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== PNFDescriptors :: This Clause defines all the resources and methods provide... ============================================================================== GET all PNF Descriptors Information :: Test ID: 5.3.1.4.1 | PASS | ------------------------------------------------------------------------------ GET PNF Descriptors Information with attribute-based filter :: Tes... | PASS | ------------------------------------------------------------------------------ GET PNF Descriptors Information with invalid attribute-based filte... | PASS | ------------------------------------------------------------------------------ GET all PNF Descriptors Information with "all_fields" attribute se... | PASS | ------------------------------------------------------------------------------ GET all PNF Descriptors Information with "exclude_default" attribu... | PASS | ------------------------------------------------------------------------------ GET all PNF Descriptors Information with "fields" attribute select... | PASS | ------------------------------------------------------------------------------ GET all PNF Descriptors Information with "exclude_fields" attribut... | PASS | ------------------------------------------------------------------------------ Create new PNF Descriptor Resource :: Test ID: 5.3.1.4.8 | PASS | ------------------------------------------------------------------------------ PUT all PNF Descriptors - Method not implemented :: Test ID: 5.3.1... | PASS | ------------------------------------------------------------------------------ PATCH all PNF Descriptors - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ DELETE all PNF Descriptors - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ GET all PNF Descriptors Information as Paged Response :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET PNF Descriptors Information - Bad Request Response too Big :: ... | PASS | ------------------------------------------------------------------------------ PNFDescriptors :: This Clause defines all the resources and method... | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSDManagement-API/Subscriptions.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/NSDManagement-API/NSDManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== Subscriptions ============================================================================== Get All NSD Management Subscriptions :: Test ID: 5.3.1.7.1 | PASS | ------------------------------------------------------------------------------ Get NSD Management Subscriptions with attribute-based filter :: Te... | PASS | ------------------------------------------------------------------------------ Get NSD Management Subscriptions with invalid attribute-based filt... | PASS | ------------------------------------------------------------------------------ GET NSD Management Subscription with invalid resource endpoint :: ... | PASS | ------------------------------------------------------------------------------ Create new NSD Management subscription :: Test ID: 5.3.1.7.5 | PASS | ------------------------------------------------------------------------------ Create duplicated NSD Management subscription with NFVO not creati... | PASS | ------------------------------------------------------------------------------ Create duplicated NSD Management subscription with NFVO creating d... | PASS | ------------------------------------------------------------------------------ PUT NSD Management Subscriptions - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ PATCH NSD Management Subscriptions - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ DELETE NSD Management Subscriptions - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ Get All NSD Management Subscriptions as Paged Response :: Test ID:... | PASS | ------------------------------------------------------------------------------ Get NSD Management Subscriptions - Bad Request Response too Big ::... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/Alarms.robot ============================================================================== Alarms ============================================================================== POST Alarms - Method not implemented :: Test ID: 5.3.3.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms :: Test ID: 5.3.3.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filters :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms Bad Request Invalid attribut... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "all_fields" attribute ... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with exclude_default attribu... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with fields attribute select... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with "exclude_fields" attrib... | PASS | ------------------------------------------------------------------------------ PUT Alarms - Method not implemented :: Test ID: 5.3.3.1.5 | PASS | ------------------------------------------------------------------------------ PATCH Alarms - Method not implemented :: Test ID: 5.3.3.1.6 | PASS | ------------------------------------------------------------------------------ DELETE Alarms - Method not implemented :: Test ID: 5.3.3.1.7 | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms as Paged Response :: Test ID... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms - Bad Request Response too B... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "id" :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "rootCauseFaulty... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "eventType" :: T... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "perceivedSeveri... | PASS | ------------------------------------------------------------------------------ GET information about multiple alarms with filter "probableCause" ... | PASS | ------------------------------------------------------------------------------ Alarms | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 5.3.3.6.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 5.3.3.6.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 5.3.3.6.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 5.3.3.6.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 5.3.3.6.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 5.3.3.6.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/IndividualAlarm.robot ============================================================================== IndividualAlarm ============================================================================== POST Individual Alarm - Method not implemented :: Test ID: 5.3.3.2.1 | PASS | ------------------------------------------------------------------------------ GET information about Individual Alarm :: Test ID: 5.3.3.2.2 | PASS | ------------------------------------------------------------------------------ GET information about Invalid Individual Alarm :: Test ID: 5.3.3.2.3 | PASS | ------------------------------------------------------------------------------ PUT Individual Alarm - Method not implemented :: Test ID: 5.3.3.2.4 | PASS | ------------------------------------------------------------------------------ PATCH Alarm :: Test ID: 5.3.3.2.5 | PASS | ------------------------------------------------------------------------------ PATCH Alarm - Conflict :: Test ID: 5.3.3.2.6 | PASS | ------------------------------------------------------------------------------ PATCH Alarm - Precondition failed :: Test ID: 5.3.3.2.7 | PASS | ------------------------------------------------------------------------------ DELETE Individual Alarm - Method not implemented :: Test ID: 5.3.3... | PASS | ------------------------------------------------------------------------------ IndividualAlarm | PASS | 8 critical tests, 8 passed, 0 failed 8 tests total, 8 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== Post Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ Get Information about an individual subscription :: Test ID: 5.3.3... | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 5.3.3.4.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== NS Fault Alarm Notification :: Test ID: 5.3.3.5.1 | PASS | ------------------------------------------------------------------------------ NS Fault Alarm Cleared Notification :: Test ID: 5.3.3.5.2 | PASS | ------------------------------------------------------------------------------ NS Fault Alarm List Rebuilt Notification :: Test ID: 5.3.3.5.3 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSFaultManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Create a new alarm subscription :: Test ID: 5.3.3.3.1 | PASS | ------------------------------------------------------------------------------ Create a new alarm subscription - DUPLICATION :: Test ID: 5.3.3.3.2 | PASS | ------------------------------------------------------------------------------ Create a new alarm subscription - NO DUPLICATION :: Test ID: 5.3.3... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions :: Test ID: 5.3.3.3.4 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions - Filter :: Test ID: 5.3.3.3.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 5.3.3.3.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 5.3.3.3.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 5.3.3.3.13 | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions as Paged Response :: Test I... | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 5.3.3... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "id" :: Test ID... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.notific... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.faultyR... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.perceiv... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.eventTy... | PASS | ------------------------------------------------------------------------------ Retrieve a list of alarm subscriptions with filter "filter.probabl... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 5.3.2.25.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 5.3.2.25.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 5.3.2.25.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 5.3.2.25.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 5.3.2.25.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 5.3.2.25.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/CancelOperationTask.robot ============================================================================== CancelOperationTask ============================================================================== POST Cancel operation task :: Test ID: 5.3.2.14.1 | PASS | ------------------------------------------------------------------------------ POST Cancel operation task Not Found :: Test ID: 5.3.2.14.2 | PASS | ------------------------------------------------------------------------------ POST Cancel operation task Conflict :: Test ID: 5.3.2.14.3 | PASS | ------------------------------------------------------------------------------ GET Cancel operation task - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ PUT Cancel operation task - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ PATCH Cancel operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ DELETE Cancel operation task - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ CancelOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/ContinueOperationTask.robot ============================================================================== ContinueOperationTask ============================================================================== POST Continue operation task :: Test ID: 5.3.2.12.1 | PASS | ------------------------------------------------------------------------------ POST Continue operation task Not Found :: Test ID: 5.3.2.12.2 | PASS | ------------------------------------------------------------------------------ POST Continue operation task Conflict :: Test ID: 5.3.2.12.3 | PASS | ------------------------------------------------------------------------------ GET Continue operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ PUT Continue operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ PATCH Continue operation task - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Continue operation task - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ ContinueOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/CreateNSInstanceWorkflow.robot ============================================================================== CreateNSInstanceWorkflow ============================================================================== NS Instance Creation :: Test ID: 5.3.2.18.1 | FAIL | Keyword 'NSLCMOperationKeywords.Check resource not_instantiated' expected 0 arguments, got 1. ------------------------------------------------------------------------------ NS Instance Creation with DISABLED Network Service Descriptor :: T... | PASS | ------------------------------------------------------------------------------ CreateNSInstanceWorkflow | FAIL | 2 critical tests, 1 passed, 1 failed 2 tests total, 1 passed, 1 failed ============================================================================== Output: None ++++ Issues in file SOL005/NSLifecycleManagement-API/CreateNSInstanceWorkflow.robot ++++ Dryrun SOL005/NSLifecycleManagement-API/DeleteNSInstanceWorkflow.robot ============================================================================== DeleteNSInstanceWorkflow ============================================================================== NS Instance Deletion :: Test ID: 5.3.2.19.1 | PASS | ------------------------------------------------------------------------------ DeleteNSInstanceWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/FailOperationTask.robot ============================================================================== FailOperationTask ============================================================================== POST Fail operation task :: Test ID: 5.3.2.13.1 | PASS | ------------------------------------------------------------------------------ POST Fail operation task Not Found :: Test ID: 5.3.2.13.2 | PASS | ------------------------------------------------------------------------------ POST Fail operation task Conflict :: Test ID: 5.3.2.13.3 | PASS | ------------------------------------------------------------------------------ GET Fail operation task - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ PUT Fail operation task - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ PATCH Fail operation task - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ DELETE Fail operation task - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ FailOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/HealNSTask.robot ============================================================================== HealNSTask ============================================================================== POST Heal a NSInstance :: Test ID: 5.3.2.6.1 | PASS | ------------------------------------------------------------------------------ POST Heal a NSInstance Conflict :: Test ID: 5.3.2.6.2 | PASS | ------------------------------------------------------------------------------ GET Heal NSInstance- Method not implemented :: Test ID: 5.3.2.6.3 | PASS | ------------------------------------------------------------------------------ PUT Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.4 | PASS | ------------------------------------------------------------------------------ PATCH Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.5 | PASS | ------------------------------------------------------------------------------ DELETE Heal NSInstance - Method not implemented :: Test ID: 5.3.2.6.6 | PASS | ------------------------------------------------------------------------------ HealNSTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/HealNSTaskWorkflow.robot ============================================================================== HealNSTaskWorkflow ============================================================================== Heal Flow of NS lifecycle management operations :: Test ID: 5.3.2.... | PASS | ------------------------------------------------------------------------------ HealNSTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/IndividualNSInstance.robot ============================================================================== IndividualNSInstance ============================================================================== POST Individual NSInstance - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ GET Information about an individual NS Instance :: Test ID: 5.3.2.2.2 | PASS | ------------------------------------------------------------------------------ PUT Individual NSInstance - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ PATCH Individual NSInstance - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ DELETE Individual NSInstance :: Test ID: 5.3.2.2.5 | PASS | ------------------------------------------------------------------------------ DELETE Individual NSInstance Conflict :: Test ID: 5.3.2.2.6 | PASS | ------------------------------------------------------------------------------ IndividualNSInstance | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/IndividualNSLCMOccurences.robot ============================================================================== IndividualNSLCMOccurences ============================================================================== Post Individual NS LCM occurrences - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ Get status information about Individual NS LCM occurrences :: Test... | PASS | ------------------------------------------------------------------------------ PUT status information about Individual NS LCM occurrences - Metho... | PASS | ------------------------------------------------------------------------------ PATCH status information about Individual NS LCM occurrences - Met... | PASS | ------------------------------------------------------------------------------ DELETE status information about Individual NS LCM occurrences - Me... | PASS | ------------------------------------------------------------------------------ IndividualNSLCMOccurences | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription ============================================================================== POST Individual Subscription - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET Information about an individual subscription :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ PUT an individual subscription - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ PATCH an individual subscription - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE an individual subscription :: Test ID: 5.3.2.16.5 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/InstanciateNSTaskWorkflow.robot ============================================================================== InstanciateNSTaskWorkflow ============================================================================== Instantiate Flow of NS lifecycle management operations :: Test ID:... | PASS | ------------------------------------------------------------------------------ InstanciateNSTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/InstantiateNSTask.robot ============================================================================== InstantiateNSTask ============================================================================== POST Instantiate a nsInstance :: Test ID: 5.3.2.3.1 | PASS | ------------------------------------------------------------------------------ POST Instantiate a nsInstance Conflict :: Test ID: 5.3.2.3.2 | PASS | ------------------------------------------------------------------------------ GET Instantiate NSInstance - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ PUT Instantiate NSInstance - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ PATCH Instantiate NSInstance - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Instantiate NSInstance - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ InstantiateNSTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/NSInstances.robot ============================================================================== NSInstances ============================================================================== POST Create a new NsInstance :: Test ID: 5.3.2.1.1 | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances :: Test ID: 5.3.2.1.2 | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances Bad Request Invalid at... | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances Bad Request Invalid at... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "all_fields" attribute selector :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "exclude_default" attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "fields" attribute selector :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ GET NSInstances with "exclude_fields" attribute selector :: Test I... | PASS | ------------------------------------------------------------------------------ PUT NSInstances - Method not implemented :: Test ID: 5.3.2.1.9 | PASS | ------------------------------------------------------------------------------ PATCH NSInstances - Method not implemented :: Test ID: 5.3.2.1.10 | PASS | ------------------------------------------------------------------------------ DELETE NSInstances - Method not implemented :: Test ID: 5.3.2.1.11 | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances as Paged Response :: T... | PASS | ------------------------------------------------------------------------------ GET information about multiple NS instances - Bad Request Response... | PASS | ------------------------------------------------------------------------------ NSInstances | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/NSLCMOccurences.robot ============================================================================== NSLCMOccurences ============================================================================== POST NS LCM occurrences - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences :: Test I... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences Bad Reque... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences Bad Reque... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences with "all... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences with "exc... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences with "fie... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences with "exc... | PASS | ------------------------------------------------------------------------------ PUT status information about multiple NS LCM occurrences - Method ... | PASS | ------------------------------------------------------------------------------ PATCH status information about multiple NS LCM occurrences - Metho... | PASS | ------------------------------------------------------------------------------ DELETE status information about multiple NS LCM occurrences - Meth... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences as Paged ... | PASS | ------------------------------------------------------------------------------ GET status information about multiple NS LCM occurrences - Bad Req... | PASS | ------------------------------------------------------------------------------ NSLCMOccurences | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/NotificationEndpoint.robot ============================================================================== NotificationEndpoint ============================================================================== NS LCM Operation Occurrence Start Notification :: Test ID: 5.3.2.17.1 | PASS | ------------------------------------------------------------------------------ NS LCM Operation Occurrence Result Notification :: Test ID: 5.3.2.... | PASS | ------------------------------------------------------------------------------ NS Identifier Creation Notification :: Test ID: 5.3.2.17.3 | PASS | ------------------------------------------------------------------------------ NS Identifier Deletion Notification :: Test ID: 5.3.2.17.4 | PASS | ------------------------------------------------------------------------------ NotificationEndpoint | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/RetryOperationTask.robot ============================================================================== RetryOperationTask ============================================================================== Post Retry operation task :: Test ID: 5.3.2.10.1 | PASS | ------------------------------------------------------------------------------ Post Retry operation task Not Found :: Test ID: 5.3.2.10.2 | PASS | ------------------------------------------------------------------------------ Post Retry operation task Conflict :: Test ID: 5.3.2.10.3 | PASS | ------------------------------------------------------------------------------ GET Retry operation task - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ PUT Retry operation task - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ PATCH Retry operation task - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ DELETE Retry operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ RetryOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/RollbackOperationTask.robot ============================================================================== RollbackOperationTask ============================================================================== POST Rollback operation task :: Test ID: 5.3.2.11.1 | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Not Found :: Test ID: 5.3.2.11.2 | PASS | ------------------------------------------------------------------------------ POST Rollback operation task Conflict :: Test ID: 5.3.2.11.3 | PASS | ------------------------------------------------------------------------------ GET Rollback operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ PUT Rollback operation task - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ PATCH Rollback operation task - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ DELETE Rollback operation task - Method not implemented :: Test ID... | PASS | ------------------------------------------------------------------------------ RollbackOperationTask | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/ScaleNSTask.robot ============================================================================== ScaleNSTask ============================================================================== POST Scale a nsInstance :: Test ID: 5.3.2.4.1 | PASS | ------------------------------------------------------------------------------ POST Instantiate a nsInstance Conflict :: Test ID: 5.3.2.4.2 | PASS | ------------------------------------------------------------------------------ GET Scale NSInstance- Method not implemented :: Test ID: 5.3.2.4.3 | PASS | ------------------------------------------------------------------------------ PUT Scale NSInstance - Method not implemented :: Test ID: 5.3.2.4.4 | PASS | ------------------------------------------------------------------------------ PATCH Scale NSInstance - Method not implemented :: Test ID: 5.3.2.4.5 | PASS | ------------------------------------------------------------------------------ DELETE Scale NSInstance - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ ScaleNSTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/ScaleNSTaskWorkflow.robot ============================================================================== ScaleNSTaskWorkflow ============================================================================== Scale Flow of NS lifecycle management operations :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ ScaleNSTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== POST Create a new subscription :: Test ID: 5.3.2.15.1 | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - DUPLICATION :: Test ID: 5.3.2.15.2 | PASS | ------------------------------------------------------------------------------ POST Create a new Subscription - NO-DUPLICATION :: Test ID: 5.3.2.... | PASS | ------------------------------------------------------------------------------ GET Subscriptions :: Test ID: 5.3.2.15.4 | PASS | ------------------------------------------------------------------------------ GET Subscription - Filter :: Test ID: 5.3.2.15.5 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Invalid attribute-based filtering ... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "all_fields" attribute selector :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_default" attribute selector :: Tes... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "fields" attribute selector :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ GET subscriptions with "exclude_fields" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ PUT subscriptions - Method not implemented :: Test ID: 5.3.2.15.11 | PASS | ------------------------------------------------------------------------------ PATCH subscriptions - Method not implemented :: Test ID: 5.3.2.15.12 | PASS | ------------------------------------------------------------------------------ DELETE subscriptions - Method not implemented :: Test ID: 5.3.2.15.13 | PASS | ------------------------------------------------------------------------------ GET Subscriptions as Paged Response :: Test ID: 5.3.2.15.14 | PASS | ------------------------------------------------------------------------------ GET subscriptions - Bad Request Response too Big :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 15 critical tests, 15 passed, 0 failed 15 tests total, 15 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/TerminateNSTask.robot ============================================================================== TerminateNSTask ============================================================================== POST Terminate a NSInstance :: Test ID: 5.3.2.7.1 | PASS | ------------------------------------------------------------------------------ POST Terminate a NSInstance Conflict :: Test ID: 5.3.2.7.2 | PASS | ------------------------------------------------------------------------------ GET Terminate NSInstance- Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ PUT Terminate NSInstance - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ PATCH Terminate NSInstance - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ DELETE Terminate NSInstance - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ TerminateNSTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/TerminateNSTaskWorkflow.robot ============================================================================== TerminateNSTaskWorkflow ============================================================================== Terminate Flow of NS lifecycle management operations :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ TerminateNSTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/UpdateNSTask.robot ============================================================================== UpdateNSTask ============================================================================== POST Update a NSInstance :: Test ID: 5.3.2.5.1 | PASS | ------------------------------------------------------------------------------ POST Update a NSInstance Conflict :: Test ID: 5.3.2.5.2 | PASS | ------------------------------------------------------------------------------ GET Update NSInstance- Method not implemented :: Test ID: 5.3.2.5.3 | PASS | ------------------------------------------------------------------------------ PUT Update NSInstance - Method not implemented :: Test ID: 5.3.2.5.4 | PASS | ------------------------------------------------------------------------------ PATCH Update NSInstance - Method not implemented :: Test ID: 5.3.2... | PASS | ------------------------------------------------------------------------------ DELETE Update NSInstance - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ UpdateNSTask | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSLifecycleManagement-API/UpdateNSTaskWorkflow.robot ============================================================================== UpdateNSTaskWorkflow ============================================================================== Update Flow of NS lifecycle management operations :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ UpdateNSTaskWorkflow | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 5.3.4.9.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 5.3.4.9.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 5.3.4.9.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 5.3.4.9.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 5.3.4.9.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 5.3.4.9.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualPmJob.robot ============================================================================== IndividualPmJob ============================================================================== GET individual NS Performance Job :: Test ID: 5.3.4.2.1 | PASS | ------------------------------------------------------------------------------ GET individual NS Performance Job with invalid resource identifier... | PASS | ------------------------------------------------------------------------------ DELETE Individual NS Performance Job with invalid resource identif... | PASS | ------------------------------------------------------------------------------ POST Individual NS Performance Job - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PUT Individual NS Performance Job - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH Individual NS Performance Job - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE Individual NS Performance Job :: Test ID: 5.3.4.2.7 | PASS | ------------------------------------------------------------------------------ IndividualPmJob | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualReport.robot ============================================================================== IndividualReport ============================================================================== Get Individual Performance Report :: Test ID: 5.3.4.3.1 | PASS | ------------------------------------------------------------------------------ Get Individual Performance Report with invalid resource endpoint :... | PASS | ------------------------------------------------------------------------------ POST Individual Performance Report - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PUT Individual Performance Report - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH Individual Performance Report - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE Individual Performance Report - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ IndividualReport | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualSubscription.robot ============================================================================== IndividualSubscription :: This resource represents an individual subscripti... ============================================================================== GET Individual NS Performance Subscription :: Test ID: 5.3.4.7.1 | PASS | ------------------------------------------------------------------------------ GET Individual NS Performance Subscription with invalid resource i... | PASS | ------------------------------------------------------------------------------ DELETE Individual NS Performance Subscription with invalid resourc... | PASS | ------------------------------------------------------------------------------ POST Individual NS Performance Subscription - Method not implement... | PASS | ------------------------------------------------------------------------------ PUT Individual NS Performance Subscription - Method not implemente... | PASS | ------------------------------------------------------------------------------ PATCH Individual NS Performance Subscription - Method not implemen... | PASS | ------------------------------------------------------------------------------ DELETE Individual NS Performance Subscription :: Test ID: 5.3.4.7.7 | PASS | ------------------------------------------------------------------------------ IndividualSubscription :: This resource represents an individual s... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/IndividualThreshold.robot ============================================================================== IndividualThreshold :: This resource represents an individual threshold. ============================================================================== GET Individual Threshold :: Test ID: 5.3.4.5.1 | PASS | ------------------------------------------------------------------------------ GET Individual Threshold with invalid resource identifier :: Test ... | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold with invalid resource identifier :: Te... | PASS | ------------------------------------------------------------------------------ POST Individual Threshold - Method not implemented :: Test ID: 5.3... | PASS | ------------------------------------------------------------------------------ PUT Individual Threshold - Method not implemented :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ PATCH Individual Threshold - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ DELETE Individual Threshold :: Test ID: 5.3.4.5.7 | PASS | ------------------------------------------------------------------------------ IndividualThreshold :: This resource represents an individual thre... | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/Notifications.robot ============================================================================== Notifications ============================================================================== NS Performance Information Availability Notification :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ NS Threshold Crossed Notification :: Test ID: 5.3.4.8.2 | PASS | ------------------------------------------------------------------------------ Notifications | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/PMJobs.robot ============================================================================== PMJobs ============================================================================== GET all NS Performance Monitoring Jobs :: Test ID: 5.3.4.1.1 | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs with attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "all_fields" attribute... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "exclude_default" attr... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "include" attribute se... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs with "exclude" attribute se... | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs with invalid attribute-based fi... | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs with invalid resource endpoint ... | PASS | ------------------------------------------------------------------------------ Create new NS Performance Monitoring Job :: Test ID: 5.3.4.1.9 | PASS | ------------------------------------------------------------------------------ PUT all NS Performance Monitoring Jobs - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ PATCH all NS Performance Monitoring Jobs - Method not implemented ... | PASS | ------------------------------------------------------------------------------ DELETE all NS Performance Monitoring Jobs - Method not implemented... | PASS | ------------------------------------------------------------------------------ GET all NS Performance Monitoring Jobs as Paged Response :: Test I... | PASS | ------------------------------------------------------------------------------ GET NS Performance Monitoring Jobs - Bad Request Response too Big ... | PASS | ------------------------------------------------------------------------------ PMJobs | PASS | 14 critical tests, 14 passed, 0 failed 14 tests total, 14 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/Subscriptions.robot ============================================================================== Subscriptions ============================================================================== Get All NS Performance Subscriptions :: Test ID: 5.3.4.6.1 | PASS | ------------------------------------------------------------------------------ Get NS Performance Subscriptions with attribute-based filter :: Te... | PASS | ------------------------------------------------------------------------------ Get NS Performance Subscriptions with invalid attribute-based filt... | PASS | ------------------------------------------------------------------------------ GET NS Performance Subscription with invalid resource endpoint :: ... | PASS | ------------------------------------------------------------------------------ Create new NS Performance subscription :: Test ID: 5.3.4.6.5 | PASS | ------------------------------------------------------------------------------ Create duplicated NS Performance subscription with NFVO not creati... | PASS | ------------------------------------------------------------------------------ Create duplicated NS Performance subscription with NFVO creating d... | PASS | ------------------------------------------------------------------------------ PUT NSD Performance Subscriptions - Method not implemented :: Test... | PASS | ------------------------------------------------------------------------------ PATCH NSD Performance Subscriptions - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ DELETE NSD Performance Subscriptions - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ Get All NS Performance Subscriptions as Paged Response :: Test ID:... | PASS | ------------------------------------------------------------------------------ Get NS Performance Subscriptions - Bad Request Response too Big ::... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/NSPerformanceManagement-API/Thresholds.robot ============================================================================== Thresholds :: This resource represents thresholds. The client can use this ... ============================================================================== GET All Performance Thresholds :: Test ID: 5.3.4.4.1 | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with attribute-based filter :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid attribute-based filter :: ... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds with invalid resource endpoint :: Test ... | PASS | ------------------------------------------------------------------------------ Create new Performance Threshold :: Test ID: 5.3.4.4.5 | PASS | ------------------------------------------------------------------------------ PUT Performance Thresholds - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ PATCH Performance Thresholds - Method not implemented :: Test ID: ... | PASS | ------------------------------------------------------------------------------ DELETE Performance Thresholds - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ GET All Performance Thresholds as Paged Response :: Test ID: 5.3.4... | PASS | ------------------------------------------------------------------------------ GET Performance Thresholds - Bad Request Response too Big :: Test ... | PASS | ------------------------------------------------------------------------------ Thresholds :: This resource represents thresholds. The client can ... | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/ApiVersion.robot ============================================================================== ApiVersion ============================================================================== POST API Version - Method not implemented :: Test ID: 5.3.5.10.1 | PASS | ------------------------------------------------------------------------------ GET API Version :: Test ID: 5.3.5.10.2 | PASS | ------------------------------------------------------------------------------ PUT API Version - Method not implemented :: Test ID: 5.3.5.10.3 | PASS | ------------------------------------------------------------------------------ PATCH API Version - Method not implemented :: Test ID: 5.3.5.10.4 | PASS | ------------------------------------------------------------------------------ DELETE API Version - Method not implemented :: Test ID: 5.3.5.10.5 | PASS | ------------------------------------------------------------------------------ POST API Version with apiMajorVerion - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ GET API Version with apiMajorVerion :: Test ID: 5.3.5.10.7 | PASS | ------------------------------------------------------------------------------ PUT API Version with apiMajorVerion - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH API Version with apiMajorVerion - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE API Version with apiMajorVerion - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ ApiVersion | PASS | 10 critical tests, 10 passed, 0 failed 10 tests total, 10 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/IndividualSubscription.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== IndividualSubscription ============================================================================== GET Individual VNF Package Subscription :: Test ID: 5.3.5.8.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Subscription with invalid resource iden... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Subscription with invalid resource i... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Subscription - Method not implemented ... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Subscription - Method not implemented :... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Subscription - Method not implemented... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Subscription :: Test ID: 5.3.5.8.7 | PASS | ------------------------------------------------------------------------------ IndividualSubscription | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/IndividualVNFPackage.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== IndividualVNFPackage ============================================================================== GET Individual VNF Package :: Test ID: 5.3.5.2.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package with invalid resource identifier :: Tes... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package - Method not implemented :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package - Method not implemented :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ Disable Individual VNF Package :: Test ID: 5.3.5.2.5 | PASS | ------------------------------------------------------------------------------ Disable Individual VNF Package with conflict due to operational st... | PASS | ------------------------------------------------------------------------------ Enable Individual VNF Package :: Test ID: 5.3.5.2.7 | PASS | ------------------------------------------------------------------------------ Enable Individual VNF Package with conflict due to operational sta... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package :: Test ID: 5.3.5.2.9 | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package in operational state ENABLED :: Test... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package used for instantiated VNF instances ... | PASS | ------------------------------------------------------------------------------ IndividualVNFPackage | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/Notifications.robot ============================================================================== Notifications ============================================================================== VNF Package Onboarding Notification :: Test ID: 5.3.5.9.1 | PASS | ------------------------------------------------------------------------------ VNF Package Operational State Change Notification :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ VNF Package Deletion Notification :: Test ID: 5.3.5.9.3 | PASS | ------------------------------------------------------------------------------ Notifications | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/Subscriptions.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== Subscriptions ============================================================================== Get All VNF Package Subscriptions :: Test ID: 5.3.5.7.1 | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with attribute-based filter :: Test ... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions with invalid attribute-based filter ... | PASS | ------------------------------------------------------------------------------ GET VNF Package Subscription with invalid resource endpoint :: Tes... | PASS | ------------------------------------------------------------------------------ Create new VNF Package subscription :: Test ID: 5.3.5.7.5 | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO not creating ... | PASS | ------------------------------------------------------------------------------ Create duplicated VNF Package subscription with NFVO creating dupl... | PASS | ------------------------------------------------------------------------------ PUT VNF Package Subscriptions - Method not implemented :: Test ID:... | PASS | ------------------------------------------------------------------------------ PATCH VNF Package Subscriptions - Method not implemented :: Test I... | PASS | ------------------------------------------------------------------------------ DELETE VNF Package Subscriptions - Method not implemented :: Test ... | PASS | ------------------------------------------------------------------------------ Get All VNF Package Subscriptions as Paged Response :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ Get VNF Package Subscriptions - Bad Request Response too Big :: Te... | PASS | ------------------------------------------------------------------------------ Subscriptions | PASS | 12 critical tests, 12 passed, 0 failed 12 tests total, 12 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/VNFDInIndividualVNFPackage.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== VNFDInIndividualVNFPackage ============================================================================== Get single file VNFD in Individual VNF Package in Plain Format :: ... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package in Zip Format :: Test ID: 5.3.5... | PASS | ------------------------------------------------------------------------------ Get single file VNFD in Individual VNF Package in Plain or Zip For... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual VNF Package in Plain or Zip Form... | PASS | ------------------------------------------------------------------------------ Get multi file VNFD in Individual VNF Package in Plain Format :: T... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ Get VNFD in Individual VNF Package with conflict due to onboarding... | PASS | ------------------------------------------------------------------------------ POST VNFD in Individual VNF Package - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PUT VNFD in Individual VNF Package - Method not implemented :: Tes... | PASS | ------------------------------------------------------------------------------ PATCH VNFD in Individual VNF Package - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ DELETE VNFD in Individual VNF Package - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ VNFDInIndividualVNFPackage | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackageArtifacts.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== VNFPackageArtifacts ============================================================================== GET Individual VNF Package Artifact :: Test ID: 5.3.5.6.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact in octet stream format :: Test... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with Range Request and NFVO su... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with Range Request and NFVO no... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with invalid Range Request :: ... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with invalid resource identifi... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Artifact with conflict due to onboardin... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Artifact - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Artifact - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Artifact - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Artifact - Method not implemented ::... | PASS | ------------------------------------------------------------------------------ VNFPackageArtifacts | PASS | 11 critical tests, 11 passed, 0 failed 11 tests total, 11 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackageContent.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== VNFPackageContent ============================================================================== GET Individual VNF Package Content :: Test ID: 5.3.5.4.1 | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with Range Request and NFVO sup... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with Range Request and NFVO not... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with invalid Range Request :: T... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with invalid resource identifie... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content with conflict due to onboarding... | PASS | ------------------------------------------------------------------------------ POST Individual VNF Package Content - Method not implemented :: Te... | PASS | ------------------------------------------------------------------------------ Upload VNF Package Content :: Test ID: 5.3.5.4.8 | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: VNFPackageManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ Upload VNF Package Content with conflict due to onboarding state :... | FAIL | Several failures occurred: 1) No keyword with name 'Create Session' found. Did you mean: VNFPackageManagementKeywords.Create Sessions 2) No keyword with name 'Put Request' found. ------------------------------------------------------------------------------ PATCH Individual VNF Package Content - Method not implemented :: T... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Content - Method not implemented :: ... | PASS | ------------------------------------------------------------------------------ VNFPackageContent | FAIL | 11 critical tests, 9 passed, 2 failed 11 tests total, 9 passed, 2 failed ============================================================================== Output: None ++++ Issues in file SOL005/VNFPackageManagement-API/VNFPackageContent.robot ++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackageContentViaURI.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== VNFPackageContentViaURI ============================================================================== Upload VNF Package Content from URI :: Test ID: 5.3.5.5.1 | PASS | ------------------------------------------------------------------------------ Upload VNF Package Content from URI with conflict due to onboardin... | PASS | ------------------------------------------------------------------------------ GET Individual VNF Package Content from URI - Method not implement... | PASS | ------------------------------------------------------------------------------ PUT Individual VNF Package Content from URI - Method not implement... | PASS | ------------------------------------------------------------------------------ PATCH Individual VNF Package Content from URI - Method not impleme... | PASS | ------------------------------------------------------------------------------ DELETE Individual VNF Package Content from URI - Method not implem... | PASS | ------------------------------------------------------------------------------ VNFPackageContentViaURI | PASS | 6 critical tests, 6 passed, 0 failed 6 tests total, 6 passed, 0 failed ============================================================================== Output: None ++++ Dryrun SOL005/VNFPackageManagement-API/VNFPackages.robot [ ERROR ] Error in file '/home/etsi/dev/robot/SOL005/VNFPackageManagement-API/VNFPackageManagementKeywords.robot': Importing test library 'RequestsLibrary' failed: ImportError: No module named 'RequestsLibrary' Traceback (most recent call last): None PYTHONPATH: /usr/local/bin /home/etsi/dev/robot/robotframework-mockserver/src /usr/lib/python35.zip /usr/lib/python3.5 /usr/lib/python3.5/plat-x86_64-linux-gnu /usr/lib/python3.5/lib-dynload /usr/local/lib/python3.5/dist-packages /usr/lib/python3/dist-packages ============================================================================== VNFPackages ============================================================================== GET all VNF Packages :: Test ID: 5.3.5.1.1 | PASS | ------------------------------------------------------------------------------ GET VNF Packages with attribute-based filter :: Test ID: 5.3.5.1.2 | PASS | ------------------------------------------------------------------------------ GET VNF Packages with invalid attribute-based filter :: Test ID: 5... | PASS | ------------------------------------------------------------------------------ Get all VNF Packages with malformed authorization token :: Test ID... | PASS | ------------------------------------------------------------------------------ Get all VNF Packages without authorization token :: Test ID: 5.3.1... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "all_fields" attribute selector :: Test ID: ... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "exclude_default" attribute selector :: Test... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "fields" attribute selector :: Test ID: 5.3.... | PASS | ------------------------------------------------------------------------------ GET VNF Packages with "exclude_fields" attribute selector :: Test ... | PASS | ------------------------------------------------------------------------------ GET all VNF Packages with invalid resource endpoint :: Test ID: 5.... | PASS | ------------------------------------------------------------------------------ Create new VNF Package Resource :: Test ID: 5.3.5.1.11 | PASS | ------------------------------------------------------------------------------ PUT all VNF Packages - Method not implemented :: Test ID: 5.3.5.1.12 | PASS | ------------------------------------------------------------------------------ PATCH all VNF Packages - Method not implemented :: Test ID: 5.3.5.... | PASS | ------------------------------------------------------------------------------ DELETE all VNF Packages - Method not implemented :: Test ID: 5.3.5... | PASS | ------------------------------------------------------------------------------ GET all VNF Packages as Paged Response :: Test ID: 5.3.5.1.15 | PASS | ------------------------------------------------------------------------------ GET VNF Packages - Bad Request Response too Big :: Test ID: 5.3.5.... | PASS | ------------------------------------------------------------------------------ VNFPackages | PASS | 16 critical tests, 16 passed, 0 failed 16 tests total, 16 passed, 0 failed ============================================================================== Output: None Finished: SUCCESS