Skip to content
Snippets Groups Projects

NFV API Conformance Test Specification

Last edited by Giacomo Bernini

Table of Contents

NFV API Conformance Test Specification

This repository hosts the NFV API Conformance test specification for the APIs defined in ETSI NFV GS SOL002, SOL003, SOL005, SOL009, SOL011 and SOL012.

Currently available versions are v2.4.1 (published), v2.6.1 (published), v2.7.1 (published), v2.8.1 (published), v3.3.1 (published), v3.5.1 (published), v3.6.1 (published), v4.3.1 (published), v4.4.1 (published), v4.5.1 (published), v5.1.1 (published)

The Test Specification is built as a collection of Robot Framework Test Description. Robot Framework is a generic test automation framework for acceptance testing and acceptance test-driven development.

Content structure

This repository is following the structure of the ETSI NFV GS SOL002, SOL003, SOL005, SOL009, SOL011 and SOL012 specifications. It includes a dedicated folder for each of these NFV spec, with individual sub-folders for every interface in the given specification, following this structure:

    <spec_name>/<interface_name>

e.g.

    SOL002/VNF-Configuration-API/

For each of the interface sub-folders, a list of Robot Framework files is included, each providing the set of Test Cases related to a given resource endpoint within the reference interface. In addition, the following sub-folders are included:

    <spec_name>/<interface_name>/jsons
    <spec_name>/<interface_name>/schemas/
    <spec_name>/<interface_name>/environment/

The jsons folders include the templates for the JSON requests to be issued automatically issued by the Test System. The tester is expected to fill or complete the content of these JSON requests according to the tests to be executed.

The schemas folders include the JSON schemas for requests and reponses over the . They are extracted from the SOL002, SOL003 and SOL005 OpenAPIs.

The environment folders include the list of variables and parameters used in the Robot Framework Test Cases. The tester is expected to value these variables according to the tests to be executed.

In addition, a set of inter-connected test cases have been developed for SOL003 to improve the level of automation of the test suite. These are available in version 4.5.1 and 5.1.1 of the NFV API conformance test suite, under the folder:

    interconnectedTestCases/SOL003/

Dependencies and Preconditions

The main precondition for running the tests is having Robot Framework installed. The Robot Framework Installation Instructions provide full details of the installation procedure. For those familiar with installing Python packages with pip package manager, the following command can be run to install Robot Framework:

$ pip install robotframework

Robot Framework >3.0 is recommended for this NFV API Conformance Test Specification. It requires Python 3.

Robot Framework Required Libraries

The Robot Framework Test Cases in this repository depend on the following libraries:

A pip requirements file is provided to ease the installation of the required python libraries, as follows:

$ pip install -r requirements.txt

Robot Framework IDE

It is recommended to use the Robot Framework Eclipse plugin (RED) for a user-friendly browsing of the Test Cases. The RED Installation Instructions provides full details of the installation procedure.

The RED Usage Instructions describes how to use the plugin. RED is fully compliant with Robot Framework 3.0 and can be also used to run the Test Cases.

Running Tests

You need to configure the needed files in the json folder and the variables in the environment folder with proper values.

e.g. to execute the tests in

SOL002/VNF-Configuration-API

, you need to take the file

json/vnfConfigModifications.json

coming with the tests as an example, and replace the place holders such as "string" with the meaningful values for the current tests.

The Robot Framework Test Cases in this repository can be executed with the following command:

$ robot <name_of_the_robot_file>

To execute all test case files in a directory recursively, just give the directory as an argument. You can also give multiple files or directories in one go and use various command-line options supported by Robot Framework.

For more information about the command-line usage, you can run:

$ robot --help

The Robot Framework User Guide provides full details on how to execute tests in general.

Comments

    Please register or sign in to add a comment.