Testing VVP for Casablanca, I noticed some modifications on the tests executed.
VVP now tests that the meta-data parameters (vnf_id, vnf_name, vf_module_id, ...) must not be enumerated in HOT env file.
A VNF’s Heat Orchestration Template’s
I can also state that the documentation is better aligned with the code and that the new theme for the documentation is better and easier to read. A new step for the usability. Congrats to VVP,VNFRQTS teams and to Rich !
I also believe that we should keep track about evolutions between various release.
Glad to see that the VVP validation scripts are actively being leveraged.
There are many HEAT requirements enumerated in the VNFRQTs project and the requirement you highlighted (R-20856) has been there since Amsterdam (although we have more recently restructured that section so that each requirement is individually numbered). We are constantly adding to the VVP validation script repository as we work towards a goal of having complete coverage of all HEAT MUST/MUST NOT level requirements verified by a VVP validation scripts. The validation script in question was added as part of the Casablanca release.
I understand the impact that environment file parameters can have when doing manual testing - we're looking into ways to handle this so that these kind of errors can be toggled when doing manual testing/instantiation. Ultimately, our goal is to have a validation suite that verifies that the HEAT template provided is ONAP-compliant HEAT and ready for onboarding – but here’s a couple of workarounds you can use when manually testing:
There is one script that tests for environment file compliance - test_environment_file_parameters.py . If you are running the tests from the command and you remove this file, running the test suite will not flag an error for parameters that ARE/ARE NOT in the environment file. Alternatively, you can also ignore errors from this script while performing validations on templates that will be manually instantiated.
Our weekly calls are Tuesdays 11 AM ET, are you able to join one to discuss more?