Hi Eric,
Glad to see that the VVP validation scripts are actively being leveraged.
There are many HEAT requirements enumerated in the VNFRQTs project and the requirement you highlighted (R-20856) has been there since Amsterdam (although we have more recently restructured that section so that each requirement is individually numbered). We are constantly adding to the VVP validation script repository as we work towards a goal of having complete coverage of all HEAT MUST/MUST NOT level requirements verified by a VVP validation scripts. The validation script in question was added as part of the Casablanca release.
I understand the impact that environment file parameters can have when doing manual testing - we're looking into ways to handle this so that these kind of errors can be toggled when doing manual testing/instantiation. Ultimately, our goal is to have a validation suite that verifies that the HEAT template provided is ONAP-compliant HEAT and ready for onboarding – but here’s a couple of workarounds you can use when manually testing:
There is one script that tests for environment file compliance - test_environment_file_parameters.py . If you are running the tests from the command and you remove this file, running the test suite will not flag an error for parameters that ARE/ARE NOT in the environment file. Alternatively, you can also ignore errors from this script while performing validations on templates that will be manually instantiated.
Our weekly calls are Tuesdays 11 AM ET, are you able to join one to discuss more?