This page aims to list the current existing tests or validation process, and try to list what they are actually testing.
These tests are using the python Robot Framework. They basically run a series of commands and mark the result as success or failure depending on a condition. Since we can provide custom libraries in Python, these tests can be quite customizable. They also have a timeout concept, failing the test after some time. Another great advantage is the report it's providing, making it easy to check what succeeded or failed.
They are packaged with the standalone in the validation tenant, and can be triggered using the different punch-robot commands. To make it more simple,
activate.sh is available in the robot dir of validation tenant. A robot test can be run according to the file hierarchy or tags, allowing to only run
a specific set of tests. Of course, they must be able to run on a deployed punch.
To run a full test suite on a fresh standalone, you can simply unzip your standalone archive and run
script. It will automatically install your standalone, start your standalone and run all robot tests. You can then find
a report of these tests in the Reports Page.
Unit tests using JUnits are meant to test the code. The most code coverage we have, the safer we are. A report is generated during the building process and included in the Reports Page. An organized list of these tests can be found there.