IDE & Navigation
Properties & Tools
Stats Tab shows MBT execution stats collected by TestOptimal. Both current MBT execution and historical executions can be accessed from this tab. The stats are divided into sections:
Execution Summary shows basic settings and progress status for the current MBT execution. These information includes:
Model Coverage shows the coverage of the model by the MBT execution in real-time (refresh to get the latest stats from the execution):
Test Coverage shows the detailed coverage of the model in state and transition traversals.
Clicking on the blue under columns L1 - L5 will bring up the error window showing the error message as well as the link to the screenshot if a screenshot was taken at the time when the error was detected.
Requirements Coverage shows the coverage on requirements associated with the states, transitions as well as dynamically registered in script: See Tags Details for more details.
If you want to save this stat, click on the button “Save”. If will add this stat to the historical executions.
When running Concurrent models to orchestrate model executions, you must save the stats first and re-open the stats by selecting it in “Runs” tab. Then you will see a dropdown list displayed listing all models involved in the execution batch. The execution batch is also available from SvrMgr when model is run against SvrMgr.
By default, the current MBT execution is displayed. Stats tab does not automatically refresh. You may refresh the stats by clicking on . If you are viewing past execution and want to go back to current MBT execution, just select the Current Execution from the Stats Desc drop-down list.
Execution results can be saved for future review or comparison. To save the current MBT execution, hover mouse over on the far right of the header and select Save menu item. You will be prompted to enter a brief description for the execution. The stat description you've enter is also used as an identifier later to access this execution. We suggest to keep the description short to make it easier to identify and access.
By default, the maximum number of executions can be saved is set to 5, but you can adjust this setting to fit your needs with Model Property. When the number of executions exceeds this limit, the oldest execution will be removed automatically to make room for the new executions.
Past executions saved are listed in Stats Desc drop-down list. You can access any of the past execution by selecting from the drop-down list.
Past executions are used to determine the statistical range (3-sigma range) for each state and transition traversal. This statistical range gives you 95% confidence level that any traversal of that state or transition must fall within.
Past executions can be deleted by selecting Delete from the hover menu on the far right on the header.