TestOptimal Tutorials

BasicMBT - Manual Test Exeution

BasicMBT - Manual Test Execution

This tutorial will cover:

  • Generate test cases from model with BasicMBT
  • Manual Test Case Execution
    • Overview
    • Model Summary
    • Requirements Traceability
    • Execution Status
    • Progress Stats Charts
    • View Existing Defects
    • Test Execution
  • Printable Test Case Report

Test Generation with BasicMBT

Model Property:

  • set Test Output File with filename.html
  • select Test Path Graph Type: MSC or FSM
  • select SeqOut plugin
  • optional - select ALM plugin

Try it with Demo_TestGenToFile model

press down arrow for feature details

Test Generation with BasicMBT

Execute Model

  • Click on to execute model
  • Wait until model execution completes
  • Open TestCase Report

press down arrow for feature details

Test Generation with BasicMBT

Test Case Execution:

Test Case Execution Overview

Manual Test Case Execution is:

  • Interactive Web Application
  • Display, Execute, Document and Track Test Cases
  • Integration with ALM: raise defect

press down arrow for feature details

Test Case Execution Overview

Manual Test Case Execution consists of:

  • Model Summary
  • Requirements
  • Execution
  • Progress Charts
  • Raised Defects
  • Preamble
  • Postamble
  • Test Cases

press down arrow for feature details

Test Case Execution Overview

Screen Layout - Application Header

  • Menu
    • hover mouse to show Navigation Pane
    • Click "P" to pin Navigation Pane

press down arrow for feature details

Test Case Execution Overview

Application Buttons

  • Save
    • save test case execution progress
    • change to orange color when changes made to test cases
    • does not interact with ALM
  • Submit ALM
    • Raise or resolve defects to ALM
    • Visible when ALM Plugin is enabled for the model
    • Save test case changes
  • Print
    • open Test Case Reprort for printing
    • all changes to test cases are reflected

press down arrow for feature details

Test Case Execution Overview

Left Navigation Pane:

  • Pane initially hidden
  • Mouse over Menu to display
  • Mouse away to hide
  • Pin/un-pin by clicking on "P"
  • * - pendng ALM changes
  •   - test case status
  • Click on row to open the section

Section: Model Summary

Brief summary of model and model execution:

  • Left - settings from test cases generation
  • Right - graph showing test coverage
  • "Open Graph in New Window" link -
    open full-scale coverage graph in a new window

Section: Requirements

Requirement coverage and traceability matrix:

  • Requirements listed in column
  • "show tag name" - show requirement tags
  • Column "W" - total weight of transitions,
    for example priority
  • Column "Sz" - number of transitions
    or test case length

Section: Requirements

Requirement coverage and traceability matrix:

  • Test Cases listed in rows
  • Auto assigned test case id
  •   - test case status
  • Click on test case id to open test case
  • Color/shade cell - test/requirement coverage
  • Check/cross mark in cell - test step status

Section: Execution

Shows extensive stats on test cases:

press down arrow for feature details

Section: Execution

  • Test Case Matrix - Test case execution stats
  • Requirement Matrix - Requirement execution stats
  • Run Specific Details - Enter comments

press down arrow for feature details

Section: Execution

Test Case Matrix:

  • Measure - instance count and %
  • Test Case List - test cases involved
  • Total Test Cases - total count of all test cases
  • Completed - test cases in completed state
  • Passed - completed and passed
  • Failed - completed but failed
  • Blocked - completed but blocked
  • Partially Passed - not all steps are completed
  • Not Executed - test cases not yet started
  • Click on test case id to open the test case

press down arrow for feature details

Section: Execution

Requirement Matrix:

  • Measure - instance count and %
  • Requirement List - requirements involved
  • Total Requirements - total count of all requirements
  • Completed - requirements in completed state
  • Passed - completed and passed
  • Failed - completed but failed
  • Blocked - completed but blocked
  • Partially Passed - not all steps are completed
  • Not Executed - requirements not yet started

press down arrow for feature details

Section: Execution

Run Specific Details:

  • Used to document overal test execution
  • Comments are saved
  • Comments reflected in printable version for documentation

Section: Progress Charts

Various charts showing test case stats and progress:

press down arrow for feature details

Section: Progress Charts

Charts are:

  • Requirement Overall Execution
  • Requirement Execution by Test Case
  • Test Case Execution Progress

press down arrow for feature details

Section: Progress Charts

Requirement Overall Execution:

  • Shows completion status of each requirement
  • Chart option - Stacked or Un-stacked
  • Chart type - line chart or bar chart

press down arrow for feature details

Section: Progress Charts

Requirement Execution by Test Case:

  • Shows the breakdown of requirements by
    completion status for each test case
  • Chart option - Stacked or Un-stacked
  • Chart type - line chart or bar chart

press down arrow for feature details

Section: Progress Charts

Test Case Execution Progress:

  • Shows the breakdown of assert items (test steps)
    by completion status for each test case
  • Chart option - Stacked or Un-stacked
  • Chart type - line chart or bar chart

Section: Raised Defects

Shows outstanding defects previously raised by current model:

  • Requires ALM Plugin enabled for the model
  • DEMO-19 - requirement tag
  • BUG_75_50 - defect id
  • Additional Info - context information when defect was raised

Section: Preamble & Postamble

Shows the test set up and teardown instruction output from MBT_start and MBT_end MScript

Section: Test Cases

Execute Test Case and record execution results:

press down arrow for feature details

Section: Test Cases

Test Case Info:

  • Test case length, weight and # of requirements covered
  • Listing of all requirements covered by the test case
  • Test case specific setup instruction
  • At the end
    • Test case specific teardown instruction
    • Tester Name and comments

press down arrow for feature details

Section: Test Cases

Test Case Sequence Graph:

  • Test case traversal on the model
  • Choose graph type before running model:
    • MSC - Message Sequence Chart
    • FSM - Finite State Machine or State Diagram

press down arrow for feature details

Section: Test Cases

Test Case Steps:

  • Test Case consists of Test Steps
  • Test Steps are numbered sequentially
  • Test Step contains Assert Items
  • Assert Item covers one or more requirements
  • Action - test step instruction
  • Assert Expected Results - expected results
    and execution status

press down arrow for feature details

Section: Test Cases

Assert Item:

  • Lowest level executable step
  • Test instruction and test status
  • Fulfil zero, one or many requirements
  • Listed all requirements and defect id
    (to be used if it fails)
  • Test comments

press down arrow for feature details

Section: Test Cases

Setting Assert Item Status:

  • Clicking on box Passed Failed Blocked
  • Clicking on the link to set status for
    all Assert Items in the step
  • Clicking on the link to set status for all
    Assert Items in current Test Case

press down arrow for feature details

Section: Test Cases

Assert Item Status change triggers automatic updates on:

  • Test Case status
  • Execution stats
  • Progress charts
  • Requirement Traceability Matrix

Printable Test Case Report

Click on "Print" button to open Test Case Report:

THE END

Visit other tutorials Here

© TestOptimal LLC.