Differences

This shows you the differences between two versions of the page.

Link to this comparison view

tutorial:comb_data_modeling [2020/06/11 03:39]
admin [Build Model]
tutorial:comb_data_modeling [2021/01/05 03:00]
Line 1: Line 1:
-====== Tutorial: Combinatorial Modeling and Test Generation ====== 
- 
-Learning Objectives: 
-  * [[#What is Combinatorial Model?]] 
-  * [[#Build Model]] 
-  * [[#Generate Test Cases]] 
-  * [[#Make Changes]] 
- 
-===== What is Combinatorial Model? ===== 
-Combinatorial Model is an abstraction and representation of a combinatorial problem. 
- 
-Combinatorial Model consists of a list of variables with each variable having a set of domain values to be tested. The objective is to produce the least number of permutations of variable values to achieve the desired degree of interactions among variables. 
- 
-Consider three variables with each variable has a domain of 10 possible values.  If we were to test all possible permutations, we would have to create 10x10x10 = 1000 test cases.  We would rarely do this as full permutations in most cases is overkill, unnecessary, and sometimes impossible.  
- 
-So if we were to reduce the test cases to test, which of the 1000 test cases can we cut? 
- 
-According to {{https://csrc.nist.gov/projects/automated-combinatorial-testing-for-software | NIST research}} showed that most software bugs and failures are caused by one or two parameters (variables), with progressively fewer by three or more. 
- 
-//TestOptimal// provides a set of combinatorial algorithms to produce the least number of permutations to cover the desired degree of interactions.  After the model is built, we can choose the appropriate algorithms to generate sufficient test cases to meet our testing needs. 
- 
-In the example above, suppose we want to ensure every pair of variables are tested, we could use Pairwise algorithm to generate the test cases and the result is 99 test cases, which is 10% of 1000 test cases. 
- 
-  
- 
-===== Build Model ===== 
-To create a combinatorial model, clicki on {{wiki:overview:ide_btn_open.png?16}} on the toolbar or clicking on menu //File / Open/New Model//: 
- 
-{{wiki:overview:ide_menu_file.png?200}} 
- 
-The //Menu File List// opens: 
- 
-{{wiki:overview:tut_new_model.png?200}} 
- 
-By default it opens at the root folder //model// Navigate to the folder that you want the new model to be stored and click on {{wiki:overview:tut_comb_btn_new.png?20}} to create combinatorial model. 
- 
-Enter the model name at the New Model prompt: 
- 
-{{wiki:overview:ide_newmodel_prompt.png?300}} 
- 
-The new model is open in //IDE// like this: 
- 
-{{wiki:overview:tut_comb_new_model.png?600}} 
- 
- 
- 
-===== Generate Test Cases ===== 
- 
- 
-===== Make Changes ===== 
- 
- 
- 
-===== =====