Software Testing Standard Operating Procedures Software Testing
Software Testing Standard Operating Procedures
Proprietary Information This document contains confidential information relating to FUSION Alliance, Inc., and FUSION Technologies, LL !FUSION" which is pro#ided for the sole purpose of permitting the recipient to e#aluate the document su$mitted herewith. In consideration of receipt of this document, the recipient a grees to maintain such information in confidence and to not reproduce or otherwise disclose this information to an% person outside the group directl% responsi$le for e#aluation of its contents, e&cept that there is no o$ligation to maintain the confidentialit% of an% information which was 'nown to the recipient prior to receipt of such information from FUSION, or $ecomes pu$licl% 'nown through no fault of recipient, or is recei#ed without o$ligation of confidentialit% from a third part% owing no o$ligation of confidentialit% to FUSION.
i
Software Testing Standard Operating Procedures
Revision History Date
Version
Revision Description
Author
()*+*-((-
+.(
Initial document
i'e /oempel
(0*+1*-((-
+.+
2e#ised all sections and added 3efect anagement
i'e /oempel
� -((-
FUSION Alliance
ii
Software Testing Standard Operating Procedures
Tabe of !ontents "#
Discipine$ Software Testing " +.+ Purpose.........................................................................................................................+ +.Scope............................................................................................................................. + +.4 5or'flow 3etail.............................................................................................................. + %# SOP$ Test Panning % -.+ Purpose.........................................................................................................................-.Scope............................................................................................................................. -.4 5or'flow 3etail.............................................................................................................. -.) 2oles..............................................................................................................................-.0 Acti#ities.........................................................................................................................4 -.0.+ Acti#it%6 3e#elop Test /uidelines 4 -.0.- Acti#it%6 Plan Test ) SOP$ Test Design ' 4.+ Purpose.........................................................................................................................0 4.Scope............................................................................................................................. 0 4.4 5or'flow 3etail.............................................................................................................. 0 4.) 2oles..............................................................................................................................0 4.0 Acti#ities.........................................................................................................................7 4.0.+ Acti#it%6 3esign Test 7 (# SOP$ Test Impementation ) ).+ Purpose.........................................................................................................................8 ).Scope............................................................................................................................. 8 ).4 5or'flow 3etail.............................................................................................................. 8 ).) 2oles..............................................................................................................................8 ).0 Acti#ities.........................................................................................................................1 ).0.+ Acti#it%6 Implement Test 1 '# SOP$ Test *+ecution and *vauation , 0.+ Purpose......................................................................................................................... 0.Scope............................................................................................................................. 0.4 5or'flow 3etail.............................................................................................................. 0.) 2oles............................................................................................................................ +( 0.0 Acti#ities.......................................................................................................................++ 0.0.+ Acti#it%6 9&ecute Test ++ 0.0.- Acti#it%6 9#aluate Test +-# SOP$ Defect .anagement "& 7.+ Purpose....................................................................................................................... +4 7.Scope...........................................................................................................................+4 7.4 5or'flow 3etail............................................................................................................+4 7.) 2oles............................................................................................................................ +4 7.0 Acti#ities....................................................................................................................... +) 7.0.+ Acti#it%6 anage 3efects +)
� -((-
FUSION Alliance
iii
Software Testing Standard Operating Procedures
"#
Discipine$ Software Testing
"#"
Purpose The purpose of these SOPs is to guide software testing acti#ities in order to ensure a standard le#el of :ualit% and repeata$ilit% on all software pro;ects.
"#%
Scope The scope of these SOPs is all software testing acti#ities for all FUSION Alliance software engineering pro;ects.
"#&
/or0fow Detai Software Testing
� -((-
FUSION Alliance
+
Software Testing Standard Operating Procedures
%#
SOP$ Test Panning
%#"
Purpose The purpose of this SOP is to guide the Test anager through planning the testing acti#ities on software pro;ects. The purpose of test planning is to identif% and descri$e software testing that will $e conducted. This purpose is accomplished $% generating a Test Plan, which contains the re:uirements for test and test strategies.
%#%
Scope The scope of this SOP is all test planning acti#ities for Fusion Alliance software engineering pro;ects.
%#&
/or0fow Detai Test Panning
%#(
Roes Roe
Test anager
� -((-
FUSION Alliance
Responsibiities •
3e#elops Test /uidelines
-
Software Testing Standard Operating Procedures
%#'
Activities
%#'#"
Activity$ Deveop Test 1uideines
Purpose The purpose of this acti#it% is to de#elop software testing guidelines for a pro;ect.
Roe$ Test anager Timing23re4uency Test /uidelines should $e a#aila$le $efore software testing $egins. This acti#it% is normall% performed in the Inception phase.
Input Artifacts
Output Artifacts
Test /uidelines !Organi
3e#elopment ase
Test /uidelines !re#ised"
Steps +.
2e#iew the 3e#elopment ase
-.
2e#iew the organi
4.
Tailor the Test /uidelines
Artifacts
Test /uidelines
� -((-
FUSION Alliance
Tempates2 *+ampes
Toos
icrosoft 5ord
Ver#
/hen
!ass#
Review Type
+.(
Inception
Should
Informal Internal
&.&
9la$oration
ould
Informal Internal
&.&
onstruction
ould
Informal Internal
&.&
Transition
ould
Informal Internal
=es
4
Software Testing Standard Operating Procedures
%#'#%
Activity$ Pan Test
Purpose The purpose of this acti#it% is to identif% the appropriate focus of the test effort for each iteration, and to gain agreement with sta'eholders on the corresponding goals that will direct the test effort.
Roe$ Test anager Timing23re4uency A Test Plan must $e created during the Inception phase and should $e updated $% the end of each iteration in the 9la$oration and onstruction phases. The initial #ersion of the Test Plan pro#ides an o#er#iew of the test effort o#er the life of the pro;ect, pro#iding foresight into when resources will $e re:uired and when important :ualit% dimensions and ris's will $e addressed.
Input Artifacts
Output Artifacts
Iteration Plan
Software 3e#elopment Plan
Use>ase odel
3esign odel
3eplo%ment odel
Test Plan
Steps +.
Identif% 2e:uirements for Test
-.
Assess Testing 2is's
4.
3e#elop Test Strateg%
).
Identif% Testing 2esources
0.
reate Test Schedule
7.
3efine Test 9n#ironment onfiguration
8.
reate the Test Plan
1.
2e#iew the Test Plan
Artifacts
Test Plan
� -((-
FUSION Alliance
Tempates2 *+ampes
Toos
icrosoft 5ord
Ver#
/hen
+.(
Inception
&.&
!ass#
Review Type
ust
Formal Internal
9la$oration
Should
Formal Internal
&.&
onstruction
Should
Formal Internal
&.&
Transition
ould
Formal Internal
=es
)
Software Testing Standard Operating Procedures
SOP$ Test Design
"
Purpose The purpose of this SOP is to guide the Test anager through designing Test ases. The purpose of test design is to identif%, descri$e and generate the test model and its reported artifacts !test procedures and test cases". Test design is performed so test implementation and e&ecution efforts are efficient and effecti#e.
%
Scope The scope of this SOP is all test design acti#ities for FUSION Alliance software engineering pro;ects.
&
/or0fow Detai Test Design
(
Roes Roe
Test anager
� -((-
FUSION Alliance
Responsibiities •
3esigns test cases
•
9#aluates test co#erage
0
Software Testing Standard Operating Procedures
'
Activities
'#"
Activity$ Design Test
Purpose The purpose of design test is to identif% a set of #erifia$le Test ases for each $uild and test procedures that show how the Test ases will $e reali
Roe$ Test anager Timing23re4uency The initial Test ases are identified during in the 9la$oration phase as soon as there are some use cases or scenarios defined. The Test ases are refined throughout the remainder of the lifec%cle during each iteration.
Input Artifacts
Output Artifacts
Test Plan
Use ases
Supplementar% Specifications
Test /uideline
Iteration Plan
Software Architecture 3ocument
3esign /uidelines
Test ases
Steps +.
See 2UP #ersion -((+A.(0.((
Artifacts
Test ases
� -((-
FUSION Alliance
Tempates2 *+ampes
Toos
icrosoft 5ord, 2ational Testanager
Ver#
/hen
!ass#
Review Type
+.(
Inception
ould
Informal Internal
&.&
9la$oration
ust
Informal Internal
&.&
onstruction
ust
Informal Internal
&.&
Transition
ould
Informal Internal
=es
7
Software Testing Standard Operating Procedures
(#
SOP$ Test Impementation
(#"
Purpose The purpose of this SOP is to guide the Test Anal%st through implementing Test Scripts. The purpose of implementing tests is to record, or generate the Test Scripts for the Test ases that were defined in 3esign Test. The generation of Test Scripts can $e completed either with a test automation tool or manuall% using the Test ase template.
(#%
Scope The scope of this SOP is all test implementation for FUSION Alliance software engineering pro;ects.
(#&
/or0fow Detai Test Impement
(#(
Roes Roe
Test Anal%st
� -((-
FUSION Alliance
Responsibiities •
reates e&ecuta$le and reusa$le Test Scripts !automated or manuall%"
•
reates Test 3ata
•
Performs Smo'e Testing
•
reates Test Suite
8
Software Testing Standard Operating Procedures
(#'
Activities
(#'#"
Activity$ Impement Test
Purpose The purpose of implementing test is to create or generate reusa$le Test Scripts and to maintain tracea$ilit% of the test implementation artifacts $ac' to the associated Test ases and Use ases or re:uirements for test.
Roe$ Test Anal%st Timing23re4uency The initial Test Scripts are created during the test implementation acti#it% as soon as there are some use cases or scenarios implemented. The Test Scripts are modified and * or added to throughout the remainder of the lifec%cle during each iteration.
Input Artifacts
Output Artifacts
Test ases
Test Scripts
Test Procedures
Test ases !2e#ised"
Steps +.
2ecord or generate test scripts
-.
Identif% test>specific functionalit% in the design and implementation models
4.
reate test data
).
reate test $uild for e&ecution
0.
Perform smo'e testing
7.
Trace test cases $ac' to use case re:uirements
Artifacts
Test Scripts
� -((-
FUSION Alliance
Tempates2 *+ampes
Toos
icrosoft 5ord, 2ational 2o$ot, 2ational Testanager
Ver#
/hen
!ass#
Review Type
+.(
Inception
ould
Informal Internal
&.&
9la$oration
Should
Informal Internal
&.&
onstruction
Should
Informal Internal
&.&
Transition
ould
Informal Internal
=es
1
Software Testing Standard Operating Procedures
'#
SOP$ Test *+ecution and *vauation
'#"
Purpose The purpose of this SOP is to guide the Test anager and Test Anal%st through e&ecuting Test Scripts and e#aluating Test 2esults. The purpose of e&ecuting tests is to ensure that the new functionalit% !Integration Testing" or complete s%stem !S%stem Testing" functions as intended. The s%stem integrator compiles and lin's the s%stem in increments. 9ach increment needs to go through testing of the functionalit% that has $een added, as well as all tests the p re#ious $uilds went through !regression tests". 5ithin an iteration, %ou will e&ecute integration and s%stem testing se#eral times until the whole s%stem !as defined $% the goal of the iteration" functions as intended and meets the test?s success or completion criteria. The purpose of e#aluating tests is to generate and deli#er the Test 9#aluation Summar%. This is accomplished $% re#iewing and e#aluating the Test 2esults, identif%ing and logging software defects, and calculating the 'e% measures of test. The Test 9#aluation Summar% presents the test results and 'e% measures of test in an organiof>test and the :ualit% of the test p rocess.
'#%
Scope The scope of this SOP is includes e&ecuting the test for $oth integration and s%stem testing for all FUSION Alliance software engineering pro;ects.
'#&
/or0fow Detai Test *+ecution and *vauation
*+ecution
� -((-
FUSION Alliance
*vauation
Software Testing Standard Operating Procedures
'#(
Roes Roe
Test anager
Test Anal%st
� -((-
FUSION Alliance
Responsibiities •
9#aluates test results, and test effecti#eness
•
/enerates the Test 9#aluation Summar%
•
9#aluates test co#erage and test effecti#eness
•
anages testing ris's
•
9&ecutes test cases and scripts
•
9#aluates test results
•
Logs defects
•
reates test log
+(
Software Testing Standard Operating Procedures
'#'
Activities
'#'#"
Activity$ *+ecute Test
Purpose The purpose of e&ecuting tests is to e&ecute and capture test results. Those results should $e #erified and defects logged as necessar%.
Roe$ Test Anal%st Timing23re4uency The test results are captured during the e&ecution of test. Since test e&ecution ma% occur man% times during the de#elopment lifec%cle, test results should $e captured and stored in such a wa% that the% can $e re#iewed and e#aluated indi#iduall% for each instance of test e&ecution.
Input Artifacts
Test @uild
Test Scripts
Output Artifacts
Test 2esults
Steps +.
9&ecute Test @uild !scripts and procedures"
-.
9#aluate Test 9&ecution
4.
erif% Test 2esults
).
Log new defects
0.
Perform regression testing when necessar%
Artifacts
Test 2esults
� -((-
FUSION Alliance
Tempates2 *+ampes
Toos
icrosoft 5ord 2ational Testanager
Ver#
/hen
!ass#
Review Type
+.(
Inception
ould
Informal Internal
&.&
9la$oration
ust
Informal Internal
&.&
onstruction
ust
Informal Internal
&.&
Transition
ould
Informal Internal
No
++
Software Testing Standard Operating Procedures
Activity$ *vauate Test
'#'#%
Purpose The purpose of e#aluating tests is to e#aluate the test results and log change re:uests, calculate and deli#er the 'e% measures of test and generate the Test 9#aluation Summar%.
Roe$ Test anager Timing23re4uency The Test 9#aluation Summar% is created in the test e#aluation acti#it%. This acti#it% ma% occur se#eral times during an iteration.
Input Artifacts
Output Artifacts
Test 2esults
Test 9#aluation Summar%
Test Log
Steps +.
/enerate Test Log
-.
Anal%
4.
anage defects to completion
).
9#aluate Test o#erage
0.
Anal%
7.
3etermine if Test ompletion and Success riteria ha#e $een achie#ed
8.
/enerate Test 9#aluation Summar%
Artifacts
Test Log
Test 9#aluation Summar%
� -((-
FUSION Alliance
Tempates2 *+ampes
Toos
icrosoft 5ord icrosoft 9&cel
icrosoft 5ord
Ver#
/hen
!ass#
Review Type
+.(
Inception
ould
Informal Internal
&.&
9la$oration
ust
Informal Internal
&.&
onstruction
ust
Informal Internal
&.&
Transition
ould
Informal Internal
+.(
Inception
ould
Formal Internal
+.(
9la$oration
ust
Formal Internal
&.&
onstruction
ust
Formal Internal
&.&
Transition
ould
Formal Internal
=es
=es
+-
Software Testing Standard Operating Procedures
-#
SOP$ Defect .anagement
-#"
Purpose
The purpose of this SOP is to define how FUSION Alliance manages defects. This procedure is the FUSION Alliance standard process for trac'ing and managing defects on pro;ects. 2ational learBuest, ompuware Trac'2ecord or icrosoft 9&cel is used to trac' all software defects. -#%
Scope
The scope of the 3efect anagement SOP is all FUSION Alliance software pro;ects. -#&
/or0fow Detai Defect .anagement
-#(
Roes Roe
Test anager
Test Anal%st
� -((-
FUSION Alliance
Responsibiities •
anages defects
•
Assigns defects
•
loses defects
•
Logs defects
+4
Software Testing Standard Operating Procedures
Roe
Responsibiities •
� -((-
FUSION Alliance
2e>test defects
+)
Software Testing Standard Operating Procedures
-#'
Activities
-#'#"
Activity$ .anage Defects
Purpose The purpose of managing defects is to identif%, resol#e and measure defects or incidents found in the software product.
Roe$ Test anager Timing23re4uency At the conclusion of e#aluating test results, all defects should $e su$mitted into a defect management tool.
Input Artifacts
Output Artifacts
Test 2esults
Software 3efect
Steps +.
Su$mit 3efect
-.
Assign 3efect
4.
Fi& 3efect
).
2esol#e 3efect
0.
lose 3efect
Artifacts
Software 3efect
� -((-
FUSION Alliance
Tempates2 *+ampes
Toos
2ational learBuest ompuware Trac'2ecord icrosoft 9&cel
Ver#
/hen
!ass#
Review Type
N*A
Inception
ould
Informal Internal
N*A
9la$oration
Should
Informal Internal
N*A
onstruction
Should
N*A
Transition
ould
=es
Informal Internal Informal Internal
+0