This book provides administrators, as well as quality and IT managers with an integrated approach to testing SAP solutions. Reader uncover the theory of testing, as well as best practices for conducting a testing project and for the implementation of operation and load tests.

Get a detailed description of the most important SAP-related test tools and discover how the SAP Solution Manager can support you in planning and implementing large test projects and concrete operation tests. In addition, you'll learn the ins and outs of eCATT and familiarize yourself with the Coverage Analyzer and the SAP Test Data Migration Server. Performance tests are covered by the authors in painstaking detail: Profit from the description of a typical performance test project, and learn about the different monitoring options including SAP LoadRunner by Mercury.

The authors provide you with comprehensive reports from well know SAP customers for every essential topic.

Highlights

• Test Theory
• Test Methodology: How SAP Solution Manager Supports Your Project
• Test Management: Test Cases, Test Plans und Test Packages in SAP Solution Manager
• Test Automation: Cost Model and ROI
• Automatic Functionality Tests with eCATT
• SAP Test Data Migration Server
• Coverage Analyzer
• Performance and Stress Tests
• SAP LoadRunner by Mercury
• SAP GUI Scripting
• Monitoring Performance Tests

About the Author(s)

Markus Helfen is Consulting Director of SAP Test Management Consulting, where Hans Martin Trauthwein works as a Senior Consultant. Michael Lauer is a Senior Quality Specialist in the Product Technology Group at SAP AG. All authors have many years of experience in quality assurance and test management and are renowned specialists for SAP test tools.

Table of Contents

Preface ... 13
Foreword ... 15
1 Introduction ... 21

PART I Methodology
2 Theory of Software Testing ... 31
2.1 Test Types ... 31
2.2 Test Stages ... 32
2.3 Black-Box Test and White-Box Test ... 35
2.4 Test Case Design for the Black-Box Test ... 36
2.5 Test Data ... 40

3 Test Methodology ... 43
3.1 Roadmaps in SAP Solution Manager ... 44
3.2 Project Preparation ... 48
3.3 Business Blueprint ... 51
3.4 Realization ... 55
3.5 Final Preparation ... 61
3.6 Go-Live and Support ... 67

PART II Functional Testing
4 Test Management with the SAP Solution Manager ... 71
4.1 SAP Solution Manager ... 72
4.2 SAP Solution Manager vs. SAP Test Organizer ... 78
4.3 Test Case Management ... 81
4.4 Generating Test Plans and Packages ... 105
4.5 Test Execution ... 109
4.6 Status Analysis ... 114
4.7 Integration Scenario ... 119
4.8 Customer Report from BSH Bosch and Siemens Hausgeräte GmbH ... 125
4.9 Customer Report from Reno Fashion & Shoes GmbH ... 134

5 Economic Aspects of Test Automation ... 143
5.1 A Cost Model for Software Testing ... 145
5.2 A Cost Model for Software Errors ... 152
5.3 Overall View ... 155
5.4 Customer Report from INVISTA Resins & Fibers GmbH ... 157

6 Test Automation with eCATT ... 171
6.1 Test Components and Architecture of the Test Landscape ... 172
6.2 Technical Requirements for Implementing eCATT ... 175
6.3 Structure of the eCATT Scripts ... 179
6.4 Testing Transactions without Controls ... 181
6.5 Testing Transactions with Controls ... 189
6.6 Testing Web Dynpro Applications ... 200
6.7 Testing Web Services ... 205
6.8 Integration with External Tools ... 208
6.9 Checking the Results ... 212
6.10 Managing Test Data ... 225
6.11 Modularizing Test Scripts ... 232
6.12 Running eCATT Scripts ... 236
6.13 Debugging eCATT Scripts ... 238
6.14 Overview of the eCATT Versions ... 241
6.15 Further Steps ... 242
6.16 Summary: Advantages of the Integration of eCATT in the SAP System ... 243
6.17 Customer Report from Zürcher Kantonalbank ... 245

7 SAP Test Data Migration Server ... 253
7.1 Functions and System Landscape of the SAP TDMS ... 254
7.2 Customer Report from Behr GmbH & Co. KG ... 261

8 Coverage Analyzer ... 269

PART III Performance Testing
9 Project Outline of a Performance Test ... 279
9.1 Load Test - Stress Test - Volume Test ... 281
9.2 Roles in a Performance Test Project ... 282
9.3 Phase Model of a Performance Test ... 284
9.4 Test Preparation ... 286
9.5 Performing the Load Test ... 295
9.6 Performing the Stress Test ... 300
9.7 Final Report ... 301

10 SAP LoadRunner by Mercury ... 305
10.1 Performance Test for Portal Applications ... 306
10.2 Customer Report by Sanofi-Aventis ... 311

11 Performance Testing Using SAP GUI Scripting ... 321
11.1 SAP GUI Scripting ... 322
11.2 Load Test Architecture ... 323
11.3 Script Development ... 325
11.4 Load Generators ... 327
11.5 Execution Log ... 329
11.6 Availability of the Consulting Solution ... 329
11.7 Customer Report from Universitätsklinikum Würzburg ... 330

12 Monitoring a Performance Test ... 341
12.1 Procedure ... 342
12.2 Transactions for Technical Monitoring ... 348

Appendix ... 361

Index ... 365