• Learn to develop and perform functional and load tests and to build test systems with SAP TDMS
• Detailed description of SAP Solution Manager, eCATT, SAP Quality Center by HP, SAP TAO, and more
• Includes 13 comprehensive and in-depth customer case studies

The test tools and services provided by SAP are numerous and rich in functionality. In this book, you will not only learn what these tools can do for you and how they work together, you will also benefit from detailed instructions on how to use them. Dedicated chapters on methodology for functional and performance tests as well as detailed reports from projects with renowned SAP customers make this book your ultimate guide for setting up and maining your QA processes.

Tools
Whether you need information on SAP Solution Manager, eCATT, SAP TDMS, SAP TAO, SAP LoadRunner, or SAP Quality Center by HP, you will benefit from in-depth introductions on functional scope and usage of every tool.

Functional and Performance Tests
Test for both functionality and performance in your system. Learn about the basic differences of these test types, and find out how to reliably test the performance of your applications.

Test Automation
Are your test budgets notoriously tight? The authors show you how to leverage test automation to significantly reduce your testing costs.

Methodology
Design and scope of test data, scheduling, selecting the right tools, and staffing: all questions related to planning and organizing test projects are answered in detail.

Customer Case Studies
Benefit from existing experience. Numerous customer reports—including three 5-year sustain-ability reports—demonstrate how test managers in different industries deal with the specific challenges in test projects.

Highlights

Tools
   • SAP Solution Manager
   • eCATT
   • SAP Test Data Migration Server
   • SAP LoadRunner by HP
   • SAP Quality Center by HP and SAP TAO
Test methodology
   • Test strategy and standards
   • Roadmaps and project planning
Test management and automation
   • Planning and performing tests
   • Monitoring and reporting
   • Benefits and execution of test automation
Test Center
   • Concept and implementation
   • Test Center services

The Authors

M. Helfen is head of consulting for ALM-related topics at SAP Consulting in the DACH region. H.M. Trauthwein is a board member at Sofis AG, Germany. Both have years of experience with software QA and with test managment using SAP test tools.

Table of Contents

• ... Preface to the Second Edition ... 15
• ... Foreword to the Revised and Extended Second English Edition ... 19
• ... Foreword to the Second Edition ... 21
• ... Foreword to the First Edition ... 27
• 1 ... Introduction ... 31
• PART I ... Methodology ... 41
• 2 ... Theory of Software Testing ... 43
• 2.1 ... System Changes Necessitate Testing ... 43
• 2.2 ... Test Types ... 47
• 2.3 ... Test Stages ... 49
• 2.3.1 ... Test Stages in the General V-Model ... 49
• 2.3.2 ... Test Stages in SAP Projects ... 53
• 2.4 ... Black-Box Testing and White-Box Testing ... 56
• 2.5 ... Test Case Design for Black-Box Testing ... 57
• 2.5.1 ... Equivalence Class Partitioning ... 58
• 2.5.2 ... Boundary Value Analysis ... 60
• 2.5.3 ... Error Guessing ... 61
• 2.6 ... Test Data ... 62
• 2.7 ... Basic Procedures for Planning and Execution ... 62
• 2.7.1 ... Test Preparation ... 63
• 2.7.2 ... Test Case Creation ... 65
• 2.7.3 ... Test Planning and Execution ... 65
• 2.7.4 ... Test Evaluation ... 66
• 2.8 ... Selecting Test Tools ... 66
• 2.8.1 ... Types of Test Tools ... 66
• 2.8.2 ... Tool Selection and Implementation ... 72
• 2.9 ... Conclusion ... 75
• 3 ... Test Methodology ... 77
• 3.1 ... Roadmaps in SAP Solution Manager ... 78
• 3.1.1 ... Project Phases ... 80
• 3.1.2 ... Roadmaps ... 85
• 3.2 ... Project Preparation ... 90
• 3.3 ... Business Blueprint ... 95
• 3.3.1 ... Mapping Business Process Structure ... 95
• 3.3.2 ... Test Standards ... 98
• 3.4 ... Realization ... 101
• 3.5 ... Final Preparation ... 109
• 3.6 ... Go-Live & Support and Run ... 119
• 3.7 ... Conclusion ... 121
• PART II ... Functional Testing ... 123
• 4 ... Test Management with SAP Solution Manager ... 125
• 4.1 ... Testing in the Context of SAP Enterprise Support, Run SAP, and SAP Standards for Solution Operations ... 127
• 4.2 ... SAP Solution Manager Enterprise Edition ... 131
• 4.2.1 ... Application Management Lifecycle ... 131
• 4.2.2 ... Work Center ... 137
• 4.2.3 ... Adapter and Functional Enhancements ... 141
• 4.2.4 ... Projects and Solutions ... 143
• 4.3 ... SAP Solution Manager—Basic Settings ... 146
• 4.4 ... Project-Related Testing with SAP Solution Manager ... 152
• 4.4.1 ... Creating a Project ... 152
• 4.4.2 ... Creating the Process Structure ... 161
• 4.4.3 ... Integrating Test Cases ... 164
• 4.4.4 ... Creating Test Plans and Test Packages ... 167
• 4.4.5 ... Extended Functionality for Creating Test Plans and Packages ... 171
• 4.4.6 ... Test Execution ... 182
• 4.4.7 ... Status Analysis ... 186
• 4.5 ... Integration Scenarios ... 193
• 4.5.1 ... Test and Service Desk ... 194
• 4.5.2 ... Test and Change Request Management ... 198
• 4.5.3 ... Test and Quality Gate Management ... 201
• 4.5.4 ... Test and Diagnostics ... 203
• 4.5.5 ... Test and IT Reporting ... 206
• 4.6 ... Solution-Related Testing ... 209
• 4.7 ... Summary ... 212
• 4.8 ... Customer Report by SOKA-BAU ... 215
• 4.9 ... Customer Report by SEWAG ... 229
• 4.10 ... Customer Report by BSH Bosch und Siemens Hausgeräte GmbH ... 241
• 4.11 ... Update of the Customer Report by BSH Bosch und Siemens Hausgeräte GmbH ... 251
• 4.12 ... Customer Report by Reno Fashion & Shoes GmbH ... 260
• 4.13 ... Update of the Customer Report by Hamm-Reno-Group GmbH & Co. KG ... 268
• 5 ... Project-Related Testing with SAP Solution Manager and SAP Quality Center by HP ... 275
• 5.1 ... SAP Quality Center by HP ... 276
• 5.2 ... SAP Solution Manager Adapter for SAP Quality Center by HP ... 279
• 5.3 ... Test Management in the SAP Quality Center by HP ... 282
• 5.3.1 ... Creating a Project and Process Structure in SAP Solution Manager ... 282
• 5.3.2 ... Managing Requirements ... 285
• 5.3.3 ... Creating Test Cases ... 289
• 5.3.4 ... Test Planning and Execution ... 290
• 5.3.5 ... Creating and Managing Error Messages ... 292
• 5.3.6 ... Versioning and Traceability ... 294
• 5.3.7 ... Status Analysis ... 302
• 5.3.8 ... Transferring the Test Results to SAP Solution Manager ... 308
• 5.4 ... Summary ... 309
• 5.5 ... Customer Report by Endress+Hauser Group ... 309
• 5.6 ... Customer Report by DB Systel GmbH ... 323
• 6 ... Supporting Test Automation with SAP TAO ... 337
• 6.1 ... Basic Principle: Automation Through Composition ... 338
• 6.2 ... Components of and Prerequisites for SAP TAO Technology ... 340
• 6.3 ... Using SAP TAO to Create Test Cases ... 343
• 6.3.1 ... Using the Process Flow Analyzer to Create Test Components and Test-Case Designs ... 345
• 6.3.2 ... Using the Inspection Procedure to Create Test Components ... 348
• 6.3.3 ... Composing Test Cases ... 351
• 6.3.4 ... Defining Test Data ... 353
• 6.3.5 ... Consolidating Test Scripts ... 354
• 6.3.6 ... Planning and Executing the Tests ... 356
• 6.4 ... Using SAP TAO to Maintain Test Cases ... 356
• 6.5 ... Summary ... 360
• 7 ... Economic Aspects of Test Automation ... 361
• 7.1 ... Cost Model for Software Testing ... 363
• 7.1.1 ... Cost of Designing Test Cases ... 363
• 7.1.2 ... Cost of Test Tools ... 364
• 7.1.3 ... Costs of Implementing Test Automation ... 369
• 7.1.4 ... Costs of Maintaining Test Cases ... 370
• 7.1.5 ... Costs of Implementing a Test Cycle ... 372
• 7.1.6 ... Testing Costs When Creating Component-Based Test Cases ... 372
• 7.1.7 ... Individual Test Cost Model ... 377
• 7.2 ... Cost Model for Software Errors ... 378
• 7.2.1 ... Errors Not Detected During Software Testing ... 379
• 7.2.2 ... Errors Detected During Software Testing ... 381
• 7.3 ... Overall View ... 382
• 7.4 ... Summary ... 383
• 7.5 ... Customer Report by INVISTA Resins & Fibers GmbH ... 383
• 7.6 ... Update to Customer Report by INVISTA Resins & Fibers GmbH ... 397
• 8 ... Test Automation with eCATT ... 411
• 8.1 ... Implementation and Prerequisites ... 412
• 8.1.1 ... Architecture of the Test Landscape and eCATT Fundamentals ... 412
• 8.1.2 ... Structure of the eCATT Test Scripts ... 418
• 8.1.3 ... Technical Requirements ... 422
• 8.1.4 ... Summary ... 425
• 8.2 ... Creating and Running UI-Driven Tests ... 426
• 8.2.1 ... Testing Transactions without Controls (TCD) ... 426
• 8.2.2 ... Testing Transactions with Controls (SAP GUI) ... 434
• 8.2.3 ... Testing Web Dynpro Applications ... 449
• 8.2.4 ... Summary ... 457
• 8.3 ... Creating Tests Via Direct Program Control ... 457
• 8.3.1 ... Testing Global ABAP Object Classes ... 457
• 8.3.2 ... Function Modules and BAPIs ... 458
• 8.3.3 ... Inline ABAP ... 459
• 8.3.4 ... Database Accesses ... 460
• 8.3.5 ... Summary ... 461
• 8.4 ... Creating Tests for Web Services ... 461
• 8.5 ... Integration with External Test Tools ... 465
• 8.6 ... Implementing Checks ... 470
• 8.6.1 ... Testing Parameters ... 471
• 8.6.2 ... Direct Testing of Values ... 473
• 8.6.3 ... Message Handling ... 474
• 8.6.4 ... Parameterization of Message Handling ... 480
• 8.6.5 ... Checking Tables ... 482
• 8.6.6 ... Summary ... 483
• 8.7 ... Managing Test Data ... 483
• 8.7.1 ... Test Configuration ... 483
• 8.7.2 ... Variants ... 485
• 8.7.3 ... Test Data Container ... 485
• 8.7.4 ... Runtime Data Container (RDC) ... 491
• 8.7.5 ... Test Data Container Programming Interface (TDC-API) ... 492
• 8.7.6 ... Summary ... 493
• 8.8 ... Modularizing Test Scripts ... 493
• 8.9 ... Additional eCATT Commands ... 497
• 8.10 ... Starting, Logging, and Analyzing Test Executions ... 503
• 8.10.1 ... Running eCATT Scripts ... 503
• 8.10.2 ... Logging eCATT Tests ... 507
• 8.10.3 ... Log Archiving ... 510
• 8.10.4 ... Automated Performance Analysis ... 511
• 8.10.5 ... Error Analysis for eCATT Scripts ... 515
• 8.10.6 ... Summary ... 518
• 8.11 ... Overview of the eCATT Versions ... 519
• 8.12 ... Further Steps ... 521
• 8.13 ... Summary: Advantages of the Integration of eCATT in the SAP System ... 521
• 8.14 ... Customer Report by Zürcher Kantonalbank ... 524
• 9 ... SAP Test Data Migration Server ... 531
• 9.1 ... Data Privacy for Test Data Collection ... 533
• 9.2 ... Process Types ... 535
• 9.3 ... Architecture and System Landscape ... 543
• 9.4 ... Data Transfer and Extraction ... 545
• 9.5 ... Creation and Refresh of Test Systems ... 547
• 9.6 ... Summary ... 550
• 9.7 ... Customer Report by Behr GmbH & Co. KG ... 551
• 9.8 ... Customer Report by Infineon Technologies AG ... 559
• PART III ... Performance Tests ... 567
• 10 ... Project Outline of a Performance Test ... 569
• 10.1 ... Load Test—Stress Test—Volume Test ... 571
• 10.2 ... Roles in the Performance Test Project ... 572
• 10.3 ... Phase Model of a Performance Test ... 574
• 10.4 ... Planning ... 575
• 10.4.1 ... Process Analysis ... 576
• 10.4.2 ... Data Analysis ... 581
• 10.4.3 ... Selecting the Load Test Tool ... 583
• 10.4.4 ... The Load Profile ... 583
• 10.5 ... Performing the Load Test ... 584
• 10.5.1 ... Data and System Preparation ... 585
• 10.5.2 ... Single-User Test ... 586
• 10.5.3 ... Multi-User Tests ... 587
• 10.5.4 ... Result Analysis ... 588
• 10.5.5 ... Optimization ... 588
• 10.6 ... Performing the Stress Test ... 589
• 10.7 ... Completing ... 590
• 10.7.1 ... Executive Summary ... 590
• 10.7.2 ... Action Plan ... 591
• 10.7.3 ... Description of the Test Structure ... 591
• 10.7.4 ... Description of the Test Goals ... 592
• 10.7.5 ... Documentation of the Test Execution ... 592
• 10.7.6 ... Lessons Learned ... 592
• 10.8 ... Summary ... 593
• 11 ... SAP LoadRunner by HP ... 595
• 11.1 ... LoadRunner Virtual User Generator ... 597
• 11.2 ... LoadRunner Controller and LoadRunner Agent ... 600
• 11.3 ... LoadRunner Analysis ... 602
• 11.4 ... SAP Performance Center by HP ... 603
• 11.5 ... Summary ... 607
• 11.6 ... Customer Report by HeidelbergCement AG ... 608
• 11.7 ... Customer Report by Sanofi-Aventis ... 616
• 12 ... Monitoring a Performance Test ... 627
• 12.1 ... Sample Process In Case Performance Problems Occur ... 628
• 12.2 ... Localization of Performance Bottlenecks ... 630
• 12.3 ... Transactions for Technical Monitoring ... 634
• 12.3.1 ... AL08: List of all Users Logged On ... 634
• 12.3.2 ... SM04: User List ... 635
• 12.3.3 ... SM12: Lock Entry List ... 636
• 12.3.4 ... SM21: System Log ... 637
• 12.3.5 ... SM66: Global Work Process Overview ... 638
• 12.3.6 ... STAD: Transaction Analysis ... 639
• 12.3.7 ... ST02: Overview of SAP Buffers ... 640
• 12.3.8 ... ST04: Database Overview ... 642
• 12.3.9 ... ST05: SQL Trace Analysis ... 643
• 12.3.10 ... ST06: OS Monitor ... 645
• 12.3.11 ... ST22: ABAP Runtime Error ... 647
• 12.4 ... Summary ... 648
• PART IV ... Test Center ... 649
• 13 ... Test Center ... 651
• 13.1 ... Setting Up a Test Center ... 653
• 13.2 ... Test Center Services ... 656
• 13.3 ... Summary ... 660
• 13.4 ... Customer Report by Deutsche Telekom AG ... 660
• ... Appendices ... 691
• A ... SAP Solution Manager Test Workbench vs. SAP Test Organizer ... 693
• B ... SAP NetWeaver Knowledge Warehouse—Functionality in SAP Solution Manager ... 697
• C ... Recommended Reading ... 701
• D ... The Authors ... 703
• ... Index ... 705