Saturday, July 4, 2009

Automation Fundamental Concepts

What is Test Automation ?

Software Test Automation is the process of automating the steps of manual test cases using an automation tool Or utility to shorten the testing life cycle with respect to time…

When application undergoes regression, some of the steps might be missed out or skipped which can be avoided in Automation…

Automation helps to avoid human errors and also expedite the testing process…

To implement the Test Automation detailed planning and effort is required

Automation saves time and effort which results in reduction of the Test life cycle…

Benefits of Automation
- Consistency of Test Execution
- Reducing cycle time of regression test cycles
- Data driven testing
- Repeatability
- Coverage
- Reliability
- Reusability of test wares

Automation life cycle is a subset of the entire test life cycle…
Automation planning can be initiated in parallel to the test planning phase…
Factors to be considered in automation planning,
Stability of AUT (Application under test)
No of regression cycles to be performed
Compatibility of App platform with testing tools
Cost benefit analysis (ROI)
Availability of skilled resources

Regression Testing & Automation
When Automation is applicable?

Regression Testing Cycles are long and iterative.

If the application is planned to have multiple releases / builds

If it’s a long running application where in small enhancements / Bug Fixes keeps happening

Test Repeatability is required

QTP At a Glance …..

Introduction to QTP
(QuickTest Professional)
“The Mercury advanced keyword-driven testing solution”
Technologies Supported
Default Support
1. Standard Windows applications
2. Web objects / Applications
3. ActiveX controls
4. Visual Basic applications

Additional QuickTest add-ins Support,
1. Java
2. Oracle
3. SAP Solutions,
4. .NET Windows
5. Web Forms,
6. Siebel,
7. PeopleSoft,
8. Web services,
and terminal emulator applications.

Testing Process with QTP

Quick Test Pro involves 3 main stages:
Creating Test scripts

Running Tests

Analyzing Test Results

Creating Tests
Create a test script by recording a manual test scenario on the AUT (Application Under Test) using QTP.

Quick Test Pro graphically displays each step users perform in the form of a collapsible, icon based tree view in QTP’s Keyword View.

Running Tests & Analyzing Test Results
Running Tests:
Once the test scripts are recorded / created, next step is to execute them…While running (executing) the tests Quick Test Pro connects to the web site or AUT and performs each operation in the test as performed manually while recording / creating tests (test scripts)…
Debugging Test : To identify and eliminate the defects in the test scripts.
Analyzing Test Results:
Once the test scripts are executed, test results and the summary can be viewed for result analysis.

Add-in Manager

Default Add-ins
Visual basic

Other Add-Ins
.Net and many more

QTP’s Add-in Manager facilitates the users to select the technology / environment from variety of environments suitable for the AUT (Application Under Test)

Once an add-in is loaded, users can record that application in its supported environment and thus QTP recognizes the objects specific to the application under test (AUT) as loaded through Add-in Manager.

It is critical for the users to know the development technologies / environment of AUT, and load right Add-Ins while invoking Quick Test Pro.

Record & Run Modes

Recording Modes
Low level

Run Modes
Options -> General
Best Practices for General Options:
Deselect all check boxes except “Save data for integrating with performance testing …” and “Display Add-in Manager on startup” which is default setting.

Click on “Restore Layout” button to reset screens to the initial setting when QuickTest was first installed.

Options --> Run

Best Practices for Options for Run Mode:
Run Mode as Normal:
This ensures that the execution arrow appears to help with trouble shooting the tests.
Synchronization becomes better for the AUT (Application Under Test)

Test Results:
Deselect the option “View Results when run session ends”

Mercury Tool Integration:
Select "Allow other Mercury products to run tests and components“

Screen Capture:
Save step screen capture to results "On error and warnings"

Record and Run Settings

Best Practices for Record & Run Settings,
Set the options to configure QTP to "Record and run test on any open Windows- based application“

Set the option - This window will appear the first time you click on the Record button in the new test.

Manually recall this window by selecting Test Record and Run settings

QTP - Main Window

QTP - Main Window
Test Pane:
Test Pane contains two labs to view the tests,
- Keyword View
- Expert View

Keyword View:
Quick Test Pro displays your test in the form of a collapsible, icon based tree…

Expert View:
Quick Test Pro displays the source code (VB Script) of the tests in this view.

Data Table :
Data table assists in Parameterizing the tests…

Debug Viewer Pane :
It assists in debugging tests with the help of
Watch Expressions, Variables, and Command.

Quick Test Pro Commands :
The Quick Test Pro commands can be chosen from the menu bar or from a Tool bar.

File Tool bar :
File tool bar contains buttons for managing the test.

Test Tool bar :
Test tool bar contains buttons for the commands used when creating or maintaining the tests…

Debug Tool Bar :
It contains buttons for commands used when debugging the steps in the tests…

Action Tool Bar :
To view all actions in the test flow or to view the details of a selected action…

No comments: