Blog to understand automation concepts in QTP, Selenium Webdriver and Manual Testing concepts

Unified Functional testing: Understanding New Features

Unified functional testing 11.5 is latest from HP on functional automation testing. Previously I worked with QTP 11.0, and there are many changes in QTP 11 and UFT 11.5. Let me share the changes that I encountered and new features in UFT 11.5. Unified functional testing helps to work with API  as well as GUI together and the IDE has changed a lot from QTP 11.

1. UI Interface: 


Interface for UFT 11.5 has changed a lot from QTP 11 and it seems as if I was working on a completely new tool.

a.   Creating a new test:

Now we can create an API Test as well as GUI Test. API Test is for testing API Interface whereas GUI Test is the normal test or QTP Test that we have been creating in the past.
creating a new test in QTP

b.   Keyword View: 

We cannot  view Keyword view and expert view in UFT 11.5 together. To view Keyword view, We have to select View>Keyword View. To go back from keyword view to expert view, select View>Editor.
How a test looks in UFT

c.   UFT 11.5 provides easy navigation to functions/classes in the editor as shown in the below screenshot.

d.   Menu Option have changed a lot In UFT 11.5, with separate menu item for ALM, and redesign and menu options shuffled from one tab to another.

e.   Provides creating solution in which we can manage test documents including tests, function libraries, business components and test flows.


2.Using Solution explorer

we can work with multiple tests in the solutions and can edit, manage multiple tests at the same time.

3.   One of the new features of UFT 11.5 is Insight for object Identification

, an image-based identification ability to recognize objects in your application based on what they look like, instead of using properties that are part of their design. This can be useful if you are working with an application whose technology is not supported by UFT, or with an application running on a remote computer. This is a new feature and will be discussed in details in next articles.

4.   Using File content checkpoint

we can verify the content of file and can be useful for comparing Pdf files or contents of PDF file. PDF, HTML, Word, TXT, and RTF file types are supported.

5.  UFT supports testing for QT and Adobe flex Applications.

6.  Supports Microsoft Office and plug-in controls.

7.  In API Testing, Using the soapUI to API Test conversion tool, you can convert soapUI tests to UFT API tests.

8.  With UFT, new versions in different environment are supported that were not supported in QTP 11

9.  Start Page of Unified function testing provide links to new features, communities, useful links, and support. Using this we can connect to other users for forum support and information.

10. We can set preference to automatically export run results in HTML or PDF format after every run session through Tools > Options > General tab > Run Sessions

11. Bitmap checkpoint now enables to specify multiple areas to compare or ignore within the bitmap checking. It also supports checking whether a specific image appears anywhere within the runtime bitmap. 

Test Estimation : Understanding Test Efforts Calculation

Estimates plays very important role in successful projects as incorrect estimates can lead to time crunches , or improper resource utilization in case of excessive time in estimates.
In this article we will discuss various factors in estimation and how to create good estimates in a testing project.
Before providing estimates, we need to know the requirements of the project. First step before any testing task including test plans and estimates is to know what we are delivering to the client. Once we are clear on the requirements, we need to define the tasks that need to be done as exit criteria for the project. 


We have to answer following points before progressing with estimates:


1.   What is the time required to set-up the basic infrastructure. This includes acquiring resources, testing tools, setting up environment and training requirements of resources.

2.   What are the testing types we are performing in project? Does it include automation testing, API Testing, and other testing types?

3.   What is the Software Development Life cycle followed in the project, i.e. it is agile, waterfall or V-model, if iterative, what is the scope of each iteration.

4.   Is this project new phase of an existing project or a version of existing application to released in the current project.

5.  Techni Experience of resources working in Project. This helps to determine the time for preparing test artifacts.


So Once we know answers to above questions, we need to create a WBS document most preferably in Microsoft Project which helps in defining the tasks with time estimates, resources overloading  and defining milestones in project. Below points should be considered while creating the Work Breakdown Sheet.


1.  First of all create the high level milestone for the project. This can be various phases of the project or iterations of project in and agile methodology.


2.  Now create subtask for each milestones of the project. This will include tasks like test planning, test review, test execution, test data preparation for various forms of testing and regular team meetings.


3.  Task test planning, test review, test data preparation and test execution requires further breakdown of requirements into test scenarios and further into Test cases. Once the requirements are broken down into test scenarios/ test cases, we require estimates for each of the tasks.

Example: 


  • Suppose we have 250 test cases in an application for a particular milestone. We need to define time for test planning, test review, test execution, and test data preparation for each of the test artifact, can be test case for manual execution and test script in automation testing. Automation testing will also include task for framework development.

  • Now divide each of the test cases based on test complexity into high, medium and low complexity. Dividing and allocating time for each test case using test case complexity is very useful in case of large number of test cases where estimates for a particular test case in not feasible and time required for each test case is more or less uniform based on complexity. In this approach, time estimates are provided for test cases based on complexity. For e.g.  10 hours for test case preparation for high complexity, 6 hours for medium complexity, and 4 hours for low complexity.

  • In Point b), we provide test estimates based on complexity and was useful since time for test cases was uniform and there was large set of test cases. 

  • In case the project has 10 requirement of varying complexity, like 1 requirement will take 100 hours and other 2 hours, So Rather providing estimates based on complexity, we can define the estimate based on past experience of users, and provide below time:
    • Min Time to complete the task
    • Worst Scenario Time to complete the task.
    •  Average time to complete the task

  • We can calculate the average of above time to calculate time to complete the task. While providing the estimate as calculated in step c) we must take into consideration resources experience in the application and technology.

4.   We can provide time for each of the tasks in the work breakdown sheet. Summing time for all the activities will give us the test efforts required in the project.


5.   We further need to assign task to different types of resources based on the tasks and can provide resourcing estimates  for the project. we can define the resources utilization during different phases of project .


I will try to cover further in future articles on estimates things I might have missed here.



Creating First Test in Selenium IDE using FireFox

Starting working with Selenium IDE:

1. Before Working with Selenium IDE, we will need to have mozilla firefox installed in the machine.
2. Also plugins and add-ons for using Selenium needs to be installed from selenium official webSite.
3. Once the add-ons are properly installed, To Open Selenium IDE, go to Web Developer>Selenium IDE or Press "Ctrl+Alt+S"


Understanding Selenium IDE

Below Figure explains various components of Selenium IDE



File Menu - File Menu provides the options to create a new test case, test suite, and the test suite can be exported to Ruby/Java/c# Web Driver or Remote Control.
Recording - Recording starts automatically on launching the IDE.
Test Run - Icon to run  all tests or individual tests is available on Selenium IDE
Test Execution Speed - Test execution script can be set as fast or slow as shown  in figure 1.


Creating First Test in Selenium IDE

Recording starts automatically once we launch Selenium IDE, and perform some action on the Firefox browser.Once some action is performed, the action is displayed is command , e.g : Click , Open, etc. Target displays the property of object on which command is to executed and value is value to be set in input.

Assertions and Verification can not be done during recording and needs to be added manually.Difference between assert and verify Commands is test execution stops once assert statement fails but test execution continues to next step if we execute the Verify command, although the test status fails in both cases.

Tips for adding command: 
User is provided with all the possible commands on a object when Selenium IDE is open. 

Steps:
1. Right Click on an object in Firefox browser.
2. Click on Show All Available Commands>Select the required Command.
3. Command will be added in the test.


Adding command to selenium test