Review of HP Service Test 11

Review of HP Service Test 11


Unlike QTP 11, Service Test 11 is a major upgrade from Service Test 9.53. HP is touting ST 11 as “an extensibility framework for construction and execution of a functional test of headless systems that do not have a user interface.” Some of the notable changes:

  • Visual Test Designer — A canvas that creates and configures a visual representation of the steps in a test. Tests are created by dragging activities from a toolbox, and configuring their properties.
  • Multiple Technologies — Support for a variety of technologies such as Web Services, REST, .NET, Java, and more.
  • Flexible Data Handling — The ability to link to a variety of data sources, or store data locally with a test. Support for Excel data sheets.
  • Extensibility — The behavior of existing activities can be customized using event handlers. For greater control over the flow of a test, program code activities can be programmed at any point during a test.

New API Focused UI

My thoughts are that Service Test is no longer built on Loadrunner’s Vugen. Instead, it has been re-designed from the ground up, beginning with a new “modern” drag-and-drop user interface.

Use C# for Your API Tests

Unlike QuickTest Pro, which uses wimpy VBScript, ST 11 uses C#, which is a full-blown, “real man’s” programming language. HP has even revamped the famous Mercury Tours website sample to utilize web services.

I have to be honest here — I’m personally on the fence about HP’s decision to move away from Vugen. I kind of liked having a one-script solution (LR) that used the same protocol for both functional and performance testing. ST 11 scripts can still be used for load tests, but since it uses C#, I’m not clear as to how scalable tests will be compared to the Vugen equivalent.

Integrate API tests with QTP an ALM

I also like the ST 9.53 “business component” script functionality that could be integrated with Quality Center; ST 11 does not have this feature. So, it appears as though testers who have built up a large test suite of web service business components will be out of luck if they move forward with ST 11.00.

In any case, I can see why HP decided to make the change. After working with the new version, I have to admit that it’s considerably more user-friendly. QTP engineers will most likely need a minimal learning curve to get up to speed with it. QTP 11 has the ability to call ST 11 scripts, making it easier to do end-to-end testing of an application. I’ll need a little more time to evaluate the changes, but so far I say, “Well done, HP.”

To see a video demo of HP Service Test 11 check out my post

Adi Barda - October 5, 2010

ST 11.0 has much much more than a new user-friendly designer for composing tests. It has a solid framework which supports easy extensibility of the product (the ability to add new technologies, activities and user interface) , Lean API for composing tests without using the UI which is great for system integrations and automation pro, Application Life-cycle Management integration, superb support for data driven tests and ability to add you custom hooks using modern C# (.net 3.5) code. In addition the web services parser was redesigned and now can handle even the largest WSDLs available.
Composing headless tests is fun with the new ST :)

MaRenins Collins - December 15, 2010

Hello Joe,

Can you test a web service using Service Test 11, if you have an XML file instead of a WSDL? Other words, does ST 11 require that you have a WSDL file for enter input data? I ask this because we want to use JMS instead of using SOAP. Thanks in advance for your help.

    Joe Colantonio - December 15, 2010

    @MaRenins Collins: Hi MaRenins, Yes — you can test JMS Service Test 11. ST was built not only for SOA testing but any kind of headless technologies. I have not tried testing JMS yet but under the ST’s toolbox they have a JMS folder that contains the following activities that you can perform:


    Publish Message to Topic – Publishes a message to multiple subscribers using a JMS topic
    Receive Message from Queue – Receives a message from a JMS queue
    Receive Message from Topic -Receives a message through a JMS topic
    Send Message to Queue – Send Message to Queue
    Send and Receive Message from Queue – Publishes messages to multiple subscribers and receives them using a JMS queue
    Subscribe to Topic – Subscribes to messages using a JMS topic

    Hope this helps. Thanks for your question! Joe

MaRenins Collins - December 15, 2010

Thanks Joe. I appreciate your help.

    Sunny Chalotra - May 1, 2013

    Hi MaRenins Collins,

    Did you get any success on configuring HP Service Test for soap over Jms call? If yes, can you please share the steps to do the same as i am facing issue while doing the same. Getting error- Failed to invoke JMS service, initial context factory is missing or wrong eventhough they are correct as in tested the same with Jmeter.

      Joe Colantonio - May 3, 2013

      Sunny Chalotra » Hi – yes I did get it to work with ActiveMQ. IF you send me your email I will forward you the eBook I’m writing that includes a chapter on using ST with JMS.

        Soumya Nayak - May 7, 2013

        Hi Joe,

        Presently, I am facing the same issue as Sunny faced. Can you please send me the eBook where I can follow the steps and do the set up. I appreciate your help on this. Thanks…!!

        Sunny - May 7, 2013

        THanks Joe.

        I need to test API Service forn which i am trying to make a JMS connection with the help of Standard Protocols. I selected JMS – send and receive message from Queue. each time i am getting an error- Initial context factory is missing or wrong.
        When i Tested the same service with Jmeter, it worked.
        Not sure where i am making mistake. Can you please send me a sample service for whcih you created a JMS call and also please let me know if connection is ssl, where to intall certs for successful connection.

          JP - December 2, 2013

          Hi Joe,

          Presently, I am facing the same issue configuring a SOAP/JMS tests in UFT 11.52. Can you please send me the eBook where I can follow the steps and do the set up. I appreciate your help on this. Thanks…!!

          Joe Colantonio - December 5, 2013

          Hi can you please go to my contact page and send me a message including your email to send the book to?

Sen - March 16, 2011

Hi Joe,

I would like to know if multiple requirements can be mapped to a single test in service test. Also, I see that there is a option called “solution” where in you can import multiple tests (Existing/new pointing to different requirements). But i also see that i have to run each tests in a solution manually one after the other. Is there an option in service test to trigger these tests automatically one by one without me running it everytime one after the other?


    Joe Colantonio - March 24, 2011

    Sen » Hi Sen – Are you using Quality Center? I know you can link multiple requirements to QTP or service test and can string test together using the QC test lab. If you don’t have QC you should be able to use ST command line options in a .bat file to string test together. Take a look at pg 251 in the User guide for command line syntax. I have not done anything with Service Test solutions options – sorry hope this helped. thanks for your question. Cheers ~ Joe

Sen - March 28, 2011

Thanks Joe for your inputs!! We do not have QC. Need to check the command line option.

Victor - April 23, 2011

Hi Joe, do you know if I can test Tibco Services en ST 11.0

    Joe Colantonio - April 29, 2011

    Victor » Sorry it took me so long to get back to you — for some reason your comment was in my Spam folder:( I have not tried it but as long as you have a valid WSDL I think you should be able to test a Tibco service in Service Test 11.

Suresh - April 27, 2011

hello Joe Colantonio
What is advantage or difference between QTP(addin Web service) and HP service test while automating the web service

    Joe Colantonio - April 28, 2011

    Suresh » Hi Suresh – I just created a blog post for your question. Hope it helps. Check out
    Service Test 11 vs. QTP with WebService Add-in: What’s the Difference?:

    Thanks for the question!

Bryan Linder - July 11, 2011

RE: ST components, as of May 1st of this year, QTP licensing moved from Functional Test (QTP with all add ins) to ONLY being sold as Unified Functional Testing (QTP with all add ins, plus Service Test, the Service Test Management QC plug in module, and a new UI between the two that supports calling Service Tests from QTP tests). So even though ST 11 doesn’t support direct components anymore, QTP 11 can now call ST 11 from within a component, execute both from within BPT, and let you know what layer (process, application or headless) a bug is found in in the new execution reporting tool. I just got my hands on it, and am looking forward to proving out that it works as well for us as I’m hoping based on all the data papers.

    Joe Colantonio - July 11, 2011

    Bryan Linder » Thanks Bryan for this update! I hope you’ll let use know what you find with “Functional Test”. I know that Service Test 11.10 added BPT functionality. What I’m confused by is ‘Functional Test” is simply a name change for using both QTP and ST or is it a new separate product all together? For example if I currently have QTP 11 and ST 11.10 installed is this the same as “Functional Test”?? I’m going to download it myself and see – maybe it will inspire a new blog post. Cheers ~Joe

Ashok - November 28, 2011

Hi Joe,

What is the difference b/w SoapUI Pro and HP Service test 11.0 and which is a better tool for Web Services testing?


    Joe Colantonio - November 29, 2011

    Ashok » Hi Ahok this is a great question. I think I should actually do a blog post on it. My quick answer is it depends. SoapUI Pro cost a lot less then ST. But ST dies integrate nicely with QTP. If you are currently don’t use any HP products like QC or QTP and you want to just test web services then I would choose SoapUI Pro. Thanks for the question! Cheers~Joe

Indu - January 4, 2012

Hi Joe,
Is there any way to export results (captured data) from HP service test either to Quality Center or to Excel?

    Joe Colantonio - January 5, 2012

    Indu » Hi Indu – Yes its possible In Service Test to write data, returned from a web service response, to an Excel file. To see step by step instructions on how to do this check out my post ST – How to Write a Web Service Response to Excel. Hope this helps! Cheers~Joe

Partho - January 5, 2012

Hi Joe

Is there a way to develop a web based UI which would interact with HPST and provide a rich GUI for the end users?
Also, is there a way to have a J2EE application interact with HPST?

    Joe Colantonio - January 11, 2012

    Partho » Anything is possible :) ST can read database,text files and java jar files. One approach might be (I have not tried) that you could create a web front-end that writes data to a db and create a st framework that reads from the db and takes appropriate action. Also instead of reinventing the wheel I would check out business process testing with ST and Quality Center. In ST 11.20 you can now create Business Components with Service Test which allow you to use QC as a user friendly web front-end. Hope this helps. Cheers~Joe

Sachin Walukar - May 4, 2012

Hi Joe,
In my case, we have changing environment with every build. So here we have to change WSDL also, provide me the way to do this, like we do in QTP. Setting inputs in Configuration file.
Please do revert on this.

Many Thanks !

Madhusudhan - May 19, 2012


Good to see your response all the queries on HPST11.20. I have one query here that, Is there any way(API) we can interact with HPST 11.20 tool for test step creation, data driven and Execution without Drag and Drop Interface? And also, is that possible to execute 9.5.3 version of scripts using 11.20 version thru QC?. Your reply for these queries are greatly appreciated.


Mathews - June 12, 2012

I have tons of ST 9.5 Vugen scripts. In order to reuse these Vugen scipts, I

1. Downloaded HP loadrunner with just Vugen.
2. Opened the Vugen script using HP load runner (only once)
3. Opened ST11 and created a new test
4. Dragged the ‘Call Virtual User generator script’ from the Unified Functional Testing activity
5. Selected the Vugen script to run
6. Execute the ST11 script.

I haven’t been successful in printing the Vugen script output to ST 11 output window. Appreciate if someone would help me.


Sachin Walukar - June 29, 2012

Hey Joe,

Actually I need the way to Configure Endpoint information dynamically. That is my test case whe running should take endpoint from config file.

Thanks !

    Joe Colantonio - June 29, 2012

    Sachin Walukar » I guess I don’t understand what you are trying to do. The post shows how to read (take) an endpoint value from a file to use as an endpoint value in ST.

Vijay - July 11, 2012

Hi Joe,

I have a problem in Hp service test.

Hp Service test 11 is crashed during excel upload.
1. Open the Hp service test tool.
2. Created service test with available services in the WSDL.
3. Go View -> Data window.
4. Click downward arrow after “New” and click on Excel option.
5. Browse the excel file.( the file is in the Share drive and i have tried with the file in local drive)
6. With the default options, click on OK button.

After step 6 HP service test 11 is closed automatically.
Is there anything am i missing or is it a problem in Hp service test?

    Joe Colantonio - July 11, 2012

    Vijay » Hi Vijay what version of HP Service Test are you using? The earlier version’s of ST are buggy – you should have at least ST 11.20 with patch 5 installed.

Vijay - July 12, 2012

Thanks Joe,

I am using Hp Service test 11.00 Build 3440. Do i need upgrade?

    Joe Colantonio - July 12, 2012

    Vijay » Yes – HP recommends everyone upgrades to at least 11.20 with Patch 5 as it contains multiple critical fixes.

Sachin Walukar - July 27, 2012

Thanks Joe…!

Here I am facing problem during Endpoint set up. I got one solution for this, I think it is posted by you only. FInd below link:

Actually I am able to set up dynamic endpoint, but there we also need to configure same endpoint in WS Addressing as a part of security settings. But there I didnt find any solution to configure it as like dyanamic endpoint set up.

As there is no any way to link WS Addressing endpoint to file or anything.

Please suggest on the same. Because we have done a lot in this tool, also we have brought this tool in production but only because of this issue, we are stuck.

Thanks !
Sachin Walukar

    Joe Colantonio - July 27, 2012

    Sachin Walukar » Hi Sachin – sounds like you should be able to do this using custom code. I’m able to set user permissions using ST’s HttpRequestHeaders.Add method. Would you be you able to use this for the WS addressing?

      Sachin - August 1, 2012

      No it didnt work in my case. Please share your email ID so that I can forward you exact snaps of what I want..?

      Thanks !

        Joe Colantonio - August 1, 2012

        Sachin » Hi – if this is still a question about security you might want to contact HP support. I’m out of ideas. Any one else have any suggestions? My email is

abc - July 31, 2012

Can I compare response of two services in Service Test?If yes, if you could explain us how can we do it,that will be great.
e.g I have a services for getting responses from midtier and SAP.I want to validate that response from midtier and SAP returned same value.

    ramu - November 13, 2013

    i am facing same above problem can any one help me on this.

Shoid - August 2, 2012

With Service Test can you do multiple check points on the same test? (I have a value which will be for Loop 4 times for different year (2009,2010,2011,2012) and I want to validate as it goes to each loop for year I can validate a point in 2009, another in 2010 and so on?

    Joe Colantonio - August 6, 2012

    Shoid » When you data-drive a test in Service Test using the ‘Data Drive’ option under the Property Sheet you should be given and option to Data Drive “Both Input and Checkpoints’. Under the data window should appear a spreadsheet for _Input and _Checkpoints. Is this feature not working for you?

Balaji - August 10, 2012


I am new to the HP service test and started the REST service testing. I could able to create the sample REST request for adding the fax number and receiving all the fax number added to the DB. Based on the response, i want to make sure that Test4 is added successfully.


In Vugen, I can able capture the specific value from the response by using lr_web_reg_save_param… Do we have any option like this on Service test?

    Joe Colantonio - August 14, 2012

    Balaji » Hi Balaji if I understand your issue correctly I think you should be able to use a checkpoint to verify that the value appears in the response. Under the property sheet for the HTTP Request there are some “Response Body” options for Checkpoints that you can add. If that does not work you can also create Custom Code and use the args.Checkpoint object to create a custom Checkpoint event. Hope this helps you. Cheers~Joe

Balaji - August 23, 2012

Thanks you so much!

Balaji - August 23, 2012


I have few question on the service testing.
1. How to call the Data source value in custom coding to compare the response with data source value.
2. I have defined one method, in that URL field, i have include some static text and also some predefined data from Local table. Is it possible to map at the template level. Bcoz i can able to do that from Canvas once i drag that into here.


Andre - September 14, 2012

Does anyone know if Service Test and HP LoadRunner can co-exist on the same server?

    Joe Colantonio - September 14, 2012

    Andre » Yes – I have LR 11.5 and Service Test 11.20 on the same system. You can’t have LR 9.5 with the service test 11.x on the same machine. What versions are you using?

preeti - December 5, 2012

Hi Joe,

I need to check the particular value from entire xml,not by using node number.
How to put the check points using built check points in or using Xpath

Best Regards,

Kaushik - January 11, 2013

Hi Joe,

I’m trying to execute test scripts created using HP Service Test 11.20 from Test Lab of QC However HP Service Test scripts are not being executed and getting the following error
“object reference not set to an instance of an object”

I have tried after installing all of these patches but it didn’t work

What could be the reason ? Does QC 10 allow HP Service Test scripts created in version 11.20 to be executed from test lab ?

    Joe Colantonio - January 16, 2013

    Kaushik » Not sure why you are getting this error. It should works since I’m able to run ST 11.20 test from QC. Does this happen for all tests? Does it happen against all lab machines?

Sandeep - January 17, 2013

Hi All,

I would say SOAPUI is far far better than this i believe as i worked on both the tools i prefer to use SOAPUI..


    Joe Colantonio - January 17, 2013

    Hi Sandeep – I like soapUI also but I think the integration between QTP and ST is a big difference between the two tools.

rahul - January 30, 2013

Hi all,
i want to automate tibco designer by qtp automation tool

can any 1 help me with this..

Thank you

Upendra - February 6, 2013


I’m trying to create data-driven tests for HTTP requests. I would like to create requestheaders dynamically based upon the given data. Please let me know if there is any provision for this.

    Joe Colantonio - February 7, 2013

    Upendra » Hi would something like this work for you? In Service Test, click on your Web Service activity and navigate to the “Events” property sheet. Within the “Events” property sheet, for the event named “OnSendRequest” select the handler named “OnsendReq”. By double-clicking on “OnsendReq” you be taken to an editor window for the file TestUserCode.cs where you will be able to add custom code to the “OnsendReq” event. To add HTTP header information use the following code syntax:

    public void OnsendReq(object sender, HP.ST.Ext.WebServicesActivities.ActivityProcessRawMessageEventArgs args)
    this.StServiceCallActivity4.HttpRequestHeaders.Add(“My_key”, “My_value”);

Pratt - February 13, 2013

I have a different issue not sure whether anyone has faced this issue before in HP service test 11.2. In one of my service, the response XML differs from SOAPUI and HP service test 11.2. For example the response with 10 different cars, the SOAPUI displays all the 10 car details whereas ST displays only 3 car details only.

Any help is highly appreciated.


    Joe Colantonio - February 16, 2013

    Pratt » HI Pratt – do you see this in both the HP report and the ST run details?

cetejas - February 25, 2013

How i can download patches of QTP 11?, which resolved Swfwindow object recognising issue…

annapurna - April 9, 2013

Can Service Test be using to test ESB? if yes, what would be the procedure?

    Joe Colantonio - April 18, 2013

    annapurna » When you say ESB I assume it stands for (Enterprise service bus)- I have not tried. If the ESB exposes an API/web/REST Service that allows you to interact with it than I would say ST might work

Mahendra K - May 31, 2013

Hi Joe,

Nice to see all your posting with replies and solutions.I need a kind of document from which we can easily understand the HP ST. Could you please share if you have something with you.

Mahendra K

    Joe Colantonio - June 10, 2013

    Mahendra K » I’m working on my first e-book for how to use HP UFT API (AKA service test). Its taking me awhile but it’s almost done. If you join my email list you should receive an update when I finally release it.

Kumar - June 17, 2013

Joe ,
Wanted to know on the QTP usage and feasibility along with any specific features and commands for a scenario on :
1. Machine A which has the QTP software installed.
2. Machine B which needs to be remotely connected from Machine A. This machine B has the Web applications, primarily an ERP like PeopleSoft applications. The interfaces, functionalities and process[like payroll, job code addition] needs to be tested [Functional Testing] for a Regression kind of scenario. This Machine B doesnot have the QTP software installed.
3. The machine B which needs to be remotely connected keeps changing. Eg Machine B at one point of time can be a peoplesoft 8.0 version and at other times this Machine B could be actually Machine C with different version of Peoplesoft 8.5 etc.
In essence the remotely connected machines keep changing for each test case execution.
Does QTP or its versions support this kind of automation of functional testing. If yes would appreciate any heads-up information on the same.What kind of challenges or tips/tricks one needs to be aware of in this case of test automation. Thank you.

    Joe Colantonio - June 19, 2013

    Kumar » If I understand correctly you want to be able to run a QTP script against a machine that does not have QTP installed on it? IF this is correct QTP needs to be run locally on every machine.

Kumar - June 20, 2013

Joe > Thanks for your reply.
Wanted to understand if any tool or QTP supports the scenario stated.
To clarify further, QTP or automation software can be installed in one machine and this doesnot have the web application.
Web application to test and record is in another machine which doesnot have a QTP software installed.

One remotely connects to this machine to launch the web application.Application is accessed from the browser of the remote machine and not from the browser of the local machine.

In this case, can we record or script the actions and process of the remote machine from the local machine where the QTP is installed. Any known challenges or this framework of scripting and recording is not possible.

Thank you.

Vivek Gupta - April 3, 2014

Hey Joe, I need to understand the workflow of JMS with UFT-ST. I want to understand the steps as to how can retrieve message from a JMS queue. Since, I am making asynchronous service calls, it results in storing the actual response in to that JMS queue. Please let me know the procedure to retrieve the message from JMS queue as there are hardly any documentation for the same and that API guide hardly helps. Thanks in advance :)

Shalini - April 24, 2014

Hi Joe,

I am trying to create a load test for web services. What exactly should I be preparing to start with? if the web service has to be .wsdl only?

Need some guidance from you. Please suggest.

sairam - June 5, 2014

Will UFT supports Tibco EMS 7.0.1 version

Thanks and Regards,

Supriya Raj - December 8, 2014

Hello Joe,
I wanted to modify the XML parameter values before loading it and sending the request,
I am able to modify the XML (Before Execution)but it doesnt change the value while executing

Click here to add a comment

Leave a comment: