Review of HP Service Test 11

Unlike QTP 11, Service Test 11 is a major upgrade from Service Test 9.53. HP is touting ST 11 as “an extensibility framework for construction and execution of functional test of headless systems that do not have a user interface.” Some of the notable changes:

  • Visual Test Designer — A canvas that creates and configures a visual representation of the steps in a test. Tests are created by dragging activities from a toolbox, and configuring their properties.
  • Multiple Technologies — Support for a variety of technologies such as Web Services, REST, .NET, Java, and more.
  • Flexible Data Handling — The ability to link to a variety of data sources, or store data locally with a test. Support for Excel data sheets.
  • Extensibility — The behavior of existing activities can be customized using event handlers. For greater control over the flow of a test, program code activities can be programmed at any point during a test.
  • My thoughts are that Service Test is no longer built on Loadrunner’s Vugen. Instead, it has been re-designed from the ground up, beginning with a new “modern” drag-and-drop user interface.

    Unlike QuickTest Pro, which uses wimpy VBScript, ST 11 uses C#, which is a full-blown, “real man’s” programming language. HP has even revamped the famous Mercury Tours web site sample to utilize web services.

    I have to be honest here — I’m personally on the fence about HP’s decision to move away from Vugen. I kind of liked having a one-script solution (LR) that used the same protocol for both functional and performance testing. ST 11 scripts can still be used for load tests, but since it uses C#, I’m not clear as to how scalable tests will be compared to the Vugen equivalent.

    I also like the ST 9.53 “business component” script functionality that could be integrated with Quality Center; ST 11 does not have this feature. So, it appears as though testers who have built up a large test suite of web service business components will be out of luck if they move forward with ST 11.00.

    In any case, I can see why HP decided to make the change. After working with the new version, I have to admit that it’s considerably more user friendly. QTP engineers will most likely need a minimal learning curve to get up to speed with it. QTP 11 has the ability to call ST 11 scripts, making it easier to do end-to-end testing of an application. I’ll need a little more time to evaluate the changes, but so far I say, “Well done, HP.”

    To see a video demo of HP Service Test 11 check out my post


    1. says

      ST 11.0 has much much more than a new user-friendly designer for composing tests. It has a solid framework which supports easy extensibility of the product (the ability to add new technologies, activities and user interface) , Lean API for composing tests without using the UI which is great for system integrations and automation pro, Application Life-cycle Management integration, superb support for data driven tests and ability to add you custom hooks using modern C# (.net 3.5) code. In addition the web services parser was redesigned and now can handle even the largest WSDLs available.
      Composing headless tests is fun with the new ST :)

    2. MaRenins Collins says

      Hello Joe,

      Can you test a web service using Service Test 11, if you have an XML file instead of a WSDL? Other words, does ST 11 require that you have a WSDL file for enter input data? I ask this because we want to use JMS instead of using SOAP. Thanks in advance for your help.

      • Joe Colantonio says

        @MaRenins Collins: Hi MaRenins, Yes — you can test JMS Service Test 11. ST was built not only for SOA testing but any kind of headless technologies. I have not tried testing JMS yet but under the ST’s toolbox they have a JMS folder that contains the following activities that you can perform:


        Publish Message to Topic – Publishes a message to multiple subscribers using a JMS topic
        Receive Message from Queue – Receives a message from a JMS queue
        Receive Message from Topic -Receives a message through a JMS topic
        Send Message to Queue – Send Message to Queue
        Send and Receive Message from Queue – Publishes messages to multiple subscribers and receives them using a JMS queue
        Subscribe to Topic – Subscribes to messages using a JMS topic

        Hope this helps. Thanks for your question! Joe

      • Sunny Chalotra says

        Hi MaRenins Collins,

        Did you get any success on configuring HP Service Test for soap over Jms call? If yes, can you please share the steps to do the same as i am facing issue while doing the same. Getting error- Failed to invoke JMS service, initial context factory is missing or wrong eventhough they are correct as in tested the same with Jmeter.

        • says

          Sunny Chalotra » Hi – yes I did get it to work with ActiveMQ. IF you send me your email I will forward you the eBook I’m writing that includes a chapter on using ST with JMS.

          • Soumya Nayak says

            Hi Joe,

            Presently, I am facing the same issue as Sunny faced. Can you please send me the eBook where I can follow the steps and do the set up. I appreciate your help on this. Thanks…!!

          • Sunny says

            THanks Joe.

            I need to test API Service forn which i am trying to make a JMS connection with the help of Standard Protocols. I selected JMS – send and receive message from Queue. each time i am getting an error- Initial context factory is missing or wrong.
            When i Tested the same service with Jmeter, it worked.
            Not sure where i am making mistake. Can you please send me a sample service for whcih you created a JMS call and also please let me know if connection is ssl, where to intall certs for successful connection.

    3. Sen says

      Hi Joe,

      I would like to know if multiple requirements can be mapped to a single test in service test. Also, I see that there is a option called “solution” where in you can import multiple tests (Existing/new pointing to different requirements). But i also see that i have to run each tests in a solution manually one after the other. Is there an option in service test to trigger these tests automatically one by one without me running it everytime one after the other?


      • Joe Colantonio says

        Sen » Hi Sen – Are you using Quality Center? I know you can link multiple requirements to QTP or service test and can string test together using the QC test lab. If you don’t have QC you should be able to use ST command line options in a .bat file to string test together. Take a look at pg 251 in the User guide for command line syntax. I have not done anything with Service Test solutions options – sorry hope this helped. thanks for your question. Cheers ~ Joe

      • Joe Colantonio says

        Victor » Sorry it took me so long to get back to you — for some reason your comment was in my Spam folder:( I have not tried it but as long as you have a valid WSDL I think you should be able to test a Tibco service in Service Test 11.

    4. Suresh says

      hello Joe Colantonio
      What is advantage or difference between QTP(addin Web service) and HP service test while automating the web service

    5. Bryan Linder says

      RE: ST components, as of May 1st of this year, QTP licensing moved from Functional Test (QTP with all add ins) to ONLY being sold as Unified Functional Testing (QTP with all add ins, plus Service Test, the Service Test Management QC plug in module, and a new UI between the two that supports calling Service Tests from QTP tests). So even though ST 11 doesn’t support direct components anymore, QTP 11 can now call ST 11 from within a component, execute both from within BPT, and let you know what layer (process, application or headless) a bug is found in in the new execution reporting tool. I just got my hands on it, and am looking forward to proving out that it works as well for us as I’m hoping based on all the data papers.

      • Joe Colantonio says

        Bryan Linder » Thanks Bryan for this update! I hope you’ll let use know what you find with “Functional Test”. I know that Service Test 11.10 added BPT functionality. What I’m confused by is ‘Functional Test” is simply a name change for using both QTP and ST or is it a new separate product all together? For example if I currently have QTP 11 and ST 11.10 installed is this the same as “Functional Test”?? I’m going to download it myself and see – maybe it will inspire a new blog post. Cheers ~Joe

    6. Ashok says

      Hi Joe,

      What is the difference b/w SoapUI Pro and HP Service test 11.0 and which is a better tool for Web Services testing?


      • Joe Colantonio says

        Ashok » Hi Ahok this is a great question. I think I should actually do a blog post on it. My quick answer is it depends. SoapUI Pro cost a lot less then ST. But ST dies integrate nicely with QTP. If you are currently don’t use any HP products like QC or QTP and you want to just test web services then I would choose SoapUI Pro. Thanks for the question! Cheers~Joe

    7. Indu says

      Hi Joe,
      Is there any way to export results (captured data) from HP service test either to Quality Center or to Excel?

    8. Partho says

      Hi Joe

      Is there a way to develop a web based UI which would interact with HPST and provide a rich GUI for the end users?
      Also, is there a way to have a J2EE application interact with HPST?

      • Joe Colantonio says

        Partho » Anything is possible :) ST can read database,text files and java jar files. One approach might be (I have not tried) that you could create a web front-end that writes data to a db and create a st framework that reads from the db and takes appropriate action. Also instead of reinventing the wheel I would check out business process testing with ST and Quality Center. In ST 11.20 you can now create Business Components with Service Test which allow you to use QC as a user friendly web front-end. Hope this helps. Cheers~Joe

    9. Sachin Walukar says

      Hi Joe,
      In my case, we have changing environment with every build. So here we have to change WSDL also, provide me the way to do this, like we do in QTP. Setting inputs in Configuration file.
      Please do revert on this.

      Many Thanks !

    10. Madhusudhan says


      Good to see your response all the queries on HPST11.20. I have one query here that, Is there any way(API) we can interact with HPST 11.20 tool for test step creation, data driven and Execution without Drag and Drop Interface? And also, is that possible to execute 9.5.3 version of scripts using 11.20 version thru QC?. Your reply for these queries are greatly appreciated.


    11. Mathews says

      I have tons of ST 9.5 Vugen scripts. In order to reuse these Vugen scipts, I

      1. Downloaded HP loadrunner with just Vugen.
      2. Opened the Vugen script using HP load runner (only once)
      3. Opened ST11 and created a new test
      4. Dragged the ‘Call Virtual User generator script’ from the Unified Functional Testing activity
      5. Selected the Vugen script to run
      6. Execute the ST11 script.

      I haven’t been successful in printing the Vugen script output to ST 11 output window. Appreciate if someone would help me.


    12. Sachin Walukar says

      Hey Joe,

      Actually I need the way to Configure Endpoint information dynamically. That is my test case whe running should take endpoint from config file.

      Thanks !

      • Joe Colantonio says

        Sachin Walukar » I guess I don’t understand what you are trying to do. The post shows how to read (take) an endpoint value from a file to use as an endpoint value in ST.

    13. Vijay says

      Hi Joe,

      I have a problem in Hp service test.

      Hp Service test 11 is crashed during excel upload.
      1. Open the Hp service test tool.
      2. Created service test with available services in the WSDL.
      3. Go View -> Data window.
      4. Click downward arrow after “New” and click on Excel option.
      5. Browse the excel file.( the file is in the Share drive and i have tried with the file in local drive)
      6. With the default options, click on OK button.

      After step 6 HP service test 11 is closed automatically.
      Is there anything am i missing or is it a problem in Hp service test?

      • Joe Colantonio says

        Vijay » Hi Vijay what version of HP Service Test are you using? The earlier version’s of ST are buggy – you should have at least ST 11.20 with patch 5 installed.

      • Joe Colantonio says

        Vijay » Yes – HP recommends everyone upgrades to at least 11.20 with Patch 5 as it contains multiple critical fixes.

    14. Sachin Walukar says

      Thanks Joe…!

      Here I am facing problem during Endpoint set up. I got one solution for this, I think it is posted by you only. FInd below link:

      Actually I am able to set up dynamic endpoint, but there we also need to configure same endpoint in WS Addressing as a part of security settings. But there I didnt find any solution to configure it as like dyanamic endpoint set up.

      As there is no any way to link WS Addressing endpoint to file or anything.

      Please suggest on the same. Because we have done a lot in this tool, also we have brought this tool in production but only because of this issue, we are stuck.

      Thanks !
      Sachin Walukar

      • Joe Colantonio says

        Sachin Walukar » Hi Sachin – sounds like you should be able to do this using custom code. I’m able to set user permissions using ST’s HttpRequestHeaders.Add method. Would you be you able to use this for the WS addressing?

    15. says

      Can I compare response of two services in Service Test?If yes, if you could explain us how can we do it,that will be great.
      e.g I have a services for getting responses from midtier and SAP.I want to validate that response from midtier and SAP returned same value.

    16. Shoid says

      With Service Test can you do multiple check points on the same test? (I have a value which will be for Loop 4 times for different year (2009,2010,2011,2012) and I want to validate as it goes to each loop for year I can validate a point in 2009, another in 2010 and so on?

      • says

        Shoid » When you data-drive a test in Service Test using the ‘Data Drive’ option under the Property Sheet you should be given and option to Data Drive “Both Input and Checkpoints’. Under the data window should appear a spreadsheet for _Input and _Checkpoints. Is this feature not working for you?

    17. Balaji says


      I am new to the HP service test and started the REST service testing. I could able to create the sample REST request for adding the fax number and receiving all the fax number added to the DB. Based on the response, i want to make sure that Test4 is added successfully.


      In Vugen, I can able capture the specific value from the response by using lr_web_reg_save_param… Do we have any option like this on Service test?

      • says

        Balaji » Hi Balaji if I understand your issue correctly I think you should be able to use a checkpoint to verify that the value appears in the response. Under the property sheet for the HTTP Request there are some “Response Body” options for Checkpoints that you can add. If that does not work you can also create Custom Code and use the args.Checkpoint object to create a custom Checkpoint event. Hope this helps you. Cheers~Joe

    18. Balaji says


      I have few question on the service testing.
      1. How to call the Data source value in custom coding to compare the response with data source value.
      2. I have defined one method, in that URL field, i have include some static text and also some predefined data from Local table. Is it possible to map at the template level. Bcoz i can able to do that from Canvas once i drag that into here.


    19. preeti says

      Hi Joe,

      I need to check the particular value from entire xml,not by using node number.
      How to put the check points using built check points in or using Xpath

      Best Regards,

    20. Kaushik says

      Hi Joe,

      I’m trying to execute test scripts created using HP Service Test 11.20 from Test Lab of QC However HP Service Test scripts are not being executed and getting the following error
      “object reference not set to an instance of an object”

      I have tried after installing all of these patches but it didn’t work

      What could be the reason ? Does QC 10 allow HP Service Test scripts created in version 11.20 to be executed from test lab ?

      • says

        Kaushik » Not sure why you are getting this error. It should works since I’m able to run ST 11.20 test from QC. Does this happen for all tests? Does it happen against all lab machines?

    21. Sandeep says

      Hi All,

      I would say SOAPUI is far far better than this i believe as i worked on both the tools i prefer to use SOAPUI..


    22. Upendra says


      I’m trying to create data-driven tests for HTTP requests. I would like to create requestheaders dynamically based upon the given data. Please let me know if there is any provision for this.

      • says

        Upendra » Hi would something like this work for you? In Service Test, click on your Web Service activity and navigate to the “Events” property sheet. Within the “Events” property sheet, for the event named “OnSendRequest” select the handler named “OnsendReq”. By double-clicking on “OnsendReq” you be taken to an editor window for the file TestUserCode.cs where you will be able to add custom code to the “OnsendReq” event. To add HTTP header information use the following code syntax:

        public void OnsendReq(object sender, HP.ST.Ext.WebServicesActivities.ActivityProcessRawMessageEventArgs args)
        this.StServiceCallActivity4.HttpRequestHeaders.Add(“My_key”, “My_value”);

    23. Pratt says

      I have a different issue not sure whether anyone has faced this issue before in HP service test 11.2. In one of my service, the response XML differs from SOAPUI and HP service test 11.2. For example the response with 10 different cars, the SOAPUI displays all the 10 car details whereas ST displays only 3 car details only.

      Any help is highly appreciated.


      • says

        annapurna » When you say ESB I assume it stands for (Enterprise service bus)- I have not tried. If the ESB exposes an API/web/REST Service that allows you to interact with it than I would say ST might work

    24. says

      Hi Joe,

      Nice to see all your posting with replies and solutions.I need a kind of document from which we can easily understand the HP ST. Could you please share if you have something with you.

      Mahendra K

      • says

        Mahendra K » I’m working on my first e-book for how to use HP UFT API (AKA service test). Its taking me awhile but it’s almost done. If you join my email list you should receive an update when I finally release it.

    25. Kumar says

      Joe ,
      Wanted to know on the QTP usage and feasibility along with any specific features and commands for a scenario on :
      1. Machine A which has the QTP software installed.
      2. Machine B which needs to be remotely connected from Machine A. This machine B has the Web applications, primarily an ERP like PeopleSoft applications. The interfaces, functionalities and process[like payroll, job code addition] needs to be tested [Functional Testing] for a Regression kind of scenario. This Machine B doesnot have the QTP software installed.
      3. The machine B which needs to be remotely connected keeps changing. Eg Machine B at one point of time can be a peoplesoft 8.0 version and at other times this Machine B could be actually Machine C with different version of Peoplesoft 8.5 etc.
      In essence the remotely connected machines keep changing for each test case execution.
      Does QTP or its versions support this kind of automation of functional testing. If yes would appreciate any heads-up information on the same.What kind of challenges or tips/tricks one needs to be aware of in this case of test automation. Thank you.

      • says

        Kumar » If I understand correctly you want to be able to run a QTP script against a machine that does not have QTP installed on it? IF this is correct QTP needs to be run locally on every machine.

    26. Kumar says

      Joe > Thanks for your reply.
      Wanted to understand if any tool or QTP supports the scenario stated.
      To clarify further, QTP or automation software can be installed in one machine and this doesnot have the web application.
      Web application to test and record is in another machine which doesnot have a QTP software installed.

      One remotely connects to this machine to launch the web application.Application is accessed from the browser of the remote machine and not from the browser of the local machine.

      In this case, can we record or script the actions and process of the remote machine from the local machine where the QTP is installed. Any known challenges or this framework of scripting and recording is not possible.

      Thank you.

    Leave a Reply

    Your email address will not be published. Required fields are marked *